00010000:00080000:3.2F:1786101748.833486:0:0:0:(ldlm_lib.c:3031:target_recovery_expired()) lustre-MDT0000: recovery timed out; 0 clients are still in recovery after 70 seconds (1 clients connected) 00010000:00080000:1.2F:1786101877.833496:0:0:0:(ldlm_lib.c:3031:target_recovery_expired()) lustre-MDT0000: recovery timed out; 0 clients are still in recovery after 70 seconds (1 clients connected) 00010000:00010000:1.0:1786109348.421023:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca34513 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421031:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca34513 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421037:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421040:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca34513 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421045:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca34513 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421056:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.421059:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421062:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca34513 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421069:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca34513 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421084:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca34575 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421091:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca34575 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421098:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca34575 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421104:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295fe00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421108:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca34575 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421119:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca34575 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421130:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.421132:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421136:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca34575 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421143:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca34575 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421154:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca3457c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421160:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca3457c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421166:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca3457c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421171:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421175:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca3457c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421181:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca3457c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421192:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dba:0x0].0x0 (ffff930aa65d7a00) 00010000:00010000:1.0:1786109348.421194:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421212:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca3457c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421219:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca3457c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dba:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421237:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca34583 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421243:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca34583 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421249:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca34583 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421255:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421259:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca34583 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421265:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca34583 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421274:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x1e:0x0].0x0 (ffff930aa65d7c00) 00010000:00010000:1.0:1786109348.421277:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421280:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca34583 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421286:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca34583 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421305:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca345d7 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421311:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca345d7 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421319:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca345d7 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421325:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6cc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421329:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca345d7 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421335:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca345d7 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421346:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.421349:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421352:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca345d7 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421362:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca345d7 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421375:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca34639 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421381:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca34639 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421387:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca34639 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421393:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295fa00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421396:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca34639 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421409:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca34639 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421417:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.421419:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421421:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca34639 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421427:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca34639 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421516:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca34640 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421522:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca34640 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421528:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca34640 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421534:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295fc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421538:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca34640 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421545:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca34640 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421553:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dbb:0x0].0x0 (ffff930aa0ed0b00) 00010000:00010000:1.0:1786109348.421556:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421558:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca34640 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421565:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca34640 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dbb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421578:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca34647 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421585:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca34647 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421592:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca34647 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421597:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421600:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca34647 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421607:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca34647 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421614:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x1f:0x0].0x0 (ffff930aa0ed0200) 00010000:00010000:1.0:1786109348.421617:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421620:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca34647 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421626:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca34647 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421642:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3469b lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421649:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3469b lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421655:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3469b lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421661:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421664:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3469b lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421670:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3469b lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421678:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.421681:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421684:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3469b lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421690:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3469b lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421703:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca346fd lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421714:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca346fd lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421720:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca346fd lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421725:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421728:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca346fd lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421737:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca346fd lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421751:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.421754:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421757:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca346fd lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421762:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca346fd lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421773:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca34704 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421778:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca34704 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421784:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca34704 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421789:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421792:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca34704 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421800:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca34704 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421813:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dbc:0x0].0x0 (ffff930aa65d7600) 00010000:00010000:1.0:1786109348.421815:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421819:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca34704 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421825:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca34704 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421839:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca3470b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421847:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca3470b lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421854:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca3470b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421859:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421863:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca3470b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421875:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca3470b lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421883:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x20:0x0].0x0 (ffff930aa65d7e00) 00010000:00010000:1.0:1786109348.421886:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421889:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca3470b lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421897:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca3470b lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421916:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3475f lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421923:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3475f lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421931:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3475f lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421942:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6ca00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.421945:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3475f lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421951:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3475f lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421960:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.421963:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.421965:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3475f lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421971:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3475f lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.421989:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca347c1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422009:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca347c1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422017:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca347c1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422024:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422027:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca347c1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422045:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca347c1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422054:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.422057:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422059:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca347c1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422066:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca347c1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422078:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca347c8 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422085:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca347c8 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422091:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca347c8 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422096:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422100:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca347c8 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422111:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca347c8 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422121:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dbd:0x0].0x0 (ffff930986232900) 00010000:00010000:1.0:1786109348.422123:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422126:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca347c8 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422133:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca347c8 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422150:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca347cf lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422160:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca347cf lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422167:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca347cf lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422172:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422175:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca347cf lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422181:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca347cf lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422187:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x21:0x0].0x0 (ffff930986232e00) 00010000:00010000:1.0:1786109348.422189:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422192:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca347cf lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422197:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca347cf lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x21:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422231:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca34823 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422239:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca34823 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422247:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca34823 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422257:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422260:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca34823 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422266:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca34823 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422277:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.422282:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422287:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca34823 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422294:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca34823 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422309:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca34885 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422321:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca34885 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422328:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca34885 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422336:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295ec00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422344:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca34885 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422360:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca34885 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422369:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.422373:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422377:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca34885 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422384:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca34885 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422396:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca3488c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422404:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca3488c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422410:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca3488c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422415:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422417:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca3488c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422423:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca3488c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422462:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dbe:0x0].0x0 (ffff930a83abd200) 00010000:00010000:1.0:1786109348.422465:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422468:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca3488c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422474:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca3488c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dbe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422487:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca34893 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422493:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca34893 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422500:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca34893 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422506:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422509:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca34893 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422516:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca34893 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422523:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x22:0x0].0x0 (ffff930a83abdb00) 00010000:00010000:1.0:1786109348.422526:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422529:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca34893 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422534:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca34893 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422547:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca348e7 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422553:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca348e7 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422559:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca348e7 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422564:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6de00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422566:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca348e7 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422572:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca348e7 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422580:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.422583:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422585:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca348e7 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422590:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca348e7 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422604:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca34949 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422609:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca34949 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422618:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca34949 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422625:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422628:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca34949 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422639:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca34949 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422648:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.422653:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422655:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca34949 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422661:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca34949 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422675:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca34950 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422688:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca34950 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422697:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca34950 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422704:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422709:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca34950 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422717:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca34950 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422731:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dbf:0x0].0x0 (ffff930986232500) 00010000:00010000:1.0:1786109348.422736:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422739:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca34950 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422747:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca34950 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422766:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca34957 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422771:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca34957 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422778:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca34957 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422783:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422786:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca34957 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422795:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca34957 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422810:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x23:0x0].0x0 (ffff930986232800) 00010000:00010000:1.0:1786109348.422814:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422817:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca34957 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422825:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca34957 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422843:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca349ab lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422851:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca349ab lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422861:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca349ab lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422872:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6dc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422878:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca349ab lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422886:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca349ab lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422900:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.422902:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422905:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca349ab lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422914:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca349ab lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422933:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca34a0d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422941:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca34a0d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422948:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca34a0d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422956:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6ce00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.422959:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca34a0d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422971:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca34a0d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.422988:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.422992:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.422995:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca34a0d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423003:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca34a0d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423487:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca34a14 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423495:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca34a14 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423502:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca34a14 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423508:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.423512:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca34a14 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423519:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca34a14 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423529:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dc0:0x0].0x0 (ffff930986232a00) 00010000:00010000:1.0:1786109348.423532:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.423536:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca34a14 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423543:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca34a14 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423560:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca34a1b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423567:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca34a1b lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423573:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca34a1b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423578:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.423581:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca34a1b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423588:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca34a1b lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423595:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x24:0x0].0x0 (ffff930986232100) 00010000:00010000:1.0:1786109348.423597:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.423600:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca34a1b lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423606:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca34a1b lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423623:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3800/0xdb52b77d7ca34a6f lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423630:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3800/0xdb52b77d7ca34a6f lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423637:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3800/0xdb52b77d7ca34a6f lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423643:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.423646:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3800/0xdb52b77d7ca34a6f lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423656:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3800/0xdb52b77d7ca34a6f lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423669:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.423674:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.423677:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3800/0xdb52b77d7ca34a6f lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423686:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3800/0xdb52b77d7ca34a6f lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423700:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca34ad1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423709:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca34ad1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423715:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca34ad1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423724:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295ee00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.423728:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca34ad1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423745:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca34ad1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423757:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.423761:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.423766:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca34ad1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423775:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca34ad1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423791:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca34ad8 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423804:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca34ad8 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423813:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca34ad8 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423818:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.423822:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca34ad8 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423835:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca34ad8 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423844:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dc1:0x0].0x0 (ffff930a90808200) 00010000:00010000:1.0:1786109348.423846:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.423849:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca34ad8 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423855:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca34ad8 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423871:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca34adf lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423884:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca34adf lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423893:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca34adf lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423898:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295f600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.423901:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca34adf lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423910:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca34adf lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423920:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x25:0x0].0x0 (ffff930a90808700) 00010000:00010000:1.0:1786109348.423923:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.423927:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca34adf lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423938:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca34adf lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423959:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca34b33 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423972:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca34b33 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423980:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca34b33 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.423988:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.423995:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca34b33 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424006:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca34b33 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424017:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.424021:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.424026:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca34b33 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424034:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca34b33 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424050:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca34b95 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424064:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca34b95 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424072:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca34b95 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424078:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.424084:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca34b95 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424096:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca34b95 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424124:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.424128:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.424132:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca34b95 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424143:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca34b95 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424157:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca34b9c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424169:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca34b9c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424178:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca34b9c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424185:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.424188:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca34b9c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424213:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca34b9c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424222:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dc2:0x0].0x0 (ffff930aa62cfd00) 00010000:00010000:1.0:1786109348.424226:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.424231:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca34b9c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424244:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca34b9c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424284:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca34ba3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424296:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca34ba3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424305:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca34ba3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424312:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.424315:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca34ba3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424324:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca34ba3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424335:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x26:0x0].0x0 (ffff930aa62cfc00) 00010000:00010000:1.0:1786109348.424338:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.424341:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca34ba3 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424347:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca34ba3 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424370:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca34bf7 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424380:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca34bf7 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424387:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca34bf7 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424395:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.424400:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca34bf7 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424407:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca34bf7 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424417:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.424419:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.424422:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca34bf7 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424455:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca34bf7 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424467:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca34c59 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424473:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca34c59 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424478:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca34c59 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424483:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.424486:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca34c59 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424496:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca34c59 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424505:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.424508:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.424511:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca34c59 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424517:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca34c59 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424528:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca34c60 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424535:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca34c60 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424541:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca34c60 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424547:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.424550:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca34c60 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424555:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca34c60 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424566:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dc3:0x0].0x0 (ffff930a90808a00) 00010000:00010000:1.0:1786109348.424569:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.424574:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca34c60 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424588:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca34c60 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424605:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca34c67 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424613:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca34c67 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424621:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca34c67 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424629:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.424633:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca34c67 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424645:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca34c67 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424655:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x27:0x0].0x0 (ffff930a90808e00) 00010000:00010000:1.0:1786109348.424659:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.424662:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca34c67 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424675:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca34c67 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424691:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca34cbb lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424703:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca34cbb lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424714:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca34cbb lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424722:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.424726:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca34cbb lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424738:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca34cbb lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424752:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.424759:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.424764:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca34cbb lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424775:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca34cbb lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424788:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3600/0xdb52b77d7ca34d1d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424796:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3600/0xdb52b77d7ca34d1d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424805:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3600/0xdb52b77d7ca34d1d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424818:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.424821:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3600/0xdb52b77d7ca34d1d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424834:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3600/0xdb52b77d7ca34d1d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424847:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.424849:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.424853:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3600/0xdb52b77d7ca34d1d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424864:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3600/0xdb52b77d7ca34d1d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424880:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca34d24 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424893:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca34d24 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424900:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca34d24 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424908:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.424914:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca34d24 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424922:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca34d24 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424933:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dc4:0x0].0x0 (ffff930986232700) 00010000:00010000:1.0:1786109348.424937:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.424943:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca34d24 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424950:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca34d24 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424967:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca34d2b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424979:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca34d2b lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424987:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca34d2b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.424994:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.424997:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca34d2b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425005:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca34d2b lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425017:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x28:0x0].0x0 (ffff930986232c00) 00010000:00010000:1.0:1786109348.425019:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425022:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca34d2b lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425031:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca34d2b lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425053:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca34d7f lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425062:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca34d7f lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425074:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca34d7f lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425080:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.425086:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca34d7f lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425097:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca34d7f lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425108:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.425112:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425115:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca34d7f lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425123:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca34d7f lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425139:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca34de1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425151:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca34de1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425159:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca34de1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425166:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.425169:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca34de1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425185:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca34de1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425195:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.425214:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425218:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca34de1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425224:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca34de1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425235:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca34de8 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425241:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca34de8 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425248:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca34de8 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425253:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.425256:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca34de8 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425262:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca34de8 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425271:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dc5:0x0].0x0 (ffff930986232b00) 00010000:00010000:1.0:1786109348.425278:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425282:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca34de8 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425291:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca34de8 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425309:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca34def lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425320:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca34def lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425325:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca34def lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425333:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ba00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.425337:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca34def lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425345:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca34def lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425359:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x29:0x0].0x0 (ffff930986232400) 00010000:00010000:1.0:1786109348.425362:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425367:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca34def lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425373:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca34def lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425394:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca34e43 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425404:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca34e43 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425415:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca34e43 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425423:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.425426:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca34e43 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425469:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca34e43 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425478:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.425480:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425483:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca34e43 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425489:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca34e43 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425501:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca34ea5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425507:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca34ea5 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425513:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca34ea5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425518:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.425521:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca34ea5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425531:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca34ea5 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425539:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.425542:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425545:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca34ea5 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425551:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca34ea5 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425561:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca34eac lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425568:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca34eac lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425573:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca34eac lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425580:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.425587:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca34eac lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425593:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca34eac lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425600:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dc6:0x0].0x0 (ffff93098c4ae700) 00010000:00010000:1.0:1786109348.425604:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425608:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca34eac lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425622:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca34eac lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425643:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca34eb3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425653:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca34eb3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425660:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca34eb3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425664:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.425667:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca34eb3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425676:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca34eb3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425687:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2a:0x0].0x0 (ffff93098c4ae800) 00010000:00010000:1.0:1786109348.425693:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425696:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca34eb3 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425704:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca34eb3 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425720:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca34f07 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425731:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca34f07 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425738:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca34f07 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425744:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.425747:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca34f07 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425754:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca34f07 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425763:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.425769:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425771:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca34f07 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425778:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca34f07 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425793:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca34f69 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425799:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca34f69 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425805:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca34f69 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425810:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.425813:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca34f69 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425823:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca34f69 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425832:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.425834:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425837:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca34f69 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425844:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca34f69 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425856:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca34f70 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425862:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca34f70 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425868:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca34f70 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425873:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.425876:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca34f70 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425882:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca34f70 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425890:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dc7:0x0].0x0 (ffff930a90808000) 00010000:00010000:1.0:1786109348.425893:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425896:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca34f70 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425903:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca34f70 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425926:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca34f77 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425934:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca34f77 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425940:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca34f77 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425950:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.425955:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca34f77 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425962:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca34f77 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425972:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2b:0x0].0x0 (ffff930a90808100) 00010000:00010000:1.0:1786109348.425979:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.425984:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca34f77 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.425992:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca34f77 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426017:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca34fcb lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426025:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca34fcb lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426032:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca34fcb lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426038:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.426042:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca34fcb lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426052:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca34fcb lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426064:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.426066:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.426069:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca34fcb lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426076:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca34fcb lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426088:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca3502d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426095:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca3502d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426101:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca3502d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426114:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.426120:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca3502d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426138:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca3502d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426148:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930a85613200) 00010000:00010000:1.0:1786109348.426151:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.426154:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca3502d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426160:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca3502d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426180:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35034 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426190:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35034 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426214:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35034 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426220:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628be00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.426223:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35034 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426232:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35034 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426244:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dc8:0x0].0x0 (ffff930984516100) 00010000:00010000:1.0:1786109348.426246:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.426250:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35034 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426257:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35034 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426274:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca3503b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426280:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca3503b lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426286:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca3503b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426291:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628bc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.426294:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca3503b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426300:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca3503b lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426307:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2c:0x0].0x0 (ffff930984516500) 00010000:00010000:1.0:1786109348.426310:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.426313:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca3503b lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.426320:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca3503b lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109348.432365:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109348.432448:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109348.433342:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933086592 00000100:00100000:0.0:1786109348.433346:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933086592 00000100:00100000:0.0:1786109348.433369:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11982 00000100:00100000:0.0:1786109348.433374:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187949:x1872862933086592:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.433504:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187949:x1872862933086592:12345-0@lo:1000:osp_up1-0.0 Request processed in 128us (248us total) trans 25769804397 rc 0/0 00000100:00100000:0.0:1786109348.433510:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11982 00000100:00100000:0.0:1786109348.433721:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933086848 00000100:00100000:0.0:1786109348.433725:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933086848 00000100:00100000:0.0:1786109348.433744:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11983 00000100:00100000:0.0:1786109348.433750:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187949:x1872862933086848:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.433829:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187949:x1872862933086848:12345-0@lo:1000:osp_up1-0.0 Request processed in 78us (180us total) trans 25769804398 rc 0/0 00000100:00100000:0.0:1786109348.433836:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11983 00000100:00100000:0.0:1786109348.434036:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933087104 00000100:00100000:0.0:1786109348.434041:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933087104 00000100:00100000:0.0:1786109348.434059:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11984 00000100:00100000:0.0:1786109348.434065:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187949:x1872862933087104:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.434144:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187949:x1872862933087104:12345-0@lo:1000:osp_up1-0.0 Request processed in 78us (174us total) trans 25769804399 rc 0/0 00000100:00100000:0.0:1786109348.434150:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11984 00000100:00100000:0.0:1786109348.434343:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933087360 00000100:00100000:0.0:1786109348.434347:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933087360 00000100:00100000:0.0:1786109348.434362:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11985 00000100:00100000:0.0:1786109348.434367:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187949:x1872862933087360:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.434458:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187949:x1872862933087360:12345-0@lo:1000:osp_up1-0.0 Request processed in 90us (175us total) trans 25769804400 rc 0/0 00000100:00100000:0.0:1786109348.434466:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11985 00000100:00100000:0.0:1786109348.434646:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933087616 00000100:00100000:0.0:1786109348.434649:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933087616 00000100:00100000:0.0:1786109348.434664:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11986 00000100:00100000:0.0:1786109348.434669:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187949:x1872862933087616:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.434741:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187949:x1872862933087616:12345-0@lo:1000:osp_up1-0.0 Request processed in 71us (154us total) trans 25769804401 rc 0/0 00000100:00100000:0.0:1786109348.434747:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11986 00000100:00100000:0.0:1786109348.434940:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933087872 00000100:00100000:0.0:1786109348.434943:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933087872 00000100:00100000:0.0:1786109348.434961:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11987 00000100:00100000:0.0:1786109348.434966:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187949:x1872862933087872:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.435047:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187949:x1872862933087872:12345-0@lo:1000:osp_up1-0.0 Request processed in 80us (177us total) trans 25769804402 rc 0/0 00000100:00100000:0.0:1786109348.435054:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11987 00000100:00100000:0.0:1786109348.435391:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933088128 00000100:00100000:0.0:1786109348.435395:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933088128 00000100:00100000:0.0:1786109348.435415:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11988 00000100:00100000:0.0:1786109348.435468:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187949:x1872862933088128:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.435545:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187949:x1872862933088128:12345-0@lo:1000:osp_up1-0.0 Request processed in 79us (366us total) trans 25769804403 rc 0/0 00000100:00100000:0.0:1786109348.435552:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11988 00000100:00100000:0.0:1786109348.435788:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933088384 00000100:00100000:0.0:1786109348.435791:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933088384 00000100:00100000:0.0:1786109348.435810:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11989 00000100:00100000:0.0:1786109348.435815:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187949:x1872862933088384:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.435899:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187949:x1872862933088384:12345-0@lo:1000:osp_up1-0.0 Request processed in 83us (208us total) trans 25769804404 rc 0/0 00000100:00100000:0.0:1786109348.435906:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11989 00000100:00100000:0.0:1786109348.436079:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933088640 00000100:00100000:0.0:1786109348.436083:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933088640 00000100:00100000:0.0:1786109348.436100:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11990 00000100:00100000:0.0:1786109348.436105:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187949:x1872862933088640:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.436186:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187949:x1872862933088640:12345-0@lo:1000:osp_up1-0.0 Request processed in 80us (171us total) trans 25769804405 rc 0/0 00000100:00100000:0.0:1786109348.436193:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11990 00000100:00100000:0.0:1786109348.436384:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933088896 00000100:00100000:0.0:1786109348.436387:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933088896 00000100:00100000:0.0:1786109348.436403:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11991 00000100:00100000:0.0:1786109348.436408:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187949:x1872862933088896:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.436691:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:187949:x1872862933088896:12345-0@lo:1000:osp_up1-0.0 Request processed in 281us (364us total) trans 25769804406 rc 0/0 00000100:00100000:0.0:1786109348.436698:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11991 00000100:00100000:0.0:1786109348.438718:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109348.439295:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933089408 00000100:00100000:0.0:1786109348.439299:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933089408 00000100:00100000:0.0:1786109348.439323:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11993 00000100:00100000:0.0:1786109348.439329:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187949:x1872862933089408:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.439417:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187949:x1872862933089408:12345-0@lo:1000:osp_up1-0.0 Request processed in 87us (236us total) trans 25769804408 rc 0/0 00000100:00100000:0.0:1786109348.439452:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11993 00000100:00100000:0.0:1786109348.439702:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933089664 00000100:00100000:0.0:1786109348.439707:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933089664 00000100:00100000:0.0:1786109348.439724:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11994 00000100:00100000:0.0:1786109348.439729:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187949:x1872862933089664:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.439809:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187949:x1872862933089664:12345-0@lo:1000:osp_up1-0.0 Request processed in 79us (229us total) trans 25769804409 rc 0/0 00000100:00100000:0.0:1786109348.439816:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11994 00000100:00100000:0.0:1786109348.440000:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933089920 00000100:00100000:0.0:1786109348.440004:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933089920 00000100:00100000:0.0:1786109348.440022:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11995 00000100:00100000:0.0:1786109348.440027:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187949:x1872862933089920:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.440111:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187949:x1872862933089920:12345-0@lo:1000:osp_up1-0.0 Request processed in 83us (175us total) trans 25769804410 rc 0/0 00000100:00100000:0.0:1786109348.440118:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11995 00000100:00100000:0.0:1786109348.440325:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933090176 00000100:00100000:0.0:1786109348.440329:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933090176 00000100:00100000:0.0:1786109348.440347:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11996 00000100:00100000:0.0:1786109348.440353:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187949:x1872862933090176:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.440475:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:187949:x1872862933090176:12345-0@lo:1000:osp_up1-0.0 Request processed in 121us (216us total) trans 25769804411 rc 0/0 00000100:00100000:0.0:1786109348.440482:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11996 00000100:00100000:0.0:1786109348.440741:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933090432 00000100:00100000:0.0:1786109348.440745:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933090432 00000100:00100000:0.0:1786109348.440761:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11997 00000100:00100000:0.0:1786109348.440767:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab5395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:187949:x1872862933090432:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.440878:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab5395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:187949:x1872862933090432:12345-0@lo:1000:osp_up1-0.0 Request processed in 110us (193us total) trans 25769804412 rc 0/0 00000100:00100000:0.0:1786109348.440888:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11997 00000100:00100000:0.0:1786109348.443655:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922028544 00000100:00100000:0.0:1786109348.443669:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922028544 00000100:00100000:0.0:1786109348.444227:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 668 00000100:00100000:0.0:1786109348.444238:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+10:157724:x1872862922028544:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109348.444251:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109348.444280:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca3506c lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a10d2 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.444356:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35073 lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.444373:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35073 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.444387:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35073 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109348.444928:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x2c:0x0]: returning size 4096 00000004:00200000:0.0:1786109348.444934:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109348.444981:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca3506c lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10d2 expref: 12 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.445004:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35073 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10d2 expref: 11 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.445014:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2c:0x0].0x0 (ffff930a90808f00) 00010000:00010000:0.0:1786109348.445018:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109348.445023:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8e00, rc 0) 00000100:00100000:0.0:1786109348.445083:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+11:157724:x1872862922028544:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 848us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109348.445092:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 668 00000100:00100000:0.0:1786109348.446323:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933091200 00000100:00100000:0.0:1786109348.446329:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933091200 00000100:00100000:0.0:1786109348.446367:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12000 00000100:00100000:0.0:1786109348.446375:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:187949:x1872862933091200:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.446507:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:187949:x1872862933091200:12345-0@lo:1000:osp_up1-0.0 Request processed in 133us (320us total) trans 25769804415 rc 0/0 00000100:00100000:0.0:1786109348.446514:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12000 00000100:00100000:0.0:1786109348.446901:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933091456 00000100:00100000:0.0:1786109348.446906:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933091456 00000100:00100000:0.0:1786109348.446973:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12001 00000100:00100000:0.0:1786109348.446981:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:187949:x1872862933091456:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.447124:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+38:187949:x1872862933091456:12345-0@lo:1000:osp_up1-0.0 Request processed in 143us (319us total) trans 25769804416 rc 0/0 00000100:00100000:0.0:1786109348.447132:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12001 00000100:00100000:0.0:1786109348.450132:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933092224:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786109348.450141:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 646 rpc_version 646 00000020:00100000:0.0:1786109348.450155:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109348.450160:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d89b800 x1872862933092480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109348.450173:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933092480:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.450216:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109348.450272:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34240 going to sleep for 11 seconds 00000100:00100000:0.0:1786109348.455079:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933094016 00000100:00100000:0.0:1786109348.455085:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933094016 00000100:00100000:0.0:1786109348.455131:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12011 00000100:00100000:0.0:1786109348.455143:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+47:187949:x1872862933094016:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.455525:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+48:187949:x1872862933094016:12345-0@lo:1000:osp_up1-0.0 Request processed in 384us (550us total) trans 25769804426 rc 0/0 00000100:00100000:0.0:1786109348.455533:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12011 00000100:00100000:0.0:1786109348.457167:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933094912 00000100:00100000:0.0:1786109348.457171:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933094912 00000100:00100000:0.0:1786109348.457210:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12014 00000100:00100000:0.0:1786109348.457218:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+50:187949:x1872862933094912:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.457310:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+51:187949:x1872862933094912:12345-0@lo:1000:osp_up1-0.0 Request processed in 93us (243us total) trans 25769804429 rc 0/0 00000100:00100000:0.0:1786109348.457317:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12014 00000100:00100000:0.0:1786109348.457644:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933095168 00000100:00100000:0.0:1786109348.457647:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933095168 00000100:00100000:0.0:1786109348.457702:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12015 00000100:00100000:0.0:1786109348.457711:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+51:187949:x1872862933095168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.457791:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+52:187949:x1872862933095168:12345-0@lo:1000:osp_up1-0.0 Request processed in 83us (239us total) trans 25769804430 rc 0/0 00000100:00100000:0.0:1786109348.457798:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12015 00000100:00100000:1.0:1786109348.458893:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933095680:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109348.458900:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 659 rpc_version 659 00000020:00100000:1.0:1786109348.458912:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109348.458917:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f3f100 x1872862933095936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109348.458930:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933095936:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109348.458956:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.459024:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098ab959c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109348.459095:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933095936 00000100:00100000:0.0:1786109348.459100:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933095936 00000100:00100000:0.0:1786109348.459121:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12018 00000100:00100000:0.0:1786109348.459128:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+54:187949:x1872862933095936:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.459244:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+55:187949:x1872862933095936:12345-0@lo:1000:osp_up1-0.0 Request processed in 116us (286us total) trans 25769804433 rc 0/0 00000100:00100000:0.0:1786109348.459255:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12018 00000100:00100000:1.0:1786109348.459324:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933095936:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109348.459332:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 660 rpc_version 660 00000020:00100000:1.0:1786109348.459344:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109348.459349:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f3ea00 x1872862933096192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109348.459360:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933096192:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109348.459390:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.459415:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098ab959c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109348.459482:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933096192 00000100:00100000:1.0:1786109348.459494:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933096192 00000100:00100000:1.0:1786109348.459521:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12019 00000100:00100000:1.0:1786109348.459527:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+55:187949:x1872862933096192:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109348.459627:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+56:187949:x1872862933096192:12345-0@lo:1000:osp_up1-0.0 Request processed in 99us (235us total) trans 25769804434 rc 0/0 00000100:00100000:1.0:1786109348.459634:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12019 00000100:00100000:1.0:1786109348.459672:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab928ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933094144:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109348.459697:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca3509d lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109348.459729:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933096192:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.460146:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109348.469297:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922029184 00000100:00100000:0.0:1786109348.469308:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922029184 00010000:00010000:0.0:1786109348.469355:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76800/0xdb52b77d7ca35081 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10d9 expref: 7 pid: 187901 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109348.469406:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12565 00000100:00100000:0.0:1786109348.469419:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:2403:x1872862922029184:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109348.469461:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109348.469470:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76800/0xdb52b77d7ca35081 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10d9 expref: 7 pid: 187901 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.469483:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76800/0xdb52b77d7ca35081 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10d9 expref: 7 pid: 187901 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.469510:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76800/0xdb52b77d7ca35081 lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10d9 expref: 7 pid: 187901 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.469525:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x2c:0x0].0x0 (ffff930aa62cf900) 00010000:00010000:0.0:1786109348.469530:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca350ab lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca350a4 expref: 56 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.469542:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca350ab lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca350a4 expref: 56 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.469552:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca350ab lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca350a4 expref: 56 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.469593:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca350ab lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca350a4 expref: 56 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109348.469614:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6513:1872862933096576:0@lo:105: 00000100:00100000:0.0:1786109348.469660:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109348.469727:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109348.502501:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5214 00000100:00100000:1.0:1786109348.502542:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6513:x1872862933096576:12345-0@lo:105: 00010000:00010000:1.0:1786109348.502567:0:10344:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.502581:0:10344:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.502597:0:10344:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.502608:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.502617:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.502628:0:10344:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.502661:0:10344:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff93098cd76a00) 00000100:00100000:1.0:1786109348.503329:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6513:x1872862933096576:12345-0@lo:105: Request processed in 808us (33666us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.503341:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5214 00000100:00100000:1.0:1786109348.503738:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6513:1872862933096576:0@lo:105: 00010000:00010000:1.0:1786109348.503764:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109348.504132:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922029184:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 34712us (35009us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.504152:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12565 00000100:00100000:0.0:1786109348.509346:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab928ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933096704:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1786109348.511013:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].422, 656 off645056 00000040:00080000:0.0:1786109348.511286:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].303, 736 off503872 00000004:00080000:0.0:1786109348.511294:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d34840 with version 661 00000004:00080000:1.0:1786109348.511386:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 661 rpc_version 661 00000020:00100000:1.0:1786109348.511606:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109348.511619:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f3ca80 x1872862933096960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109348.511717:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933096960:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.511808:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109348.511897:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d340c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109348.512921:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933096960:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1786109348.512995:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dc8:0x0]: returning size 4096 00010000:00010000:1.0:1786109348.513023:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca3509d lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513035:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca3509d lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513044:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca3509d lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513051:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.513056:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca3509d lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513066:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca3509d lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513083:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2c:0x0].0x0 (ffff930a90808f00) 00010000:00010000:1.0:1786109348.513087:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109348.513092:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca3509d lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513099:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca3509d lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513127:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513137:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513145:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513180:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786109348.513192:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x2c:0x0] 00010000:00010000:1.0:1786109348.513211:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca35096 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513218:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca35096 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513225:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca35096 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513230:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.513234:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca35096 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513240:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca35096 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513247:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dc8:0x0].0x0 (ffff930aa62cf300) 00010000:00010000:1.0:1786109348.513250:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109348.513254:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca35096 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513260:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca35096 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dc8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513312:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35088 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513319:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35088 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513325:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35088 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513330:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.513332:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35088 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513338:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35088 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513346:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109348.513348:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.513351:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35088 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513357:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35088 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109348.513366:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb8fbe47 reply state 0000000038cdd9bd transno 326417514582 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca3508f lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513384:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca3508f lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.513392:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109348.513394:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109348.513397:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109348.513522:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+11:157724:x1872862922028928:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 59395us (59480us total) trans 326417514582 rc 0/0 00000100:00100000:1.0:1786109348.513531:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 670 00010000:00010000:0.0:1786109348.513759:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109348.513767:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.513776:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76a00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109348.513781:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109348.513790:0:29734:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.513834:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.513841:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109348.513879:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.513887:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76a00/0xdb52b77d7ca350a4 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca350ab expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.513910:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109348.513912:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109348.513914:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109348.513961:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933097088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109348.514015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109348.514104:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933097088 00000100:00100000:0.0:1786109348.514113:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933097088 00000100:00100000:0.0:1786109348.514186:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4473 00000100:00100000:0.0:1786109348.514196:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+58:3647:x1872862933097088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109348.514223:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109348.514246:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca350ab lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca350a4 expref: 58 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.514266:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x2c:0x0].0x0 (ffff930aa62cf900) 00010000:00010000:0.0:1786109348.514279:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109348.514312:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+57:3647:x1872862933097088:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109348.514320:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4473 00000100:00100000:1.0:1786109348.514413:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933097088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109348.544110:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109348.558341:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109348.576308:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109348.585037:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922029824 00000100:00100000:1.0:1786109348.585050:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922029824 00000100:00100000:1.0:1786109348.585181:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 674 00000100:00100000:1.0:1786109348.585194:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+12:157732:x1872862922029824:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1786109348.585283:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109348.585319:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca350e3 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10ee expref: 12 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.585342:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109348.585348:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109348.585499:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca350ea lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.585521:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca350ea lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.585532:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca350ea lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.585545:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca350f1 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.585553:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca350f1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.585560:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca350f1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109348.586733:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].423, 2152 off647208 00000040:00080000:1.0:1786109348.586827:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].304, 2352 off506224 00000004:00080000:1.0:1786109348.586834:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098ab950c0 with version 662 00000004:00080000:0.0:1786109348.587047:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 662 rpc_version 662 00000020:00100000:0.0:1786109348.587091:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109348.587103:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d89bb80 x1872862933097344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109348.587134:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933097344:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.587231:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109348.587325:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d340c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109348.588654:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933097344:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786109348.588826:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030600/0xdb52b77d7ca350f8 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.588846:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030600/0xdb52b77d7ca350f8 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.588861:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030600/0xdb52b77d7ca350f8 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.588883:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80031000/0xdb52b77d7ca350ff lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.588890:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80031000/0xdb52b77d7ca350ff lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.588897:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a80031000/0xdb52b77d7ca350ff lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.588939:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.588947:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.588958:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109348.588979:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933097472:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1786109348.589023:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.589114:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9480 going to sleep for 11 seconds 00000100:00100000:1.0:1786109348.589557:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c38aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933097472:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786109348.589572:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3510d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589583:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3510d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109348.589611:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023cf665d reply state 000000002c8c39c8 transno 326417514583 ns: mdt-lustre-MDT0000_UUID lock: ffff930a80031000/0xdb52b77d7ca350ff lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589624:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80031000/0xdb52b77d7ca350ff lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589630:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2d:0x0].0x0 (ffff93098c4ae700) 00010000:00010000:1.0:1786109348.589633:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109348.589637:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109348.589645:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3510d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589653:0:188678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3510d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109348.589665:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x2d:0x0] 00000004:00010000:1.0:1786109348.589670:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023cf665d reply state 000000002c8c39c8 transno 326417514583 ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030600/0xdb52b77d7ca350f8 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589678:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030600/0xdb52b77d7ca350f8 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589684:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dc9:0x0].0x0 (ffff93098c4ae800) 00010000:00010000:1.0:1786109348.589686:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109348.589688:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1786109348.589695:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dc9:0x0]: returning size 4096 00010000:00010000:1.0:1786109348.589703:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca350ea lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589710:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca350ea lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589717:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca350ea lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589725:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.589730:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca350ea lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589743:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca350ea lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589754:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109348.589756:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.589761:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca350ea lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589767:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca350ea lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109348.589783:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023cf665d reply state 000000002c8c39c8 transno 326417514583 ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca350f1 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589793:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca350f1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.589799:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109348.589801:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109348.589803:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1786109348.589892:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+13:157732:x1872862922029824:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 4699us (5036us total) trans 326417514583 rc 0/0 00000100:00100000:1.0:1786109348.589901:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 674 00000100:00100000:1.0:1786109348.608764:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109348.613066:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab928ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933097984:0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.613149:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.613192:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933098496:0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.613231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.613261:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786109348.613267:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933097856:0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.613292:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.613311:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933098368:0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.613336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.613370:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933098496 00000100:00100000:1.0:1786109348.613378:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933098496 00000100:00100000:1.0:1786109348.613459:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933098368 00000100:00100000:1.0:1786109348.613462:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933098368 00000100:00100000:1.0:1786109348.613485:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6799 00000100:00100000:1.0:1786109348.613495:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933098496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.613550:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933098496:12345-0@lo:400:kworker.0 Request processed in 56us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.613557:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6799 00000100:00100000:1.0:1786109348.613571:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6800 00000100:00100000:1.0:1786109348.613576:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933098368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.613600:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933098368:12345-0@lo:400:kworker.0 Request processed in 23us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.613606:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6800 00000100:00080000:1.0:1786109348.613625:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109348.613629:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109348.613661:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933098368:0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.613671:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933098496:0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.613696:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933097984 00000100:00100000:1.0:1786109348.613698:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933097984 00000100:00080000:1.0:1786109348.613712:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109348.613732:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933097856 00000100:00100000:1.0:1786109348.613735:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933097856 00000100:00080000:1.0:1786109348.613745:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109348.613758:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786109348.613764:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933097984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.613798:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933097984:12345-0@lo:400:kworker.0 Request processed in 34us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.613804:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786109348.613826:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab928ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933097984:0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.613845:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786109348.613852:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933097856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.613884:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933097856:12345-0@lo:400:kworker.0 Request processed in 33us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.613890:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786109348.613913:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933097856:0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.616070:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933099008:0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.616128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.616174:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109348.616180:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933098880:0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.616218:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.616536:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109348.616547:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933099136:0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.616579:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.616612:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933098880 00000100:00100000:1.0:1786109348.616620:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933098880 00000100:00100000:1.0:1786109348.616656:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933099136 00000100:00100000:1.0:1786109348.616659:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933099136 00000100:00100000:1.0:1786109348.616675:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786109348.616683:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933098880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.616734:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933098880:12345-0@lo:400:kworker.0 Request processed in 52us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.616740:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786109348.616756:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786109348.616762:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933099136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.616794:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933099136:12345-0@lo:400:kworker.0 Request processed in 32us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.616799:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786109348.616838:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933099136:0@lo:400:kworker.0 00000100:00100000:1.0:1786109348.616866:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933098880:0@lo:400:kworker.0 00000100:00100000:0.0:1786109348.617469:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933099008 00000100:00100000:0.0:1786109348.617477:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933099008 00000100:00100000:0.0:1786109348.617536:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6801 00000100:00100000:0.0:1786109348.617545:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933099008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109348.617603:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933099008:12345-0@lo:400:kworker.0 Request processed in 59us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109348.617609:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6801 00000100:00100000:0.0:1786109348.617649:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738457 gen 2 00000100:00100000:0.0:1786109348.617665:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933099008:0@lo:400:kworker.0 00000100:00100000:0.0:1786109348.625808:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109348.626047:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922030080 00000100:00100000:1.0:1786109348.626060:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922030080 00000100:00100000:1.0:1786109348.626141:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 676 00000100:00100000:1.0:1786109348.626153:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+14:157735:x1872862922030080:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109348.626181:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109348.626220:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35130 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a10fc expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.626304:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35137 lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.626320:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35137 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.626334:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35137 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109348.626398:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x2d:0x0]: returning size 4096 00000004:00200000:1.0:1786109348.626404:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786109348.626926:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35130 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10fc expref: 16 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.626963:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35137 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10fc expref: 15 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.626974:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2d:0x0].0x0 (ffff93098c4ae700) 00010000:00010000:1.0:1786109348.626978:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786109348.626981:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35a00, rc 0) 00000100:00100000:1.0:1786109348.627068:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+15:157735:x1872862922030080:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 917us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.627076:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 676 00000100:00100000:0.0:1786109348.636722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109348.637619:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933099392 00000100:00100000:0.0:1786109348.637624:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933099392 00000100:00100000:0.0:1786109348.637665:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5215 00000100:00100000:0.0:1786109348.637674:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933099392:12345-0@lo:104: 00010000:00010000:0.0:1786109348.637690:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca3510d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.637824:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786109348.637831:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933099392:12345-0@lo:104: Request processed in 159us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109348.637839:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5215 00010000:00010000:0.0:1786109348.637866:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109348.637873:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca3510d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.637884:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030200 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109348.637890:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca3510d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109348.637900:0:10402:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca3510d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.637931:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca3510d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.637938:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109348.637962:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca3510d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.637970:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35106 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca3510d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.637995:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109348.637997:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109348.638000:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109348.638009:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109348.638020:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933099520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109348.638054:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109348.638088:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933099520 00000100:00100000:0.0:1786109348.638092:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933099520 00010000:00010000:0.0:1786109348.638111:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca3510d lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca35106 expref: 59 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109348.638137:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12566 00000100:00100000:0.0:1786109348.638143:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+59:3647:x1872862933099520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109348.638154:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1786109348.645302:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804436 is committed 00000100:00100000:1.0:1786109348.646162:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933099520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109348.646258:0:187901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76600/0xdb52b77d7ca35145 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.646267:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76600/0xdb52b77d7ca35145 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109348.646342:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x2d:0x0]: returning size 4096 00000004:00200000:0.0:1786109348.646348:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109348.646400:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd77a00/0xdb52b77d7ca3513e lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1103 expref: 8 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.646418:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76600/0xdb52b77d7ca35145 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1103 expref: 7 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.646629:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x2d:0x0].0x0 (ffff930984516e00) 00010000:00010000:0.0:1786109348.646632:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109348.646636:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76600, rc 0) 00000100:00100000:0.0:1786109348.646736:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:157735:x1872862922030208:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 9702us (10024us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109348.646745:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 677 00000100:00100000:0.0:1786109348.655105:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109348.660894:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922030592 00000100:00100000:1.0:1786109348.660904:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922030592 00010000:00010000:1.0:1786109348.660968:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35137 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10fc expref: 15 pid: 187899 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109348.661123:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12567 00000100:00100000:1.0:1786109348.661136:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:397d331e-10fc-4558-be87-308c3622e8eb+15:2405:x1872862922030592:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109348.661154:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109348.661162:0:177416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35137 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10fc expref: 15 pid: 187899 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.661183:0:177416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35137 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10fc expref: 15 pid: 187899 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.661221:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35137 lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a10fc expref: 15 pid: 187899 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.661239:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2d:0x0].0x0 (ffff93098c4ae700) 00010000:00010000:1.0:1786109348.661244:0:177416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca35161 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.661256:0:177416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca35161 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.661264:0:177416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca35161 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.661299:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109348.661386:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:397d331e-10fc-4558-be87-308c3622e8eb+14:2405:x1872862922030592:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 240us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.661395:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12567 00000100:00100000:0.0:1786109348.671356:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8451:1872862933099904:192.168.203.38@tcp:104: 00010000:00010000:0.0:1786109348.671407:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd77200/0xdb52b77d7ca3516f lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35168 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.671425:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x2d:0x0].0x0 (ffff930984516e00) 00010000:00010000:0.0:1786109348.671476:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109348.671482:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd77200/0xdb52b77d7ca3516f lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35168 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.671497:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd77200/0xdb52b77d7ca3516f lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35168 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.671505:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77200, rc 0) 00000100:00100000:0.0:1786109348.671616:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933099776:12345-0@lo:101:mdt00_003.0 Request processed in 9687us (9978us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109348.671626:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12027 00000100:00100000:1.0:1786109348.671720:0:188678:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804436 gen 2 00000004:00080000:1.0:1786109348.671729:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804385 committed transno 25769804436 00000020:00080000:1.0:1786109348.671736:0:188678:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab8c48180 refcount 2 committed 0 result 0 batchid 322122568645 00000020:00080000:1.0:1786109348.671741:0:188678:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8fc7d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab8c48a80 00000020:00080000:1.0:1786109348.671745:0:188678:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].301 00000020:00080000:1.0:1786109348.671749:0:188678:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8fc7700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930982d19400 00000020:00080000:1.0:1786109348.671752:0:188678:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].420 00000004:00080000:1.0:1786109348.671782:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804386 committed transno 25769804436 00000020:00080000:1.0:1786109348.671798:0:188678:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab8c48f00 refcount 2 committed 0 result 0 batchid 322122568646 00000020:00080000:1.0:1786109348.671803:0:188678:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0972100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab8c48cc0 00000020:00080000:1.0:1786109348.671807:0:188678:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].302 00000020:00080000:1.0:1786109348.671808:0:188678:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0972a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930982d18200 00000020:00080000:1.0:1786109348.671811:0:188678:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].421 00000004:00080000:1.0:1786109348.671827:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804387 committed transno 25769804436 00000004:00080000:1.0:1786109348.671842:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804388 committed transno 25769804436 00000004:00080000:1.0:1786109348.671860:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804389 committed transno 25769804436 00000004:00080000:1.0:1786109348.671873:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804390 committed transno 25769804436 00000004:00080000:1.0:1786109348.671885:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804391 committed transno 25769804436 00000004:00080000:1.0:1786109348.671907:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804392 committed transno 25769804436 00000004:00080000:1.0:1786109348.671917:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804393 committed transno 25769804436 00000004:00080000:1.0:1786109348.671929:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804394 committed transno 25769804436 00000004:00080000:1.0:1786109348.671966:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804395 committed transno 25769804436 00000004:00080000:1.0:1786109348.671978:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804396 committed transno 25769804436 00000004:00080000:1.0:1786109348.671991:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804397 committed transno 25769804436 00000004:00080000:1.0:1786109348.672006:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804398 committed transno 25769804436 00000004:00080000:1.0:1786109348.672020:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804399 committed transno 25769804436 00000004:00080000:1.0:1786109348.672035:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804400 committed transno 25769804436 00000004:00080000:1.0:1786109348.672047:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804401 committed transno 25769804436 00000004:00080000:1.0:1786109348.672055:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804402 committed transno 25769804436 00000004:00080000:1.0:1786109348.672068:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804403 committed transno 25769804436 00000004:00080000:1.0:1786109348.672080:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804404 committed transno 25769804436 00000004:00080000:1.0:1786109348.672091:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804405 committed transno 25769804436 00000004:00080000:1.0:1786109348.672104:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804406 committed transno 25769804436 00000004:00080000:1.0:1786109348.672114:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804407 committed transno 25769804436 00000004:00080000:1.0:1786109348.672126:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804408 committed transno 25769804436 00000004:00080000:1.0:1786109348.672139:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804409 committed transno 25769804436 00000004:00080000:1.0:1786109348.672154:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804410 committed transno 25769804436 00000004:00080000:1.0:1786109348.672167:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804411 committed transno 25769804436 00000004:00080000:1.0:1786109348.672178:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804412 committed transno 25769804436 00000004:00080000:1.0:1786109348.672191:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804413 committed transno 25769804436 00000004:00080000:1.0:1786109348.672216:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804414 committed transno 25769804436 00000004:00080000:1.0:1786109348.672226:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804415 committed transno 25769804436 00000004:00080000:1.0:1786109348.672236:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804416 committed transno 25769804436 00000004:00080000:1.0:1786109348.672245:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804417 committed transno 25769804436 00000004:00080000:1.0:1786109348.672254:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804418 committed transno 25769804436 00000004:00080000:1.0:1786109348.672263:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804419 committed transno 25769804436 00000004:00080000:1.0:1786109348.672274:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804420 committed transno 25769804436 00000004:00080000:1.0:1786109348.672283:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804421 committed transno 25769804436 00000004:00080000:1.0:1786109348.672292:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804422 committed transno 25769804436 00000004:00080000:1.0:1786109348.672303:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804423 committed transno 25769804436 00000004:00080000:1.0:1786109348.672312:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804424 committed transno 25769804436 00000004:00080000:1.0:1786109348.672319:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804425 committed transno 25769804436 00000004:00080000:1.0:1786109348.672327:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804426 committed transno 25769804436 00000004:00080000:1.0:1786109348.672363:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804427 committed transno 25769804436 00000004:00080000:1.0:1786109348.672373:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804428 committed transno 25769804436 00000004:00080000:1.0:1786109348.672394:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804429 committed transno 25769804436 00000020:00080000:0.0:1786109348.672403:0:187973:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 322122568646 committed batchid 322122568610 00000004:00080000:1.0:1786109348.672406:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804430 committed transno 25769804436 00000004:00080000:1.0:1786109348.672416:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804431 committed transno 25769804436 00000020:00080000:0.0:1786109348.672502:0:187973:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 322122568610 00000100:00100000:0.0:1786109348.672518:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933100032 00000100:00100000:0.0:1786109348.672522:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933100032 00000100:00100000:0.0:1786109348.672558:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5216 00000100:00100000:0.0:1786109348.672566:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:9538:x1872862933100032:12345-0@lo:105: 00010000:00010000:0.0:1786109348.672582:0:6510:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.672599:0:6510:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.672610:0:6510:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.672619:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.672626:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.672635:0:6510:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.672653:0:6510:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930aa628b200) 00000100:00100000:0.0:1786109348.672699:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:9538:x1872862933100032:12345-0@lo:105: Request processed in 131us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109348.672708:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5216 00000004:00080000:1.0:1786109348.675640:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804432 committed transno 25769804436 00000004:00080000:1.0:1786109348.675667:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804433 committed transno 25769804436 00000004:00080000:1.0:1786109348.675677:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804434 committed transno 25769804436 00000004:00080000:1.0:1786109348.675685:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804435 committed transno 25769804436 00000004:00080000:1.0:1786109348.675712:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804436 committed transno 25769804436 00000100:00100000:1.0:1786109348.675743:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933099776:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786109348.675775:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109348.676751:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933100160:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1786109348.677100:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.677150:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9480 going to sleep for 11 seconds 00000040:00080000:0.0:1786109348.687940:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].424, 656 off647864 00000040:00080000:0.0:1786109348.688171:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].305, 736 off506960 00000004:00080000:0.0:1786109348.688179:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d340c0 with version 663 00000004:00080000:1.0:1786109348.688333:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 663 rpc_version 663 00000020:00100000:1.0:1786109348.688378:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109348.688390:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098c388000 x1872862933100416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109348.688416:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933100416:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109348.688652:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.688745:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109348.689473:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933100416:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786109348.690765:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109348.690776:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.690786:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109348.690792:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109348.690801:0:6514:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.690846:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.690853:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1786109348.690917:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933100544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109348.691006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786109348.691066:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.691075:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca35168 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3516f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.691099:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109348.691101:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109348.691103:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109348.691814:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933100544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109348.730799:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922030976 00000100:00100000:1.0:1786109348.730813:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922030976 00000100:00100000:1.0:1786109348.730925:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 680 00000100:00100000:1.0:1786109348.730939:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+15:157740:x1872862922030976:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109348.730981:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109348.731009:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca3518b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1111 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731095:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35192 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731112:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35192 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731126:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35192 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731138:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35199 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731146:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35199 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731158:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35199 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731223:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35192 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731231:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35192 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731238:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35192 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731244:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.731248:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35192 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731256:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35192 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731270:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109348.731273:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.731278:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35192 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731285:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35192 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731301:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35199 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731307:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35199 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731314:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35199 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731319:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109348.731321:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35199 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731327:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35199 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731334:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109348.731336:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.731339:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35199 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731344:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35199 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731378:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca3518b lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1111 expref: 16 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731390:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109348.731392:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109348.731395:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca3518b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1111 expref: 16 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.731405:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35a00, rc 0) 00000100:00100000:1.0:1786109348.731570:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+15:157740:x1872862922030976:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 634us (928us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109348.731580:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 680 00000100:00100000:0.0:1786109348.746556:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922031104 00000100:00100000:0.0:1786109348.746570:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922031104 00000100:00100000:0.0:1786109348.746700:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 681 00000100:00100000:0.0:1786109348.746713:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+15:157740:x1872862922031104:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109348.746739:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109348.746764:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca351a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1118 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.746863:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca351a7 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.746882:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca351a7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.746897:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca351a7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109348.746968:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:0.0:1786109348.746973:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109348.746997:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca351a7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.747027:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca351a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1118 expref: 17 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.747048:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca351a7 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1118 expref: 16 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.747057:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109348.747062:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109348.747066:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8400, rc 0) 00000100:00100000:0.0:1786109348.747215:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+16:157740:x1872862922031104:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 504us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109348.747223:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 681 00000004:00080000:1.0:1786109348.765513:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 664 rpc_version 664 00000020:00100000:1.0:1786109348.765566:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109348.765580:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098c388700 x1872862933100800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109348.765790:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933100800:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109348.765886:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.765945:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109348.766067:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933100800 00000100:00100000:0.0:1786109348.766078:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933100800 00000100:00100000:0.0:1786109348.766211:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12030 00000100:00100000:0.0:1786109348.766223:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab5397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933100800:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109348.767045:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab5397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933100800:12345-0@lo:1000:osp_up1-0.0 Request processed in 820us (1154us total) trans 25769804438 rc 0/0 00000100:00100000:0.0:1786109348.767056:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12030 00000100:00100000:1.0:1786109348.767419:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933100800:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109348.807978:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922031616 00000100:00100000:1.0:1786109348.807992:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922031616 00000100:00100000:1.0:1786109348.808069:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 684 00000100:00100000:1.0:1786109348.808082:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+18:157743:x1872862922031616:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109348.808109:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109348.808138:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca351f4 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1126 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.808317:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca351fb lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.808335:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca351fb lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.808348:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca351fb lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109348.808418:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x2e:0x0]: returning size 4096 00000004:00200000:1.0:1786109348.808560:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786109348.808611:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca351f4 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1126 expref: 20 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.808634:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca351fb lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1126 expref: 19 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.808643:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2e:0x0].0x0 (ffff930984516b00) 00010000:00010000:1.0:1786109348.808647:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786109348.808651:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35000, rc 0) 00000100:00100000:1.0:1786109348.808784:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+19:157743:x1872862922031616:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 704us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.808793:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 684 00000100:00100000:0.0:1786109348.815071:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922031744 00000100:00100000:0.0:1786109348.815085:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922031744 00000100:00100000:0.0:1786109348.815160:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 685 00000100:00100000:0.0:1786109348.815172:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:157743:x1872862922031744:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109348.815270:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109348.815298:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35202 lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a112d expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.815373:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35209 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.815390:0:187901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca351d1 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca351ca expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.815400:0:187901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35209 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.815533:0:187901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca351d1 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca351ca expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109348.815552:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933101056:0@lo:104: 00000100:00100000:0.0:1786109348.815609:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109348.815702:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109348.815746:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933101056 00000100:00100000:1.0:1786109348.815750:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933101056 00000100:00100000:1.0:1786109348.815825:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5217 00000100:00100000:1.0:1786109348.815834:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933101056:12345-0@lo:104: 00010000:00010000:1.0:1786109348.815850:0:10344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b800/0xdb52b77d7ca351ca lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca351d1 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.815932:0:10344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786109348.815940:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933101056:12345-0@lo:104: Request processed in 107us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.815958:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5217 00000100:00100000:0.0:1786109348.816237:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933101184 00000100:00100000:0.0:1786109348.816243:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933101184 00010000:00010000:0.0:1786109348.816264:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca351d1 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca351ca expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109348.816297:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12569 00000100:00100000:0.0:1786109348.816303:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3648:x1872862933101184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109348.816315:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1786109348.818808:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804438 is committed 00010000:00010000:1.0:1786109348.819033:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca351d1 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca351ca expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.819059:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x2e:0x0].0x0 (ffff930aa62cfb00) 00010000:00010000:1.0:1786109348.819066:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35209 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.819080:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35209 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.819088:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35209 lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.819127:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109348.819292:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933101184:12345-0@lo:103:ldlm_bl.0 Request processed in 2986us (3079us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.819305:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12569 00000100:00100000:0.0:1786109348.865792:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109348.866844:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933101440 00000100:00100000:0.0:1786109348.866861:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933101440 00000100:00100000:0.0:1786109348.866984:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12032 00000100:00100000:0.0:1786109348.866994:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188678:x1872862933101440:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109348.867014:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109348.867031:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35233 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3522c expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.867058:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35209 lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a112d expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.867075:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35233 lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3522c expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.867104:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35209 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a112d expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.867117:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35209 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x2e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a112d expref: 6 pid: 187901 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109348.867130:0:8452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8452:1872862933101568:192.168.203.38@tcp:104: 00000100:00100000:0.0:1786109348.867225:0:8452:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d346c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109348.898240:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109348.899011:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933101696 00000100:00100000:1.0:1786109348.899017:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933101696 00000100:00100000:1.0:1786109348.899062:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5218 00000100:00100000:1.0:1786109348.899070:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6511:x1872862933101696:12345-0@lo:105: 00010000:00010000:1.0:1786109348.899082:0:6509:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca3522c lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35233 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.899091:0:6509:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca3522c lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35233 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.899099:0:6509:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca3522c lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35233 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.899107:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca3522c lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35233 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.899114:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca3522c lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35233 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.899123:0:6509:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca3522c lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35233 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109348.899186:0:6509:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff93098cd76600) 00000100:00100000:1.0:1786109348.899245:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6511:x1872862933101696:12345-0@lo:105: Request processed in 175us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.899252:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5218 00000100:00100000:1.0:1786109348.899287:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6511:1872862933101696:0@lo:105: 00010000:00010000:1.0:1786109348.899305:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109348.899353:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922032256:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 758us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109348.899360:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12571 00000100:00100000:0.0:1786109348.900856:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933101824 00000100:00100000:0.0:1786109348.900864:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933101824 00000100:00100000:0.0:1786109348.900920:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12033 00000100:00100000:0.0:1786109348.900931:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933101824:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1786109348.903518:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933101824:12345-0@lo:403:mdt00_003.0 Request processed in 2576us (2796us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109348.903533:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12033 00000004:00080000:1.0:1786109348.904995:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 665 rpc_version 665 00000020:00100000:1.0:1786109348.905035:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109348.905044:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098c38b100 x1872862933102080/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109348.905071:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933102080:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109348.905135:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109348.905229:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109348.905728:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c38b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933102080:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1786109348.905834:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dca:0x0]: returning size 4096 00010000:00010000:0.0:1786109348.905860:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35225 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.905871:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35225 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.905879:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35225 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.905888:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ae00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109348.905892:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35225 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.905900:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35225 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.905918:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2e:0x0].0x0 (ffff930984516b00) 00010000:00010000:0.0:1786109348.905921:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109348.905926:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35225 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.905932:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35225 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.905947:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca3522c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35233 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.905955:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca3522c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35233 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.905963:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca3522c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35233 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.905990:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786109348.905999:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x2e:0x0] 00010000:00010000:0.0:1786109348.906006:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca3521e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906011:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca3521e lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906018:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca3521e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906024:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109348.906026:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca3521e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906032:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca3521e lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906039:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dca:0x0].0x0 (ffff930984516800) 00010000:00010000:0.0:1786109348.906041:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109348.906043:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca3521e lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906048:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca3521e lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906060:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35210 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906066:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35210 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906072:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35210 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906077:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109348.906080:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35210 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906090:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35210 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906097:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109348.906099:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109348.906102:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35210 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906107:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35210 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109348.906117:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b71e8ec reply state 0000000021ffd3d3 transno 326417514586 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca35217 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906130:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca35217 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.906137:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109348.906139:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109348.906141:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109348.906792:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+19:157743:x1872862922032000:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 52117us (52419us total) trans 326417514586 rc 0/0 00000100:00100000:0.0:1786109348.906801:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 686 00000100:00100000:0.0:1786109348.950405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109348.952314:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+19:157749:x1872862922032384:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1689us (1919us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109348.952325:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 687 00000100:00100000:1.0:1786109348.960239:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109348.960950:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 688 00000100:00100000:0.0:1786109348.960968:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+19:157749:x1872862922032512:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109348.960995:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109348.961019:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca3524f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a113b expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961093:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca35256 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961108:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca35256 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961121:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca35256 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961132:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3525d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961140:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3525d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961146:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3525d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961211:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca35256 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961218:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca35256 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961225:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca35256 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961231:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109348.961236:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca35256 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961243:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca35256 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961257:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109348.961260:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109348.961265:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca35256 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961271:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca35256 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961287:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3525d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961293:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3525d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961299:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3525d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961304:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109348.961306:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3525d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961311:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3525d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961318:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109348.961320:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109348.961323:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3525d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961329:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3525d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961359:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca3524f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a113b expref: 20 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961370:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109348.961372:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109348.961375:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca3524f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a113b expref: 20 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109348.961385:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8800, rc 0) 00000100:00100000:0.0:1786109348.963777:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+19:157749:x1872862922032512:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2795us (3532us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109348.963793:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 688 00000100:00100000:1.0:1786109348.974389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109349.008070:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000004:00080000:1.0:1786109349.014619:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 666 rpc_version 666 00000020:00100000:1.0:1786109349.014690:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109349.014705:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098c38b800 x1872862933102464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109349.014737:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933102464:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109349.014837:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109349.014887:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109349.015652:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933102464 00000100:00100000:0.0:1786109349.015664:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933102464 00000100:00100000:0.0:1786109349.016132:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12035 00000100:00100000:0.0:1786109349.016148:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933102464:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109349.018365:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933102464:12345-0@lo:1000:osp_up1-0.0 Request processed in 2213us (3518us total) trans 25769804440 rc 0/0 00000100:00100000:0.0:1786109349.018384:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12035 00000100:00100000:1.0:1786109349.020361:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c38b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933102464:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109349.026771:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c0a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109349.026842:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933102592:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109349.026875:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76000/0xdb52b77d7ca3528e lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35295 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.026893:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76000/0xdb52b77d7ca3528e lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35295 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109349.026929:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3492f7a reply state 000000004b870a8c transno 326417514587 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77600/0xdb52b77d7ca35287 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.026947:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77600/0xdb52b77d7ca35287 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.026956:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2f:0x0].0x0 (ffff930985b9d200) 00010000:00010000:0.0:1786109349.026959:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109349.026964:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109349.026971:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76000/0xdb52b77d7ca3528e lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35295 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.026980:0:188678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76000/0xdb52b77d7ca3528e lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35295 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109349.026994:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x2f:0x0] 00000004:00010000:0.0:1786109349.027004:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3492f7a reply state 000000004b870a8c transno 326417514587 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca35280 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.027013:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca35280 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.027020:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcb:0x0].0x0 (ffff930985b9dd00) 00010000:00010000:0.0:1786109349.027023:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109349.027025:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1786109349.027031:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dcb:0x0]: returning size 4096 00010000:00010000:0.0:1786109349.027042:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ac00/0xdb52b77d7ca35272 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.027048:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ac00/0xdb52b77d7ca35272 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.027056:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ac00/0xdb52b77d7ca35272 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.027063:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ac00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109349.027068:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ac00/0xdb52b77d7ca35272 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.027075:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ac00/0xdb52b77d7ca35272 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.027087:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109349.027089:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.027093:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ac00/0xdb52b77d7ca35272 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.027099:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ac00/0xdb52b77d7ca35272 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109349.027115:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3492f7a reply state 000000004b870a8c transno 326417514587 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35279 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.027125:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35279 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.027130:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109349.027133:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109349.027135:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1786109349.029056:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+21:157749:x1872862922032896:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 19336us (20755us total) trans 326417514587 rc 0/0 00000100:00100000:0.0:1786109349.029072:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 690 00000100:00100000:0.0:1786109349.057742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109349.078487:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922033152 00000100:00100000:0.0:1786109349.078500:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922033152 00000100:00100000:0.0:1786109349.078582:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 692 00000100:00100000:0.0:1786109349.078595:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+22:157756:x1872862922033152:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109349.078621:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.078648:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca352b8 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1150 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.080962:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca352bf lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.080991:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca352bf lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.081007:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca352bf lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109349.081091:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x2f:0x0]: returning size 4096 00000004:00200000:0.0:1786109349.081098:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109349.081161:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca352b8 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1150 expref: 24 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.081191:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca352bf lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1150 expref: 23 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.081216:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2f:0x0].0x0 (ffff930985b9d200) 00010000:00010000:0.0:1786109349.081219:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109349.081223:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9e00, rc 0) 00000100:00100000:0.0:1786109349.081326:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+23:157756:x1872862922033152:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 2733us (3167us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.081335:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 692 00000100:00100000:1.0:1786109349.092626:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109349.093951:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922033280 00000100:00100000:0.0:1786109349.093970:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922033280 00000100:00100000:0.0:1786109349.094601:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 693 00000100:00100000:0.0:1786109349.094620:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:157756:x1872862922033280:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109349.094647:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.094676:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca352c6 lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1157 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.094757:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca352cd lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.094776:0:187901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35295 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3528e expref: 8 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.094786:0:187901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca352cd lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.096264:0:187901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35295 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca3528e expref: 8 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109349.096293:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1e64380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933102720:0@lo:104: 00000100:00100000:0.0:1786109349.096388:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109349.096494:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34000 going to sleep for 11 seconds 00000100:00100000:1.0:1786109349.096703:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933102720 00000100:00100000:1.0:1786109349.096712:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933102720 00000100:00100000:1.0:1786109349.096780:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5219 00000100:00100000:1.0:1786109349.096789:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933102720:12345-0@lo:104: 00010000:00010000:1.0:1786109349.096805:0:10344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76000/0xdb52b77d7ca3528e lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35295 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.097547:0:10344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786109349.097559:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933102720:12345-0@lo:104: Request processed in 769us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109349.097569:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5219 00010000:00010000:1.0:1786109349.097604:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109349.097611:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76000/0xdb52b77d7ca3528e lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35295 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.097622:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76000 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109349.097628:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76000/0xdb52b77d7ca3528e lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca35295 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109349.097638:0:10402:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76000/0xdb52b77d7ca3528e lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca35295 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.097680:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76000/0xdb52b77d7ca3528e lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35295 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.097688:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109349.097713:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76000/0xdb52b77d7ca3528e lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35295 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.097721:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76000/0xdb52b77d7ca3528e lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35295 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.097748:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109349.097750:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109349.097752:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109349.097760:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109349.097775:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933102848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109349.097836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109349.097887:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933102848 00000100:00100000:1.0:1786109349.097893:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933102848 00010000:00010000:1.0:1786109349.097916:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35295 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca3528e expref: 9 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109349.097960:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12572 00000100:00100000:1.0:1786109349.097969:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e358380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3647:x1872862933102848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109349.097981:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1786109349.145629:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804440 is committed 00010000:00010000:1.0:1786109349.145915:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35295 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca3528e expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.145948:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x2f:0x0].0x0 (ffff930984516300) 00010000:00010000:1.0:1786109349.145954:0:43921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca352cd lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.145965:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca352cd lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.145973:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca352cd lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.146058:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109349.146168:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933102848:12345-0@lo:103:ldlm_bl.0 Request processed in 48198us (48329us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109349.146180:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12572 00000100:00100000:0.0:1786109349.146297:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933102848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109349.160147:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922033664 00000100:00100000:0.0:1786109349.160160:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922033664 00010000:00010000:0.0:1786109349.160221:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca352bf lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1150 expref: 23 pid: 187899 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109349.160273:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12573 00000100:00100000:0.0:1786109349.160284:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397d331e-10fc-4558-be87-308c3622e8eb+23:2403:x1872862922033664:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109349.160301:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109349.160309:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca352bf lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1150 expref: 23 pid: 187899 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.160323:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca352bf lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1150 expref: 23 pid: 187899 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.160350:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca352bf lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1150 expref: 23 pid: 187899 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.160369:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2f:0x0].0x0 (ffff930985b9d200) 00010000:00010000:0.0:1786109349.160375:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca352e9 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.160387:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca352e9 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.160400:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca352e9 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.160635:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109349.160713:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397d331e-10fc-4558-be87-308c3622e8eb+22:2403:x1872862922033664:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 429us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.160722:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12573 00000100:00100000:0.0:1786109349.161460:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933103104 00000100:00100000:0.0:1786109349.161467:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933103104 00000100:00100000:0.0:1786109349.161518:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12037 00000100:00100000:0.0:1786109349.161527:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188678:x1872862933103104:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109349.161549:0:179257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.161567:0:179257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca352f7 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca352f0 expref: -99 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.161595:0:179257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca352cd lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1157 expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.161604:0:179257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca352f7 lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca352f0 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.161634:0:179257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca352cd lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1157 expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.161648:0:179257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca352cd lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1157 expref: 6 pid: 187901 timeout: 8305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109349.161666:0:179257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:179257:1872862933103232:192.168.203.38@tcp:104: 00000100:00100000:0.0:1786109349.161753:0:179257:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109349.182993:0:179257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:179257:1872862933103232:192.168.203.38@tcp:104: 00010000:00010000:0.0:1786109349.183047:0:179257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca352f7 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca352f0 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.183062:0:179257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x2f:0x0].0x0 (ffff930984516300) 00010000:00010000:0.0:1786109349.183066:0:179257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109349.183070:0:179257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca352f7 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca352f0 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.183081:0:179257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca352f7 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca352f0 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.183088:0:179257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8600, rc 0) 00000100:00100000:0.0:1786109349.183238:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933103104:12345-0@lo:101:mdt00_003.0 Request processed in 21710us (22236us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.183249:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12037 00000100:00100000:1.0:1786109349.189650:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109349.190386:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933103360 00000100:00100000:1.0:1786109349.190391:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933103360 00000100:00100000:1.0:1786109349.190490:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5220 00000100:00100000:1.0:1786109349.190499:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:177416:x1872862933103360:12345-0@lo:105: 00010000:00010000:1.0:1786109349.190512:0:6510:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.190522:0:6510:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.190530:0:6510:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.190542:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.190550:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.190557:0:6510:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.190585:0:6510:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930aa628b200) 00000100:00100000:1.0:1786109349.190629:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:177416:x1872862933103360:12345-0@lo:105: Request processed in 132us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109349.190636:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5220 00010000:00010000:0.0:1786109349.191296:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.191310:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109349.192101:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933103488:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1786109349.192169:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109349.192288:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34480 going to sleep for 11 seconds 00000100:00100000:1.0:1786109349.192654:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933103488 00000100:00100000:1.0:1786109349.192665:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933103488 00000100:00100000:1.0:1786109349.192758:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12038 00000100:00100000:1.0:1786109349.192769:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933103488:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1786109349.196397:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933103488:12345-0@lo:403:mdt00_003.0 Request processed in 3604us (4200us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109349.196427:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12038 00000100:00100000:0.0:1786109349.196780:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933103488:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1786109349.198081:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].428, 656 off653480 00000040:00080000:0.0:1786109349.198305:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].309, 736 off513136 00000004:00080000:0.0:1786109349.198312:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d34480 with version 667 00000004:00080000:1.0:1786109349.198624:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 667 rpc_version 667 00000020:00100000:1.0:1786109349.198668:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109349.198679:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098e358700 x1872862933103744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109349.198708:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933103744:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109349.198790:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109349.198879:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109349.199514:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933103744:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786109349.200237:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109349.200245:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.200254:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109349.200259:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109349.200267:0:6514:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.200302:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.200309:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109349.200345:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.200353:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b200/0xdb52b77d7ca352f0 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca352f7 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.200374:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109349.200376:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109349.200377:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109349.200385:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109349.200400:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933103872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109349.200475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109349.200518:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933103872 00000100:00100000:1.0:1786109349.200524:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933103872 00000100:00100000:1.0:1786109349.200571:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4476 00000100:00100000:1.0:1786109349.200580:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3646:x1872862933103872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109349.200593:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109349.200621:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca352f7 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca352f0 expref: 8 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.200637:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x2f:0x0].0x0 (ffff930984516300) 00010000:00010000:1.0:1786109349.200645:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109349.200674:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1872862933103872:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109349.200681:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4476 00000100:00100000:1.0:1786109349.200716:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933103872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109349.292406:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1786109349.295528:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3530c lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.295534:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3530c lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.295539:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109349.295541:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3530c lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.295547:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3530c lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.295552:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109349.295555:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109349.295558:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3530c lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.295563:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3530c lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.296274:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca352fe lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a115e expref: 24 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.296290:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109349.296293:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109349.296297:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca352fe lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a115e expref: 24 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.296311:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77e00, rc 0) 00000100:00100000:3.0:1786109349.298376:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+23:157765:x1872862922033920:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 4010us (5966us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109349.298394:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 695 00000100:00100000:3.0:1786109349.308952:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109349.309101:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922034048 00000100:00100000:0.0:1786109349.309114:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922034048 00000100:00100000:0.0:1786109349.309236:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 696 00000100:00100000:0.0:1786109349.309248:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+23:157765:x1872862922034048:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109349.309275:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.309302:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35313 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1165 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309384:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3531a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309400:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3531a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309412:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3531a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309423:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35321 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309500:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35321 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309508:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35321 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309565:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3531a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309573:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3531a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309579:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3531a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309586:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109349.309592:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3531a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309600:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3531a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309614:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109349.309618:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.309623:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3531a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309630:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3531a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309643:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35321 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309650:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35321 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309656:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35321 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309662:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109349.309665:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35321 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309671:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35321 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309679:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109349.309681:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.309684:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35321 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309690:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35321 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309722:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35313 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1165 expref: 24 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309733:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109349.309735:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.309739:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35313 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1165 expref: 24 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.309749:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9e00, rc 0) 00000100:00100000:0.0:1786109349.309818:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+23:157765:x1872862922034048:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 572us (879us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109349.309837:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 696 00000100:00100000:1.0:1786109349.313163:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109349.313278:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922034176 00000100:00100000:0.0:1786109349.313292:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922034176 00000100:00100000:0.0:1786109349.313368:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 697 00000100:00100000:0.0:1786109349.313391:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+23:157765:x1872862922034176:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109349.313417:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.313477:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a116c expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.313564:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3532f lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.313579:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3532f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.313606:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3532f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109349.313667:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:0.0:1786109349.313671:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109349.313696:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3532f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.313724:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a116c expref: 25 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.313747:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3532f lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a116c expref: 24 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.313756:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109349.313759:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109349.313763:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8a00, rc 0) 00000100:00100000:0.0:1786109349.313833:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+24:157765:x1872862922034176:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 445us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.313841:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 697 00000100:00100000:1.0:1786109349.328814:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109349.328925:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922034432 00000100:00100000:3.0:1786109349.328939:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922034432 00000100:00100000:3.0:1786109349.329019:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 698 00000100:00100000:3.0:1786109349.329033:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8c53050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+24:157765:x1872862922034432:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:3.0:1786109349.329110:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109349.329143:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3532f lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a116c expref: 24 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.329169:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109349.329176:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109349.329260:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca35336 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.329276:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca35336 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.329287:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca35336 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.329299:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3533d lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.329308:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3533d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.329314:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3533d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109349.331172:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 668 rpc_version 668 00000020:00100000:1.0:1786109349.331227:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109349.331238:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098e359880 x1872862933104128/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109349.331266:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e359880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933104128:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109349.331348:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109349.331446:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109349.331631:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933104128 00000100:00100000:3.0:1786109349.331641:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933104128 00000100:00100000:3.0:1786109349.331737:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12040 00000100:00100000:3.0:1786109349.331749:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933104128:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109349.332262:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933104128:12345-0@lo:1000:osp_up1-0.0 Request processed in 515us (912us total) trans 25769804442 rc 0/0 00000100:00100000:3.0:1786109349.332272:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12040 00000100:00100000:0.0:1786109349.332409:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e359880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933104128:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109349.333129:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933104256 00000100:00100000:1.0:1786109349.333135:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933104256 00000100:00100000:1.0:1786109349.333185:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12041 00000100:00100000:1.0:1786109349.333206:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188678:x1872862933104256:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786109349.333223:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109349.333242:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35359 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35352 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.333265:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35359 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35352 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.333277:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35359 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35352 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.333286:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x30:0x0].0x0 (ffff93098c4ae300) 00010000:00010000:1.0:1786109349.333289:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109349.333293:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35400, rc 0) 00000100:00100000:1.0:1786109349.333332:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188678:x1872862933104256:12345-0@lo:101:mdt00_003.0 Request processed in 139us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109349.333339:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12041 00000100:00100000:1.0:1786109349.367669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109349.367804:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922034560 00000100:00100000:0.0:1786109349.368120:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922034560 00000100:00100000:0.0:1786109349.368257:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 699 00000100:00100000:0.0:1786109349.368270:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+25:157778:x1872862922034560:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109349.368302:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.368328:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35360 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1173 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.368420:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35367 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.368488:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35367 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.368505:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35367 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.368520:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca3536e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.368528:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca3536e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.368535:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca3536e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.368710:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35375 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.368721:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35375 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.368728:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35375 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109349.368940:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dcc:0x0]: returning size 4096 00000004:00200000:0.0:1786109349.368948:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1786109349.368974:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35375 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.368988:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35367 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.368994:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35367 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369002:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35367 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369009:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109349.369014:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35367 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369022:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35367 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369036:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109349.369040:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.369045:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35367 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369051:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35367 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369069:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca3536e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369075:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca3536e lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369080:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca3536e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369085:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109349.369088:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca3536e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369094:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca3536e lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369103:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109349.369105:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.369108:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca3536e lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369114:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca3536e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369145:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35360 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1173 expref: 27 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369164:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35375 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1173 expref: 26 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.369171:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcc:0x0].0x0 (ffff930984516c00) 00010000:00010000:0.0:1786109349.369173:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109349.369176:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9200, rc 0) 00000100:00100000:0.0:1786109349.369266:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+26:157778:x1872862922034560:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 997us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.369275:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 699 00000100:00100000:1.0:1786109349.372902:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109349.372994:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922034688 00000100:00100000:0.0:1786109349.373005:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922034688 00000100:00100000:0.0:1786109349.373111:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 700 00000100:00100000:0.0:1786109349.373123:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+26:157778:x1872862922034688:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109349.373149:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.373173:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca3537c lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a117a expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.373251:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35383 lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.373266:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35383 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.373278:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35383 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109349.373334:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x30:0x0]: returning size 4096 00000004:00200000:0.0:1786109349.373340:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109349.373380:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca3537c lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a117a expref: 28 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.373403:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35383 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x30:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a117a expref: 27 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.373413:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x30:0x0].0x0 (ffff930984516200) 00010000:00010000:0.0:1786109349.373425:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109349.373460:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9800, rc 0) 00000100:00100000:0.0:1786109349.373525:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+27:157778:x1872862922034688:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 405us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.373533:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 700 00000100:00100000:1.0:1786109349.382747:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109349.383748:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922034816 00000100:00100000:3.0:1786109349.383762:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922034816 00000100:00100000:3.0:1786109349.384105:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 701 00000100:00100000:3.0:1786109349.384119:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:157778:x1872862922034816:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109349.384148:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109349.384176:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd77000/0xdb52b77d7ca3538a lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1181 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.384270:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35391 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.384287:0:187900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35359 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35352 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.384297:0:187900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35391 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.384339:0:187900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35359 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35352 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109349.384362:0:187900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985ebad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933104384:0@lo:104: 00000100:00100000:3.0:1786109349.391327:0:187900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109349.391544:0:187900:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c0a5900 going to sleep for 11 seconds 00010000:00010000:0.0:1786109349.391990:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109349.392000:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b400/0xdb52b77d7ca35352 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35359 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.392009:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b400 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109349.392016:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b400/0xdb52b77d7ca35352 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca35359 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109349.392025:0:29734:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b400/0xdb52b77d7ca35352 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca35359 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.392064:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b400/0xdb52b77d7ca35352 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35359 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.392072:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109349.392112:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b400/0xdb52b77d7ca35352 lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35359 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.392122:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628b400/0xdb52b77d7ca35352 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35359 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.392145:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109349.392147:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109349.392148:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109349.392218:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933104512 00000100:00100000:0.0:1786109349.392223:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933104512 00010000:00010000:0.0:1786109349.392247:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35359 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca35352 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109349.392281:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12575 00000100:00100000:0.0:1786109349.392287:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3648:x1872862933104512:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109349.392292:0:187900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985ebad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933104384:0@lo:104: 00010000:00010000:0.0:1786109349.392299:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109349.392316:0:187900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35391 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x30:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786109349.407790:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804442 is committed 00010000:00010000:1.0:1786109349.409130:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35359 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca35352 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.409160:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x30:0x0].0x0 (ffff93098c4ae300) 00010000:00010000:1.0:1786109349.409167:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35391 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.409178:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35391 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.409188:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35391 lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.411154:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109349.411344:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933104512:12345-0@lo:103:ldlm_bl.0 Request processed in 19050us (19165us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.411358:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12575 00010000:00010000:3.0:1786109349.411673:0:187900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35391 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x30:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.411686:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35391 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x30:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109349.411763:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x30:0x0]: returning size 4096 00000004:00200000:3.0:1786109349.411771:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786109349.411849:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd77000/0xdb52b77d7ca3538a lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1181 expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.411872:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35391 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1181 expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.411881:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x30:0x0].0x0 (ffff93098c4ae300) 00010000:00010000:3.0:1786109349.411884:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786109349.411888:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76a00, rc 0) 00000100:00100000:3.0:1786109349.412036:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:157778:x1872862922034816:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 27919us (29303us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109349.412045:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 701 00000100:00100000:1.0:1786109349.420326:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109349.433358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109349.433724:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922035200 00000100:00100000:0.0:1786109349.433739:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922035200 00010000:00010000:0.0:1786109349.433797:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35383 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x30:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a117a expref: 27 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109349.437112:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12576 00000100:00100000:0.0:1786109349.437149:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+27:2403:x1872862922035200:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109349.437182:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109349.437208:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35383 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x30:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a117a expref: 27 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.437227:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35383 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x30:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a117a expref: 27 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.437255:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35383 lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x30:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a117a expref: 27 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.437276:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x30:0x0].0x0 (ffff930984516200) 00010000:00010000:0.0:1786109349.437282:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca353ad lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.437294:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca353ad lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.437302:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca353ad lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.437337:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109349.438526:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+26:2403:x1872862922035200:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 1392us (5178us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.438538:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12576 00000100:00100000:3.0:1786109349.444700:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933104768 00000100:00100000:3.0:1786109349.444720:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933104768 00000100:00100000:0.0:1786109349.472745:0:188678:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804442 gen 2 00000004:00080000:0.0:1786109349.472753:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804441 committed transno 25769804442 00000004:00080000:0.0:1786109349.473021:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804442 committed transno 25769804442 00000100:00100000:0.0:1786109349.473050:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933104768:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109349.473077:0:188678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.473089:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109349.475125:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109349.478503:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933105024 00000100:00100000:3.0:1786109349.478515:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933105024 00000100:00100000:3.0:1786109349.480097:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5222 00000100:00100000:3.0:1786109349.480129:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:9538:x1872862933105024:12345-0@lo:105: 00010000:00010000:3.0:1786109349.480151:0:10344:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.480165:0:10344:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.480176:0:10344:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.480186:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.480205:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.480214:0:10344:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.480244:0:10344:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930aa628aa00) 00000100:00100000:3.0:1786109349.480352:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:9538:x1872862933105024:12345-0@lo:105: Request processed in 237us (2834us total) trans 0 rc 0/0 00010000:00010000:0.0:1786109349.481008:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.481022:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109349.483013:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933105152:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1786109349.483112:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109349.483164:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109349.484824:0:9538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9538:1872862933105024:0@lo:105: 00010000:00010000:0.0:1786109349.484859:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109349.485023:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922035328:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 7839us (9908us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.485037:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12577 00000100:00100000:1.0:1786109349.486821:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933105152 00000100:00100000:1.0:1786109349.486837:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933105152 00000100:00100000:1.0:1786109349.486910:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12043 00000100:00100000:1.0:1786109349.486921:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933105152:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1786109349.488106:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5222 00000100:00100000:1.0:1786109349.497714:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933105152:12345-0@lo:403:mdt00_003.0 Request processed in 10776us (14584us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109349.497736:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12043 00000100:00100000:0.0:1786109349.498699:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933105152:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1786109349.503151:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].431, 656 off658168 00000040:00080000:0.0:1786109349.503390:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].311, 736 off516224 00000004:00080000:0.0:1786109349.503397:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d34480 with version 669 00000004:00080000:1.0:1786109349.506347:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 669 rpc_version 669 00000100:00100000:0.0:1786109349.511101:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933105408 00000100:00100000:0.0:1786109349.511118:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933105408 00000100:00100000:0.0:1786109349.517475:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933105408:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1786109349.518078:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dcc:0x0]: returning size 4096 00010000:00010000:1.0:1786109349.518117:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca353ad lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.518130:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca353ad lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.518139:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca353ad lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.518146:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ae00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109349.518152:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca353ad lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.518161:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca353ad lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.518184:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x30:0x0].0x0 (ffff930984516200) 00010000:00010000:1.0:1786109349.518188:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109349.518205:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca353ad lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.518213:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca353ad lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.518234:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.518243:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.518251:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519650:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786109349.519677:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x30:0x0] 00010000:00010000:1.0:1786109349.519694:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca353a6 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519703:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca353a6 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519711:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca353a6 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519716:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109349.519721:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca353a6 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519730:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca353a6 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519746:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcc:0x0].0x0 (ffff930984516c00) 00010000:00010000:1.0:1786109349.519749:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109349.519753:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca353a6 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519759:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca353a6 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519783:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca35398 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519790:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca35398 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519795:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca35398 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519800:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109349.519803:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca35398 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519809:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca35398 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519817:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109349.519820:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109349.519823:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca35398 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519832:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca35398 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109349.519843:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dea10476 reply state 00000000273b2ef3 transno 326417514590 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3539f lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519857:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3539f lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.519864:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109349.519866:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109349.519870:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109349.519996:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+27:157778:x1872862922035072:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 99147us (99678us total) trans 326417514590 rc 0/0 00000100:00100000:1.0:1786109349.520008:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 702 00010000:00010000:3.0:1786109349.521769:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109349.521789:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.521802:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628aa00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:3.0:1786109349.521810:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109349.521821:0:6515:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.521878:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.521885:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1786109349.522542:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1786109349.522660:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.522671:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628aa00/0xdb52b77d7ca353b4 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca353bb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.522702:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109349.522704:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109349.522706:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109349.524740:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985ebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933105536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109349.524846:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109349.532779:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985ebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933105536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109349.547426:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109349.549023:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922035456 00000100:00100000:0.0:1786109349.549037:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922035456 00000100:00100000:0.0:1786109349.549167:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 703 00000100:00100000:0.0:1786109349.549179:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+27:157789:x1872862922035456:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109349.549222:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.549252:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca353c2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1188 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549337:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca353c9 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549354:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca353c9 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549367:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca353c9 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549380:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353d0 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549388:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353d0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549395:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353d0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549494:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca353c9 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549508:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca353c9 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549514:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca353c9 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549521:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109349.549525:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca353c9 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549533:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca353c9 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549548:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109349.549552:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.549557:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca353c9 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549564:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca353c9 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549949:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353d0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549959:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353d0 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549965:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353d0 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549971:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109349.549975:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353d0 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549982:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353d0 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.549991:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109349.549994:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.549997:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353d0 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.550002:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353d0 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.550039:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca353c2 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1188 expref: 28 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.550049:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109349.550052:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.550055:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca353c2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1188 expref: 28 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.550064:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8800, rc 0) 00000100:00100000:0.0:1786109349.550142:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+27:157789:x1872862922035456:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 966us (2738us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109349.550152:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 703 00000100:00100000:0.0:1786109349.557552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109349.557722:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922035584 00000100:00100000:1.0:1786109349.557735:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922035584 00000100:00100000:1.0:1786109349.557991:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 704 00000100:00100000:1.0:1786109349.558005:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+27:157789:x1872862922035584:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109349.558033:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109349.558059:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca353d7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a118f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558141:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca353de lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558157:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca353de lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558172:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca353de lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558185:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca353e5 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558207:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca353e5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558215:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca353e5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558269:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca353de lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558277:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca353de lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558283:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca353de lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558289:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109349.558294:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca353de lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558301:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca353de lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558314:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109349.558318:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109349.558323:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca353de lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558329:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca353de lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558342:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca353e5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558348:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca353e5 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558352:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca353e5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558356:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109349.558358:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca353e5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558363:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca353e5 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558369:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109349.558371:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109349.558375:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca353e5 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558381:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca353e5 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558410:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca353d7 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a118f expref: 28 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558427:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109349.558485:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109349.558490:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca353d7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a118f expref: 28 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.558500:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34400, rc 0) 00000100:00100000:1.0:1786109349.558579:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+27:157789:x1872862922035584:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 577us (1041us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109349.559762:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 704 00000100:00100000:1.0:1786109349.569807:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109349.570030:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922035712 00000100:00100000:3.0:1786109349.570043:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922035712 00000100:00100000:3.0:1786109349.570119:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 705 00000100:00100000:3.0:1786109349.570130:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+27:157789:x1872862922035712:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109349.570158:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109349.570188:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca353ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1196 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.570295:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca353f3 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.570312:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca353f3 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.570326:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca353f3 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109349.570382:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:3.0:1786109349.570387:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109349.570410:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca353f3 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.571250:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca353ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1196 expref: 29 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.571281:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca353f3 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1196 expref: 28 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.571291:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109349.571294:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109349.571299:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76c00, rc 0) 00000100:00100000:0.0:1786109349.594920:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922035968 00000100:00100000:0.0:1786109349.594933:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922035968 00000100:00100000:0.0:1786109349.595012:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 706 00000100:00100000:0.0:1786109349.595024:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+28:157789:x1872862922035968:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:0.0:1786109349.595100:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109349.595945:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca353f3 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1196 expref: 28 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.595973:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109349.595978:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109349.596057:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353fa lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.596072:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353fa lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.596082:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353fa lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.596094:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35401 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.596753:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35401 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.596773:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35401 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109349.602796:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 670 rpc_version 670 00000020:00100000:0.0:1786109349.602850:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109349.602864:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984ff2d80 x1872862933105792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109349.602900:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933105792:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109349.603272:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109349.603788:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34540 going to sleep for 11 seconds 00000100:00100000:0.0:1786109349.608821:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933105792:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786109349.609185:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca35408 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.609218:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca35408 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.609231:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca35408 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.609256:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca3540f lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.609263:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca3540f lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.609269:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca3540f lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.609315:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35c00/0xdb52b77d7ca35416 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.609323:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35c00/0xdb52b77d7ca35416 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.609334:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35c00/0xdb52b77d7ca35416 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109349.609359:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933105920:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1786109349.611020:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109349.611278:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109349.612871:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933105920:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786109349.612896:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35c00/0xdb52b77d7ca35416 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3541d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.612910:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35c00/0xdb52b77d7ca35416 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3541d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109349.613186:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046496d5e reply state 000000004e29dec1 transno 326417514591 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca3540f lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613216:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca3540f lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613225:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x31:0x0].0x0 (ffff93098c4aeb00) 00010000:00010000:1.0:1786109349.613229:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109349.613233:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109349.613240:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35c00/0xdb52b77d7ca35416 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3541d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613250:0:188678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35c00/0xdb52b77d7ca35416 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3541d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109349.613265:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x31:0x0] 00000004:00010000:1.0:1786109349.613275:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046496d5e reply state 000000004e29dec1 transno 326417514591 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca35408 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613284:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca35408 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613291:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcd:0x0].0x0 (ffff93098c4ae100) 00010000:00010000:1.0:1786109349.613293:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109349.613295:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1786109349.613303:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dcd:0x0]: returning size 4096 00010000:00010000:1.0:1786109349.613315:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353fa lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613321:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353fa lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613329:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353fa lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613337:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109349.613342:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353fa lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613351:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353fa lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613363:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109349.613366:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109349.613371:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353fa lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613378:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca353fa lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109349.613396:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046496d5e reply state 000000004e29dec1 transno 326417514591 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35401 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613406:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35401 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.613412:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109349.613415:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109349.613417:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1786109349.614340:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+29:157789:x1872862922035968:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 19305us (19531us total) trans 326417514591 rc 0/0 00000100:00100000:1.0:1786109349.614353:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 706 00010000:00010000:1.0:1786109349.637392:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109349.642837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109349.642950:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922036096 00000100:00100000:3.0:1786109349.642963:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922036096 00000100:00100000:3.0:1786109349.643085:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 707 00000100:00100000:3.0:1786109349.643099:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+29:157796:x1872862922036096:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109349.643200:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109349.643229:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35424 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a119d expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643312:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca3542b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643328:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca3542b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643341:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca3542b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643355:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35432 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643364:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35432 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643388:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35432 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643587:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca35439 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643599:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca35439 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643607:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca35439 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109349.643715:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dcd:0x0]: returning size 4096 00000004:00200000:3.0:1786109349.643722:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1786109349.643746:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca35439 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643759:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca3542b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643766:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca3542b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643772:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca3542b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643779:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109349.643783:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca3542b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643792:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca3542b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643804:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109349.643807:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109349.643812:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca3542b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643818:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca3542b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643831:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35432 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643837:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35432 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643848:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35432 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643853:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109349.643855:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35432 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643861:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35432 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643868:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109349.643871:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109349.643873:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35432 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643878:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35432 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643909:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35424 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a119d expref: 31 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643925:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca35439 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a119d expref: 30 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.643933:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcd:0x0].0x0 (ffff93098c4ae100) 00010000:00010000:3.0:1786109349.643936:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109349.643939:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76c00, rc 0) 00000100:00100000:3.0:1786109349.644075:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+30:157796:x1872862922036096:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 977us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109349.644083:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 707 00000100:00100000:1.0:1786109349.659211:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109349.659480:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922036224 00000100:00100000:0.0:1786109349.659494:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922036224 00000100:00100000:0.0:1786109349.659573:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 708 00000100:00100000:0.0:1786109349.659586:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+30:157796:x1872862922036224:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109349.659615:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.659639:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35440 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a11a4 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.659733:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35447 lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.659749:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35447 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.659763:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35447 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109349.659822:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x31:0x0]: returning size 4096 00000004:00200000:0.0:1786109349.659830:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109349.659874:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35440 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11a4 expref: 32 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.659899:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35447 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11a4 expref: 31 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.659909:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x31:0x0].0x0 (ffff93098c4aeb00) 00010000:00010000:0.0:1786109349.659913:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109349.659917:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8e00, rc 0) 00000100:00100000:0.0:1786109349.660012:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+31:157796:x1872862922036224:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 428us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.660019:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 708 00000100:00100000:0.0:1786109349.667165:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922036352 00000100:00100000:0.0:1786109349.667178:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922036352 00000100:00100000:0.0:1786109349.667416:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 709 00000100:00100000:0.0:1786109349.667450:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:157796:x1872862922036352:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109349.667479:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.667508:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3544e lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a11ab expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.667589:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca35455 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.667608:0:187900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca3541d lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35416 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.667618:0:187900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca35455 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.667662:0:187900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca3541d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35416 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109349.667760:0:187900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933106048:0@lo:104: 00000100:00100000:0.0:1786109349.667831:0:187900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109349.667898:0:187900:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109349.668656:0:187900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933106048:0@lo:104: 00010000:00010000:1.0:1786109349.668699:0:187900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca35455 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109349.668829:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933106176 00000100:00100000:3.0:1786109349.668834:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933106176 00010000:00010000:3.0:1786109349.668859:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca3541d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca35416 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109349.668946:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12578 00000100:00100000:3.0:1786109349.668955:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa4e89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+9:3646:x1872862933106176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109349.668968:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1786109349.674712:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804444 is committed 00010000:00010000:0.0:1786109349.675005:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca3541d lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca35416 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.675032:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x31:0x0].0x0 (ffff930aa0f7e400) 00010000:00010000:0.0:1786109349.675038:0:177416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca35455 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.675050:0:177416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca35455 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.675058:0:177416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca35455 lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.675158:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109349.675284:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa4e89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933106176:12345-0@lo:103:ldlm_bl.0 Request processed in 6327us (6727us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.675296:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12578 00010000:00010000:1.0:1786109349.675683:0:187900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca35455 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.675693:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca35455 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109349.675770:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x31:0x0]: returning size 4096 00000004:00200000:1.0:1786109349.675778:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786109349.675838:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3544e lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ab expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.675859:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca35455 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ab expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.675868:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x31:0x0].0x0 (ffff930aa0f7e400) 00010000:00010000:1.0:1786109349.675872:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786109349.675875:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8200, rc 0) 00000100:00100000:1.0:1786109349.675979:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:157796:x1872862922036352:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 8551us (9009us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109349.675988:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 709 00000100:00100000:1.0:1786109349.704353:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109349.745818:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922036736 00000100:00100000:0.0:1786109349.745832:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922036736 00010000:00010000:0.0:1786109349.745887:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35447 lrc: 5/0,0 mode: PR/PR res: [0x2000255c0:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11a4 expref: 31 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109349.746777:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12579 00000100:00100000:0.0:1786109349.746798:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:397d331e-10fc-4558-be87-308c3622e8eb+31:2402:x1872862922036736:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109349.746821:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109349.746833:0:43921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35447 lrc: 5/0,0 mode: PR/PR res: [0x2000255c0:0x31:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11a4 expref: 31 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.746856:0:43921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35447 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x31:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11a4 expref: 31 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.746889:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x31:0x0].0x0 (ffff93098c4aeb00) 00010000:00010000:0.0:1786109349.746896:0:43921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.746908:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.746915:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.747076:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109349.747823:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:397d331e-10fc-4558-be87-308c3622e8eb+31:2402:x1872862922036736:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 1028us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.747836:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12579 00010000:00010000:3.0:1786109349.757478:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35447 lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x31:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11a4 expref: 30 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109349.757517:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933106304:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109349.757552:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.757565:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.757571:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.757643:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.757652:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.757671:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109349.757697:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985ebad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933106432:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1786109349.757779:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109349.757837:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c0a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109349.757967:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933106432 00000100:00100000:0.0:1786109349.757976:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933106432 00000100:00100000:0.0:1786109349.758055:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12047 00000100:00100000:0.0:1786109349.758067:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188678:x1872862933106432:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109349.758089:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.758107:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca3547f lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35478 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.758140:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca35455 lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ab expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.758156:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca3547f lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35478 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.758187:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca35455 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ab expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.758215:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca35455 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x31:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ab expref: 6 pid: 187900 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109349.758228:0:8452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8452:1872862933106560:192.168.203.38@tcp:104: 00000100:00100000:0.0:1786109349.758482:0:8452:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109349.795990:0:8452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8452:1872862933106560:192.168.203.38@tcp:104: 00010000:00010000:0.0:1786109349.796041:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca3547f lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35478 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.796056:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x31:0x0].0x0 (ffff930aa0f7e400) 00010000:00010000:0.0:1786109349.796060:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109349.796065:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca3547f lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35478 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.796076:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca3547f lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35478 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.796084:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9400, rc 0) 00000100:00100000:0.0:1786109349.796221:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933106432:12345-0@lo:101:mdt00_003.0 Request processed in 38156us (38441us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.796231:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12047 00000100:00100000:3.0:1786109349.796314:0:188678:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804444 gen 2 00000004:00080000:3.0:1786109349.796322:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804443 committed transno 25769804444 00000004:00080000:3.0:1786109349.796345:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804444 committed transno 25769804444 00000100:00100000:3.0:1786109349.796361:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985ebad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933106432:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786109349.796381:0:188678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.796393:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109349.797174:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109349.797844:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933106688 00000100:00100000:3.0:1786109349.797848:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933106688 00000100:00100000:3.0:1786109349.797893:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5224 00000100:00100000:3.0:1786109349.797901:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6512:x1872862933106688:12345-0@lo:105: 00010000:00010000:3.0:1786109349.797914:0:10344:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.797924:0:10344:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.797934:0:10344:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.797942:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.797949:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.797956:0:10344:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109349.797979:0:10344:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff93098cd77000) 00000100:00100000:3.0:1786109349.798023:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6512:x1872862933106688:12345-0@lo:105: Request processed in 123us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109349.798030:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5224 00000100:00100000:3.0:1786109349.798062:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6512:1872862933106688:0@lo:105: 00010000:00010000:3.0:1786109349.798080:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109349.798124:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922036864:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 649us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109349.798131:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12580 00010000:00010000:1.0:1786109349.798208:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.798218:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109349.798997:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933106816:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1786109349.799059:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109349.799096:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786109349.799981:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933106816 00000100:00100000:3.0:1786109349.799992:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933106816 00000100:00100000:3.0:1786109349.800083:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12048 00000100:00100000:3.0:1786109349.800093:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933106816:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1786109349.803134:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933106816:12345-0@lo:403:mdt00_003.0 Request processed in 3029us (4060us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109349.803153:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12048 00000100:00100000:1.0:1786109349.803265:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933106816:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1786109349.804740:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].433, 656 off660976 00000040:00080000:0.0:1786109349.804941:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].313, 736 off519312 00000004:00080000:0.0:1786109349.804948:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a901c9a80 with version 671 00000100:00100000:3.0:1786109349.805328:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933107072 00000100:00100000:3.0:1786109349.805336:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933107072 00000100:00100000:3.0:1786109349.805427:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12049 00000100:00100000:3.0:1786109349.805456:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933107072:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109349.805692:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933107072:12345-0@lo:1000:osp_up1-0.0 Request processed in 238us (506us total) trans 25769804445 rc 0/0 00000100:00100000:3.0:1786109349.805700:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12049 00000004:00200000:1.0:1786109349.805882:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dcd:0x0]: returning size 4096 00010000:00010000:1.0:1786109349.805907:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.805917:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.805927:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.805934:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109349.805939:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.805948:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.805965:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x31:0x0].0x0 (ffff93098c4aeb00) 00010000:00010000:1.0:1786109349.805968:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109349.805973:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.805979:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35471 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.805994:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806003:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806010:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77000/0xdb52b77d7ca35478 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3547f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806038:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786109349.806046:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x31:0x0] 00010000:00010000:1.0:1786109349.806054:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3546a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806061:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3546a lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806067:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3546a lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806072:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109349.806074:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3546a lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806080:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3546a lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806087:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcd:0x0].0x0 (ffff93098c4ae100) 00010000:00010000:1.0:1786109349.806089:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109349.806092:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3546a lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806098:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3546a lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806110:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3545c lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806116:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3545c lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806122:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3545c lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806132:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109349.806135:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3545c lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806140:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3545c lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806147:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109349.806149:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109349.806152:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3545c lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806157:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3545c lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109349.806166:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c5ac9be reply state 000000003d7c35f4 transno 326417514592 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca35463 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806180:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca35463 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.806187:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109349.806200:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109349.806203:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109349.806275:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+31:157796:x1872862922036608:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 101376us (101936us total) trans 326417514592 rc 0/0 00000100:00100000:1.0:1786109349.806283:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 710 00000100:00100000:0.0:1786109349.889041:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109349.889185:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922036992 00000100:00100000:3.0:1786109349.889209:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922036992 00000100:00100000:3.0:1786109349.889344:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 711 00000100:00100000:3.0:1786109349.889358:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+31:157808:x1872862922036992:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109349.889392:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109349.889420:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35486 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a11b2 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109349.942564:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109349.942709:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922037120 00000100:00100000:0.0:1786109349.942724:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922037120 00000100:00100000:0.0:1786109349.942844:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 712 00000100:00100000:0.0:1786109349.942858:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+31:157808:x1872862922037120:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109349.942886:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.942914:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca3549b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a11b9 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943002:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca354a2 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943080:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca354a2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943094:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca354a2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943109:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354a9 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943117:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354a9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943128:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354a9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943176:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca354a2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943183:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca354a2 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943207:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca354a2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943215:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109349.943219:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca354a2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943227:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca354a2 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943241:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109349.943244:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.943250:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca354a2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943256:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca354a2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943274:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354a9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943280:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354a9 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943287:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354a9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943293:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109349.943296:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354a9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943303:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354a9 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943310:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109349.943313:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.943316:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354a9 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943322:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354a9 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943359:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca3549b lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11b9 expref: 32 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943370:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109349.943372:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.943376:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca3549b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11b9 expref: 32 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.943385:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9c00, rc 0) 00000100:00100000:0.0:1786109349.943535:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+31:157808:x1872862922037120:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 679us (985us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109349.943545:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 712 00000100:00100000:1.0:1786109349.951005:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922037248 00000100:00100000:1.0:1786109349.951019:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922037248 00000100:00100000:1.0:1786109349.951136:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 713 00000100:00100000:1.0:1786109349.951149:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+31:157808:x1872862922037248:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109349.951174:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109349.951214:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca354b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a11c0 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.951301:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca354b7 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.951318:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca354b7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.951332:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca354b7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109349.951384:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:1.0:1786109349.951388:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786109349.951409:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca354b7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.951496:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca354b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11c0 expref: 33 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.951516:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca354b7 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11c0 expref: 32 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.951525:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109349.951528:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109349.951532:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35a00, rc 0) 00000100:00100000:1.0:1786109349.951628:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+32:157808:x1872862922037248:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 483us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109349.951636:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 713 00000100:00100000:3.0:1786109349.966145:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109349.966270:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922037504 00000100:00100000:1.0:1786109349.966284:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922037504 00000100:00100000:1.0:1786109349.966380:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 714 00000100:00100000:1.0:1786109349.966392:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+32:157808:x1872862922037504:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1786109349.966739:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109349.966777:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca354b7 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11c0 expref: 32 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.966802:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109349.966808:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109349.966884:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca354be lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.966900:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca354be lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.966930:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca354be lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.966944:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca354c5 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.966954:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca354c5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.966962:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca354c5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109349.968151:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].434, 2152 off663128 00000040:00080000:1.0:1786109349.968279:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].314, 2352 off521664 00000004:00080000:1.0:1786109349.968287:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a901c9e40 with version 672 00000100:00100000:1.0:1786109349.968874:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933107456 00000100:00100000:1.0:1786109349.968883:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933107456 00000100:00100000:1.0:1786109349.968969:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12050 00000100:00100000:1.0:1786109349.968979:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab5395050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933107456:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109349.969600:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab5395050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933107456:12345-0@lo:1000:osp_up1-0.0 Request processed in 619us (953us total) trans 25769804446 rc 0/0 00000100:00100000:1.0:1786109349.969611:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12050 00010000:00010000:0.0:1786109349.970034:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca354cc lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.970052:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca354cc lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.970065:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca354cc lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.970087:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354d3 lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.970093:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354d3 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.970099:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354d3 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.970134:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.970140:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.970151:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109349.970168:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933107584:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1786109349.971704:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109349.971780:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34780 going to sleep for 11 seconds 00000100:00100000:1.0:1786109349.971792:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933107584 00000100:00100000:1.0:1786109349.971808:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933107584 00000100:00100000:1.0:1786109349.971934:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12051 00000100:00100000:1.0:1786109349.971946:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188678:x1872862933107584:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786109349.971973:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109349.972000:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca354e1 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca354da expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.972036:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca354e1 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca354da expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.972052:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca354e1 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca354da expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109349.972062:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x32:0x0].0x0 (ffff93098c4ae600) 00010000:00010000:1.0:1786109349.972066:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109349.972071:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34800, rc 0) 00000100:00100000:1.0:1786109349.972152:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188678:x1872862933107584:12345-0@lo:101:mdt00_003.0 Request processed in 209us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109349.972160:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12051 00000100:00100000:0.0:1786109349.972260:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933107584:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109349.972286:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca354e1 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972300:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca354e1 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109349.972329:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a9949b8 reply state 00000000d73cbdac transno 326417514593 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354d3 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972342:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354d3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972350:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x32:0x0].0x0 (ffff930a83abd500) 00010000:00010000:0.0:1786109349.972353:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109349.972357:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109349.972362:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca354e1 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972370:0:188678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca354e1 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109349.972382:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x32:0x0] 00000004:00010000:0.0:1786109349.972389:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a9949b8 reply state 00000000d73cbdac transno 326417514593 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca354cc lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972398:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca354cc lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972403:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dce:0x0].0x0 (ffff930a83abd300) 00010000:00010000:0.0:1786109349.972405:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109349.972407:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1786109349.972412:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dce:0x0]: returning size 4096 00010000:00010000:0.0:1786109349.972421:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca354be lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972426:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca354be lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972456:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca354be lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972462:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109349.972468:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca354be lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972476:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca354be lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972486:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109349.972489:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109349.972493:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca354be lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972501:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca354be lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109349.972517:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a9949b8 reply state 00000000d73cbdac transno 326417514593 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca354c5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972526:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca354c5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.972536:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109349.972538:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109349.972540:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1786109349.972633:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+33:157808:x1872862922037504:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 6241us (6500us total) trans 326417514593 rc 0/0 00000100:00100000:0.0:1786109349.972643:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 714 00000100:00100000:0.0:1786109349.992581:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109349.998997:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922037760 00000100:00100000:0.0:1786109349.999022:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922037760 00000100:00100000:0.0:1786109349.999109:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 716 00000100:00100000:0.0:1786109349.999121:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+34:157811:x1872862922037760:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109349.999150:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109349.999177:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35504 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a11ce expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.999323:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3550b lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.999340:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3550b lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.999353:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3550b lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109349.999623:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x32:0x0]: returning size 4096 00000004:00200000:0.0:1786109349.999631:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109349.999679:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35504 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ce expref: 36 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.999704:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3550b lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ce expref: 35 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109349.999714:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x32:0x0].0x0 (ffff930a83abd500) 00010000:00010000:0.0:1786109349.999717:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109349.999720:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8400, rc 0) 00000100:00100000:0.0:1786109349.999844:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+35:157811:x1872862922037760:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 724us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109349.999853:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 716 00000100:00100000:0.0:1786109350.007182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109350.007528:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922037888 00000100:00100000:1.0:1786109350.007541:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922037888 00000100:00100000:1.0:1786109350.007680:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 717 00000100:00100000:1.0:1786109350.007692:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:157811:x1872862922037888:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109350.007721:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109350.007748:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35512 lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a11d5 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.007830:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35519 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.007848:0:187900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca354e1 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca354da expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.007858:0:187900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35519 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.007901:0:187900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca354e1 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca354da expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.007921:0:187900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933107712:0@lo:104: 00000100:00100000:1.0:1786109350.008271:0:187900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109350.008339:0:187900:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f240 going to sleep for 11 seconds 00000100:00100000:0.0:1786109350.008472:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933107712 00000100:00100000:0.0:1786109350.008478:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933107712 00000100:00100000:0.0:1786109350.008524:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5225 00000100:00100000:0.0:1786109350.008533:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933107712:12345-0@lo:104: 00010000:00010000:0.0:1786109350.008549:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca354e1 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.008622:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786109350.008630:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933107712:12345-0@lo:104: Request processed in 99us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109350.008638:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5225 00000100:00100000:1.0:1786109350.008766:0:187900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933107712:0@lo:104: 00010000:00010000:1.0:1786109350.008789:0:187900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35519 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786109350.009105:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1786109350.009122:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109350.009130:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca354e1 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.009140:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8c00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:3.0:1786109350.009146:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca354e1 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109350.009156:0:6515:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca354e1 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.009207:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca354e1 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.009215:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109350.009247:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca354e1 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.009256:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf8c00/0xdb52b77d7ca354da lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca354e1 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.009282:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109350.009285:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109350.009286:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109350.009334:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109350.009350:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933107840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109350.009389:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109350.009572:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933107840 00000100:00100000:3.0:1786109350.009578:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933107840 00010000:00010000:3.0:1786109350.009603:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca354e1 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca354da expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109350.009677:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12581 00000100:00100000:3.0:1786109350.009686:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3649:x1872862933107840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109350.009699:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1786109350.014663:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804446 is committed 00010000:00010000:0.0:1786109350.042984:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca354e1 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca354da expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.043011:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x32:0x0].0x0 (ffff93098c4ae600) 00010000:00010000:0.0:1786109350.043017:0:43921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35519 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.043030:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35519 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.043038:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35519 lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.043080:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109350.043199:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933107840:12345-0@lo:103:ldlm_bl.0 Request processed in 33500us (33795us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109350.043212:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12581 00000100:00100000:0.0:1786109350.043296:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933107840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109350.082165:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922038144 00000100:00100000:3.0:1786109350.082179:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922038144 00000100:00100000:3.0:1786109350.082272:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 718 00000100:00100000:3.0:1786109350.082285:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+35:157811:x1872862922038144:12345-192.168.203.38@tcp:36:rmdir.0 00010000:00010000:3.0:1786109350.082359:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109350.085286:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca354fd lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11c7 expref: 35 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.085325:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dce:0x0].0x0 (ffff930a83abd300) 00010000:00010000:3.0:1786109350.085332:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109350.085929:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35520 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.085947:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35520 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.085959:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35520 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.085971:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35527 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.085980:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35527 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.085987:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35527 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.086089:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3552e lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.086096:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3552e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.086103:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3552e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.086129:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.086141:0:188678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3550b lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ce expref: 34 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.086149:0:188678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.086208:0:188678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3550b lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ce expref: 34 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.086225:0:188678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3550b lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ce expref: 34 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109350.086243:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933107968:192.168.203.38@tcp:104: 00000100:00100000:3.0:1786109350.087152:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c0a53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109350.100770:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933107968:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109350.100807:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109350.108739:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922038272 00000100:00100000:0.0:1786109350.108754:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922038272 00010000:00010000:0.0:1786109350.108806:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3550b lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ce expref: 35 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109350.108860:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12582 00000100:00100000:0.0:1786109350.108873:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:397d331e-10fc-4558-be87-308c3622e8eb+35:2403:x1872862922038272:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109350.108891:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109350.108899:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3550b lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x32:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ce expref: 35 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.108913:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3550b lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x32:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ce expref: 35 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.108941:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3550b lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x32:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ce expref: 35 pid: 187899 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.108967:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x32:0x0].0x0 (ffff930a83abd500) 00010000:00010000:0.0:1786109350.108974:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.108985:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.108992:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.109028:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109350.109089:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:397d331e-10fc-4558-be87-308c3622e8eb+34:2403:x1872862922038272:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 219us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109350.109098:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12582 00010000:00010000:3.0:1786109350.109593:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.109604:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.109660:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.109669:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.109681:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109350.109704:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933108096:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1786109350.109752:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109350.109783:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c0a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109350.119627:0:177399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177399:1872862933108224:192.168.203.38@tcp:104: 00010000:00010000:0.0:1786109350.119681:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35543 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3553c expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.119697:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x32:0x0].0x0 (ffff93098c4ae600) 00010000:00010000:0.0:1786109350.119700:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109350.119704:0:177399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35543 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3553c expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.119715:0:177399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35543 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3553c expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.119722:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628b000, rc 0) 00000100:00100000:0.0:1786109350.119842:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933108096:12345-0@lo:101:mdt00_003.0 Request processed in 9512us (10088us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109350.119852:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12052 00000100:00100000:3.0:1786109350.119934:0:188678:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804446 gen 2 00000004:00080000:3.0:1786109350.119943:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804445 committed transno 25769804446 00000004:00080000:3.0:1786109350.119964:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804446 committed transno 25769804446 00000100:00100000:3.0:1786109350.119979:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933108096:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786109350.119999:0:188678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.120010:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109350.123323:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922038400 00000100:00100000:0.0:1786109350.123339:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922038400 00010000:00010000:0.0:1786109350.123403:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35519 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11d5 expref: 7 pid: 187900 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109350.123620:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12583 00000100:00100000:0.0:1786109350.123633:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:2402:x1872862922038400:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109350.123654:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109350.123662:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35519 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11d5 expref: 7 pid: 187900 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.123678:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35519 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11d5 expref: 7 pid: 187900 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.123705:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35519 lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11d5 expref: 7 pid: 187900 timeout: 8306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.123720:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x32:0x0].0x0 (ffff93098c4ae600) 00010000:00010000:0.0:1786109350.123729:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35543 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3553c expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.123741:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35543 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca3553c expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.123750:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35543 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca3553c expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.123794:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35543 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3553c expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109350.123811:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6513:1872862933108352:0@lo:105: 00000100:00100000:0.0:1786109350.123883:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109350.123991:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109350.124100:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933108352 00000100:00100000:1.0:1786109350.124105:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933108352 00000100:00100000:1.0:1786109350.124183:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5226 00000100:00100000:1.0:1786109350.124247:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6513:x1872862933108352:12345-0@lo:105: 00010000:00010000:1.0:1786109350.124261:0:10344:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.124272:0:10344:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.124281:0:10344:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.124290:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.124298:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.124308:0:10344:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.124351:0:10344:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff93098cd77800) 00000100:00100000:1.0:1786109350.124421:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6513:x1872862933108352:12345-0@lo:105: Request processed in 172us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109350.124455:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5226 00000100:00100000:3.0:1786109350.124609:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6513:1872862933108352:0@lo:105: 00010000:00010000:3.0:1786109350.124640:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109350.124707:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922038400:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 1075us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109350.124719:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12583 00000100:00100000:3.0:1786109350.125648:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933108480 00000100:00100000:3.0:1786109350.125654:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933108480 00000100:00100000:3.0:1786109350.125709:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12053 00000100:00100000:3.0:1786109350.125719:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933108480:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1786109350.129025:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933108480:12345-0@lo:403:mdt00_003.0 Request processed in 3292us (3591us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109350.129042:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12053 00000040:00080000:3.0:1786109350.131988:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].435, 656 off663784 00000040:00080000:3.0:1786109350.133286:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].315, 736 off522400 00000004:00080000:3.0:1786109350.133303:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098c0a53c0 with version 673 00000100:00100000:3.0:1786109350.134883:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933108736 00000100:00100000:3.0:1786109350.134894:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933108736 00000100:00100000:3.0:1786109350.134956:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12054 00000100:00100000:3.0:1786109350.134967:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933108736:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109350.135322:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933108736:12345-0@lo:1000:osp_up1-0.0 Request processed in 354us (608us total) trans 25769804447 rc 0/0 00000100:00100000:3.0:1786109350.135331:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12054 00000100:00100000:3.0:1786109350.135406:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1143480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933108736:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1786109350.135462:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dce:0x0]: returning size 4096 00010000:00010000:3.0:1786109350.135490:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135501:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135510:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135517:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109350.135522:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135536:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135553:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x32:0x0].0x0 (ffff930a83abd500) 00010000:00010000:3.0:1786109350.135557:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109350.135562:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135568:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35535 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135585:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135593:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135601:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135627:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786109350.135638:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x32:0x0] 00010000:00010000:3.0:1786109350.135648:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3552e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135654:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3552e lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135660:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3552e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135668:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109350.135671:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3552e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135676:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3552e lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135685:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dce:0x0].0x0 (ffff930a83abd300) 00010000:00010000:3.0:1786109350.135687:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109350.135690:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3552e lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135696:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3552e lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135710:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35520 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135717:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35520 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135722:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35520 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135728:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109350.135730:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35520 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135736:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35520 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135748:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109350.135750:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109350.135753:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35520 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135759:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35520 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109350.135768:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050a6a26a reply state 0000000072cfb00c transno 326417514594 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35527 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135782:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35527 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.135790:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109350.135792:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109350.135795:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786109350.135867:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+35:157811:x1872862922038144:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 53583us (53846us total) trans 326417514594 rc 0/0 00000100:00100000:3.0:1786109350.135875:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 718 00010000:00010000:0.0:1786109350.137317:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109350.137331:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.137344:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77800 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109350.137352:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109350.137362:0:10402:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.137740:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.137749:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109350.139259:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.139275:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd77800/0xdb52b77d7ca3553c lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35543 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.139305:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109350.139308:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109350.139311:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109350.139536:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933108864 00000100:00100000:0.0:1786109350.139546:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933108864 00000100:00100000:0.0:1786109350.139622:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4479 00000100:00100000:0.0:1786109350.139633:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3649:x1872862933108864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109350.139649:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109350.139679:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35543 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3553c expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.139696:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x32:0x0].0x0 (ffff93098c4ae600) 00010000:00010000:0.0:1786109350.139707:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109350.142507:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1872862933108864:12345-0@lo:103:ldlm_bl.0 Request processed in 2860us (4584us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109350.142524:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4479 00000100:00100000:3.0:1786109350.149105:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933108992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109350.149218:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109350.149352:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933108992 00000100:00100000:1.0:1786109350.149363:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933108992 00000100:00100000:1.0:1786109350.149461:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12055 00000100:00100000:1.0:1786109350.149471:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3646:x1872862933108992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109350.149519:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445580800 avail 1299341312 00000100:00100000:1.0:1786109350.150395:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3646:x1872862933108992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 922us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109350.150407:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12055 00000100:00100000:3.0:1786109350.152626:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933108992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109350.232150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109350.232245:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922038528 00000100:00100000:0.0:1786109350.232261:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922038528 00000100:00100000:0.0:1786109350.232352:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 719 00000100:00100000:0.0:1786109350.232364:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+35:157815:x1872862922038528:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109350.232395:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109350.232422:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3554a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a11dc expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.232526:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35551 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233267:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35551 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233285:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35551 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233303:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35558 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233312:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35558 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233319:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35558 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233371:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35551 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233378:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35551 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233385:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35551 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233392:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.233397:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35551 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233404:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35551 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233423:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109350.233426:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.233511:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35551 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233519:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35551 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233533:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35558 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233540:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35558 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233545:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35558 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233550:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.233553:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35558 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233559:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35558 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233566:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109350.233569:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.233572:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35558 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233577:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35558 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233617:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3554a lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11dc expref: 36 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233678:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109350.233681:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.233686:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3554a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11dc expref: 36 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.233699:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8e00, rc 0) 00000100:00100000:0.0:1786109350.233792:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+35:157815:x1872862922038528:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1429us (1651us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109350.233801:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 719 00000100:00100000:0.0:1786109350.299497:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922038656 00000100:00100000:0.0:1786109350.299513:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922038656 00000100:00100000:0.0:1786109350.299599:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 720 00000100:00100000:0.0:1786109350.299612:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+35:157815:x1872862922038656:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109350.299638:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109350.299664:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3555f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a11e3 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.299740:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35566 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.299756:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35566 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.301249:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35566 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.301291:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3556d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.301304:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3556d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.301312:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3556d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.301900:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35566 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.301912:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35566 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.301919:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35566 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.301926:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.301931:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35566 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.301939:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35566 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.301955:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109350.301958:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.301962:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35566 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.301969:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35566 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.302883:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3556d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.302892:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3556d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.302900:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3556d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.302906:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.302909:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3556d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.302915:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3556d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.302927:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109350.302931:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.302934:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3556d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.302941:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca3556d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.302989:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3555f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11e3 expref: 36 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.303000:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109350.303003:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.303007:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3555f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11e3 expref: 36 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.303144:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8e00, rc 0) 00000100:00100000:0.0:1786109350.303979:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+35:157815:x1872862922038656:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 4363us (5748us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109350.303991:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 720 00000100:00100000:3.0:1786109350.312238:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109350.312577:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922038784 00000100:00100000:1.0:1786109350.312591:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922038784 00000100:00100000:1.0:1786109350.312674:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 721 00000100:00100000:1.0:1786109350.312686:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+35:157815:x1872862922038784:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109350.312714:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109350.312739:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34000/0xdb52b77d7ca35574 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a11ea expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.312821:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3557b lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.312838:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3557b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.312851:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3557b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109350.312908:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:1.0:1786109350.312912:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786109350.312936:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3557b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.312965:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34000/0xdb52b77d7ca35574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ea expref: 37 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.312984:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3557b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ea expref: 36 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.312994:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109350.312997:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109350.313001:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35e00, rc 0) 00000100:00100000:1.0:1786109350.313083:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+36:157815:x1872862922038784:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 399us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109350.313091:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 721 00000100:00100000:1.0:1786109350.323750:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109350.323962:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922039040 00000100:00100000:3.0:1786109350.323974:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922039040 00000100:00100000:0.0:1786109350.331745:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 722 00000100:00100000:0.0:1786109350.331782:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+36:157815:x1872862922039040:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:0.0:1786109350.331866:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109350.331903:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3557b lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ea expref: 36 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.331930:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109350.331936:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109350.333963:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35582 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.333992:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35582 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.334018:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca35582 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.334035:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35589 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.334046:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35589 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.334057:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35589 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109350.335728:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].436, 2152 off665936 00000040:00080000:0.0:1786109350.335821:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].317, 2352 off526640 00000004:00080000:0.0:1786109350.335828:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d340c0 with version 674 00000004:00080000:3.0:1786109350.335898:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 674 rpc_version 674 00000020:00100000:3.0:1786109350.336142:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109350.336156:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930985ebad80 x1872862933109248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109350.336395:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985ebad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933109248:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109350.336786:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109350.336865:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c0a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109350.336907:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933109248 00000100:00100000:3.0:1786109350.336916:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933109248 00000100:00100000:3.0:1786109350.337086:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12056 00000100:00100000:3.0:1786109350.337098:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933109248:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109350.338666:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933109248:12345-0@lo:1000:osp_up1-0.0 Request processed in 1562us (1873us total) trans 25769804448 rc 0/0 00000100:00100000:3.0:1786109350.338682:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12056 00000100:00100000:0.0:1786109350.338865:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985ebad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933109248:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786109350.339242:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34000/0xdb52b77d7ca35590 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.339264:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34000/0xdb52b77d7ca35590 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.339280:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34000/0xdb52b77d7ca35590 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.339302:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35597 lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.339309:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35597 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.339321:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35597 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.339364:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35600/0xdb52b77d7ca3559e lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.339372:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35600/0xdb52b77d7ca3559e lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.339610:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35600/0xdb52b77d7ca3559e lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.339640:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933109376:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109350.339698:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109350.340266:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109350.361238:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922039168 00000100:00100000:0.0:1786109350.361251:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922039168 00000100:00100000:0.0:1786109350.361335:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 723 00000100:00100000:0.0:1786109350.361346:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+37:157823:x1872862922039168:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109350.361377:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109350.361404:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca355ac lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a11f1 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362208:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355b3 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362230:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355b3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362244:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355b3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362258:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355ba lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362266:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355ba lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362273:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355ba lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362736:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca355c1 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362748:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca355c1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362755:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca355c1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109350.362856:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dcf:0x0]: returning size 4096 00000004:00200000:1.0:1786109350.362863:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1786109350.362887:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca355c1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362902:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355b3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362908:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355b3 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362915:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355b3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362922:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109350.362927:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355b3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362935:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355b3 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362948:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109350.362952:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109350.362957:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355b3 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362964:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355b3 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362979:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355ba lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362985:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355ba lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362991:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355ba lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.362996:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109350.362999:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355ba lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.363004:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355ba lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.363012:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109350.363014:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109350.363017:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355ba lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.363023:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355ba lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.363059:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca355ac lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11f1 expref: 39 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.363076:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca355c1 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11f1 expref: 38 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.363083:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcf:0x0].0x0 (ffff93098c4ae900) 00010000:00010000:1.0:1786109350.363086:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109350.363088:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34600, rc 0) 00000100:00100000:1.0:1786109350.363204:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+38:157823:x1872862922039168:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 1859us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109350.363215:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 723 00000100:00100000:1.0:1786109350.368611:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922039296 00000100:00100000:1.0:1786109350.368624:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922039296 00000100:00100000:1.0:1786109350.368734:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 724 00000100:00100000:1.0:1786109350.368747:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+38:157823:x1872862922039296:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109350.368774:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109350.368798:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355c8 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a11f8 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.368873:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355cf lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.368888:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355cf lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.368901:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355cf lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109350.368965:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x33:0x0]: returning size 4096 00000004:00200000:1.0:1786109350.368972:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786109350.369013:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355c8 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11f8 expref: 40 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.369034:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355cf lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x33:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11f8 expref: 39 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.369044:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x33:0x0].0x0 (ffff93098c4aea00) 00010000:00010000:1.0:1786109350.369048:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786109350.369052:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34200, rc 0) 00000100:00100000:1.0:1786109350.369216:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+39:157823:x1872862922039296:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 471us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109350.369224:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 724 00000100:00100000:1.0:1786109350.375296:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109350.377267:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933109504 00000100:00100000:3.0:1786109350.377275:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933109504 00000100:00100000:3.0:1786109350.377335:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5227 00000100:00100000:3.0:1786109350.377345:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933109504:12345-0@lo:104: 00010000:00010000:3.0:1786109350.377362:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35600/0xdb52b77d7ca3559e lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca355a5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.377471:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786109350.377477:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933109504:12345-0@lo:104: Request processed in 134us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109350.377485:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5227 00010000:00010000:1.0:1786109350.377739:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109350.377749:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35600/0xdb52b77d7ca3559e lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca355a5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.377759:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35600 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109350.377766:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35600/0xdb52b77d7ca3559e lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x33:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca355a5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109350.377777:0:6514:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35600/0xdb52b77d7ca3559e lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x33:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca355a5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.377817:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35600/0xdb52b77d7ca3559e lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x33:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca355a5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.377826:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1786109350.378213:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933109632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109350.378260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786109350.378413:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35600/0xdb52b77d7ca3559e lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x33:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca355a5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.378774:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35600/0xdb52b77d7ca3559e lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x33:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca355a5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.378798:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109350.378800:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109350.378802:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786109350.382808:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804448 is committed 00000100:00100000:0.0:1786109350.383594:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933109632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109350.383618:0:187900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca355dd lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x33:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.383633:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca355dd lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x33:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109350.383705:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x33:0x0]: returning size 4096 00000004:00200000:3.0:1786109350.383711:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786109350.383768:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca355d6 lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ff expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.383787:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca355dd lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x33:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ff expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.383795:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x33:0x0].0x0 (ffff930aa0ddd900) 00010000:00010000:3.0:1786109350.383798:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786109350.383801:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628ae00, rc 0) 00000100:00100000:3.0:1786109350.384179:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:157823:x1872862922039424:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 7919us (8893us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109350.384198:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 725 00000100:00100000:1.0:1786109350.391202:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922039680 00000100:00100000:1.0:1786109350.391218:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922039680 00000100:00100000:1.0:1786109350.393394:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 726 00000100:00100000:1.0:1786109350.393417:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+39:157823:x1872862922039680:12345-192.168.203.38@tcp:36:rmdir.0 00010000:00010000:1.0:1786109350.393522:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109350.393558:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca355c1 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11f1 expref: 39 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393578:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcf:0x0].0x0 (ffff93098c4ae900) 00010000:00010000:1.0:1786109350.393584:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109350.393610:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca355e4 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393626:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca355e4 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393637:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca355e4 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393650:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355eb lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393667:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355eb lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393674:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355eb lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393769:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca355f2 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393778:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca355f2 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393786:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca355f2 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393806:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca355f9 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393816:0:187899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355cf lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11f8 expref: 38 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393824:0:187899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca355f9 lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393866:0:187899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355cf lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11f8 expref: 38 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.393883:0:187899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355cf lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11f8 expref: 38 pid: 188678 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.393906:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933109760:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109350.394029:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f240 going to sleep for 11 seconds 00010000:00010000:3.0:1786109350.397720:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca355cf lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11f8 expref: 38 pid: 188678 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109350.397738:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933109760:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109350.397761:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca355f9 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.397771:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca355f9 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.397781:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca355f9 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.397833:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35600 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.397841:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35600 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.397853:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35600 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109350.397878:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933109888:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1786109350.397929:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109350.397968:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098ab959c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109350.406540:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922039936 00000100:00100000:1.0:1786109350.406551:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922039936 00010000:00010000:1.0:1786109350.406600:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca355dd lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x33:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ff expref: 7 pid: 187900 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.406642:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12586 00000100:00100000:1.0:1786109350.406654:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:397d331e-10fc-4558-be87-308c3622e8eb+7:2402:x1872862922039936:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109350.406671:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786109350.407179:0:177399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177399:1872862933110016:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109350.407230:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca35607 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35600 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.407243:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x33:0x0].0x0 (ffff930aa0ddd900) 00010000:00010000:3.0:1786109350.407246:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109350.407251:0:177399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca35607 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35600 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.407262:0:177399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca35607 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35600 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.407270:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628a000, rc 0) 00000100:00100000:3.0:1786109350.407354:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933109888:12345-0@lo:101:mdt00_000.0 Request processed in 7381us (9424us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109350.407362:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12058 00010000:00010000:1.0:1786109350.407605:0:43921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca355dd lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ff expref: 7 pid: 187900 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.407620:0:43921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca355dd lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ff expref: 7 pid: 187900 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.407647:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca355dd lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x33:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a11ff expref: 7 pid: 187900 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.407662:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x33:0x0].0x0 (ffff930aa0ddd900) 00010000:00010000:1.0:1786109350.407667:0:43921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca35607 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35600 expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.408246:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca35607 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca35600 expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.408264:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca35607 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca35600 expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.408319:0:43921:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca35607 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35600 expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.408337:0:43921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:43921:1872862933110144:0@lo:105: 00000100:00100000:1.0:1786109350.408392:0:43921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109350.408705:0:10344:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786109350.408720:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933110144 00000100:00100000:3.0:1786109350.408726:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933110144 00000100:00100000:3.0:1786109350.408769:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5228 00000100:00100000:3.0:1786109350.408779:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:43921:x1872862933110144:12345-0@lo:105: 00010000:00010000:3.0:1786109350.408790:0:10344:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35600 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35607 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.408799:0:10344:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35600 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35607 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.408809:0:10344:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35600 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35607 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.408818:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35600 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35607 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.408825:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35600 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35607 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.408834:0:10344:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35600 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35607 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.408851:0:10344:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff93098cd76600) 00000100:00100000:3.0:1786109350.410303:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:43921:x1872862933110144:12345-0@lo:105: Request processed in 1520us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109350.410326:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5228 00000100:00100000:1.0:1786109350.420761:0:43921:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109350.420827:0:43921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:43921:1872862933110144:0@lo:105: 00010000:00010000:1.0:1786109350.420856:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109350.421015:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922039936:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 14360us (14753us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109350.421028:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12586 00000100:00100000:1.0:1786109350.421082:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933110272 00000100:00100000:1.0:1786109350.421091:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933110272 00000100:00100000:1.0:1786109350.421142:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12059 00000100:00100000:1.0:1786109350.421151:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933110272:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1786109350.428686:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933110272:12345-0@lo:403:mdt00_000.0 Request processed in 7520us (16760us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109350.428706:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12059 00000100:00100000:3.0:1786109350.444694:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1143480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933110272:0@lo:403:mdt00_000.0 00000040:00080000:3.0:1786109350.453396:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].437, 656 off666592 00000040:00080000:3.0:1786109350.460257:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].318, 736 off527376 00000004:00080000:3.0:1786109350.460277:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098ab959c0 with version 675 00000004:00080000:0.0:1786109350.461360:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 675 rpc_version 675 00000020:00100000:0.0:1786109350.461578:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109350.461593:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984ff1180 x1872862933110528/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109350.461624:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933110528:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109350.461711:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109350.461795:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab96879c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109350.461960:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933110528 00000100:00100000:3.0:1786109350.461970:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933110528 00000100:00100000:3.0:1786109350.462121:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12060 00000100:00100000:3.0:1786109350.462132:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933110528:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109350.463124:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933110528:12345-0@lo:1000:osp_up1-0.0 Request processed in 988us (1406us total) trans 25769804449 rc 0/0 00000100:00100000:0.0:1786109350.463136:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12060 00000004:00200000:3.0:1786109350.464031:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dcf:0x0]: returning size 4096 00010000:00010000:3.0:1786109350.464063:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca355f9 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.464074:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca355f9 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.464082:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca355f9 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.464089:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109350.464094:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca355f9 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.464101:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca355f9 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.464121:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x33:0x0].0x0 (ffff93098c4aea00) 00010000:00010000:3.0:1786109350.464124:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109350.464128:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca355f9 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.464134:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca355f9 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.464153:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35600 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35607 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.464161:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35600 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35607 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.465808:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35600 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35607 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.465972:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786109350.465996:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x33:0x0] 00010000:00010000:3.0:1786109350.466014:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca355f2 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466021:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca355f2 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466028:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca355f2 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466035:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109350.466040:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca355f2 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466048:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca355f2 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466069:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcf:0x0].0x0 (ffff93098c4ae900) 00010000:00010000:3.0:1786109350.466072:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109350.466077:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca355f2 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466082:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca355f2 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466103:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca355e4 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466109:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca355e4 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466114:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca355e4 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466118:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109350.466120:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca355e4 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466125:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca355e4 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466133:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109350.466135:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109350.466138:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca355e4 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.466145:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca355e4 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109350.467045:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f780dab reply state 0000000053f3e0dc transno 326417514596 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355eb lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.467060:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355eb lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.467069:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109350.467071:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109350.467075:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786109350.467168:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+39:157823:x1872862922039680:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 73755us (76855us total) trans 326417514596 rc 0/0 00000100:00100000:3.0:1786109350.467177:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 726 00000100:00100000:0.0:1786109350.508643:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109350.509216:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922040064 00000100:00100000:1.0:1786109350.509231:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922040064 00000100:00100000:1.0:1786109350.509305:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 727 00000100:00100000:1.0:1786109350.509316:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+39:157829:x1872862922040064:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109350.509351:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109350.509389:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3560e lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1206 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509679:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35615 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509698:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35615 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509711:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35615 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509726:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3561c lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509734:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3561c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509742:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3561c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509790:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35615 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509799:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35615 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509807:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35615 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509815:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109350.509821:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35615 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509830:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35615 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509845:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109350.509849:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109350.509854:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35615 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509861:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35615 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509876:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3561c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509882:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3561c lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509889:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3561c lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509895:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109350.509899:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3561c lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509905:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3561c lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509915:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109350.509918:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109350.509923:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3561c lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509929:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3561c lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509961:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3560e lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1206 expref: 40 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509971:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109350.509973:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109350.509977:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3560e lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1206 expref: 40 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.509986:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34600, rc 0) 00000100:00100000:1.0:1786109350.510063:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+39:157829:x1872862922040064:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 748us (1434us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109350.510070:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 727 00000100:00100000:0.0:1786109350.514588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109350.514704:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922040192 00000100:00100000:1.0:1786109350.514717:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922040192 00000100:00100000:1.0:1786109350.514800:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 728 00000100:00100000:1.0:1786109350.514813:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+39:157829:x1872862922040192:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109350.514840:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109350.514866:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35623 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a120d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515303:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3562a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515327:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3562a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515341:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3562a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515357:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35631 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515746:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35631 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515755:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35631 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515807:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3562a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515815:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3562a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515823:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3562a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515831:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109350.515836:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3562a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515845:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3562a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515865:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109350.515869:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109350.515874:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3562a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515882:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3562a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515895:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35631 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515902:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35631 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515908:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35631 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515914:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109350.515916:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35631 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515922:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35631 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.515929:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109350.515932:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109350.516235:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35631 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.516244:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35631 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.516289:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35623 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a120d expref: 40 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.516302:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109350.516305:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109350.516309:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35623 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a120d expref: 40 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.516319:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35a00, rc 0) 00000100:00100000:1.0:1786109350.517619:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+39:157829:x1872862922040192:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2797us (3033us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109350.517633:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 728 00000100:00100000:1.0:1786109350.520630:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109350.520785:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922040320 00000100:00100000:3.0:1786109350.520799:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922040320 00000100:00100000:3.0:1786109350.521258:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 729 00000100:00100000:3.0:1786109350.521272:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+39:157829:x1872862922040320:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109350.521300:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109350.521326:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1214 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.521818:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3563f lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.521837:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3563f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.521851:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3563f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109350.522044:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:3.0:1786109350.522049:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109350.522074:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3563f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.522110:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1214 expref: 41 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.522132:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3563f lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1214 expref: 40 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.522142:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109350.522146:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109350.522150:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77e00, rc 0) 00000100:00100000:3.0:1786109350.522249:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+40:157829:x1872862922040320:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 979us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109350.522257:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 729 00000100:00100000:1.0:1786109350.538874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000004:00080000:3.0:1786109350.550311:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 676 rpc_version 676 00000020:00100000:3.0:1786109350.555541:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109350.555648:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930985ebb100 x1872862933110912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109350.555943:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985ebb100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933110912:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109350.556180:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109350.556243:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a905900 going to sleep for 11 seconds 00000100:00100000:0.0:1786109350.558061:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933110912 00000100:00100000:0.0:1786109350.558087:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933110912 00000100:00100000:0.0:1786109350.558222:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12061 00000100:00100000:0.0:1786109350.558234:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933110912:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109350.559342:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933110912:12345-0@lo:1000:osp_up1-0.0 Request processed in 1105us (3157us total) trans 25769804450 rc 0/0 00000100:00100000:0.0:1786109350.559354:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12061 00000100:00100000:3.0:1786109350.560816:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985ebb100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933110912:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109350.567461:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1141c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933111040:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786109350.567482:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628ac00/0xdb52b77d7ca35662 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35669 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567493:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628ac00/0xdb52b77d7ca35662 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35669 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109350.567523:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3fdfaaf reply state 000000003f322285 transno 326417514597 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3565b lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567539:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3565b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567545:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x34:0x0].0x0 (ffff930aa0dddd00) 00010000:00010000:3.0:1786109350.567548:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109350.567552:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109350.567557:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628ac00/0xdb52b77d7ca35662 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35669 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567565:0:187899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628ac00/0xdb52b77d7ca35662 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35669 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109350.567579:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x34:0x0] 00000004:00010000:3.0:1786109350.567586:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3fdfaaf reply state 000000003f322285 transno 326417514597 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35654 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567594:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35654 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567599:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd0:0x0].0x0 (ffff930aa0ddd900) 00010000:00010000:3.0:1786109350.567602:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109350.567605:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1786109350.567611:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd0:0x0]: returning size 4096 00010000:00010000:3.0:1786109350.567620:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35646 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567627:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35646 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567634:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35646 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567642:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109350.567647:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35646 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567656:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35646 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567668:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109350.567670:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109350.567674:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35646 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567681:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a000/0xdb52b77d7ca35646 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109350.567694:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3fdfaaf reply state 000000003f322285 transno 326417514597 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3564d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567705:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3564d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.567711:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109350.567715:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109350.567717:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1786109350.567803:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+41:157829:x1872862922040576:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 26383us (28940us total) trans 326417514597 rc 0/0 00000100:00100000:3.0:1786109350.567811:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 730 00000100:00100000:3.0:1786109350.592504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109350.592682:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922040704 00000100:00100000:1.0:1786109350.592695:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922040704 00000100:00100000:1.0:1786109350.592767:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 731 00000100:00100000:1.0:1786109350.592780:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+41:157837:x1872862922040704:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109350.592814:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109350.592842:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35670 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a121b expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.592917:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35677 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.592935:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35677 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.592948:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35677 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.592959:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3567e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.592967:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3567e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.593622:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3567e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.593722:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35685 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.593731:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35685 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.593739:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35685 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109350.593846:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd0:0x0]: returning size 4096 00000004:00200000:1.0:1786109350.593853:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1786109350.593878:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35685 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.593891:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35677 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.593898:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35677 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.593910:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35677 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.593918:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109350.593922:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35677 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.593931:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35677 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.593946:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109350.593950:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109350.593956:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35677 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.593963:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35677 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.594584:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3567e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.594596:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3567e lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.594602:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3567e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.594608:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109350.594612:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3567e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.594623:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3567e lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.594633:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109350.594636:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109350.594640:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3567e lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.594647:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca3567e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.594690:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35670 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a121b expref: 43 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.594706:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35685 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a121b expref: 42 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.594715:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd0:0x0].0x0 (ffff930aa0ddd900) 00010000:00010000:1.0:1786109350.594717:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109350.594720:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34600, rc 0) 00000100:00100000:1.0:1786109350.596231:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+42:157837:x1872862922040704:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 3439us (3727us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109350.596246:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 731 00000001:02000400:0.0:1786109350.601275:0:188960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:3.0:1786109350.607870:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109350.637115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109350.637254:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922040960 00000100:00100000:1.0:1786109350.637267:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922040960 00000100:00100000:1.0:1786109350.637346:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 733 00000100:00100000:1.0:1786109350.637358:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:157837:x1872862922040960:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109350.637388:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109350.637427:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca3569a lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1229 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.637645:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.637664:0:187901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35669 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35662 expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.637674:0:187901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.637721:0:187901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35669 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35662 expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.637742:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933111168:0@lo:104: 00000100:00100000:1.0:1786109350.637802:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109350.637924:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109350.637973:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933111168 00000100:00100000:3.0:1786109350.637977:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933111168 00000100:00100000:3.0:1786109350.638047:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5229 00000100:00100000:3.0:1786109350.638056:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933111168:12345-0@lo:104: 00010000:00010000:3.0:1786109350.638070:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628ac00/0xdb52b77d7ca35662 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35669 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.638148:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786109350.638155:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933111168:12345-0@lo:104: Request processed in 101us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109350.638162:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5229 00010000:00010000:0.0:1786109350.638177:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109350.638195:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628ac00/0xdb52b77d7ca35662 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35669 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.638205:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ac00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109350.638212:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628ac00/0xdb52b77d7ca35662 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca35669 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109350.638224:0:6515:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628ac00/0xdb52b77d7ca35662 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca35669 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.638246:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933111168:0@lo:104: 00010000:00010000:0.0:1786109350.638259:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628ac00/0xdb52b77d7ca35662 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35669 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.638268:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109350.638269:0:187901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.638299:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628ac00/0xdb52b77d7ca35662 lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35669 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.638307:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1786109350.638308:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930aa628ac00/0xdb52b77d7ca35662 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35669 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.638322:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933111296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109350.638338:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109350.638341:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109350.638343:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109350.638359:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109350.638421:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933111296 00000100:00100000:0.0:1786109350.638426:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933111296 00010000:00010000:0.0:1786109350.638545:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35669 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca35662 expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109350.638582:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12587 00000100:00100000:0.0:1786109350.638591:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+9:3648:x1872862933111296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109350.638603:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1786109350.650778:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804450 is committed 00010000:00010000:0.0:1786109350.651399:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca35669 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca35662 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.651424:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x34:0x0].0x0 (ffff930aa0dddb00) 00010000:00010000:0.0:1786109350.651449:0:177416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.651462:0:177416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.651470:0:177416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.651510:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109350.651669:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933111296:12345-0@lo:103:ldlm_bl.0 Request processed in 13078us (13307us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109350.651680:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12587 00000100:00100000:1.0:1786109350.651863:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933111296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109350.651903:0:187901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.651912:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109350.651986:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x34:0x0]: returning size 4096 00000004:00200000:1.0:1786109350.651998:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786109350.652050:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca3569a lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1229 expref: 8 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.652070:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1229 expref: 7 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.652079:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x34:0x0].0x0 (ffff930aa0dddb00) 00010000:00010000:1.0:1786109350.652082:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786109350.652085:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35000, rc 0) 00000100:00100000:1.0:1786109350.652346:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:157837:x1872862922040960:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 14988us (15244us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109350.652356:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 733 00000100:00100000:1.0:1786109350.656227:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:0.0:1786109350.661696:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109350.663536:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109350.664210:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786109350.664654:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35693 lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1222 expref: 42 pid: 188678 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.664675:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f50000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933111424:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109350.664706:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca356bd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.664722:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca356bd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.664729:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca356bd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.665987:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35a00/0xdb52b77d7ca356c4 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.666000:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35a00/0xdb52b77d7ca356c4 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.666014:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35a00/0xdb52b77d7ca356c4 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.666039:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933111808:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1786109350.666086:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109350.666125:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109350.666743:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933111680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109350.666762:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933111552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109350.667327:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933111808 00000100:00100000:0.0:1786109350.667336:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933111808 00000100:00100000:0.0:1786109350.667590:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12063 00000100:00100000:0.0:1786109350.667602:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188678:x1872862933111808:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109350.667624:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109350.667647:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca356cb lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca356c4 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.667682:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1229 expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.667693:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca356cb lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca356c4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.667729:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1229 expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.667743:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1229 expref: 6 pid: 187901 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109350.667757:0:8452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8452:1872862933111936:192.168.203.38@tcp:104: 00000100:00100000:0.0:1786109350.667853:0:8452:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109350.676034:0:8452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8452:1872862933111936:192.168.203.38@tcp:104: 00010000:00010000:0.0:1786109350.676081:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca356cb lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca356c4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.676096:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x34:0x0].0x0 (ffff930aa0dddb00) 00010000:00010000:0.0:1786109350.676099:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109350.676104:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca356cb lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca356c4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.676117:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca356cb lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca356c4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.676125:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9200, rc 0) 00000100:00100000:3.0:1786109350.676157:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922041472 00000100:00100000:3.0:1786109350.676167:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922041472 00010000:00010000:3.0:1786109350.676218:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1229 expref: 7 pid: 187901 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109350.676257:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12589 00000100:00100000:0.0:1786109350.676261:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933111808:12345-0@lo:101:mdt00_003.0 Request processed in 8663us (10175us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109350.676268:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa4e8b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:2403:x1872862922041472:12345-192.168.203.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1786109350.676269:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12063 00010000:00010000:3.0:1786109350.676285:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109350.676292:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1229 expref: 7 pid: 187901 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.677222:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1229 expref: 7 pid: 187901 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.677259:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca356a1 lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x34:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1229 expref: 7 pid: 187901 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.677276:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x34:0x0].0x0 (ffff930aa0dddb00) 00010000:00010000:3.0:1786109350.677289:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca356cb lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca356c4 expref: 6 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.677300:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca356cb lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca356c4 expref: 6 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.677315:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca356cb lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca356c4 expref: 6 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.677372:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca356cb lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca356c4 expref: 6 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109350.678034:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985ebb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6512:1872862933112064:0@lo:105: 00000100:00100000:3.0:1786109350.678164:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109350.678233:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1ec00 going to sleep for 11 seconds 00010000:00010000:3.0:1786109350.678508:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35a00/0xdb52b77d7ca356c4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca356cb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.678518:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35a00/0xdb52b77d7ca356c4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca356cb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109350.680899:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933112192:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1786109350.681016:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109350.681135:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1e600 going to sleep for 11 seconds 00000100:00100000:3.0:1786109350.683570:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933112192:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1786109350.684814:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].439, 944 off669688 00000040:00080000:0.0:1786109350.685026:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].320, 1024 off530752 00000004:00080000:0.0:1786109350.685034:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e600 with version 677 00000004:00080000:3.0:1786109350.685097:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 677 rpc_version 677 00000020:00100000:3.0:1786109350.685140:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109350.685152:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930985eb8e00 x1872862933112448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1984/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109350.685178:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933112448:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109350.685264:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109350.685351:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1e840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109350.686022:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933112448:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1786109350.686066:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd0:0x0]: returning size 4096 00010000:00010000:0.0:1786109350.686094:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca356bd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686105:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca356bd lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686115:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca356bd lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686123:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.686128:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca356bd lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686138:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca356bd lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686157:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x34:0x0].0x0 (ffff930aa0dddd00) 00010000:00010000:0.0:1786109350.686161:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109350.686167:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca356bd lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686174:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca356bd lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686198:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35a00/0xdb52b77d7ca356c4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca356cb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686207:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35a00/0xdb52b77d7ca356c4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca356cb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686215:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35a00/0xdb52b77d7ca356c4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca356cb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686272:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786109350.686282:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x34:0x0] 00010000:00010000:0.0:1786109350.686290:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca356b6 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686297:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca356b6 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686304:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca356b6 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686310:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6dc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.686313:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca356b6 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686319:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca356b6 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686327:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd0:0x0].0x0 (ffff930aa0ddd900) 00010000:00010000:0.0:1786109350.686330:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109350.686333:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca356b6 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686340:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca356b6 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686353:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca356a8 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686359:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca356a8 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686364:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca356a8 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686370:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.686373:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca356a8 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686384:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca356a8 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686392:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109350.686394:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.686397:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca356a8 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686402:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca356a8 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109350.686411:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000486df1b3 reply state 000000003a104ee4 transno 326417514598 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca356af lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686423:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca356af lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.686488:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109350.686491:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109350.686494:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109350.686610:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+43:157837:x1872862922041216:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 30073us (30393us total) trans 326417514598 rc 0/0 00000100:00100000:0.0:1786109350.686618:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 734 00000100:00100000:3.0:1786109350.740898:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109350.740977:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922041600 00000100:00100000:0.0:1786109350.740989:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922041600 00000100:00100000:0.0:1786109350.741064:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 735 00000100:00100000:0.0:1786109350.741076:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+43:157846:x1872862922041600:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109350.741106:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109350.741132:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca356d2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1230 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741224:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356d9 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741241:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356d9 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741255:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356d9 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741267:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356e0 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741274:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356e0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741280:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356e0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741332:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356d9 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741340:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356d9 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741347:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356d9 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741354:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.741358:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356d9 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741368:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356d9 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741381:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109350.741385:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.741390:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356d9 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741396:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356d9 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741411:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356e0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741417:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356e0 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741423:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356e0 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741462:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.741465:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356e0 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741471:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356e0 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741479:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109350.741481:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.741484:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356e0 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741491:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356e0 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741523:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca356d2 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1230 expref: 44 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741535:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109350.741538:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.741541:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca356d2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1230 expref: 44 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.741552:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9800, rc 0) 00000100:00100000:0.0:1786109350.741631:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+43:157846:x1872862922041600:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 556us (743us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109350.741639:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 735 00000100:00100000:3.0:1786109350.750728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109350.750845:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922041728 00000100:00100000:0.0:1786109350.750859:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922041728 00000100:00100000:0.0:1786109350.750934:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 736 00000100:00100000:0.0:1786109350.750946:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+43:157846:x1872862922041728:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109350.750975:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109350.751001:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca356e7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1237 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751087:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356ee lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751104:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356ee lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751120:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356ee lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751133:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356f5 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751141:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356f5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751148:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356f5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751206:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356ee lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751214:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356ee lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751222:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356ee lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751229:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.751233:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356ee lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751242:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356ee lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751257:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109350.751261:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.751267:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356ee lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751274:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca356ee lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751290:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356f5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751298:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356f5 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751304:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356f5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751310:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.751313:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356f5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751320:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356f5 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751328:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109350.751330:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.751334:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356f5 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751339:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca356f5 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751372:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca356e7 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1237 expref: 44 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751389:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109350.751392:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.751396:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca356e7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1237 expref: 44 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.751407:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9800, rc 0) 00000100:00100000:0.0:1786109350.751539:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+43:157846:x1872862922041728:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 595us (825us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109350.751548:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 736 00000100:00100000:1.0:1786109350.771552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109350.771646:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922041856 00000100:00100000:3.0:1786109350.771658:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922041856 00000100:00100000:3.0:1786109350.771732:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 737 00000100:00100000:3.0:1786109350.771745:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+43:157846:x1872862922041856:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109350.771774:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109350.771799:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca356fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a123e expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.771891:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35703 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.771909:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35703 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.771924:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35703 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109350.771978:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:3.0:1786109350.771982:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109350.772006:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35703 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.772035:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca356fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a123e expref: 45 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.772052:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35703 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a123e expref: 44 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.772061:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109350.772064:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109350.772069:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76000, rc 0) 00000100:00100000:3.0:1786109350.772143:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+44:157846:x1872862922041856:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 400us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109350.772151:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 737 00000100:00100000:3.0:1786109350.796263:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922042112 00000100:00100000:3.0:1786109350.796279:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922042112 00000100:00100000:3.0:1786109350.796400:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 738 00000100:00100000:3.0:1786109350.796412:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+44:157846:x1872862922042112:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:3.0:1786109350.796504:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109350.796541:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca35703 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a123e expref: 44 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.796559:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109350.796565:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109350.796644:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3570a lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.796660:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3570a lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.796671:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3570a lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.796683:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35711 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.796695:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35711 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.796703:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35711 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786109350.798928:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].440, 2152 off671840 00000040:00080000:3.0:1786109350.799033:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].321, 2352 off533104 00000004:00080000:3.0:1786109350.799041:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e840 with version 678 00000004:00080000:3.0:1786109350.799080:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 678 rpc_version 678 00000020:00100000:3.0:1786109350.799126:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109350.799137:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930985ebad80 x1872862933112832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109350.799164:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985ebad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933112832:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109350.802336:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109350.802385:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109350.802413:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933112832 00000100:00100000:3.0:1786109350.802424:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933112832 00000100:00100000:3.0:1786109350.802501:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12066 00000100:00100000:3.0:1786109350.802511:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933112832:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109350.808288:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933112832:12345-0@lo:1000:osp_up1-0.0 Request processed in 5765us (5949us total) trans 25769804452 rc 0/0 00000100:00100000:3.0:1786109350.808306:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12066 00010000:00010000:3.0:1786109350.813941:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca35718 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.813965:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca35718 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.813979:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca35718 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.814002:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3571f lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.814009:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3571f lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.814016:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3571f lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.814068:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35726 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.814076:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35726 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.814088:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35726 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109350.814115:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1141180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933112960:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1786109350.820474:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109350.820712:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34540 going to sleep for 11 seconds 00000100:00100000:0.0:1786109350.821083:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933112960 00000100:00100000:0.0:1786109350.821096:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933112960 00000100:00100000:0.0:1786109350.821172:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12067 00000100:00100000:0.0:1786109350.821196:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187899:x1872862933112960:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786109350.821226:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109350.821256:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca3572d lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35726 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.821292:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca3572d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35726 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.821309:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca3572d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35726 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.821334:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x35:0x0].0x0 (ffff930a90808200) 00010000:00010000:0.0:1786109350.821339:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.821344:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9800, rc 0) 00000100:00100000:0.0:1786109350.821424:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187899:x1872862933112960:12345-0@lo:101:mdt00_000.0 Request processed in 242us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109350.821460:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12067 00000100:00100000:3.0:1786109350.822396:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1141180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933112960:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786109350.822424:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35726 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3572d expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822452:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35726 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3572d expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109350.822485:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c777af34 reply state 00000000dd5b3273 transno 326417514599 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3571f lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822501:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3571f lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822509:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x35:0x0].0x0 (ffff930aa62cfe00) 00010000:00010000:3.0:1786109350.822512:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109350.822516:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109350.822523:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35726 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3572d expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822532:0:187899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76600/0xdb52b77d7ca35726 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3572d expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109350.822545:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x35:0x0] 00000004:00010000:3.0:1786109350.822556:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c777af34 reply state 00000000dd5b3273 transno 326417514599 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca35718 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822565:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca35718 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822571:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd1:0x0].0x0 (ffff930aa62cf200) 00010000:00010000:3.0:1786109350.822573:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109350.822575:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1786109350.822581:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd1:0x0]: returning size 4096 00010000:00010000:3.0:1786109350.822592:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3570a lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822598:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3570a lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822606:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3570a lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822613:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109350.822618:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3570a lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822626:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3570a lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822643:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109350.822645:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109350.822649:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3570a lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822655:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3570a lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109350.822671:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c777af34 reply state 00000000dd5b3273 transno 326417514599 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35711 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822681:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35711 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.822686:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109350.822688:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109350.822690:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1786109350.822787:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+45:157846:x1872862922042112:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 26375us (27500us total) trans 326417514599 rc 0/0 00000100:00100000:3.0:1786109350.822796:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 738 00000100:00100000:3.0:1786109350.873381:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109350.873763:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922042240 00000100:00100000:0.0:1786109350.873775:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922042240 00000100:00100000:0.0:1786109350.873844:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 739 00000100:00100000:0.0:1786109350.873857:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+45:157850:x1872862922042240:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109350.873886:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109350.873914:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35734 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1245 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.873993:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3573b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.874284:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3573b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.874301:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3573b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.874722:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca35742 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.874735:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca35742 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.874744:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca35742 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.874845:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca35749 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.874859:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca35749 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.874867:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca35749 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109350.874977:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd1:0x0]: returning size 4096 00000004:00200000:1.0:1786109350.875038:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1786109350.875067:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca35749 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875083:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3573b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875090:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3573b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875098:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3573b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875105:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109350.875168:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3573b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875177:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3573b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875202:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109350.875206:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109350.875211:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3573b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875223:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3573b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875245:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca35742 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875251:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca35742 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875257:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca35742 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875262:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109350.875265:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca35742 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875271:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca35742 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875278:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109350.875280:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109350.875284:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca35742 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875290:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca35742 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875628:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35734 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1245 expref: 47 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875650:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca35749 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1245 expref: 46 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.875658:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd1:0x0].0x0 (ffff930aa62cf200) 00010000:00010000:1.0:1786109350.875660:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109350.875664:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35600, rc 0) 00000100:00100000:1.0:1786109350.875760:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+46:157850:x1872862922042240:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 1905us (2393us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109350.875771:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 739 00000100:00100000:3.0:1786109350.895393:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109350.907998:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109350.909720:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922042496 00000100:00100000:1.0:1786109350.909738:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922042496 00000100:00100000:1.0:1786109350.909875:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 741 00000100:00100000:1.0:1786109350.909887:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:157850:x1872862922042496:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109350.909912:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109350.909941:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3575e lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1253 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.910020:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca35765 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.910039:0:187901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca3572d lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35726 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.910050:0:187901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca35765 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.910093:0:187901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca3572d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35726 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.910114:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933113088:0@lo:104: 00000100:00100000:1.0:1786109350.910389:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109350.910514:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109350.910897:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933113216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109350.911684:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109350.911860:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933113088:0@lo:104: 00010000:00010000:1.0:1786109350.911944:0:187901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca35765 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786109350.920021:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804452 is committed 00000100:00100000:0.0:1786109350.920687:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933113216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109350.920832:0:187901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca35765 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.920842:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca35765 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109350.921024:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x35:0x0]: returning size 4096 00000004:00200000:1.0:1786109350.921032:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786109350.921088:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3575e lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1253 expref: 8 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.921108:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca35765 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1253 expref: 7 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.921116:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x35:0x0].0x0 (ffff930a90808200) 00010000:00010000:1.0:1786109350.921119:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786109350.921122:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34a00, rc 0) 00000100:00100000:1.0:1786109350.921249:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:157850:x1872862922042496:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 11364us (13265us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109350.921257:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 741 00000100:00100000:3.0:1786109350.924064:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109350.924321:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922042752 00000100:00100000:0.0:1786109350.924335:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922042752 00000100:00100000:0.0:1786109350.924716:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 742 00000100:00100000:0.0:1786109350.924730:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+47:157850:x1872862922042752:12345-192.168.203.38@tcp:36:rmdir.0 00010000:00010000:0.0:1786109350.924809:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109350.924844:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca35749 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1245 expref: 47 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.924868:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd1:0x0].0x0 (ffff930aa62cf200) 00010000:00010000:0.0:1786109350.924874:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109350.925010:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca3576c lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925027:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca3576c lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925038:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca3576c lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925049:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca35773 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925060:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca35773 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925066:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca35773 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925166:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca3577a lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925174:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca3577a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925243:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca3577a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925268:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35781 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925280:0:187899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca35757 lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a124c expref: 46 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925290:0:187899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35781 lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925331:0:187899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca35757 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a124c expref: 46 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.925348:0:187899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca35757 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x35:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a124c expref: 46 pid: 188678 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109350.925365:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933113344:192.168.203.38@tcp:104: 00000100:00100000:0.0:1786109350.925817:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109350.927776:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109350.927857:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109350.927891:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109350.927940:0:187890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922042880 00000100:00100000:0.0:1786109350.927953:0:187890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922042880 00000100:00100000:0.0:1786109350.928028:0:187890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:0.0:1786109350.928040:0:187890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2405:x1872862922042880:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109350.928125:0:187890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2405:x1872862922042880:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 86us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109350.928133:0:187890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:1.0:1786109350.928802:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933113344:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109350.928835:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35781 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109350.929077:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6802 00000100:00100000:0.0:1786109350.929089:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:397d331e-10fc-4558-be87-308c3622e8eb+5:2405:x1872862922043008:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109350.929143:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:397d331e-10fc-4558-be87-308c3622e8eb+5:2405:x1872862922043008:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 56us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109350.929152:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6802 00000100:00100000:0.0:1786109350.929168:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6803 00000100:00100000:0.0:1786109350.929175:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:397d331e-10fc-4558-be87-308c3622e8eb+5:2405:x1872862922043136:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109350.929215:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:397d331e-10fc-4558-be87-308c3622e8eb+5:2405:x1872862922043136:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 40us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109350.929221:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6803 00000100:00080000:3.0:1786109350.929271:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109350.929277:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109350.932030:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:1.0:1786109350.932805:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35781 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.932815:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35781 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.932874:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.932881:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.932892:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109350.932921:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933113472:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109350.932980:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109350.933027:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109350.933104:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933113472 00000100:00100000:0.0:1786109350.933110:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933113472 00000100:00100000:0.0:1786109350.933162:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12068 00000100:00100000:0.0:1786109350.933173:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187899:x1872862933113472:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786109350.933202:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109350.933221:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3578f lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35788 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.933245:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca35765 lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1253 expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.933255:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3578f lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35788 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.933278:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca35765 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1253 expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.933296:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca35765 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1253 expref: 6 pid: 187901 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109350.933308:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8451:1872862933113600:192.168.203.38@tcp:104: 00000100:00100000:0.0:1786109350.933377:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab96879c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109350.941460:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8451:1872862933113600:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109350.941509:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3578f lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35788 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.941526:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x35:0x0].0x0 (ffff930a90808200) 00010000:00010000:3.0:1786109350.941530:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109350.941535:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3578f lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35788 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.941548:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3578f lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35788 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.941555:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8400, rc 0) 00000100:00100000:3.0:1786109350.941628:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933113472:12345-0@lo:101:mdt00_000.0 Request processed in 8458us (8646us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109350.941637:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12068 00000100:00100000:0.0:1786109350.944542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109350.947632:0:187899:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804452 gen 2 00000004:00080000:1.0:1786109350.947641:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804451 committed transno 25769804452 00000004:00080000:1.0:1786109350.947674:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804452 committed transno 25769804452 00000100:00100000:1.0:1786109350.947880:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933113472:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109350.947906:0:187899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.947919:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109350.948466:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933113728 00000100:00100000:3.0:1786109350.948472:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933113728 00000100:00100000:3.0:1786109350.948564:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5232 00000100:00100000:3.0:1786109350.948572:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6513:x1872862933113728:12345-0@lo:105: 00010000:00010000:3.0:1786109350.948585:0:6510:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.948596:0:6510:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.948607:0:6510:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.948615:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.948623:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.948632:0:6510:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109350.948658:0:6510:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ab1c35e00) 00010000:00010000:0.0:1786109350.948715:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109350.948723:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6513:x1872862933113728:12345-0@lo:105: Request processed in 151us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109350.948734:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5232 00010000:00010000:0.0:1786109350.948734:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109350.949853:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933113856:0@lo:403:mdt00_000.0 00000100:00100000:0.0:1786109350.949922:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109350.950007:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687000 going to sleep for 11 seconds 00000100:00100000:0.0:1786109350.953854:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933113856:0@lo:403:mdt00_000.0 00000040:00080000:0.0:1786109350.955108:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].441, 656 off672496 00000040:00080000:0.0:1786109350.955346:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].322, 736 off533840 00000004:00080000:0.0:1786109350.955354:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab9687000 with version 679 00000100:00100000:1.0:1786109350.955939:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933114112 00000100:00100000:1.0:1786109350.955948:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933114112 00000100:00100000:1.0:1786109350.956050:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12070 00000100:00100000:1.0:1786109350.956063:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933114112:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109350.956350:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933114112:12345-0@lo:1000:osp_up1-0.0 Request processed in 290us (546us total) trans 25769804453 rc 0/0 00000100:00100000:1.0:1786109350.956360:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12070 00000004:00200000:0.0:1786109350.956599:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd1:0x0]: returning size 4096 00010000:00010000:0.0:1786109350.956628:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35781 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956640:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35781 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956654:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35781 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956660:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.956665:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35781 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956674:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35781 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956692:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x35:0x0].0x0 (ffff930aa62cfe00) 00010000:00010000:0.0:1786109350.956695:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109350.956701:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35781 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956708:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35781 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956725:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956733:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956740:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35e00/0xdb52b77d7ca35788 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3578f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956762:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786109350.956773:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x35:0x0] 00010000:00010000:0.0:1786109350.956782:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca3577a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956789:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca3577a lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956796:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca3577a lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956801:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.956804:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca3577a lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956810:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca3577a lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956819:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd1:0x0].0x0 (ffff930aa62cf200) 00010000:00010000:0.0:1786109350.956821:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109350.956824:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca3577a lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956829:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca3577a lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956846:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca3576c lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956853:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca3576c lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956858:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca3576c lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956868:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109350.956870:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca3576c lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956876:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca3576c lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956884:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109350.956886:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109350.956890:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca3576c lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956896:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca3576c lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109350.956907:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b4b0764 reply state 0000000087bfc505 transno 326417514600 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca35773 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956922:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca35773 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109350.956930:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109350.956932:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109350.956935:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109350.957014:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+47:157850:x1872862922042752:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 32284us (32960us total) trans 326417514600 rc 0/0 00000100:00100000:0.0:1786109350.957022:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 742 00000100:00100000:1.0:1786109350.957926:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933114240 00000100:00100000:1.0:1786109350.957936:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933114240 00000100:00100000:1.0:1786109350.958028:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4482 00000100:00100000:1.0:1786109350.958039:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3647:x1872862933114240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109350.958053:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109350.958076:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca3578f lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca35788 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109350.958092:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x35:0x0].0x0 (ffff930a90808200) 00010000:00010000:1.0:1786109350.958102:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109350.958212:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3647:x1872862933114240:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109350.958220:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4482 00000100:00100000:3.0:1786109350.958303:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933114240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109351.085529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.085654:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922043520 00000100:00100000:3.0:1786109351.085667:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922043520 00000100:00100000:3.0:1786109351.085810:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 743 00000100:00100000:3.0:1786109351.085822:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+47:157859:x1872862922043520:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109351.085866:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.085895:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca35796 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a125a expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.085992:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3579d lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086009:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3579d lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086036:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3579d lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086052:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357a4 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 21 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086060:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357a4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086068:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357a4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086135:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3579d lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086143:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3579d lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086151:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3579d lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086170:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.086175:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3579d lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086195:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3579d lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086211:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.086215:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.086222:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3579d lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086229:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3579d lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086245:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357a4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086258:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357a4 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086264:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357a4 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086269:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.086272:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357a4 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086278:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357a4 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086286:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109351.086289:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.086293:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357a4 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086299:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357a4 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086331:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca35796 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a125a expref: 48 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086348:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.086351:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.086354:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca35796 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a125a expref: 48 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.086364:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77800, rc 0) 00000100:00100000:3.0:1786109351.086516:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+47:157859:x1872862922043520:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 695us (1001us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109351.086524:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 743 00000100:00080000:0.0:1786109351.086773:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109351.168886:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.173899:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922043776 00000100:00100000:3.0:1786109351.173913:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922043776 00000100:00100000:3.0:1786109351.174006:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 745 00000100:00100000:3.0:1786109351.174020:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+47:157859:x1872862922043776:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109351.174047:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.174074:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca357c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1268 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.174162:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357c7 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.174193:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357c7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.174208:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357c7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109351.174272:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:3.0:1786109351.174277:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109351.174302:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357c7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.174333:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca357c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1268 expref: 49 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.174352:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357c7 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1268 expref: 48 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.174361:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.174364:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109351.174369:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76000, rc 0) 00000100:00100000:3.0:1786109351.174617:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+48:157859:x1872862922043776:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 600us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.174625:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 745 00000100:00100000:3.0:1786109351.179527:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.179707:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922044032 00000100:00100000:1.0:1786109351.179726:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922044032 00000100:00100000:1.0:1786109351.179807:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 746 00000100:00100000:1.0:1786109351.179820:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+48:157859:x1872862922044032:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1786109351.179896:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109351.179931:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca357c7 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1268 expref: 48 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.179954:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.179960:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109351.180393:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca357ce lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.180412:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca357ce lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.180424:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca357ce lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.180629:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca357d5 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 21 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.180642:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca357d5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.180656:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca357d5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109351.182119:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].442, 2152 off674648 00000040:00080000:1.0:1786109351.182228:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].323, 2352 off536192 00000004:00080000:1.0:1786109351.182238:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098502f480 with version 680 00000100:00100000:3.0:1786109351.183107:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933114496 00000100:00100000:3.0:1786109351.183117:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933114496 00000100:00100000:3.0:1786109351.183216:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12071 00000100:00100000:3.0:1786109351.183229:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933114496:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109351.184146:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933114496:12345-0@lo:1000:osp_up1-0.0 Request processed in 916us (1263us total) trans 25769804454 rc 0/0 00000100:00100000:3.0:1786109351.184158:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12071 00000100:00100000:0.0:1786109351.184344:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f50700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933114496:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786109351.184657:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca357dc lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.184676:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca357dc lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.184693:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca357dc lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.184716:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca357e3 lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.184723:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca357e3 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.184730:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca357e3 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.184769:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35800/0xdb52b77d7ca357ea lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.184777:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35800/0xdb52b77d7ca357ea lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.184787:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35800/0xdb52b77d7ca357ea lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.184807:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933114624:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109351.184852:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.184878:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109351.185098:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933114624 00000100:00100000:0.0:1786109351.185106:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933114624 00000100:00100000:0.0:1786109351.185159:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12072 00000100:00100000:0.0:1786109351.185169:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187899:x1872862933114624:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786109351.185201:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.185219:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca357f1 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca357ea expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.185245:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca357f1 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca357ea expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.185258:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca357f1 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca357ea expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.185267:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x36:0x0].0x0 (ffff930a90808300) 00010000:00010000:0.0:1786109351.185271:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.185275:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8200, rc 0) 00000100:00100000:0.0:1786109351.185651:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187899:x1872862933114624:12345-0@lo:101:mdt00_000.0 Request processed in 482us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.185659:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12072 00000100:00100000:0.0:1786109351.198223:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.200223:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922044160 00000100:00100000:1.0:1786109351.200242:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922044160 00000100:00100000:1.0:1786109351.200333:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 747 00000100:00100000:1.0:1786109351.200346:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+49:157861:x1872862922044160:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109351.200376:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.200765:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca357f8 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a126f expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201247:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca357ff lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201266:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca357ff lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201280:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca357ff lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201294:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35806 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 22 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201303:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35806 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201309:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35806 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201566:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3580d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201576:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3580d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201585:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3580d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109351.201688:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd2:0x0]: returning size 4096 00000004:00200000:1.0:1786109351.201694:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1786109351.201733:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3580d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201753:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca357ff lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201760:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca357ff lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201768:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca357ff lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201775:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.201791:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca357ff lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201801:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca357ff lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201815:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.201818:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.201825:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca357ff lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.201831:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca357ff lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.202383:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35806 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.202394:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35806 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.202400:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35806 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.202407:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.202411:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35806 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.202418:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35806 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.202650:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109351.202654:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.202658:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35806 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.202665:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35806 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.202707:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca357f8 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a126f expref: 51 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.203172:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3580d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a126f expref: 50 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.203195:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd2:0x0].0x0 (ffff930aa65d7b00) 00010000:00010000:1.0:1786109351.203197:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109351.203200:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34800, rc 0) 00000100:00100000:1.0:1786109351.203818:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+50:157861:x1872862922044160:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 3468us (5636us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.203830:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 747 00000100:00100000:1.0:1786109351.211198:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.214569:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.215627:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922044416 00000100:00100000:1.0:1786109351.215643:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922044416 00000100:00100000:1.0:1786109351.215729:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 749 00000100:00100000:1.0:1786109351.215741:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:157861:x1872862922044416:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109351.215770:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.215798:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35822 lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a127d expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.217037:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35829 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.217065:0:187900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca357f1 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca357ea expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.217076:0:187900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35829 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.217125:0:187900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca357f1 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca357ea expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.217147:0:187900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933114752:0@lo:104: 00000100:00100000:1.0:1786109351.217243:0:187900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.217329:0:187900:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109351.218662:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933114752 00000100:00100000:0.0:1786109351.218680:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933114752 00000100:00100000:0.0:1786109351.219199:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5233 00000100:00100000:0.0:1786109351.219214:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933114752:12345-0@lo:104: 00010000:00010000:0.0:1786109351.219237:0:10344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab1c35800/0xdb52b77d7ca357ea lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca357f1 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.219568:0:10344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786109351.219578:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933114752:12345-0@lo:104: Request processed in 369us (2335us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.219586:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5233 00000100:00100000:3.0:1786109351.220072:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933114880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109351.220134:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.220235:0:187900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933114752:0@lo:104: 00010000:00010000:3.0:1786109351.220263:0:187900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35829 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786109351.223540:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804454 is committed 00010000:00010000:3.0:1786109351.224055:0:187900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35829 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.224066:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35829 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109351.224309:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x36:0x0]: returning size 4096 00000004:00200000:3.0:1786109351.224315:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786109351.224375:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35822 lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a127d expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.224395:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35829 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a127d expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.224416:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x36:0x0].0x0 (ffff930a90808300) 00010000:00010000:3.0:1786109351.224420:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786109351.224423:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34e00, rc 0) 00000100:00100000:3.0:1786109351.224529:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:157861:x1872862922044416:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 8791us (9974us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.224537:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 749 00000100:00100000:0.0:1786109351.225131:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933114880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109351.226873:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.227013:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922044672 00000100:00100000:1.0:1786109351.227024:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922044672 00000100:00100000:1.0:1786109351.227124:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 750 00000100:00100000:1.0:1786109351.227136:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+51:157861:x1872862922044672:12345-192.168.203.38@tcp:36:rmdir.0 00010000:00010000:1.0:1786109351.227221:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109351.227255:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca3580d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a126f expref: 51 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227277:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd2:0x0].0x0 (ffff930aa65d7b00) 00010000:00010000:1.0:1786109351.227283:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109351.227324:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35830 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227339:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35830 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227350:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35830 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227362:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35837 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 22 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227373:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35837 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227379:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35837 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227525:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3583e lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227534:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3583e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227541:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3583e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227565:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227575:0:187899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3581b lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1276 expref: 50 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227584:0:187899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227622:0:187899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3581b lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1276 expref: 50 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.227638:0:187899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3581b lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1276 expref: 50 pid: 188678 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.227656:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933115008:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109351.227765:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.230693:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933115008:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109351.230732:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.230894:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922044800 00000100:00100000:0.0:1786109351.230903:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922044800 00010000:00010000:0.0:1786109351.230949:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3581b lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1276 expref: 51 pid: 188678 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.231024:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12594 00000100:00100000:0.0:1786109351.231036:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:397d331e-10fc-4558-be87-308c3622e8eb+51:2402:x1872862922044800:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109351.231055:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109351.231063:0:177416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3581b lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x36:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1276 expref: 51 pid: 188678 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.231076:0:177416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3581b lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x36:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1276 expref: 51 pid: 188678 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.231105:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca3581b lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x36:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1276 expref: 51 pid: 188678 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.231123:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x36:0x0].0x0 (ffff930aa65d7500) 00010000:00010000:0.0:1786109351.231129:0:177416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.231140:0:177416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.231148:0:177416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.231216:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109351.231288:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:397d331e-10fc-4558-be87-308c3622e8eb+50:2402:x1872862922044800:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 254us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.231296:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12594 00010000:00010000:1.0:1786109351.231383:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.231392:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.231487:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.231496:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.231508:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.231532:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933115136:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109351.231587:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.231985:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.237742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109351.237807:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922044928 00000100:00100000:0.0:1786109351.237816:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922044928 00010000:00010000:0.0:1786109351.237858:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35829 lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x36:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a127d expref: 7 pid: 187900 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.237892:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12595 00000100:00100000:0.0:1786109351.237904:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:397d331e-10fc-4558-be87-308c3622e8eb+7:2402:x1872862922044928:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109351.237918:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109351.237925:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35829 lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a127d expref: 7 pid: 187900 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.237938:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35829 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x36:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a127d expref: 7 pid: 187900 timeout: 8307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.237959:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x36:0x0].0x0 (ffff930a90808300) 00010000:00010000:0.0:1786109351.237966:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35853 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3584c expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.237983:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35853 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca3584c expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.237991:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35853 lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca3584c expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.238024:0:9538:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35853 lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3584c expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.238038:0:9538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9538:1872862933115392:0@lo:105: 00000100:00100000:0.0:1786109351.238307:0:9538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.238412:0:9538:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687600 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.238579:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933115392 00000100:00100000:3.0:1786109351.238584:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933115392 00000100:00100000:3.0:1786109351.238626:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5234 00000100:00100000:3.0:1786109351.238635:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:9538:x1872862933115392:12345-0@lo:105: 00010000:00010000:3.0:1786109351.238649:0:6510:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.238660:0:6510:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.238668:0:6510:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.238681:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.238689:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.238697:0:6510:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.238711:0:6510:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930a80030c00) 00000100:00100000:3.0:1786109351.238747:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:9538:x1872862933115392:12345-0@lo:105: Request processed in 113us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.238755:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5234 00000100:00100000:0.0:1786109351.238825:0:9538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9538:1872862933115392:0@lo:105: 00010000:00010000:0.0:1786109351.238836:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109351.238888:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922044928:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 986us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.238896:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12595 00000100:00100000:0.0:1786109351.239082:0:187899:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804454 gen 2 00000004:00080000:0.0:1786109351.239089:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804453 committed transno 25769804454 00000004:00080000:0.0:1786109351.239108:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804454 committed transno 25769804454 00000100:00100000:0.0:1786109351.239124:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933115136:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786109351.239139:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.239911:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933115520:0@lo:403:mdt00_000.0 00000100:00100000:0.0:1786109351.239959:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.240048:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687000 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.240332:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933115520 00000100:00100000:3.0:1786109351.240339:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933115520 00000100:00100000:3.0:1786109351.240420:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12074 00000100:00100000:3.0:1786109351.240445:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933115520:12345-0@lo:403:mdt00_000.0 00000100:00100000:3.0:1786109351.242234:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933115520:12345-0@lo:403:mdt00_000.0 Request processed in 1800us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.242246:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12074 00000100:00100000:1.0:1786109351.242352:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933115520:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1786109351.243392:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].443, 656 off675304 00000040:00080000:1.0:1786109351.243733:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].324, 736 off536928 00000004:00080000:1.0:1786109351.243739:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a901c9f00 with version 681 00000004:00080000:0.0:1786109351.243793:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 681 rpc_version 681 00000020:00100000:0.0:1786109351.243823:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109351.243831:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984ff3100 x1872862933115776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109351.243854:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933115776:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109351.243906:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.243974:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.244035:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933115776 00000100:00100000:3.0:1786109351.244042:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933115776 00000100:00100000:3.0:1786109351.244097:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12075 00000100:00100000:3.0:1786109351.244106:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933115776:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109351.244424:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933115776:12345-0@lo:1000:osp_up1-0.0 Request processed in 319us (517us total) trans 25769804455 rc 0/0 00000100:00100000:3.0:1786109351.244448:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12075 00000100:00100000:0.0:1786109351.244615:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933115776:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1786109351.244684:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd2:0x0]: returning size 4096 00010000:00010000:3.0:1786109351.244704:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244714:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244723:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244729:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.244734:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244742:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244757:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x36:0x0].0x0 (ffff930aa65d7500) 00010000:00010000:3.0:1786109351.244760:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109351.244765:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244771:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35845 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244790:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244797:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244804:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244834:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786109351.244841:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x36:0x0] 00010000:00010000:3.0:1786109351.244849:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3583e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244855:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3583e lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244861:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3583e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244866:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.244869:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3583e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244875:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3583e lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244883:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd2:0x0].0x0 (ffff930aa65d7b00) 00010000:00010000:3.0:1786109351.244886:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109351.244890:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3583e lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244896:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3583e lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244908:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35830 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244914:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35830 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244920:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35830 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244925:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.244928:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35830 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244933:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35830 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244940:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.244943:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.244946:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35830 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244951:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35830 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109351.244961:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee21a7d8 reply state 000000002893c548 transno 326417514602 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35837 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244978:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35837 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.244985:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109351.244987:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109351.244990:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786109351.245049:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+51:157861:x1872862922044672:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 17915us (18186us total) trans 326417514602 rc 0/0 00000100:00100000:3.0:1786109351.245057:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 750 00010000:00010000:0.0:1786109351.245304:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109351.245312:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.245319:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030c00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109351.245324:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109351.245332:0:6514:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.245360:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.245367:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109351.245386:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.245411:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030c00/0xdb52b77d7ca3584c lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35853 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.245450:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109351.245452:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109351.245453:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109351.245464:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933115904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109351.245497:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.245705:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933115904 00000100:00100000:3.0:1786109351.245711:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933115904 00000100:00100000:3.0:1786109351.245743:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4483 00000100:00100000:3.0:1786109351.245750:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3648:x1872862933115904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109351.245761:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109351.245780:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35853 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3584c expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.245791:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x36:0x0].0x0 (ffff930a90808300) 00010000:00010000:3.0:1786109351.245799:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109351.245824:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1872862933115904:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.245830:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4483 00000100:00100000:0.0:1786109351.245890:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933115904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109351.272257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.283536:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.289635:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.291729:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922045312 00000100:00100000:1.0:1786109351.291744:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922045312 00000100:00100000:1.0:1786109351.291827:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 753 00000100:00100000:1.0:1786109351.291838:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+51:157862:x1872862922045312:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109351.291857:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.291879:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1292 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.291940:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca3588b lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.291955:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca3588b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.291966:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca3588b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109351.292013:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:1.0:1786109351.292017:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786109351.292487:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca3588b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.292521:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1292 expref: 53 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.292541:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca3588b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1292 expref: 52 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.292550:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.292553:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109351.292557:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a80030200, rc 0) 00000100:00100000:1.0:1786109351.292635:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+52:157862:x1872862922045312:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 798us (3006us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.292641:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 753 00000100:00100000:3.0:1786109351.316210:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.316936:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922045568 00000100:00100000:1.0:1786109351.316948:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922045568 00000100:00100000:1.0:1786109351.317022:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 754 00000100:00100000:1.0:1786109351.317032:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+52:157862:x1872862922045568:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1786109351.317089:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109351.317116:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca3588b lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1292 expref: 52 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.317138:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.317144:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109351.317257:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35892 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.317270:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35892 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.317280:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35892 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.317292:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c800/0xdb52b77d7ca35899 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 23 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.317303:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c800/0xdb52b77d7ca35899 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.317309:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c800/0xdb52b77d7ca35899 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109351.320026:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].444, 2152 off677456 00000040:00080000:1.0:1786109351.320107:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].325, 2352 off539280 00000004:00080000:1.0:1786109351.320113:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7cc4c00 with version 682 00000004:00080000:0.0:1786109351.321227:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 682 rpc_version 682 00000020:00100000:0.0:1786109351.321270:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109351.321281:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984ff2680 x1872862933116160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109351.321305:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933116160:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109351.322973:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.323070:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.323121:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933116160 00000100:00100000:3.0:1786109351.323130:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933116160 00000100:00100000:3.0:1786109351.323587:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12076 00000100:00100000:3.0:1786109351.323597:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933116160:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109351.324937:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933116160:12345-0@lo:1000:osp_up1-0.0 Request processed in 1338us (1966us total) trans 25769804456 rc 0/0 00000100:00100000:3.0:1786109351.324948:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12076 00000100:00100000:0.0:1786109351.325393:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933116160:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1786109351.326060:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca358a0 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.326077:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca358a0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.326088:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca358a0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.326113:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca358a7 lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.326120:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca358a7 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.326126:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca358a7 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.326161:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9400/0xdb52b77d7ca358ae lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.326168:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9400/0xdb52b77d7ca358ae lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.326250:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9400/0xdb52b77d7ca358ae lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.326272:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933116288:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1786109351.326315:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.326410:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.326600:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933116288 00000100:00100000:1.0:1786109351.326607:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933116288 00000100:00100000:1.0:1786109351.326641:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12077 00000100:00100000:1.0:1786109351.326806:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187899:x1872862933116288:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109351.326823:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.326838:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca358b5 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca358ae expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.326857:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca358b5 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca358ae expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.326868:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca358b5 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca358ae expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.326877:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x37:0x0].0x0 (ffff93098c4ae500) 00010000:00010000:1.0:1786109351.326880:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.326883:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2dc00, rc 0) 00000100:00100000:1.0:1786109351.326918:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187899:x1872862933116288:12345-0@lo:101:mdt00_000.0 Request processed in 117us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.326924:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12077 00000100:00100000:0.0:1786109351.328085:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933116288:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786109351.328108:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9400/0xdb52b77d7ca358ae lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca358b5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328119:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9400/0xdb52b77d7ca358ae lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca358b5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109351.328145:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7ba1fa1 reply state 000000006141e1c2 transno 326417514603 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca358a7 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328174:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca358a7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328192:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x37:0x0].0x0 (ffff930a90808100) 00010000:00010000:0.0:1786109351.328195:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109351.328199:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109351.328205:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9400/0xdb52b77d7ca358ae lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca358b5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328213:0:187899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9400/0xdb52b77d7ca358ae lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca358b5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109351.328224:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x37:0x0] 00000004:00010000:0.0:1786109351.328231:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7ba1fa1 reply state 000000006141e1c2 transno 326417514603 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca358a0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328239:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca358a0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328245:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd3:0x0].0x0 (ffff930a90808f00) 00010000:00010000:0.0:1786109351.328247:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109351.328249:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1786109351.328254:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd3:0x0]: returning size 4096 00010000:00010000:0.0:1786109351.328263:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35892 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328269:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35892 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328276:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35892 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328284:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.328288:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35892 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328295:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35892 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328306:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.328308:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.328311:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35892 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328317:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35892 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109351.328331:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7ba1fa1 reply state 000000006141e1c2 transno 326417514603 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c800/0xdb52b77d7ca35899 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328339:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c800/0xdb52b77d7ca35899 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.328345:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109351.328347:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109351.328349:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1786109351.328980:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+53:157862:x1872862922045568:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 11945us (12801us total) trans 326417514603 rc 0/0 00000100:00100000:0.0:1786109351.328989:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 754 00000100:00100000:3.0:1786109351.339889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.353241:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109351.353836:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922045824 00000100:00100000:0.0:1786109351.353847:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922045824 00000100:00100000:0.0:1786109351.354078:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 756 00000100:00100000:0.0:1786109351.354091:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+54:157863:x1872862922045824:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109351.354112:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.354133:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca358d8 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a12a0 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.354201:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca358df lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.354214:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca358df lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.354226:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca358df lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109351.354273:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x37:0x0]: returning size 4096 00000004:00200000:0.0:1786109351.354279:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109351.354316:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca358d8 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a0 expref: 56 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.354334:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca358df lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a0 expref: 55 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.354343:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x37:0x0].0x0 (ffff930a90808100) 00010000:00010000:0.0:1786109351.354346:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109351.354349:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8400, rc 0) 00000100:00100000:0.0:1786109351.354416:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+55:157863:x1872862922045824:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 329us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.354424:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 756 00000100:00100000:3.0:1786109351.362049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.362612:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922045952 00000100:00100000:1.0:1786109351.362622:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922045952 00000100:00100000:1.0:1786109351.362851:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 757 00000100:00100000:1.0:1786109351.362863:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:157863:x1872862922045952:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109351.362882:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.362903:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca358e6 lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a12a7 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.363032:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.363047:0:187900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca358b5 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca358ae expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.363055:0:187900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.363096:0:187900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca358b5 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca358ae expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.363110:0:187900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933116416:0@lo:104: 00000100:00100000:1.0:1786109351.363162:0:187900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.363217:0:187900:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4240 going to sleep for 11 seconds 00000100:00100000:0.0:1786109351.363348:0:10344:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786109351.363361:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933116416 00000100:00100000:0.0:1786109351.363365:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933116416 00000100:00100000:0.0:1786109351.363405:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5235 00000100:00100000:0.0:1786109351.363412:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933116416:12345-0@lo:104: 00010000:00010000:0.0:1786109351.363423:0:10344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9400/0xdb52b77d7ca358ae lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca358b5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.363872:0:10344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786109351.363879:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933116416:12345-0@lo:104: Request processed in 468us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.363887:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5235 00000100:00100000:0.0:1786109351.364263:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933116544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109351.364300:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.364544:0:187900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933116416:0@lo:104: 00010000:00010000:1.0:1786109351.364562:0:187900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786109351.368863:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804456 is committed 00010000:00010000:1.0:1786109351.369415:0:187900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.369424:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109351.369778:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x37:0x0]: returning size 4096 00000004:00200000:1.0:1786109351.369784:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786109351.369826:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca358e6 lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a7 expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.369843:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a7 expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.369851:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x37:0x0].0x0 (ffff93098c4ae500) 00010000:00010000:1.0:1786109351.369854:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786109351.369856:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2de00, rc 0) 00000100:00100000:1.0:1786109351.370128:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:157863:x1872862922045952:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 7054us (7874us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.370138:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 757 00000100:00100000:0.0:1786109351.370816:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933116544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109351.374866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1786109351.376245:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109351.376277:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca358d1 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1299 expref: 55 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376297:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd3:0x0].0x0 (ffff930a90808f00) 00010000:00010000:3.0:1786109351.376302:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109351.376324:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca358f4 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376347:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca358f4 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376357:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca358f4 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376370:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca358fb lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 24 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376381:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca358fb lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376393:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca358fb lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376504:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35902 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376513:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35902 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376519:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35902 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376536:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376546:0:188678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca358df lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a0 expref: 54 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376554:0:188678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376587:0:188678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca358df lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a0 expref: 54 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.376601:0:188678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca358df lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a0 expref: 54 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.376616:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c344380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933116672:192.168.203.38@tcp:104: 00000100:00100000:3.0:1786109351.376830:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.380892:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c344380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933116672:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109351.380932:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.380956:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922046336 00000100:00100000:1.0:1786109351.380963:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922046336 00010000:00010000:1.0:1786109351.380998:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca358df lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a0 expref: 55 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.381075:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12597 00000100:00100000:1.0:1786109351.381086:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:397d331e-10fc-4558-be87-308c3622e8eb+55:2402:x1872862922046336:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109351.381101:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109351.381109:0:43921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca358df lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a0 expref: 55 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.381121:0:43921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca358df lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a0 expref: 55 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.381143:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca358df lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a0 expref: 55 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.381158:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x37:0x0].0x0 (ffff930a90808100) 00010000:00010000:1.0:1786109351.381163:0:43921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.381172:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.381191:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.381224:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109351.381286:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:397d331e-10fc-4558-be87-308c3622e8eb+54:2402:x1872862922046336:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 200us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.381293:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12597 00010000:00010000:3.0:1786109351.381346:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.381355:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.381396:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.381416:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.381426:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.381460:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c344380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933116800:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1786109351.381499:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.382375:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.382519:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933116800 00000100:00100000:1.0:1786109351.382526:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933116800 00000100:00100000:1.0:1786109351.382564:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12078 00000100:00100000:1.0:1786109351.382574:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188678:x1872862933116800:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786109351.382590:0:177399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.382606:0:177399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35917 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35910 expref: -99 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.382629:0:177399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a7 expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.382639:0:177399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35917 lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35910 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.382665:0:177399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a7 expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.382867:0:177399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a7 expref: 6 pid: 187900 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.382883:0:177399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177399:1872862933116928:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109351.383029:0:177399:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4240 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.386156:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922046464 00000100:00100000:3.0:1786109351.386165:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922046464 00010000:00010000:3.0:1786109351.386210:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a7 expref: 7 pid: 187900 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.386251:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12598 00000100:00100000:3.0:1786109351.386261:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:397d331e-10fc-4558-be87-308c3622e8eb+7:2403:x1872862922046464:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109351.386276:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109351.386283:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a7 expref: 7 pid: 187900 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.386296:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a7 expref: 7 pid: 187900 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.386317:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x37:0x0].0x0 (ffff93098c4ae500) 00010000:00010000:3.0:1786109351.386323:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35917 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35910 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.386334:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35917 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca35910 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.386343:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35917 lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca35910 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.386372:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35917 lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35910 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.386384:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c344700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6511:1872862933117056:0@lo:105: 00000100:00100000:3.0:1786109351.386454:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.386500:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34540 going to sleep for 11 seconds 00010000:00010000:1.0:1786109351.386584:0:177399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca358ed lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12a7 expref: 7 pid: 187900 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.386599:0:177399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177399:1872862933116928:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109351.386622:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35917 lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35910 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.386629:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x37:0x0].0x0 (ffff93098c4ae500) 00010000:00010000:1.0:1786109351.386632:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109351.386634:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d000, rc 0) 00000100:00100000:1.0:1786109351.386753:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933116800:12345-0@lo:101:mdt00_003.0 Request processed in 4181us (5252us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.386762:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12078 00000100:00100000:0.0:1786109351.386882:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933117056 00000100:00100000:0.0:1786109351.386887:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933117056 00000100:00100000:0.0:1786109351.386945:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5236 00000100:00100000:0.0:1786109351.386954:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c347800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6511:x1872862933117056:12345-0@lo:105: 00010000:00010000:0.0:1786109351.386965:0:6509:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35917 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.386974:0:6509:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35917 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.386983:0:6509:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35917 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.386995:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35917 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.387003:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35917 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.387011:0:6509:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35917 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.387023:0:6509:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff93098cd76c00) 00000100:00100000:0.0:1786109351.387067:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c347800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6511:x1872862933117056:12345-0@lo:105: Request processed in 115us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.387073:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5236 00000100:00100000:3.0:1786109351.387193:0:188678:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804456 gen 2 00000004:00080000:3.0:1786109351.387200:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804455 committed transno 25769804456 00000004:00080000:3.0:1786109351.387221:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804456 committed transno 25769804456 00000100:00100000:3.0:1786109351.387234:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c344380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933116800:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786109351.387248:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35917 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.388292:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c344380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933117184:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1786109351.388341:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.388422:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.391270:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933117184 00000100:00100000:1.0:1786109351.391286:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933117184 00000100:00100000:1.0:1786109351.391350:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12079 00000100:00100000:1.0:1786109351.391360:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933117184:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1786109351.393962:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933117184:12345-0@lo:403:mdt00_003.0 Request processed in 2595us (5610us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.393976:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12079 00000100:00100000:3.0:1786109351.394054:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c344380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933117184:0@lo:403:mdt00_003.0 00000040:00080000:3.0:1786109351.395132:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].445, 656 off678112 00000040:00080000:3.0:1786109351.395329:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].326, 736 off540016 00000004:00080000:3.0:1786109351.395335:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d34d80 with version 683 00000004:00080000:0.0:1786109351.395589:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 683 rpc_version 683 00000020:00100000:0.0:1786109351.399318:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109351.399335:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f53100 x1872862933117440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109351.399361:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f53100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933117440:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109351.399617:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.399652:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.399727:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933117440 00000100:00100000:3.0:1786109351.399734:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933117440 00000100:00100000:3.0:1786109351.399802:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12080 00000100:00100000:3.0:1786109351.399811:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933117440:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109351.400056:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933117440:12345-0@lo:1000:osp_up1-0.0 Request processed in 245us (439us total) trans 25769804457 rc 0/0 00000100:00100000:3.0:1786109351.400065:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12080 00000004:00200000:3.0:1786109351.400265:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd3:0x0]: returning size 4096 00010000:00010000:3.0:1786109351.400286:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400296:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400304:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400309:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.400314:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400326:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400341:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x37:0x0].0x0 (ffff930a90808100) 00010000:00010000:3.0:1786109351.400343:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109351.400347:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400353:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca35909 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400367:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35917 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400376:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35917 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400383:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76c00/0xdb52b77d7ca35910 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35917 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400524:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786109351.400534:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x37:0x0] 00010000:00010000:3.0:1786109351.400541:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35902 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400547:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35902 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400553:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35902 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400563:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.400566:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35902 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400572:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35902 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400581:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd3:0x0].0x0 (ffff930a90808f00) 00010000:00010000:3.0:1786109351.400583:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109351.400586:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35902 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400592:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca35902 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400604:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca358f4 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400610:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca358f4 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400616:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca358f4 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400621:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.400623:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca358f4 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400629:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca358f4 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400639:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.400642:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.400644:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca358f4 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400650:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca358f4 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109351.400658:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db1530c3 reply state 00000000a7288338 transno 326417514604 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca358fb lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400669:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca358fb lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.400676:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109351.400678:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109351.400680:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786109351.400835:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+55:157863:x1872862922046208:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 25686us (25974us total) trans 326417514604 rc 0/0 00000100:00100000:3.0:1786109351.400842:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 758 00000100:00100000:3.0:1786109351.401046:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109351.401058:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933117568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109351.401090:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.415359:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922046592 00000100:00100000:3.0:1786109351.415370:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922046592 00000100:00100000:3.0:1786109351.415583:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 759 00000100:00100000:3.0:1786109351.415594:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+55:157864:x1872862922046592:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109351.415620:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.415644:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca3591e lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a12ae expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415708:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca35925 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415723:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca35925 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415735:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca35925 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415747:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3592c lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 25 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415755:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3592c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415762:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3592c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415803:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca35925 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415811:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca35925 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415818:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca35925 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415825:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.415829:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca35925 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415837:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca35925 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415849:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.415852:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.415857:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca35925 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415864:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca35925 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415876:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3592c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415883:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3592c lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415889:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3592c lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415894:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.415897:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3592c lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415903:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3592c lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415910:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109351.415913:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.415916:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3592c lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415922:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca3592c lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415947:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca3591e lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ae expref: 56 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415957:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.415959:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.415963:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca3591e lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ae expref: 56 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.415971:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76000, rc 0) 00000100:00100000:3.0:1786109351.416033:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+55:157864:x1872862922046592:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 441us (774us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109351.416041:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 759 00000100:00100000:0.0:1786109351.423322:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.423406:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922046720 00000100:00100000:1.0:1786109351.423414:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922046720 00000100:00100000:1.0:1786109351.423504:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 760 00000100:00100000:1.0:1786109351.423514:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+55:157864:x1872862922046720:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109351.423533:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.423554:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca35933 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a12b5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423624:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3593a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423637:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3593a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423649:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3593a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423660:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35941 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 25 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423667:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35941 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423674:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35941 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423712:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3593a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423719:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3593a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423726:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3593a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423732:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.423736:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3593a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423747:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3593a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423759:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.423762:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.423767:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3593a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423773:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3593a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423786:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35941 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423793:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35941 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423799:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35941 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423804:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.423807:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35941 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423813:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35941 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423821:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109351.423823:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.423826:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35941 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423832:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35941 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423859:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca35933 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12b5 expref: 56 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423869:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.423872:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.423875:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca35933 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12b5 expref: 56 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.423884:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2de00, rc 0) 00000100:00100000:1.0:1786109351.423937:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+55:157864:x1872862922046720:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 425us (624us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109351.423944:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 760 00000100:00100000:0.0:1786109351.428020:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.428120:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922046848 00000100:00100000:3.0:1786109351.428134:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922046848 00000100:00100000:3.0:1786109351.428229:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 761 00000100:00100000:3.0:1786109351.428240:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+55:157864:x1872862922046848:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109351.428261:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.428280:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35948 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a12bc expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.428344:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3594f lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.428358:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3594f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.428370:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3594f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109351.428462:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:3.0:1786109351.428467:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109351.428487:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3594f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.428512:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35948 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12bc expref: 57 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.428528:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3594f lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12bc expref: 56 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.428536:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.428539:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109351.428542:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35e00, rc 0) 00000100:00100000:3.0:1786109351.428591:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+56:157864:x1872862922046848:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 353us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.428598:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 761 00000100:00100000:0.0:1786109351.433322:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.433570:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922047104 00000100:00100000:1.0:1786109351.433579:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922047104 00000100:00100000:0.0:1786109351.433734:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 762 00000100:00100000:0.0:1786109351.433745:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+56:157864:x1872862922047104:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:0.0:1786109351.433804:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109351.433829:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca3594f lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12bc expref: 56 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.433846:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.433851:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109351.433911:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35956 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.433924:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35956 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.433933:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35956 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.433945:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca3595d lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 25 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.433957:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca3595d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.433964:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca3595d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109351.434796:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].446, 2152 off680264 00000040:00080000:0.0:1786109351.434870:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].327, 2352 off542368 00000004:00080000:0.0:1786109351.434876:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab9687c00 with version 684 00000100:00100000:0.0:1786109351.435262:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933117824 00000100:00100000:0.0:1786109351.435269:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933117824 00000100:00100000:0.0:1786109351.435320:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12081 00000100:00100000:0.0:1786109351.435328:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933117824:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109351.436007:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933117824:12345-0@lo:1000:osp_up1-0.0 Request processed in 677us (848us total) trans 25769804458 rc 0/0 00000100:00100000:0.0:1786109351.436015:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12081 00010000:00010000:0.0:1786109351.436315:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35964 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.436330:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35964 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.436342:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35964 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.436361:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3596b lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.436368:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3596b lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.436375:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3596b lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.436645:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9200/0xdb52b77d7ca35972 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.436654:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9200/0xdb52b77d7ca35972 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.436664:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9200/0xdb52b77d7ca35972 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.436680:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933117952:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1786109351.436718:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.436772:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f240 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.436807:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933117952 00000100:00100000:3.0:1786109351.436813:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933117952 00000100:00100000:3.0:1786109351.436877:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12082 00000100:00100000:3.0:1786109351.436885:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187899:x1872862933117952:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786109351.436901:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.436918:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35979 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35972 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.436943:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35979 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35972 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.436955:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35979 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35972 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.436964:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x38:0x0].0x0 (ffff930985b9dc00) 00010000:00010000:3.0:1786109351.436967:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.436971:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34e00, rc 0) 00000100:00100000:3.0:1786109351.437019:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187899:x1872862933117952:12345-0@lo:101:mdt00_000.0 Request processed in 135us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.437025:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12082 00000100:00100000:1.0:1786109351.437082:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933117952:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109351.437095:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9200/0xdb52b77d7ca35972 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35979 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437105:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9200/0xdb52b77d7ca35972 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35979 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109351.437124:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2316ae9 reply state 00000000ac2bb30d transno 326417514605 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3596b lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437142:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3596b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437148:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x38:0x0].0x0 (ffff930a90808800) 00010000:00010000:1.0:1786109351.437151:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109351.437153:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109351.437159:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9200/0xdb52b77d7ca35972 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35979 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437166:0:187899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9200/0xdb52b77d7ca35972 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35979 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109351.437208:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x38:0x0] 00000004:00010000:1.0:1786109351.437216:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2316ae9 reply state 00000000ac2bb30d transno 326417514605 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35964 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437225:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35964 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437231:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd4:0x0].0x0 (ffff930a90808e00) 00010000:00010000:1.0:1786109351.437233:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109351.437235:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1786109351.437240:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd4:0x0]: returning size 4096 00010000:00010000:1.0:1786109351.437248:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35956 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437253:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35956 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437260:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35956 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437267:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.437271:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35956 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437279:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35956 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437289:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.437291:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.437294:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35956 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437300:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35956 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109351.437315:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2316ae9 reply state 00000000ac2bb30d transno 326417514605 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca3595d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437324:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca3595d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.437330:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109351.437332:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109351.437334:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1786109351.437420:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+57:157864:x1872862922047104:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 3675us (4106us total) trans 326417514605 rc 0/0 00000100:00100000:1.0:1786109351.437428:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 762 00000100:00100000:0.0:1786109351.448074:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.448347:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922047232 00000100:00100000:1.0:1786109351.448357:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922047232 00000100:00100000:1.0:1786109351.448521:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 763 00000100:00100000:1.0:1786109351.448533:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+57:157865:x1872862922047232:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109351.448558:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.448579:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca35980 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a12c3 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448642:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35987 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448656:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35987 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448667:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35987 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448678:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3598e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 26 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448685:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3598e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448692:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3598e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448767:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35995 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448776:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35995 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448784:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35995 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109351.448863:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd4:0x0]: returning size 4096 00000004:00200000:1.0:1786109351.448869:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1786109351.448890:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35995 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448903:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35987 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448910:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35987 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448917:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35987 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448923:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.448927:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35987 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448934:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35987 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448946:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.448949:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.448953:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35987 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448960:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35987 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448973:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3598e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448985:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3598e lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448990:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3598e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.448996:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.448999:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3598e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.449005:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3598e lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.449013:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109351.449015:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.449018:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3598e lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.449023:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca3598e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.449047:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca35980 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12c3 expref: 59 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.449061:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35995 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12c3 expref: 58 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.449068:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd4:0x0].0x0 (ffff930a90808e00) 00010000:00010000:1.0:1786109351.449071:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109351.449074:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2c000, rc 0) 00000100:00100000:1.0:1786109351.449143:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+58:157865:x1872862922047232:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 612us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.449150:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 763 00000100:00100000:1.0:1786109351.456539:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922047360 00000100:00100000:1.0:1786109351.456550:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922047360 00000100:00100000:1.0:1786109351.456606:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 764 00000100:00100000:1.0:1786109351.456616:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+58:157865:x1872862922047360:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109351.456636:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.456657:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca3599c lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a12ca expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.456720:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359a3 lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.456735:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359a3 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.456747:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359a3 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109351.456797:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x38:0x0]: returning size 4096 00000004:00200000:1.0:1786109351.456802:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786109351.456836:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca3599c lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ca expref: 60 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.456855:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359a3 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ca expref: 59 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.456870:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x38:0x0].0x0 (ffff930a90808800) 00010000:00010000:1.0:1786109351.456873:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786109351.456877:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d200, rc 0) 00000100:00100000:1.0:1786109351.456941:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+59:157865:x1872862922047360:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 327us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.456949:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 764 00000100:00100000:0.0:1786109351.461691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.461791:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922047488 00000100:00100000:3.0:1786109351.461800:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922047488 00000100:00100000:3.0:1786109351.461896:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 765 00000100:00100000:3.0:1786109351.461907:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:157865:x1872862922047488:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109351.461940:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.461961:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34600/0xdb52b77d7ca359aa lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a12d1 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.462019:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.462033:0:187901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35979 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35972 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.462041:0:187901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.462073:0:187901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35979 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35972 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.462088:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c345880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933118080:0@lo:104: 00000100:00100000:3.0:1786109351.462134:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.462200:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1e480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109351.462256:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933118080 00000100:00100000:0.0:1786109351.462261:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933118080 00000100:00100000:0.0:1786109351.462306:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5237 00000100:00100000:0.0:1786109351.462314:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c347100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933118080:12345-0@lo:104: 00010000:00010000:0.0:1786109351.462326:0:10344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9200/0xdb52b77d7ca35972 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35979 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.462513:0:10344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786109351.462520:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c347100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933118080:12345-0@lo:104: Request processed in 207us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.462528:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5237 00000100:00100000:3.0:1786109351.464989:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c345880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933118080:0@lo:104: 00010000:00010000:3.0:1786109351.465015:0:187901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786109351.465140:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804458 is committed 00000100:00100000:1.0:1786109351.465706:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933118208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109351.465794:0:187901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.465803:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109351.465929:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x38:0x0]: returning size 4096 00000004:00200000:0.0:1786109351.465936:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109351.465981:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34600/0xdb52b77d7ca359aa lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12d1 expref: 8 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.465997:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12d1 expref: 7 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.466005:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x38:0x0].0x0 (ffff930985b9dc00) 00010000:00010000:0.0:1786109351.466008:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109351.466011:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34800, rc 0) 00000100:00100000:0.0:1786109351.466093:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:157865:x1872862922047488:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 4187us (4424us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.466101:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 765 00000100:00100000:0.0:1786109351.469746:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.469846:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922047744 00000100:00100000:1.0:1786109351.469856:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922047744 00000100:00100000:1.0:1786109351.469952:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 766 00000100:00100000:1.0:1786109351.469962:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+59:157865:x1872862922047744:12345-192.168.203.38@tcp:36:rmdir.0 00010000:00010000:1.0:1786109351.470013:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109351.470039:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35995 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12c3 expref: 59 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470058:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd4:0x0].0x0 (ffff930a90808e00) 00010000:00010000:1.0:1786109351.470063:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109351.470084:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca359b8 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470097:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca359b8 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470105:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca359b8 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470119:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca359bf lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 26 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470131:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca359bf lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470138:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca359bf lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470224:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca359c6 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470233:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca359c6 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470240:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca359c6 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470256:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca359cd lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470265:0:188678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359a3 lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ca expref: 58 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470273:0:188678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca359cd lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470305:0:188678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359a3 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ca expref: 58 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.470323:0:188678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359a3 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ca expref: 58 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.470338:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933118336:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109351.470657:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4240 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.473745:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922047872 00000100:00100000:3.0:1786109351.473753:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922047872 00010000:00010000:3.0:1786109351.473788:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359a3 lrc: 5/0,0 mode: PR/PR res: [0x2000255c0:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ca expref: 59 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.473828:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12600 00000100:00100000:3.0:1786109351.473837:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397d331e-10fc-4558-be87-308c3622e8eb+59:2402:x1872862922047872:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109351.473850:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109351.473857:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359a3 lrc: 5/0,0 mode: PR/PR res: [0x2000255c0:0x38:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ca expref: 59 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.473875:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359a3 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x38:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ca expref: 59 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.473895:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x38:0x0].0x0 (ffff930a90808800) 00010000:00010000:3.0:1786109351.473901:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca359cd lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x38:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.473910:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca359cd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x38:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.473927:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca359cd lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x38:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.473942:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109351.473990:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397d331e-10fc-4558-be87-308c3622e8eb+59:2402:x1872862922047872:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 154us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.473997:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12600 00010000:00010000:1.0:1786109351.474168:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359a3 lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ca expref: 58 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.474195:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933118336:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109351.474216:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca359cd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.474225:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca359cd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.474230:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca359cd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.474271:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.474279:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.474288:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.474305:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933118464:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1786109351.474341:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.474373:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4240 going to sleep for 11 seconds 00000100:00100000:0.0:1786109351.474420:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933118464 00000100:00100000:0.0:1786109351.474425:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933118464 00000100:00100000:0.0:1786109351.474487:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12083 00000100:00100000:0.0:1786109351.474495:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188678:x1872862933118464:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109351.474509:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.474521:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca359db lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca359d4 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.474541:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12d1 expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.474549:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca359db lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca359d4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.474573:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12d1 expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.474585:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12d1 expref: 6 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.474595:0:8452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8452:1872862933118592:192.168.203.38@tcp:104: 00000100:00100000:0.0:1786109351.474649:0:8452:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.478225:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922048000 00000100:00100000:3.0:1786109351.478234:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922048000 00010000:00010000:3.0:1786109351.478270:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12d1 expref: 7 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.478308:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12601 00000100:00100000:3.0:1786109351.478318:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:397d331e-10fc-4558-be87-308c3622e8eb+7:2403:x1872862922048000:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109351.478331:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109351.478337:0:177416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12d1 expref: 7 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.478354:0:177416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12d1 expref: 7 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.478375:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x38:0x0].0x0 (ffff930985b9dc00) 00010000:00010000:3.0:1786109351.478381:0:177416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca359db lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca359d4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.478392:0:177416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca359db lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca359d4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.478410:0:177416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca359db lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca359d4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.478473:0:177416:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca359db lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca359d4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.478488:0:177416:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c345880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:177416:1872862933118720:0@lo:105: 00000100:00100000:3.0:1786109351.478534:0:177416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.478580:0:177416:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1e480 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.478654:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933118720 00000100:00100000:1.0:1786109351.478659:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933118720 00000100:00100000:1.0:1786109351.478697:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5238 00000100:00100000:1.0:1786109351.478703:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c346a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:177416:x1872862933118720:12345-0@lo:105: 00010000:00010000:1.0:1786109351.478713:0:6510:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.478722:0:6510:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.478729:0:6510:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.478736:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.478742:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.478749:0:6510:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.478763:0:6510:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ac0b2da00) 00000100:00100000:1.0:1786109351.478801:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c346a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:177416:x1872862933118720:12345-0@lo:105: Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.478808:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5238 00000100:00100000:3.0:1786109351.478934:0:177416:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c345880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:177416:1872862933118720:0@lo:105: 00010000:00010000:3.0:1786109351.478948:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109351.478995:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:397d331e-10fc-4558-be87-308c3622e8eb+7:2403:x1872862922048000:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 678us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.479002:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12601 00010000:00010000:0.0:1786109351.480962:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c34800/0xdb52b77d7ca359b1 lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12d1 expref: 6 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.480989:0:8452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8452:1872862933118592:192.168.203.38@tcp:104: 00010000:00010000:0.0:1786109351.481126:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca359db lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca359d4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.481137:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x38:0x0].0x0 (ffff930985b9dc00) 00010000:00010000:0.0:1786109351.481140:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109351.481143:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9a00, rc 0) 00000100:00100000:0.0:1786109351.481302:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933118464:12345-0@lo:101:mdt00_003.0 Request processed in 6807us (6959us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.481311:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12083 00000100:00100000:1.0:1786109351.481339:0:188678:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804458 gen 2 00000004:00080000:1.0:1786109351.481345:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804457 committed transno 25769804458 00000004:00080000:1.0:1786109351.481362:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804458 committed transno 25769804458 00000100:00100000:1.0:1786109351.481377:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933118464:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786109351.481392:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.482560:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933118848:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1786109351.482621:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.482693:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.482737:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933118848 00000100:00100000:1.0:1786109351.482743:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933118848 00000100:00100000:1.0:1786109351.482794:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12084 00000100:00100000:1.0:1786109351.482803:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933118848:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1786109351.485136:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933118848:12345-0@lo:403:mdt00_003.0 Request processed in 2327us (2506us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.485150:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12084 00000100:00100000:3.0:1786109351.485318:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933118848:0@lo:403:mdt00_003.0 00000040:00080000:3.0:1786109351.487641:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].447, 656 off680920 00000040:00080000:3.0:1786109351.488133:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].328, 736 off543104 00000004:00080000:3.0:1786109351.488141:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e480 with version 685 00000100:00100000:3.0:1786109351.488624:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2e300 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.488676:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933119104 00000100:00100000:1.0:1786109351.488684:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933119104 00000100:00100000:3.0:1786109351.488820:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12085 00000100:00100000:3.0:1786109351.488829:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933119104:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109351.489059:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933119104:12345-0@lo:1000:osp_up1-0.0 Request processed in 230us (690us total) trans 25769804459 rc 0/0 00000100:00100000:3.0:1786109351.489066:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12085 00000100:00100000:1.0:1786109351.489159:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fba680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933119104:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786109351.489746:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109351.489752:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.489760:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2da00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109351.489764:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109351.489772:0:6514:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.489801:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.489813:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109351.489840:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.489847:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca359d4 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca359db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.489863:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109351.489865:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109351.489868:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109351.489875:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109351.489887:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933119232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109351.489921:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.489956:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933119232 00000100:00100000:1.0:1786109351.489961:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933119232 00000100:00100000:1.0:1786109351.489994:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4485 00000100:00100000:1.0:1786109351.490001:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3649:x1872862933119232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109351.490011:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109351.490028:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca359db lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca359d4 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.490038:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x38:0x0].0x0 (ffff930985b9dc00) 00010000:00010000:1.0:1786109351.490046:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109351.490074:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3649:x1872862933119232:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.490080:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4485 00000100:00100000:1.0:1786109351.490112:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933119232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109351.503964:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922048128 00000100:00100000:1.0:1786109351.503974:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922048128 00000100:00100000:1.0:1786109351.504076:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 767 00000100:00100000:1.0:1786109351.504089:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+59:157866:x1872862922048128:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109351.504114:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.504134:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359e2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a12d8 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504207:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca359e9 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504220:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca359e9 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504232:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca359e9 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504243:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca359f0 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 27 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504251:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca359f0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504257:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca359f0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504292:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca359e9 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504299:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca359e9 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504307:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca359e9 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504314:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.504318:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca359e9 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504325:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca359e9 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504336:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.504340:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.504344:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca359e9 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504350:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca359e9 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504362:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca359f0 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504369:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca359f0 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504375:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca359f0 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504380:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.504383:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca359f0 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504394:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca359f0 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504401:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109351.504404:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.504407:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca359f0 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504412:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca359f0 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504475:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359e2 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12d8 expref: 60 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504486:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.504488:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.504492:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca359e2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12d8 expref: 60 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.504502:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d200, rc 0) 00000100:00100000:1.0:1786109351.504557:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+59:157866:x1872862922048128:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 472us (699us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109351.504565:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 767 00000100:00100000:3.0:1786109351.509602:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109351.516035:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922048384 00000100:00100000:0.0:1786109351.516044:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922048384 00000100:00100000:0.0:1786109351.516130:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 769 00000100:00100000:0.0:1786109351.516141:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+59:157866:x1872862922048384:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109351.516160:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.516188:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35a0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a12e6 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.516256:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35a13 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.516270:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35a13 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.516281:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35a13 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109351.516325:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:0.0:1786109351.516329:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109351.516348:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35a13 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.516372:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35a0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12e6 expref: 61 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.516392:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35a13 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12e6 expref: 60 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.516400:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.516403:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109351.516407:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8400, rc 0) 00000100:00100000:0.0:1786109351.516501:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+60:157866:x1872862922048384:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 362us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.516519:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 769 00000100:00100000:0.0:1786109351.520652:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.520891:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922048640 00000100:00100000:3.0:1786109351.520901:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922048640 00000100:00100000:3.0:1786109351.521000:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 770 00000100:00100000:3.0:1786109351.521010:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+60:157866:x1872862922048640:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:3.0:1786109351.521068:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109351.521095:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35a13 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12e6 expref: 60 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.521113:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.521118:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109351.521196:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35a1a lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.521210:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35a1a lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.521220:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35a1a lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.521235:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35a21 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 27 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.521246:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35a21 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.521253:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35a21 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786109351.522152:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].448, 2152 off683072 00000040:00080000:3.0:1786109351.522240:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].329, 2352 off545456 00000004:00080000:3.0:1786109351.522247:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e300 with version 686 00000004:00080000:1.0:1786109351.522650:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 686 rpc_version 686 00000020:00100000:1.0:1786109351.522683:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109351.522692:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930986553800 x1872862933119488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109351.522719:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933119488:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109351.522778:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.522842:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4240 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.522885:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933119488 00000100:00100000:3.0:1786109351.522891:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933119488 00000100:00100000:3.0:1786109351.522963:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12086 00000100:00100000:3.0:1786109351.522972:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933119488:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109351.523714:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933119488:12345-0@lo:1000:osp_up1-0.0 Request processed in 742us (934us total) trans 25769804460 rc 0/0 00000100:00100000:3.0:1786109351.523724:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12086 00000100:00100000:1.0:1786109351.523828:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933119488:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109351.524309:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933119616 00000100:00100000:0.0:1786109351.524315:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933119616 00000100:00100000:0.0:1786109351.524362:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12087 00000100:00100000:0.0:1786109351.524370:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188678:x1872862933119616:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109351.524386:0:177399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.524414:0:177399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35a3d lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35a36 expref: -99 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.524453:0:177399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35a3d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35a36 expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.524465:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35a3d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35a36 expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.524475:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x39:0x0].0x0 (ffff930a90808900) 00010000:00010000:0.0:1786109351.524479:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.524482:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9600, rc 0) 00000100:00100000:0.0:1786109351.524514:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188678:x1872862933119616:12345-0@lo:101:mdt00_003.0 Request processed in 146us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.524521:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12087 00000100:00100000:3.0:1786109351.535940:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.536023:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922048768 00000100:00100000:1.0:1786109351.536032:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922048768 00000100:00100000:1.0:1786109351.536090:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 771 00000100:00100000:1.0:1786109351.536100:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+61:157867:x1872862922048768:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109351.536123:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.536144:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35a44 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a12ed expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536222:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35a4b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536236:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35a4b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536246:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35a4b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536257:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a52 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 28 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536265:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a52 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536272:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a52 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536340:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35a59 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536349:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35a59 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536356:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35a59 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109351.536473:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd5:0x0]: returning size 4096 00000004:00200000:1.0:1786109351.536479:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1786109351.536498:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35a59 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536511:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35a4b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536516:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35a4b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536522:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35a4b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536528:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.536532:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35a4b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536539:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35a4b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536551:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.536555:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.536559:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35a4b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536565:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35a4b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536576:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a52 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536583:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a52 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536589:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a52 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536593:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.536596:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a52 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536602:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a52 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536609:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109351.536612:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.536615:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a52 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536620:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a52 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536646:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35a44 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ed expref: 63 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536659:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35a59 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dd5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12ed expref: 62 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.536667:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd5:0x0].0x0 (ffff930984516400) 00010000:00010000:1.0:1786109351.536670:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109351.536672:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2da00, rc 0) 00000100:00100000:1.0:1786109351.536732:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+62:157867:x1872862922048768:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 633us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.536739:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 771 00000100:00100000:0.0:1786109351.540061:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.543799:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922049024 00000100:00100000:1.0:1786109351.543808:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922049024 00000100:00100000:1.0:1786109351.543907:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 773 00000100:00100000:1.0:1786109351.543930:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:157867:x1872862922049024:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109351.543949:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.543968:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35a6e lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a12fb expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.544025:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.544040:0:187900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35a3d lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35a36 expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.544050:0:187900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.544082:0:187900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35a3d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35a36 expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.544097:0:187900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933119744:0@lo:104: 00000100:00100000:1.0:1786109351.544139:0:187900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.544237:0:187900:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4240 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.544582:0:187900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933119744:0@lo:104: 00010000:00010000:3.0:1786109351.544599:0:187900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.544677:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109351.544685:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6c200/0xdb52b77d7ca35a36 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35a3d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.544692:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c200 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109351.544697:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6c200/0xdb52b77d7ca35a36 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca35a3d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109351.544706:0:29734:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6c200/0xdb52b77d7ca35a36 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca35a3d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.544736:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6c200/0xdb52b77d7ca35a36 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35a3d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.544742:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109351.544764:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6c200/0xdb52b77d7ca35a36 lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35a3d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.544771:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6c200/0xdb52b77d7ca35a36 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35a3d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.544788:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109351.544790:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109351.544792:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109351.544800:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109351.544810:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933119872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109351.544840:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.544869:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933119872 00000100:00100000:0.0:1786109351.544873:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933119872 00010000:00010000:0.0:1786109351.544891:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35a3d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca35a36 expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.544914:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12602 00000100:00100000:0.0:1786109351.544921:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3648:x1872862933119872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109351.544929:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1786109351.546822:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804460 is committed 00010000:00010000:3.0:1786109351.546945:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35a3d lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca35a36 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.546962:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x39:0x0].0x0 (ffff930a90808900) 00010000:00010000:3.0:1786109351.546968:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.546977:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.546984:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.547021:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109351.547084:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933119872:12345-0@lo:103:ldlm_bl.0 Request processed in 2163us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.547092:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12602 00000100:00100000:3.0:1786109351.547142:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933119872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109351.547206:0:187900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.547218:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109351.547268:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x39:0x0]: returning size 4096 00000004:00200000:0.0:1786109351.547274:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109351.547313:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35a6e lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12fb expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.547330:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12fb expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.547337:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x39:0x0].0x0 (ffff930a90808900) 00010000:00010000:0.0:1786109351.547340:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109351.547342:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2ce00, rc 0) 00000100:00100000:0.0:1786109351.547456:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:157867:x1872862922049024:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 3541us (3813us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.547464:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 773 00000100:00100000:3.0:1786109351.550850:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.554255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109351.554617:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922049408 00000100:00100000:0.0:1786109351.554626:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922049408 00010000:00010000:0.0:1786109351.554662:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35a67 lrc: 5/0,0 mode: PR/PR res: [0x2000255c0:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12f4 expref: 63 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.554862:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12603 00000100:00100000:0.0:1786109351.554873:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+63:2403:x1872862922049408:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109351.554888:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109351.554895:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35a67 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x39:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12f4 expref: 63 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.554906:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35a67 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x39:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12f4 expref: 63 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.554928:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35a67 lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x39:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12f4 expref: 63 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.554942:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x39:0x0].0x0 (ffff930984516d00) 00010000:00010000:0.0:1786109351.554945:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca35a91 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.554955:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca35a91 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.554962:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca35a91 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.554991:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109351.555049:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+62:2403:x1872862922049408:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 178us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.555057:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12603 00000100:00100000:1.0:1786109351.555456:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933120128 00000100:00100000:1.0:1786109351.555461:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933120128 00000100:00100000:1.0:1786109351.555493:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12088 00000100:00100000:1.0:1786109351.555501:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187899:x1872862933120128:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109351.555515:0:177399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.555528:0:177399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a9f lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35a98 expref: -99 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.555547:0:177399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12fb expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.555557:0:177399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a9f lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35a98 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.555580:0:177399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12fb expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.555591:0:177399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12fb expref: 6 pid: 187900 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.555602:0:177399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177399:1872862933120256:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109351.555658:0:177399:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.559421:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109351.559520:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922049536 00000100:00100000:0.0:1786109351.559530:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922049536 00010000:00010000:0.0:1786109351.559569:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12fb expref: 7 pid: 187900 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.559613:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12604 00000100:00100000:0.0:1786109351.559622:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:397d331e-10fc-4558-be87-308c3622e8eb+7:2403:x1872862922049536:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109351.559639:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109351.559645:0:43921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12fb expref: 7 pid: 187900 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.559658:0:43921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12fb expref: 7 pid: 187900 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.559679:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x39:0x0].0x0 (ffff930a90808900) 00010000:00010000:0.0:1786109351.559685:0:43921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a9f lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35a98 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.559695:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a9f lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca35a98 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.559704:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a9f lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca35a98 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.559734:0:43921:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a9f lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35a98 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.559747:0:43921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c2ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:43921:1872862933120384:0@lo:105: 00000100:00100000:0.0:1786109351.559787:0:43921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.559827:0:43921:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.559935:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933120384 00000100:00100000:3.0:1786109351.559939:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933120384 00000100:00100000:3.0:1786109351.559982:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5240 00000100:00100000:3.0:1786109351.559989:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:43921:x1872862933120384:12345-0@lo:105: 00010000:00010000:3.0:1786109351.560001:0:6509:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.560009:0:6509:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.560017:0:6509:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.560029:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.560036:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.560044:0:6509:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.560060:0:6509:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ab8f6d600) 00000100:00100000:3.0:1786109351.560101:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:43921:x1872862933120384:12345-0@lo:105: Request processed in 112us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.560108:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5240 00000100:00100000:3.0:1786109351.560149:0:43921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c2ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:43921:1872862933120384:0@lo:105: 00010000:00010000:3.0:1786109351.560165:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109351.560218:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:397d331e-10fc-4558-be87-308c3622e8eb+7:2403:x1872862922049536:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 596us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.560225:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12604 00010000:00010000:1.0:1786109351.560396:0:177399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35a75 lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x39:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a12fb expref: 6 pid: 187900 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.560417:0:177399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177399:1872862933120256:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109351.560473:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a9f lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35a98 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.560482:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x39:0x0].0x0 (ffff930a90808900) 00010000:00010000:1.0:1786109351.560485:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109351.560487:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2c000, rc 0) 00000100:00100000:1.0:1786109351.560525:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933120128:12345-0@lo:101:mdt00_000.0 Request processed in 5024us (5168us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.560531:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12088 00000100:00100000:3.0:1786109351.560826:0:187899:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804460 gen 2 00000004:00080000:3.0:1786109351.560832:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804459 committed transno 25769804460 00000004:00080000:3.0:1786109351.560848:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804460 committed transno 25769804460 00000100:00100000:3.0:1786109351.560866:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933120128:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786109351.560880:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.561682:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c347b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933120512:0@lo:403:mdt00_000.0 00000100:00100000:3.0:1786109351.561735:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.561809:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a905a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109351.562167:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933120512 00000100:00100000:0.0:1786109351.562174:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933120512 00000100:00100000:0.0:1786109351.562264:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12089 00000100:00100000:0.0:1786109351.562273:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933120512:12345-0@lo:403:mdt00_000.0 00000100:00100000:0.0:1786109351.564659:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933120512:12345-0@lo:403:mdt00_000.0 Request processed in 2380us (2915us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.564671:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12089 00000100:00100000:3.0:1786109351.564746:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c347b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933120512:0@lo:403:mdt00_000.0 00000040:00080000:3.0:1786109351.565868:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].449, 656 off683728 00000040:00080000:3.0:1786109351.566044:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].330, 736 off546192 00000004:00080000:3.0:1786109351.566049:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098a905a80 with version 687 00000004:00080000:1.0:1786109351.566136:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 687 rpc_version 687 00000020:00100000:1.0:1786109351.566167:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109351.566187:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930986552300 x1872862933120768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109351.566211:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933120768:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109351.566265:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.566351:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109351.566794:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12090 00000100:00100000:0.0:1786109351.566805:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933120768:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109351.567074:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933120768:12345-0@lo:1000:osp_up1-0.0 Request processed in 271us (808us total) trans 25769804461 rc 0/0 00000100:00100000:0.0:1786109351.567082:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12090 00000100:00100000:3.0:1786109351.567234:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933120768:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1786109351.567964:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109351.567970:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.567977:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d600 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109351.567981:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109351.567988:0:6515:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.568015:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.568022:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109351.568043:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.568049:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35a98 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35a9f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.568066:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109351.568068:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109351.568070:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109351.568077:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109351.568089:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933120896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109351.568131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.568165:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933120896 00000100:00100000:0.0:1786109351.568171:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933120896 00000100:00100000:0.0:1786109351.568228:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4486 00000100:00100000:0.0:1786109351.568236:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1872862933120896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109351.568247:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109351.568263:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35a9f lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca35a98 expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.568274:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x39:0x0].0x0 (ffff930a90808900) 00010000:00010000:0.0:1786109351.568281:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109351.568310:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1872862933120896:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.568317:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4486 00000100:00100000:0.0:1786109351.568370:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933120896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109351.583878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109351.583973:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922049664 00000100:00100000:0.0:1786109351.583983:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922049664 00000100:00100000:0.0:1786109351.584072:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 775 00000100:00100000:0.0:1786109351.584081:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+63:157868:x1872862922049664:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109351.584103:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.584124:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35aa6 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1302 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584197:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35aad lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584212:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35aad lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584223:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35aad lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584236:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35ab4 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 29 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584244:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35ab4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584250:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35ab4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584292:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35aad lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584300:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35aad lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584306:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35aad lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584312:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.584316:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35aad lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584325:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35aad lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584337:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.584340:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.584344:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35aad lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584350:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35aad lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584362:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35ab4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584368:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35ab4 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584373:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35ab4 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584378:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.584381:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35ab4 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584387:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35ab4 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584394:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109351.584397:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.584411:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35ab4 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584419:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35ab4 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584493:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35aa6 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1302 expref: 64 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584504:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.584506:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.584510:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35aa6 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1302 expref: 64 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.584520:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8800, rc 0) 00000100:00100000:0.0:1786109351.584571:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+63:157868:x1872862922049664:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 491us (703us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109351.584578:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 775 00000100:00100000:1.0:1786109351.588362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109351.588529:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922049792 00000100:00100000:0.0:1786109351.588538:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922049792 00000100:00100000:0.0:1786109351.588626:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 776 00000100:00100000:0.0:1786109351.588637:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+63:157868:x1872862922049792:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109351.588656:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.588675:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35abb lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1309 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588748:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35ac2 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588761:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35ac2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588773:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35ac2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588784:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35ac9 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 29 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588792:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35ac9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588799:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35ac9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588834:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35ac2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588841:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35ac2 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588848:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35ac2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588854:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.588858:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35ac2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588866:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35ac2 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588877:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.588880:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.588885:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35ac2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588891:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35ac2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588905:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35ac9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588910:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35ac9 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588916:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35ac9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588920:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.588923:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35ac9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588928:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35ac9 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588935:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109351.588938:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.588941:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35ac9 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588947:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35ac9 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588977:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35abb lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1309 expref: 64 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.588992:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.588994:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.588999:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35abb lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1309 expref: 64 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.589008:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9600, rc 0) 00000100:00100000:0.0:1786109351.589162:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+63:157868:x1872862922049792:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 525us (807us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109351.589169:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 776 00000100:00100000:1.0:1786109351.592735:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.592813:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922049920 00000100:00100000:3.0:1786109351.592823:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922049920 00000100:00100000:3.0:1786109351.592879:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 777 00000100:00100000:3.0:1786109351.592889:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+63:157868:x1872862922049920:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109351.592911:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.592946:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35ad0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1310 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.593015:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35ad7 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.593029:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35ad7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.593040:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35ad7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109351.593087:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:3.0:1786109351.593092:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109351.593110:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35ad7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.593134:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35ad0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1310 expref: 65 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.593152:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35ad7 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1310 expref: 64 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.593160:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.593163:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109351.593167:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34800, rc 0) 00000100:00100000:3.0:1786109351.593239:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+64:157868:x1872862922049920:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 351us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.593246:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 777 00000100:00100000:3.0:1786109351.597962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000004:00080000:1.0:1786109351.599345:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 688 rpc_version 688 00000020:00100000:1.0:1786109351.599381:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109351.599390:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930985ebaa00 x1872862933121152/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109351.599417:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985ebaa00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933121152:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109351.599529:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.599562:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.600639:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab5394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933121152:12345-0@lo:1000:osp_up1-0.0 Request processed in 862us (1107us total) trans 25769804462 rc 0/0 00000100:00100000:1.0:1786109351.600650:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12091 00000100:00100000:3.0:1786109351.600828:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985ebaa00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933121152:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109351.601266:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933121280 00000100:00100000:1.0:1786109351.601272:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933121280 00000100:00100000:1.0:1786109351.601352:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12092 00000100:00100000:1.0:1786109351.601361:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187899:x1872862933121280:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109351.601376:0:177399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.601390:0:177399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35b01 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35afa expref: -99 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.601418:0:177399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35b01 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35afa expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.601453:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35b01 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35afa expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.601461:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3a:0x0].0x0 (ffff93098c4ae300) 00010000:00010000:1.0:1786109351.601464:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.601467:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2ca00, rc 0) 00000100:00100000:1.0:1786109351.601499:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187899:x1872862933121280:12345-0@lo:101:mdt00_000.0 Request processed in 139us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.601504:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12092 00000100:00100000:1.0:1786109351.614860:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.614995:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922050304 00000100:00100000:3.0:1786109351.615006:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922050304 00000100:00100000:3.0:1786109351.615112:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 779 00000100:00100000:3.0:1786109351.615123:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+65:157869:x1872862922050304:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109351.615145:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.615164:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35b08 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1317 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615239:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b0f lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615257:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b0f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615269:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b0f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615279:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b16 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 30 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615287:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b16 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615293:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b16 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615366:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35b1d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615375:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35b1d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615382:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35b1d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109351.615636:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd6:0x0]: returning size 4096 00000004:00200000:3.0:1786109351.615642:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1786109351.615661:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35b1d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615672:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b0f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615682:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b0f lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615689:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b0f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615695:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.615699:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b0f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615706:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b0f lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615719:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.615726:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.615734:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b0f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615740:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b0f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615754:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b16 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615760:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b16 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615769:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b16 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615773:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.615777:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b16 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615786:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b16 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615792:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109351.615798:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.615801:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b16 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615806:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b16 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615833:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35b08 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1317 expref: 67 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615846:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35b1d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1317 expref: 66 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.615853:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd6:0x0].0x0 (ffff930984516e00) 00010000:00010000:3.0:1786109351.615855:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109351.615858:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35e00, rc 0) 00000100:00100000:3.0:1786109351.615912:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+66:157869:x1872862922050304:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 791us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.615919:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 779 00000100:00100000:3.0:1786109351.619653:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109351.619756:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922050432 00000100:00100000:0.0:1786109351.619766:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922050432 00000100:00100000:0.0:1786109351.619825:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 780 00000100:00100000:0.0:1786109351.619836:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+66:157869:x1872862922050432:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109351.619855:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.619875:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35b24 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a131e expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.619982:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35b2b lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.619995:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35b2b lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.620007:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35b2b lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109351.620060:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x3a:0x0]: returning size 4096 00000004:00200000:0.0:1786109351.620066:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109351.620100:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35b24 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a131e expref: 68 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.620118:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35b2b lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a131e expref: 67 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.620127:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3a:0x0].0x0 (ffff930984516600) 00010000:00010000:0.0:1786109351.620129:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109351.620133:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8400, rc 0) 00000100:00100000:0.0:1786109351.620253:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+67:157869:x1872862922050432:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 418us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.620260:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 780 00000100:00100000:1.0:1786109351.623777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109351.623865:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922050560 00000100:00100000:0.0:1786109351.623874:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922050560 00000100:00100000:0.0:1786109351.623971:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 781 00000100:00100000:0.0:1786109351.623982:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:157869:x1872862922050560:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109351.624004:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.624023:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35b32 lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1325 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.624086:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35b39 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.624101:0:187901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35b01 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35afa expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.624109:0:187901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35b39 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.624142:0:187901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35b01 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35afa expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.624157:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933121408:0@lo:104: 00000100:00100000:0.0:1786109351.624213:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.624263:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f480 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.624710:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109351.624723:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933121536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109351.624752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.624821:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933121408:0@lo:104: 00010000:00010000:1.0:1786109351.624840:0:187901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35b39 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786109351.626998:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804462 is committed 00010000:00010000:1.0:1786109351.627574:0:187901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35b39 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.627583:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35b39 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109351.627632:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x3a:0x0]: returning size 4096 00000004:00200000:1.0:1786109351.627637:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786109351.627679:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35b32 lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1325 expref: 8 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.627696:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35b39 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1325 expref: 7 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.627703:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3a:0x0].0x0 (ffff93098c4ae300) 00010000:00010000:1.0:1786109351.627706:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786109351.627709:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8800, rc 0) 00000100:00100000:1.0:1786109351.627762:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:157869:x1872862922050560:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 3782us (3994us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.627772:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 781 00000100:00100000:3.0:1786109351.628148:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933121536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109351.630984:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:1.0:1786109351.637531:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35b2b lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x3a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a131e expref: 66 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.637550:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933121664:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109351.637571:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35b55 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.637579:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35b55 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.637586:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35b55 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.637624:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.637630:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.637640:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.637656:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933121792:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109351.638798:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.638834:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4900 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.644115:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8451:1872862933121920:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109351.644152:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35b63 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35b5c expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.644165:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3a:0x0].0x0 (ffff93098c4ae300) 00010000:00010000:3.0:1786109351.644167:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109351.644171:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35b63 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35b5c expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.644192:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35b63 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35b5c expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.644200:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6ca00, rc 0) 00000100:00100000:3.0:1786109351.644265:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933121792:12345-0@lo:101:mdt00_000.0 Request processed in 5136us (5469us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.644274:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12093 00000100:00100000:1.0:1786109351.644814:0:187899:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804462 gen 2 00000004:00080000:1.0:1786109351.644821:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804461 committed transno 25769804462 00000004:00080000:1.0:1786109351.644849:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804462 committed transno 25769804462 00000100:00100000:1.0:1786109351.644863:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933121792:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109351.644878:0:187899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.644888:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.645425:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786109351.645463:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933122048 00000100:00100000:0.0:1786109351.645466:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933122048 00000100:00100000:0.0:1786109351.645500:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5242 00000100:00100000:0.0:1786109351.645507:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1439850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6511:x1872862933122048:12345-0@lo:105: 00010000:00010000:0.0:1786109351.645515:0:6510:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.645523:0:6510:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.645530:0:6510:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.645537:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.645544:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.645550:0:6510:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.645570:0:6510:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ac0b2dc00) 00010000:00010000:1.0:1786109351.645868:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.645879:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.645988:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1439850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6511:x1872862933122048:12345-0@lo:105: Request processed in 482us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.645996:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5242 00000100:00100000:3.0:1786109351.647081:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6511:1872862933122048:0@lo:105: 00010000:00010000:3.0:1786109351.647104:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109351.647155:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922051072:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 2133us (3266us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.647163:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12607 00000100:00100000:1.0:1786109351.648905:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933122176:0@lo:403:mdt00_000.0 00000100:00100000:1.0:1786109351.649081:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.649163:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4900 going to sleep for 11 seconds 00000100:00100000:0.0:1786109351.649212:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933122176 00000100:00100000:0.0:1786109351.649220:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933122176 00000100:00100000:0.0:1786109351.649302:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12094 00000100:00100000:0.0:1786109351.649311:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933122176:12345-0@lo:403:mdt00_000.0 00000100:00100000:0.0:1786109351.652213:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933122176:12345-0@lo:403:mdt00_000.0 Request processed in 2896us (3124us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.652226:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12094 00000100:00100000:1.0:1786109351.652303:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933122176:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1786109351.653773:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].451, 656 off686536 00000040:00080000:1.0:1786109351.654023:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].332, 736 off549280 00000004:00080000:1.0:1786109351.654029:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7cc4900 with version 689 00000004:00080000:3.0:1786109351.654120:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 689 rpc_version 689 00000020:00100000:3.0:1786109351.654151:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109351.654159:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098c347800 x1872862933122432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109351.654192:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c347800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933122432:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109351.654244:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.654307:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977600 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.654348:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933122432 00000100:00100000:1.0:1786109351.654355:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933122432 00000100:00100000:1.0:1786109351.654480:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12095 00000100:00100000:1.0:1786109351.654489:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933122432:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109351.654774:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933122432:12345-0@lo:1000:osp_up1-0.0 Request processed in 285us (528us total) trans 25769804463 rc 0/0 00000100:00100000:1.0:1786109351.654785:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12095 00000100:00100000:0.0:1786109351.654869:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c347800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933122432:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1786109351.655109:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd6:0x0]: returning size 4096 00010000:00010000:1.0:1786109351.655129:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35b55 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655138:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35b55 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655146:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35b55 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655152:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.655155:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35b55 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655163:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35b55 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655187:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3a:0x0].0x0 (ffff930984516600) 00010000:00010000:1.0:1786109351.655190:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109351.655195:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35b55 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655201:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35b55 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655215:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655223:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655235:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655297:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786109351.655306:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x3a:0x0] 00010000:00010000:1.0:1786109351.655316:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35b4e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655322:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35b4e lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655328:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35b4e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655333:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6de00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.655336:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35b4e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655342:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35b4e lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655350:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd6:0x0].0x0 (ffff930984516e00) 00010000:00010000:1.0:1786109351.655352:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109351.655355:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35b4e lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655360:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35b4e lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655374:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35b40 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655380:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35b40 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655385:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35b40 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655390:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109351.655393:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35b40 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.655519:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109351.655526:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.655534:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2dc00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109351.655538:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109351.655547:0:6514:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.655573:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.655584:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109351.655690:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35b40 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655699:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.655701:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.655704:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35b40 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655709:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35b40 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109351.655718:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a149c581 reply state 00000000f8078b79 transno 326417514610 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca35b47 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655728:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca35b47 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.655734:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109351.655737:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109351.655739:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109351.655803:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+67:157869:x1872862922050816:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 24625us (24827us total) trans 326417514610 rc 0/0 00000100:00100000:1.0:1786109351.655811:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 782 00010000:00010000:0.0:1786109351.655854:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.655861:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2dc00/0xdb52b77d7ca35b5c lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35b63 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.655877:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109351.655879:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109351.655881:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109351.664159:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933122560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109351.664250:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.664775:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933122560 00000100:00100000:1.0:1786109351.664783:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933122560 00000100:00100000:1.0:1786109351.665590:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4487 00000100:00100000:1.0:1786109351.665604:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3649:x1872862933122560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109351.665619:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109351.665645:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35b63 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca35b5c expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.665663:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3a:0x0].0x0 (ffff93098c4ae300) 00010000:00010000:1.0:1786109351.665673:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109351.665740:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1872862933122560:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.665748:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4487 00000100:00100000:0.0:1786109351.665846:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933122560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109351.674651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.674896:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922051200 00000100:00100000:3.0:1786109351.674904:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922051200 00000100:00100000:3.0:1786109351.675016:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 783 00000100:00100000:3.0:1786109351.675027:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+67:157870:x1872862922051200:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109351.675051:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.675071:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35b6a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a132c expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675138:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b71 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675152:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b71 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675163:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b71 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675174:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b78 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 31 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675192:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b78 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675200:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b78 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675242:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b71 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675249:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b71 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675257:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b71 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675263:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.675267:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b71 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675276:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b71 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675288:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.675291:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.675296:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b71 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675302:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35b71 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675316:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b78 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675322:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b78 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675328:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b78 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675333:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.675337:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b78 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675348:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b78 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675355:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109351.675358:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.675361:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b78 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675366:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35b78 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675392:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35b6a lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a132c expref: 68 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675403:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.675406:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.675410:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35b6a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a132c expref: 68 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.675419:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35800, rc 0) 00000100:00100000:3.0:1786109351.676272:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+67:157870:x1872862922051200:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1243us (1625us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109351.676281:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 783 00000100:00100000:3.0:1786109351.679709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109351.679829:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922051328 00000100:00100000:0.0:1786109351.679839:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922051328 00000100:00100000:0.0:1786109351.680142:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 784 00000100:00100000:0.0:1786109351.680154:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+67:157870:x1872862922051328:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109351.680188:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.680208:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35b7f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1333 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680269:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35b86 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680284:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35b86 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680298:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35b86 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680311:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35b8d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 31 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680318:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35b8d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680325:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35b8d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680363:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35b86 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680370:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35b86 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680376:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35b86 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680382:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.680386:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35b86 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680394:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35b86 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680414:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.680418:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.680422:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35b86 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680428:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35b86 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680479:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35b8d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680485:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35b8d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680491:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35b8d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680496:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.680499:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35b8d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680505:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35b8d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680512:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109351.680514:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.680517:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35b8d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680522:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35b8d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680549:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35b7f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1333 expref: 68 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680565:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.680567:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.680571:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35b7f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1333 expref: 68 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.680581:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9400, rc 0) 00000100:00100000:0.0:1786109351.680639:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+67:157870:x1872862922051328:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 487us (939us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109351.680645:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 784 00000100:00100000:0.0:1786109351.684609:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1786109351.684890:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109351.685191:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922051456 00000100:00100000:1.0:1786109351.685201:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922051456 00000100:00100000:1.0:1786109351.685260:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 785 00000100:00100000:1.0:1786109351.685271:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+67:157870:x1872862922051456:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109351.685291:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.685310:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35b94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a133a expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.685375:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35b9b lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.685392:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35b9b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.685402:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35b9b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109351.685473:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:1.0:1786109351.685477:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786109351.685496:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35b9b lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.685521:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35b94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a133a expref: 69 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.685538:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35b9b lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a133a expref: 68 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.685546:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.685549:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109351.685553:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2c200, rc 0) 00000100:00100000:1.0:1786109351.685660:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+68:157870:x1872862922051456:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 391us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.685667:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 785 00000100:00100000:1.0:1786109351.692163:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922051712 00000100:00100000:1.0:1786109351.692172:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922051712 00000100:00100000:1.0:1786109351.692274:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 786 00000100:00100000:1.0:1786109351.692284:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+68:157870:x1872862922051712:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1786109351.692338:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109351.692364:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35b9b lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a133a expref: 68 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.692382:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.692387:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109351.692520:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35ba2 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.692533:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35ba2 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.692543:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35ba2 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.692554:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35ba9 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 31 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.692566:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35ba9 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.692574:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35ba9 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109351.693844:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].453, 2152 off690280 00000040:00080000:1.0:1786109351.693994:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].333, 2352 off551632 00000004:00080000:1.0:1786109351.694001:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7cc4600 with version 690 00000004:00080000:0.0:1786109351.694086:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 690 rpc_version 690 00000020:00100000:0.0:1786109351.694119:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109351.694129:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab1c29f80 x1872862933122816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109351.694150:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c29f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933122816:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109351.694216:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.694276:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.694320:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933122816 00000100:00100000:1.0:1786109351.694326:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933122816 00000100:00100000:1.0:1786109351.694398:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12096 00000100:00100000:1.0:1786109351.696105:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933122816:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109351.697078:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933122816:12345-0@lo:1000:osp_up1-0.0 Request processed in 983us (2859us total) trans 25769804464 rc 0/0 00000100:00100000:1.0:1786109351.697089:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12096 00000100:00100000:0.0:1786109351.697248:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c29f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933122816:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786109351.697381:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35bb0 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.697397:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35bb0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.697527:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35bb0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.697548:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35bb7 lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.697556:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35bb7 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.697562:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35bb7 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.697594:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d400/0xdb52b77d7ca35bbe lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.697602:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d400/0xdb52b77d7ca35bbe lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.697612:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d400/0xdb52b77d7ca35bbe lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.697630:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933122944:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109351.697666:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.697737:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.697772:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933122944 00000100:00100000:3.0:1786109351.697779:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933122944 00000100:00100000:3.0:1786109351.697846:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12097 00000100:00100000:3.0:1786109351.697856:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187899:x1872862933122944:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786109351.697871:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.697886:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35bc5 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35bbe expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.697906:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35bc5 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35bbe expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.697992:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35bc5 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35bbe expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.698001:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3b:0x0].0x0 (ffff930985b9df00) 00010000:00010000:3.0:1786109351.698004:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.698008:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35800, rc 0) 00000100:00100000:3.0:1786109351.698052:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187899:x1872862933122944:12345-0@lo:101:mdt00_000.0 Request processed in 197us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.698059:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12097 00000100:00100000:0.0:1786109351.712782:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922051840 00000100:00100000:0.0:1786109351.712793:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922051840 00000100:00100000:0.0:1786109351.712856:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 787 00000100:00100000:0.0:1786109351.712865:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+69:157871:x1872862922051840:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109351.712889:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.712911:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35bcc lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1341 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713103:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35bd3 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713118:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35bd3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713130:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35bd3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713142:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35bda lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 32 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713150:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35bda lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713157:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35bda lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713240:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35be1 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713248:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35be1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713256:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35be1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109351.713337:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd7:0x0]: returning size 4096 00000004:00200000:0.0:1786109351.713342:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1786109351.713362:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35be1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713379:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35bd3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713386:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35bd3 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713393:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35bd3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713399:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.713403:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35bd3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713412:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35bd3 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713423:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.713426:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.713469:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35bd3 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713476:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35bd3 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713490:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35bda lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713496:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35bda lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713502:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35bda lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713507:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.713510:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35bda lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713515:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35bda lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713521:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109351.713524:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.713526:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35bda lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713532:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35bda lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713559:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca35bcc lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1341 expref: 71 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713574:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35be1 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1341 expref: 70 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.713581:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd7:0x0].0x0 (ffff93098c4ae300) 00010000:00010000:0.0:1786109351.713582:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109351.713585:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8400, rc 0) 00000100:00100000:0.0:1786109351.713648:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+70:157871:x1872862922051840:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 784us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.713655:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 787 00000100:00100000:0.0:1786109351.717172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.718042:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 788 00000100:00100000:3.0:1786109351.718052:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+70:157871:x1872862922051968:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109351.718072:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.718092:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35be8 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1348 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.718151:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35bef lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.718164:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35bef lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.718190:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35bef lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109351.718236:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x3b:0x0]: returning size 4096 00000004:00200000:3.0:1786109351.718241:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786109351.718278:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35be8 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1348 expref: 72 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.718297:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35bef lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1348 expref: 71 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.718305:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3b:0x0].0x0 (ffff93098c4ae400) 00010000:00010000:3.0:1786109351.718308:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786109351.718312:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34600, rc 0) 00000100:00100000:3.0:1786109351.718376:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+71:157871:x1872862922051968:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 326us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.718382:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 788 00000100:00100000:1.0:1786109351.722362:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922052096 00000100:00100000:1.0:1786109351.722372:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922052096 00000100:00100000:1.0:1786109351.725500:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 789 00000100:00100000:1.0:1786109351.725528:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:157871:x1872862922052096:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109351.725551:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.725574:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35bf6 lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a134f expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.725640:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35bfd lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.725655:0:187901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35bc5 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35bbe expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.725665:0:187901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35bfd lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.725698:0:187901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35bc5 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35bbe expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.725715:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933123072:0@lo:104: 00000100:00100000:1.0:1786109351.725777:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.725893:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4e40 going to sleep for 11 seconds 00010000:00010000:3.0:1786109351.726285:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109351.726293:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d400/0xdb52b77d7ca35bbe lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35bc5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.726301:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d400 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:3.0:1786109351.726307:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d400/0xdb52b77d7ca35bbe lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca35bc5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109351.726316:0:6515:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d400/0xdb52b77d7ca35bbe lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca35bc5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.726347:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d400/0xdb52b77d7ca35bbe lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35bc5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.726353:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109351.726373:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d400/0xdb52b77d7ca35bbe lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35bc5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.726381:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d400/0xdb52b77d7ca35bbe lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35bc5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.726414:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109351.726416:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109351.726418:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109351.726425:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109351.726454:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933123200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109351.726486:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.726677:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933123072:0@lo:104: 00010000:00010000:1.0:1786109351.726697:0:187901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35bfd lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786109351.728923:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804464 is committed 00000100:00100000:0.0:1786109351.729299:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933123200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109351.729383:0:187901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35bfd lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.729392:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35bfd lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109351.729484:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x3b:0x0]: returning size 4096 00000004:00200000:1.0:1786109351.729489:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786109351.729534:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35bf6 lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a134f expref: 8 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.729551:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35bfd lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a134f expref: 7 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.729559:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3b:0x0].0x0 (ffff930985b9df00) 00010000:00010000:1.0:1786109351.729562:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786109351.729564:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d600, rc 0) 00000100:00100000:1.0:1786109351.729609:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:157871:x1872862922052096:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 4097us (7371us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.729616:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 789 00000100:00100000:0.0:1786109351.733053:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109351.738790:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.738883:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922052480 00000100:00100000:3.0:1786109351.738891:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922052480 00010000:00010000:3.0:1786109351.738928:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35bef lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1348 expref: 71 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.739002:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12609 00000100:00100000:3.0:1786109351.739012:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397d331e-10fc-4558-be87-308c3622e8eb+71:2403:x1872862922052480:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109351.739027:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109351.739034:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35bef lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1348 expref: 71 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.739052:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35bef lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1348 expref: 71 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.739074:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35bef lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1348 expref: 71 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.739088:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3b:0x0].0x0 (ffff93098c4ae400) 00010000:00010000:3.0:1786109351.739093:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c19 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.739104:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c19 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.739111:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c19 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.739142:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109351.739208:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397d331e-10fc-4558-be87-308c3622e8eb+70:2403:x1872862922052480:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 197us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.739216:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12609 00010000:00010000:1.0:1786109351.739267:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c19 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.739275:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c19 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.739320:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.739327:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.739340:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.739358:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933123456:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109351.739397:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.739457:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933123456 00000100:00100000:1.0:1786109351.739461:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933123456 00000100:00100000:1.0:1786109351.739489:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12098 00000100:00100000:1.0:1786109351.739495:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187899:x1872862933123456:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109351.739509:0:179257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.739521:0:179257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35c27 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35c20 expref: -99 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.739541:0:179257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35bfd lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a134f expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.739550:0:179257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35c27 lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35c20 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.739571:0:179257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35bfd lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a134f expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.739583:0:179257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35bfd lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a134f expref: 6 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.739595:0:179257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:179257:1872862933123584:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109351.739644:0:179257:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.739660:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109351.742971:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.743080:0:179257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:179257:1872862933123584:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109351.743114:0:179257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35c27 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35c20 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.743126:0:179257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3b:0x0].0x0 (ffff930985b9df00) 00010000:00010000:1.0:1786109351.743129:0:179257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109351.743133:0:179257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35c27 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35c20 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.743143:0:179257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35c27 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35c20 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.743150:0:179257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2cc00, rc 0) 00000100:00100000:1.0:1786109351.743222:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933123456:12345-0@lo:101:mdt00_000.0 Request processed in 3726us (3824us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.743231:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12098 00000100:00100000:0.0:1786109351.743716:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933123712 00000100:00100000:0.0:1786109351.743720:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933123712 00000100:00100000:0.0:1786109351.743755:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5244 00000100:00100000:0.0:1786109351.743761:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:177416:x1872862933123712:12345-0@lo:105: 00010000:00010000:0.0:1786109351.743772:0:10344:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.743782:0:10344:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.743789:0:10344:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.743797:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.743804:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.743812:0:10344:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.743823:0:10344:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ac0b2c200) 00000100:00100000:0.0:1786109351.743853:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:177416:x1872862933123712:12345-0@lo:105: Request processed in 92us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.743860:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5244 00000100:00100000:3.0:1786109351.744159:0:187899:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804464 gen 2 00000004:00080000:3.0:1786109351.744165:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804463 committed transno 25769804464 00000004:00080000:3.0:1786109351.744192:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804464 committed transno 25769804464 00000100:00100000:3.0:1786109351.744208:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933123456:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786109351.744221:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.744926:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c347800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933123840:0@lo:403:mdt00_000.0 00000100:00100000:3.0:1786109351.744971:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.744990:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977900 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.745055:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933123840 00000100:00100000:1.0:1786109351.745060:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933123840 00000100:00100000:1.0:1786109351.745097:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12099 00000100:00100000:1.0:1786109351.745105:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933123840:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1786109351.747285:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933123840:12345-0@lo:403:mdt00_000.0 Request processed in 2173us (2305us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.747297:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12099 00000004:00080000:0.0:1786109351.758354:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 691 rpc_version 691 00000020:00100000:0.0:1786109351.758389:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109351.758400:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab1c2ad80 x1872862933124096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109351.758424:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c2ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933124096:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109351.759010:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.759335:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.759628:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933124096 00000100:00100000:1.0:1786109351.759636:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933124096 00000100:00100000:1.0:1786109351.759955:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12100 00000100:00100000:1.0:1786109351.759966:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933124096:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109351.761205:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933124096:12345-0@lo:1000:osp_up1-0.0 Request processed in 1236us (2191us total) trans 25769804465 rc 0/0 00000100:00100000:1.0:1786109351.761349:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12100 00000100:00100000:3.0:1786109351.761703:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c2ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933124096:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1786109351.764151:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109351.764163:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.764185:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c200 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109351.764193:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109351.764202:0:10402:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.765383:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.765396:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1786109351.766008:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933124224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109351.766070:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786109351.766377:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.766387:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c200/0xdb52b77d7ca35c20 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35c27 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.766875:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109351.766878:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109351.766880:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109351.768085:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933124224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109351.863621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.864083:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922052736 00000100:00100000:3.0:1786109351.864092:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922052736 00000100:00100000:0.0:1786109351.864479:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 791 00000100:00100000:0.0:1786109351.864493:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+71:157872:x1872862922052736:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109351.864519:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.864541:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c2e lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1356 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864605:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c35 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864620:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c35 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864631:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c35 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864643:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c3c lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 33 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864651:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c3c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864657:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c3c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864936:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c35 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864945:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c35 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864952:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c35 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864959:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.864963:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c35 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864969:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c35 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864985:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.864988:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.864993:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c35 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.864999:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c35 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.865014:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c3c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.865020:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c3c lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.865025:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c3c lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.865030:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.865033:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c3c lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.865039:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c3c lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.865045:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109351.865047:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.865051:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c3c lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.865056:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c3c lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.865085:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c2e lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1356 expref: 72 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.865095:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.865097:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.865101:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c2e lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1356 expref: 72 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.865109:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9200, rc 0) 00000100:00100000:0.0:1786109351.865739:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+71:157872:x1872862922052736:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1246us (2125us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109351.865750:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 791 00000100:00100000:1.0:1786109351.925852:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109351.925968:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922052864 00000100:00100000:3.0:1786109351.925978:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922052864 00000100:00100000:3.0:1786109351.926082:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 792 00000100:00100000:3.0:1786109351.926092:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+71:157872:x1872862922052864:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109351.926111:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.926130:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35c43 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a135d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926303:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35c4a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926318:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35c4a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926330:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35c4a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926346:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35c51 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 33 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926353:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35c51 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926360:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35c51 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926396:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35c4a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926413:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35c4a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926420:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35c4a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926426:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.926457:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35c4a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926465:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35c4a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926477:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.926479:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.926484:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35c4a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926489:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35c4a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926501:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35c51 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926506:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35c51 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926512:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35c51 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926517:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109351.926519:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35c51 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926525:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35c51 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926533:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109351.926535:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.926538:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35c51 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926543:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35c51 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926570:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35c43 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a135d expref: 72 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926580:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109351.926582:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109351.926587:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35c43 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a135d expref: 72 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.926596:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c34600, rc 0) 00000100:00100000:3.0:1786109351.928300:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+71:157872:x1872862922052864:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2198us (2446us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109351.928313:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 792 00000100:00100000:3.0:1786109351.932281:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.932415:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922052992 00000100:00100000:1.0:1786109351.932424:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922052992 00000100:00100000:1.0:1786109351.932623:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 793 00000100:00100000:1.0:1786109351.932634:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+71:157872:x1872862922052992:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109351.932655:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.932676:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35c58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1364 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.932742:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35c5f lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.932756:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35c5f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.932767:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35c5f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109351.932813:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:1.0:1786109351.932817:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786109351.932835:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35c5f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.932858:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35c58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1364 expref: 73 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.932874:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35c5f lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1364 expref: 72 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.932883:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109351.932887:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109351.932890:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d200, rc 0) 00000100:00100000:1.0:1786109351.933031:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+72:157872:x1872862922052992:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 398us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.933038:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 793 00000100:00100000:0.0:1786109351.938672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000004:00080000:0.0:1786109351.940128:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 692 rpc_version 692 00000020:00100000:0.0:1786109351.940158:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109351.940168:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab1c29880 x1872862933124480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109351.940204:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c29880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933124480:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109351.940265:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.940300:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109351.941205:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c29880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933124480:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1786109351.941306:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c74 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.941321:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c74 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.941335:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c74 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.941351:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c7b lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.941357:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c7b lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.941364:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c7b lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.941390:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.941397:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.941417:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.941452:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933124608:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1786109351.941481:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.941845:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.941924:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933124608 00000100:00100000:1.0:1786109351.941931:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933124608 00000100:00100000:1.0:1786109351.941975:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12102 00000100:00100000:1.0:1786109351.941983:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187899:x1872862933124608:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109351.941997:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.942013:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35c89 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35c82 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.942032:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35c89 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35c82 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.942044:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35c89 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35c82 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.942052:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3c:0x0].0x0 (ffff930ab7f80e00) 00010000:00010000:1.0:1786109351.942055:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109351.942058:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2ce00, rc 0) 00000100:00100000:1.0:1786109351.942090:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187899:x1872862933124608:12345-0@lo:101:mdt00_000.0 Request processed in 108us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.942097:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12102 00000100:00100000:0.0:1786109351.942205:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933124608:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786109351.942218:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35c89 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942232:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35c89 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109351.942258:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ccc94b3 reply state 000000007090ab78 transno 326417514613 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c7b lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942269:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c7b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942276:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3c:0x0].0x0 (ffff930a90808000) 00010000:00010000:0.0:1786109351.942279:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109351.942282:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109351.942288:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35c89 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942295:0:187899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35c89 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109351.942305:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x3c:0x0] 00000004:00010000:0.0:1786109351.942311:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ccc94b3 reply state 000000007090ab78 transno 326417514613 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c74 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942319:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c74 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942326:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd8:0x0].0x0 (ffff930a90808b00) 00010000:00010000:0.0:1786109351.942328:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109351.942330:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1786109351.942335:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd8:0x0]: returning size 4096 00010000:00010000:0.0:1786109351.942342:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35c66 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942348:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35c66 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942355:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35c66 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942361:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.942366:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35c66 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942373:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35c66 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942383:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.942385:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.942388:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35c66 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942395:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35c66 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109351.942418:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ccc94b3 reply state 000000007090ab78 transno 326417514613 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c6d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942426:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c6d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.942559:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109351.942562:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109351.942564:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1786109351.942640:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+73:157872:x1872862922053248:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 3702us (3977us total) trans 326417514613 rc 0/0 00000100:00100000:0.0:1786109351.942648:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 794 00000100:00100000:0.0:1786109351.952101:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922053376 00000100:00100000:0.0:1786109351.952111:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922053376 00000100:00100000:0.0:1786109351.952263:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 795 00000100:00100000:0.0:1786109351.952274:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+73:157878:x1872862922053376:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109351.952298:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109351.952318:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35c90 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a136b expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952377:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35c97 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952390:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35c97 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952411:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35c97 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952426:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c9e lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 34 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952467:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c9e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952475:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c9e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952545:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca35ca5 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952553:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca35ca5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952563:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca35ca5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109351.952640:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd8:0x0]: returning size 4096 00000004:00200000:0.0:1786109351.952644:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1786109351.952664:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca35ca5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952828:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35c97 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952838:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35c97 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952845:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35c97 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952851:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.952855:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35c97 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952862:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35c97 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952874:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109351.952877:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.952882:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35c97 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952889:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca35c97 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952907:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c9e lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952987:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c9e lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952992:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c9e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.952998:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109351.953001:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c9e lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.953008:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c9e lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.953015:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109351.953018:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109351.953021:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c9e lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.953027:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca35c9e lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.953056:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca35c90 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a136b expref: 75 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.953068:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca35ca5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a136b expref: 74 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.953080:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd8:0x0].0x0 (ffff930a90808b00) 00010000:00010000:0.0:1786109351.953082:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109351.953085:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2600, rc 0) 00000100:00100000:0.0:1786109351.953151:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+74:157878:x1872862922053376:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 879us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.953159:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 795 00000100:00100000:3.0:1786109351.957473:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922053504 00000100:00100000:3.0:1786109351.957483:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922053504 00000100:00100000:3.0:1786109351.957539:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 796 00000100:00100000:3.0:1786109351.957549:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+74:157878:x1872862922053504:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109351.957568:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109351.957587:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35cac lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1372 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.957647:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35cb3 lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.957662:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35cb3 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.957674:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35cb3 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109351.957724:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x3c:0x0]: returning size 4096 00000004:00200000:3.0:1786109351.957730:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786109351.957764:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35cac lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1372 expref: 76 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.957793:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35cb3 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1372 expref: 75 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.957801:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3c:0x0].0x0 (ffff930a90808000) 00010000:00010000:3.0:1786109351.957805:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786109351.957808:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab1c35800, rc 0) 00000100:00100000:3.0:1786109351.957873:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+75:157878:x1872862922053504:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 325us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.957880:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 796 00000100:00100000:3.0:1786109351.965076:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109351.965153:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922053632 00000100:00100000:1.0:1786109351.965162:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922053632 00000100:00100000:1.0:1786109351.965227:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 797 00000100:00100000:1.0:1786109351.965237:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:157878:x1872862922053632:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109351.965258:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109351.965279:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35cba lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1379 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.965341:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.965355:0:187901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35c89 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35c82 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.965369:0:187901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.965409:0:187901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35c89 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35c82 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.965424:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933124736:0@lo:104: 00000100:00100000:1.0:1786109351.965498:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109351.965543:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.965863:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933124736 00000100:00100000:3.0:1786109351.965868:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933124736 00000100:00100000:3.0:1786109351.965904:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5245 00000100:00100000:3.0:1786109351.965977:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933124736:12345-0@lo:104: 00010000:00010000:3.0:1786109351.965991:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35c89 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.966050:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786109351.966056:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933124736:12345-0@lo:104: Request processed in 146us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.966063:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5245 00010000:00010000:3.0:1786109351.966082:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109351.966088:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35c89 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.966095:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9600 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:3.0:1786109351.966100:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca35c89 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109351.966109:0:6514:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca35c89 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.966133:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35c89 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.966139:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109351.966158:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35c89 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.966165:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8cf9600/0xdb52b77d7ca35c82 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35c89 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.966192:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109351.966194:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109351.966196:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109351.966208:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933124864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109351.966235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.966269:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933124864 00000100:00100000:3.0:1786109351.966273:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933124864 00010000:00010000:3.0:1786109351.966290:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35c89 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca35c82 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.966312:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12611 00000100:00100000:3.0:1786109351.966319:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3647:x1872862933124864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109351.966328:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1786109351.966811:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933124736:0@lo:104: 00010000:00010000:1.0:1786109351.966830:0:187901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786109351.969861:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804466 is committed 00010000:00010000:1.0:1786109351.970084:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35c89 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca35c82 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.970102:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3c:0x0].0x0 (ffff930ab7f80e00) 00010000:00010000:1.0:1786109351.970107:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.970118:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.970125:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.970196:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109351.970839:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933124864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109351.970889:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933124864:12345-0@lo:103:ldlm_bl.0 Request processed in 4568us (4651us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.970900:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12611 00010000:00010000:0.0:1786109351.971072:0:187901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.971081:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109351.971133:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x3c:0x0]: returning size 4096 00000004:00200000:0.0:1786109351.971137:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109351.971186:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35cba lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1379 expref: 8 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.971203:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1379 expref: 7 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.971211:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3c:0x0].0x0 (ffff930ab7f80e00) 00010000:00010000:0.0:1786109351.971214:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109351.971217:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2c600, rc 0) 00000100:00100000:0.0:1786109351.971998:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:157878:x1872862922053632:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 6759us (6926us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109351.972007:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 797 00000100:00100000:3.0:1786109351.978033:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922053888 00000100:00100000:3.0:1786109351.978048:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922053888 00000100:00100000:3.0:1786109351.978184:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 798 00000100:00100000:3.0:1786109351.978195:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+75:157878:x1872862922053888:12345-192.168.203.38@tcp:36:rmdir.0 00010000:00010000:3.0:1786109351.978248:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109351.978273:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca35ca5 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a136b expref: 75 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.978293:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd8:0x0].0x0 (ffff930a90808b00) 00010000:00010000:3.0:1786109351.978297:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109351.978319:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35cc8 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.978331:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35cc8 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.978341:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35cc8 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.978351:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35ccf lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 34 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.978362:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35ccf lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.978368:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35ccf lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.979068:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35cd6 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.979080:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35cd6 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.979089:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35cd6 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.979109:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.979119:0:188678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35cb3 lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1372 expref: 74 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.979127:0:188678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.979161:0:188678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35cb3 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1372 expref: 74 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.979186:0:188678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35cb3 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1372 expref: 74 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.979201:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c346d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933124992:192.168.203.38@tcp:104: 00000100:00100000:3.0:1786109351.979297:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac09773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109351.985107:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922054016 00000100:00100000:1.0:1786109351.985117:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922054016 00010000:00010000:1.0:1786109351.985157:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35cb3 lrc: 5/0,0 mode: PR/PR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1372 expref: 75 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.985209:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12612 00000100:00100000:1.0:1786109351.985220:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+75:2403:x1872862922054016:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109351.985235:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109351.985242:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35cb3 lrc: 5/0,0 mode: PR/PR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1372 expref: 75 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.985255:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35cb3 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1372 expref: 75 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.985277:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3c:0x0].0x0 (ffff930a90808000) 00010000:00010000:1.0:1786109351.985283:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.985293:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.985300:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.985318:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109351.985370:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+75:2403:x1872862922054016:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 151us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.985381:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12612 00010000:00010000:3.0:1786109351.987312:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35800/0xdb52b77d7ca35cb3 lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1372 expref: 74 pid: 188678 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.987336:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c346d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933124992:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109351.987356:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.987366:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.987372:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.987798:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.987806:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.987819:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.987842:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c346d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933125120:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1786109351.987901:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.988130:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac09773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109351.993152:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922054144 00000100:00100000:0.0:1786109351.993162:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922054144 00010000:00010000:0.0:1786109351.993209:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1379 expref: 7 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.993245:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12613 00000100:00100000:0.0:1786109351.993254:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:397d331e-10fc-4558-be87-308c3622e8eb+7:2402:x1872862922054144:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109351.993270:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109351.993276:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1379 expref: 7 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.993288:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1379 expref: 7 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.993310:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3c:0x0].0x0 (ffff930ab7f80e00) 00010000:00010000:0.0:1786109351.993316:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35ceb lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35ce4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.993326:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35ceb lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca35ce4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.993423:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35ceb lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca35ce4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109351.993493:0:9538:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35ceb lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35ce4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109351.993507:0:9538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9538:1872862933125376:0@lo:105: 00000100:00100000:0.0:1786109351.993553:0:9538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109351.993602:0:9538:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109351.993783:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933125376 00000100:00100000:3.0:1786109351.993788:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933125376 00000100:00100000:3.0:1786109351.993817:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5246 00000100:00100000:3.0:1786109351.993824:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:9538:x1872862933125376:12345-0@lo:105: 00010000:00010000:3.0:1786109351.993834:0:6510:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.993843:0:6510:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.993852:0:6510:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.993860:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.993866:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.993874:0:6510:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109351.993888:0:6510:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ab295f600) 00000100:00100000:3.0:1786109351.994011:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:9538:x1872862933125376:12345-0@lo:105: Request processed in 187us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.994019:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5246 00000100:00100000:3.0:1786109351.994054:0:9538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9538:1872862933125376:0@lo:105: 00010000:00010000:3.0:1786109351.994070:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109351.994109:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:397d331e-10fc-4558-be87-308c3622e8eb+7:2402:x1872862922054144:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 855us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109351.994115:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12613 00010000:00010000:1.0:1786109351.995631:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35cc1 lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1379 expref: 6 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109351.995653:0:8452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8452:1872862933125248:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109351.995763:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35ceb lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35ce4 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109351.995774:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3c:0x0].0x0 (ffff930ab7f80e00) 00010000:00010000:1.0:1786109351.995777:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109351.995780:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d600, rc 0) 00000100:00100000:1.0:1786109351.995888:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933125120:12345-0@lo:101:mdt00_003.0 Request processed in 7574us (7986us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109351.995897:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12103 00000100:00100000:3.0:1786109351.996026:0:188678:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804466 gen 2 00000004:00080000:3.0:1786109351.996032:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804465 committed transno 25769804466 00000004:00080000:3.0:1786109351.996049:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804466 committed transno 25769804466 00000100:00100000:3.0:1786109351.996064:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c346d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933125120:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786109351.996077:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109351.997294:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c346d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933125504:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1786109351.997817:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109351.997884:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac09773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109351.997976:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933125504 00000100:00100000:0.0:1786109351.997983:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933125504 00000100:00100000:0.0:1786109351.998066:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12104 00000100:00100000:0.0:1786109351.998075:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933125504:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1786109352.001454:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933125504:12345-0@lo:403:mdt00_003.0 Request processed in 3347us (3604us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.001471:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12104 00000100:00100000:3.0:1786109352.001837:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c346d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933125504:0@lo:403:mdt00_003.0 00000004:00080000:0.0:1786109352.004134:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 693 rpc_version 693 00000020:00100000:0.0:1786109352.004165:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109352.004186:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9309854f8e00 x1872862933125760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1696/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109352.004209:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933125760:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109352.004268:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109352.004350:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.004764:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933125760 00000100:00100000:3.0:1786109352.004772:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933125760 00000100:00100000:0.0:1786109352.005635:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933125760:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1786109352.005808:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd8:0x0]: returning size 4096 00010000:00010000:3.0:1786109352.005830:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.005840:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.005847:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.005853:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.005857:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.005863:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.005877:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3c:0x0].0x0 (ffff930a90808000) 00010000:00010000:3.0:1786109352.005880:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109352.005884:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.005889:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34800/0xdb52b77d7ca35cdd lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.005905:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006363:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006370:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006388:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786109352.006396:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x3c:0x0] 00010000:00010000:3.0:1786109352.006406:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35cd6 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006412:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35cd6 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006419:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35cd6 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006424:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.006427:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35cd6 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006456:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35cd6 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006465:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd8:0x0].0x0 (ffff930a90808b00) 00010000:00010000:3.0:1786109352.006467:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109352.006471:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35cd6 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006476:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35e00/0xdb52b77d7ca35cd6 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006491:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35cc8 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006496:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35cc8 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006501:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35cc8 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006505:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.006508:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35cc8 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006513:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35cc8 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006519:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.006521:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.006523:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35cc8 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006528:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34600/0xdb52b77d7ca35cc8 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109352.006536:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad7c3942 reply state 00000000953b89cf transno 326417514614 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35ccf lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006552:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35ccf lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.006558:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109352.006560:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109352.006563:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786109352.006641:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+75:157878:x1872862922053888:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 28444us (31296us total) trans 326417514614 rc 0/0 00000100:00100000:3.0:1786109352.006649:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 798 00010000:00010000:0.0:1786109352.006876:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109352.006884:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.006892:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295f600 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109352.006896:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109352.006903:0:29734:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.007011:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.007017:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109352.007045:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.007053:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f600/0xdb52b77d7ca35ce4 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35ceb expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.007069:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109352.007071:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109352.007072:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109352.007080:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786109352.007091:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933125888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109352.007135:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109352.008626:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933125888 00000100:00100000:3.0:1786109352.008636:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933125888 00000100:00100000:3.0:1786109352.008744:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4489 00000100:00100000:3.0:1786109352.008754:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3649:x1872862933125888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109352.008767:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109352.008789:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35ceb lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca35ce4 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.008804:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3c:0x0].0x0 (ffff930ab7f80e00) 00010000:00010000:3.0:1786109352.008813:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109352.008873:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1872862933125888:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.008880:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4489 00000100:00100000:0.0:1786109352.009417:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933125888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109352.022164:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922054272 00000100:00100000:0.0:1786109352.022185:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922054272 00000100:00100000:0.0:1786109352.022286:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 799 00000100:00100000:0.0:1786109352.022298:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+75:157881:x1872862922054272:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109352.022321:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109352.022342:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35cf2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1380 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022415:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35cf9 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022465:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35cf9 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022478:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35cf9 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022490:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35d00 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 35 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022498:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35d00 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022504:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35d00 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022542:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35cf9 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022550:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35cf9 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022557:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35cf9 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022563:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109352.022566:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35cf9 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022573:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35cf9 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022588:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109352.022592:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109352.022596:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35cf9 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022602:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35cf9 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022612:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35d00 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022618:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35d00 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022623:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35d00 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022627:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109352.022630:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35d00 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022637:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35d00 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022644:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109352.022646:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109352.022649:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35d00 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022655:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35d00 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022682:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35cf2 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1380 expref: 76 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022692:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109352.022694:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109352.022697:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35cf2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1380 expref: 76 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.022707:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3600, rc 0) 00000100:00100000:0.0:1786109352.022763:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+75:157881:x1872862922054272:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 467us (676us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109352.022770:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 799 00000100:00100000:1.0:1786109352.056375:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109352.056682:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922054400 00000100:00100000:0.0:1786109352.056692:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922054400 00000100:00100000:1.0:1786109352.057098:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 800 00000100:00100000:1.0:1786109352.057110:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+75:157881:x1872862922054400:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109352.057131:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109352.057151:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35d07 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1387 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057228:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35d0e lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057242:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35d0e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057257:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35d0e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057268:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d15 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 35 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057276:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d15 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057283:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d15 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057327:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35d0e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057335:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35d0e lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057342:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35d0e lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057349:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2cc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109352.057692:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35d0e lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057704:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35d0e lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057717:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109352.057721:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.057726:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35d0e lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057732:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35d0e lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057745:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d15 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057751:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d15 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057758:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d15 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057764:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109352.057767:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d15 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057773:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d15 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057779:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109352.057782:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.057785:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d15 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057789:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d15 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057819:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35d07 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1387 expref: 76 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057835:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109352.057838:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.057842:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35d07 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1387 expref: 76 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.057850:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2c600, rc 0) 00000100:00100000:1.0:1786109352.057922:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+75:157881:x1872862922054400:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 814us (1572us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109352.057929:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 800 00000100:00100000:3.0:1786109352.069093:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.069334:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922054528 00000100:00100000:1.0:1786109352.069344:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922054528 00000100:00100000:1.0:1786109352.069856:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 801 00000100:00100000:1.0:1786109352.069867:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+75:157881:x1872862922054528:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109352.069888:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109352.069906:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35d1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a138e expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.069969:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d23 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.069982:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d23 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.069993:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d23 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109352.070032:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:1.0:1786109352.070036:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786109352.070053:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d23 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.070076:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35d1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a138e expref: 77 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.070094:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d23 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a138e expref: 76 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.070102:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109352.070105:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109352.070108:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d600, rc 0) 00000100:00100000:1.0:1786109352.070186:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+76:157881:x1872862922054528:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 311us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.070194:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 801 00000100:00100000:3.0:1786109352.077056:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922054784 00000100:00100000:3.0:1786109352.077066:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922054784 00000100:00100000:3.0:1786109352.077166:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 802 00000100:00100000:3.0:1786109352.077189:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+76:157881:x1872862922054784:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:3.0:1786109352.077261:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109352.077289:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d23 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a138e expref: 76 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.077308:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.077313:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109352.077386:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca35d2a lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.077400:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca35d2a lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.077410:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca35d2a lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.077420:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca35d31 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 35 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.077573:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca35d31 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.077583:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca35d31 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109352.078741:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 694 rpc_version 694 00000020:00100000:3.0:1786109352.078779:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109352.078790:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098c346d80 x1872862933126144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109352.078812:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c346d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933126144:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109352.078877:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109352.078917:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977900 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.080086:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c346d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933126144:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1786109352.080214:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35d38 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.080229:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35d38 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.080240:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35d38 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.080257:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35d3f lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.080264:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35d3f lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.080271:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35d3f lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.080300:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.080306:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.080316:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.080331:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933126272:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786109352.080361:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109352.080593:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109352.080644:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933126272 00000100:00100000:1.0:1786109352.080649:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933126272 00000100:00100000:1.0:1786109352.080725:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12107 00000100:00100000:1.0:1786109352.080734:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188678:x1872862933126272:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786109352.080749:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109352.080764:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35d4d lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35d46 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.080784:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35d4d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35d46 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.080796:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35d4d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35d46 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.080810:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3d:0x0].0x0 (ffff930ab7f80d00) 00010000:00010000:1.0:1786109352.080813:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.080816:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2c600, rc 0) 00000100:00100000:1.0:1786109352.080866:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188678:x1872862933126272:12345-0@lo:101:mdt00_003.0 Request processed in 132us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.080872:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12107 00000100:00100000:3.0:1786109352.080928:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933126272:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786109352.080942:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35d4d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.080952:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35d4d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109352.080972:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8ba36b7 reply state 00000000a059f3cf transno 326417514615 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35d3f lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.080982:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35d3f lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.080988:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3d:0x0].0x0 (ffff930984516300) 00010000:00010000:3.0:1786109352.080990:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109352.080993:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109352.080998:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35d4d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.081005:0:188678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35d4d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109352.081031:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x3d:0x0] 00000004:00010000:3.0:1786109352.081037:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8ba36b7 reply state 00000000a059f3cf transno 326417514615 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35d38 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.081050:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35d38 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.081055:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd9:0x0].0x0 (ffff930984516900) 00010000:00010000:3.0:1786109352.081058:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109352.081059:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1786109352.081064:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd9:0x0]: returning size 4096 00010000:00010000:3.0:1786109352.081071:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca35d2a lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.081077:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca35d2a lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.081083:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca35d2a lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.081089:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.081093:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca35d2a lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.081101:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca35d2a lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.081109:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.081112:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.081115:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca35d2a lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.081120:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca35d2a lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109352.081136:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8ba36b7 reply state 00000000a059f3cf transno 326417514615 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca35d31 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.081145:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca35d31 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.081151:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109352.081153:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109352.081155:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1786109352.081240:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+77:157881:x1872862922054784:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 4063us (4311us total) trans 326417514615 rc 0/0 00000100:00100000:3.0:1786109352.081246:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 802 00000100:00100000:2.0:1786109352.112379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109352.112979:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922054912 00000100:00100000:0.0:1786109352.112989:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922054912 00000100:00100000:1.0:1786109352.113164:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 803 00000100:00100000:1.0:1786109352.113184:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+77:157883:x1872862922054912:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109352.113209:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109352.113303:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35d54 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1395 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.113370:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35d5b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.113383:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35d5b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.113394:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35d5b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.113405:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35d62 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 36 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.113537:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35d62 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.113547:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35d62 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.113617:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35d69 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.113626:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35d69 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.113632:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35d69 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109352.113987:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd9:0x0]: returning size 4096 00000004:00200000:1.0:1786109352.113993:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1786109352.114013:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35d69 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114025:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35d5b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114032:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35d5b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114040:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35d5b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114046:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109352.114050:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35d5b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114058:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35d5b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114069:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109352.114073:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.114077:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35d5b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114083:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35d5b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114096:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35d62 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114103:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35d62 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114108:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35d62 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114114:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109352.114117:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35d62 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114123:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35d62 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114130:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109352.114133:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.114136:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35d62 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114141:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35d62 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114167:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35d54 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1395 expref: 79 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114192:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35d69 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1395 expref: 78 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.114200:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd9:0x0].0x0 (ffff930984516900) 00010000:00010000:1.0:1786109352.114202:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109352.114205:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d400, rc 0) 00000100:00100000:1.0:1786109352.114342:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+78:157883:x1872862922054912:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 1167us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.114350:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 803 00000100:00100000:0.0:1786109352.118997:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.119055:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922055040 00000100:00100000:1.0:1786109352.119063:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922055040 00000100:00100000:1.0:1786109352.119110:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 804 00000100:00100000:1.0:1786109352.119122:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+78:157883:x1872862922055040:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:1.0:1786109352.119142:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109352.119162:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35d70 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a139c expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.119234:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d77 lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.119262:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d77 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.119273:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d77 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109352.119323:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x3d:0x0]: returning size 4096 00000004:00200000:1.0:1786109352.119329:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786109352.119363:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35d70 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a139c expref: 80 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.119382:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d77 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a139c expref: 79 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.119390:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3d:0x0].0x0 (ffff930984516300) 00010000:00010000:1.0:1786109352.119393:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786109352.119396:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d600, rc 0) 00000100:00100000:1.0:1786109352.119562:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+79:157883:x1872862922055040:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 442us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.119570:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 804 00000100:00100000:3.0:1786109352.127193:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109352.127522:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922055168 00000100:00100000:2.0:1786109352.127532:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922055168 00000100:00080000:0.0:1786109352.128010:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109352.128857:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 805 00000100:00100000:3.0:1786109352.128879:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:157883:x1872862922055168:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109352.128901:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.128924:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e800/0xdb52b77d7ca35d7e lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13a3 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.128986:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.129002:0:187901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35d4d lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35d46 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.129011:0:187901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.129050:0:187901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35d4d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35d46 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.129066:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933126400:0@lo:104: 00000100:00100000:3.0:1786109352.129128:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109352.129583:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977900 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.132271:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933126400 00000100:00100000:0.0:1786109352.132285:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933126400 00000100:00100000:0.0:1786109352.132408:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5247 00000100:00100000:0.0:1786109352.132419:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933126400:12345-0@lo:104: 00010000:00010000:0.0:1786109352.132477:0:10344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35d4d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.132573:0:10344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786109352.132579:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187901:x1872862933126400:12345-0@lo:104: Request processed in 163us (3452us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.132587:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5247 00000100:00100000:2.0:1786109352.132671:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:187901:1872862933126400:0@lo:104: 00010000:00010000:2.0:1786109352.132699:0:187901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.132855:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109352.132862:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35d4d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.132870:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d200 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109352.132875:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca35d4d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109352.132884:0:6515:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca35d4d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.132914:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35d4d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.132920:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1786109352.132970:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933126528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109352.133010:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.133081:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933126528 00000100:00100000:1.0:1786109352.133086:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933126528 00010000:00010000:1.0:1786109352.133107:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35d4d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca35d46 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.133142:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12614 00000100:00100000:1.0:1786109352.133149:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3649:x1872862933126528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109352.133160:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109352.134239:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35d4d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.134252:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d200/0xdb52b77d7ca35d46 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35d4d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.134273:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109352.134275:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109352.134277:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786109352.135797:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804468 is committed 00010000:00010000:1.0:1786109352.135958:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35d4d lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca35d46 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.135975:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3d:0x0].0x0 (ffff930ab7f80d00) 00010000:00010000:1.0:1786109352.135981:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.135995:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.136001:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.136067:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109352.136138:0:187901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.136146:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.136209:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933126528:12345-0@lo:103:ldlm_bl.0 Request processed in 3058us (3196us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.136219:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12614 00000100:00100000:3.0:1786109352.136316:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933126528:0@lo:103:ldlm_bl.0 00000004:00200000:2.0:1786109352.136392:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x3d:0x0]: returning size 4096 00000004:00200000:2.0:1786109352.136397:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786109352.136611:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e800/0xdb52b77d7ca35d7e lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13a3 expref: 8 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.136630:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13a3 expref: 7 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.136638:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3d:0x0].0x0 (ffff930ab7f80d00) 00010000:00010000:2.0:1786109352.136640:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786109352.136643:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295e600, rc 0) 00000100:00100000:2.0:1786109352.136733:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:157883:x1872862922055168:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 7864us (9569us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.136741:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 805 00000100:00100000:2.0:1786109352.145102:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.145213:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922055424 00000100:00100000:3.0:1786109352.145223:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922055424 00000100:00100000:3.0:1786109352.145290:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 806 00000100:00100000:3.0:1786109352.145300:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+79:157883:x1872862922055424:12345-192.168.203.38@tcp:36:rmdir.0 00010000:00010000:3.0:1786109352.145352:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109352.145379:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35d69 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1395 expref: 79 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145397:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd9:0x0].0x0 (ffff930984516900) 00010000:00010000:3.0:1786109352.145416:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109352.145480:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca35d8c lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145493:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca35d8c lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145502:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca35d8c lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145512:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca35d93 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 36 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145524:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca35d93 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145530:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca35d93 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145599:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca35d9a lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145606:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca35d9a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145612:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca35d9a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145627:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145636:0:188678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d77 lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a139c expref: 78 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145643:0:188678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145674:0:188678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d77 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a139c expref: 78 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.145687:0:188678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d77 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a139c expref: 78 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.145707:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933126656:192.168.203.38@tcp:104: 00000100:00100000:3.0:1786109352.147414:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977240 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.169383:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933126656:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109352.169424:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.175011:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.175074:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922055552 00000100:00100000:3.0:1786109352.175085:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922055552 00010000:00010000:3.0:1786109352.175123:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d77 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a139c expref: 79 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.175165:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12615 00000100:00100000:3.0:1786109352.175186:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:397d331e-10fc-4558-be87-308c3622e8eb+79:2403:x1872862922055552:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109352.175202:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109352.175210:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d77 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a139c expref: 79 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.175224:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d77 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a139c expref: 79 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.175247:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35d77 lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a139c expref: 79 pid: 187899 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.175262:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3d:0x0].0x0 (ffff930984516300) 00010000:00010000:3.0:1786109352.175267:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.175278:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.175285:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.175325:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109352.175383:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:397d331e-10fc-4558-be87-308c3622e8eb+78:2403:x1872862922055552:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 209us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.175391:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12615 00010000:00010000:2.0:1786109352.175903:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.175914:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.175958:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.175967:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.175978:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.175998:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933126784:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786109352.176039:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109352.176076:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab96439c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109352.176105:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933126784 00000100:00100000:1.0:1786109352.176110:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933126784 00000100:00100000:1.0:1786109352.176150:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12108 00000100:00100000:1.0:1786109352.176158:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188678:x1872862933126784:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786109352.176187:0:177399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109352.176201:0:177399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35daf lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35da8 expref: -99 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.176224:0:177399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13a3 expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.176233:0:177399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35daf lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35da8 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.176257:0:177399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13a3 expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.176270:0:177399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13a3 expref: 6 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.176282:0:177399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177399:1872862933126912:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109352.176358:0:177399:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109352.183887:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.183977:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922055680 00000100:00100000:3.0:1786109352.183984:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922055680 00000100:00100000:1.0:1786109352.184008:0:177399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177399:1872862933126912:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109352.184018:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13a3 expref: 7 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.184040:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35daf lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35da8 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.184052:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3d:0x0].0x0 (ffff930ab7f80d00) 00010000:00010000:1.0:1786109352.184055:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109352.184065:0:177399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35daf lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35da8 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.184075:0:177399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35daf lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35da8 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.184083:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2c600, rc 0) 00000100:00100000:3.0:1786109352.184114:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12616 00000100:00100000:3.0:1786109352.184125:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:2403:x1872862922055680:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109352.184137:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109352.184147:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13a3 expref: 7 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.184159:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13a3 expref: 7 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.184215:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933126784:12345-0@lo:101:mdt00_003.0 Request processed in 8057us (8173us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.184224:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12108 00010000:00010000:3.0:1786109352.184233:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35d85 lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13a3 expref: 7 pid: 187901 timeout: 8308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.184256:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3d:0x0].0x0 (ffff930ab7f80d00) 00010000:00010000:3.0:1786109352.184262:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35daf lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35da8 expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.184271:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35daf lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca35da8 expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.184280:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35daf lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca35da8 expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.184295:0:188678:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804468 gen 2 00000004:00080000:2.0:1786109352.184303:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804467 committed transno 25769804468 00010000:00010000:3.0:1786109352.184310:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35daf lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35da8 expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.184325:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6512:1872862933127040:0@lo:105: 00000004:00080000:2.0:1786109352.184339:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804468 committed transno 25769804468 00000100:00100000:2.0:1786109352.184361:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933126784:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1786109352.184366:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786109352.184380:0:188678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.184391:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.184506:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.184646:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933127040 00000100:00100000:0.0:1786109352.184651:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933127040 00000100:00100000:0.0:1786109352.184719:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5248 00000100:00100000:0.0:1786109352.184727:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6512:x1872862933127040:12345-0@lo:105: 00010000:00010000:0.0:1786109352.184736:0:6509:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.184746:0:6509:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.184754:0:6509:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.184761:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.184768:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.184777:0:6509:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.184803:0:6509:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ab8f6d600) 00000100:00100000:0.0:1786109352.184852:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6512:x1872862933127040:12345-0@lo:105: Request processed in 126us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.184858:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5248 00000100:00100000:1.0:1786109352.184915:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6512:1872862933127040:0@lo:105: 00010000:00010000:1.0:1786109352.184927:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109352.184952:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.184969:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922055680:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 844us (1088us total) trans 0 rc 0/0 00010000:00010000:2.0:1786109352.184971:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.184984:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12616 00000100:00100000:2.0:1786109352.185768:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933127168:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1786109352.185816:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109352.185854:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab96439c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.185881:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933127168 00000100:00100000:0.0:1786109352.185887:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933127168 00000100:00100000:0.0:1786109352.185971:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12109 00000100:00100000:0.0:1786109352.185980:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933127168:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1786109352.188074:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933127168:12345-0@lo:403:mdt00_003.0 Request processed in 2087us (2250us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.188087:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12109 00000100:00100000:2.0:1786109352.188110:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933127168:0@lo:403:mdt00_003.0 00000040:00080000:2.0:1786109352.189321:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].458, 656 off696552 00000040:00080000:2.0:1786109352.189524:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].339, 736 off560144 00000004:00080000:2.0:1786109352.189530:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab96439c0 with version 695 00000004:00080000:3.0:1786109352.189672:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 695 rpc_version 695 00000020:00100000:3.0:1786109352.189705:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109352.189713:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984908380 x1872862933127424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109352.189734:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933127424:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109352.189787:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109352.189852:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109352.189899:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933127424 00000100:00100000:2.0:1786109352.189906:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933127424 00000100:00100000:2.0:1786109352.190019:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12110 00000100:00100000:2.0:1786109352.190029:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933127424:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109352.190388:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933127424:12345-0@lo:1000:osp_up1-0.0 Request processed in 360us (600us total) trans 25769804469 rc 0/0 00000100:00100000:2.0:1786109352.190397:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12110 00000100:00100000:3.0:1786109352.190649:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933127424:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1786109352.190717:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dd9:0x0]: returning size 4096 00010000:00010000:2.0:1786109352.190745:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190756:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190763:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190774:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.190779:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190786:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190802:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3d:0x0].0x0 (ffff930984516300) 00010000:00010000:2.0:1786109352.190805:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109352.190810:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190817:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca35da1 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190833:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190841:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190849:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190916:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786109352.190925:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x3d:0x0] 00010000:00010000:2.0:1786109352.190935:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca35d9a lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190942:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca35d9a lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190949:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca35d9a lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190955:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.190958:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca35d9a lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190965:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca35d9a lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190973:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd9:0x0].0x0 (ffff930984516900) 00010000:00010000:2.0:1786109352.190976:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109352.190980:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca35d9a lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190985:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca35d9a lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.190999:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca35d8c lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.191006:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca35d8c lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.191012:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca35d8c lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.191018:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295ec00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.191021:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca35d8c lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.191032:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca35d8c lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.191039:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109352.191042:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.191045:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca35d8c lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.191051:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca35d8c lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109352.191061:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0f7bef8 reply state 00000000965fd903 transno 326417514616 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca35d93 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.191074:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca35d93 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.191081:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109352.191084:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109352.191087:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109352.191161:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+79:157883:x1872862922055424:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 45860us (46067us total) trans 326417514616 rc 0/0 00000100:00100000:2.0:1786109352.191170:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 806 00010000:00010000:1.0:1786109352.191229:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109352.191238:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.191246:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d600 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109352.191251:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.191259:0:10402:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.191290:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.191297:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1786109352.191366:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933127552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109352.191406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786109352.191616:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.191625:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab8f6d600/0xdb52b77d7ca35da8 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35daf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.191645:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109352.191647:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109352.191649:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109352.191680:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933127552 00000100:00100000:2.0:1786109352.191686:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933127552 00000100:00100000:2.0:1786109352.191760:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4490 00000100:00100000:2.0:1786109352.191769:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3646:x1872862933127552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109352.191780:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109352.191796:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35daf lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca35da8 expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.191807:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3d:0x0].0x0 (ffff930ab7f80d00) 00010000:00010000:2.0:1786109352.191815:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109352.191902:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3646:x1872862933127552:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.191908:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4490 00000100:00100000:3.0:1786109352.191957:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933127552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109352.253686:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.253782:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922055808 00000100:00100000:1.0:1786109352.256748:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922055808 00000100:00100000:2.0:1786109352.257345:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 807 00000100:00100000:2.0:1786109352.257361:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+79:157886:x1872862922055808:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109352.257386:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109352.257409:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35db6 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13aa expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257496:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35dbd lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257510:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35dbd lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257522:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35dbd lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257531:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35dc4 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 37 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257538:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35dc4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257544:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35dc4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257585:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35dbd lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257591:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35dbd lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257597:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35dbd lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257602:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6de00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.257606:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35dbd lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257613:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35dbd lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257624:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109352.257627:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.257630:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35dbd lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257636:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35dbd lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257648:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35dc4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257654:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35dc4 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257659:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35dc4 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257665:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.257667:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35dc4 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257672:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35dc4 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257694:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109352.257697:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.257700:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35dc4 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257705:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35dc4 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257730:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35db6 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13aa expref: 80 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257739:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109352.257741:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.257744:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35db6 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13aa expref: 80 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.257751:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d600, rc 0) 00000100:00100000:2.0:1786109352.257823:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+79:157886:x1872862922055808:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 468us (4146us total) trans 0 rc 301/301 00000100:00100000:2.0:1786109352.257830:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 807 00000100:00100000:0.0:1786109352.264806:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.264912:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922055936 00000100:00100000:1.0:1786109352.264922:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922055936 00000100:00100000:1.0:1786109352.264977:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 808 00000100:00100000:1.0:1786109352.264988:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+79:157886:x1872862922055936:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109352.265029:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109352.265051:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dcb lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13b1 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265124:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dd2 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265139:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dd2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265151:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dd2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265162:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35dd9 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 37 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265170:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35dd9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265195:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35dd9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265254:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dd2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265261:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dd2 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265268:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dd2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265274:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2cc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109352.265278:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dd2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265286:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dd2 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265298:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109352.265301:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.265306:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dd2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265407:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dd2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265422:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35dd9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265570:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35dd9 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265578:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35dd9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265583:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109352.265586:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35dd9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265592:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35dd9 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265601:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109352.265603:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.265606:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35dd9 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265612:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35dd9 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265641:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dcb lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13b1 expref: 80 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265651:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109352.265653:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.265657:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dcb lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13b1 expref: 80 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.265665:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2dc00, rc 0) 00000100:00100000:1.0:1786109352.265775:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+79:157886:x1872862922055936:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 790us (978us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109352.265783:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 808 00000100:00100000:0.0:1786109352.271542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109352.271600:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922056064 00000100:00100000:2.0:1786109352.271611:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922056064 00000100:00100000:2.0:1786109352.271687:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 809 00000100:00100000:2.0:1786109352.271698:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+79:157886:x1872862922056064:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109352.271718:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109352.271740:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35de0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13b8 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.271807:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35de7 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.271820:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35de7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.271836:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35de7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109352.271884:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:2.0:1786109352.271888:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109352.271920:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35de7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.271945:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35de0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13b8 expref: 81 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.271962:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35de7 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13b8 expref: 80 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.271971:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109352.271974:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109352.271977:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d200, rc 0) 00000100:00100000:2.0:1786109352.272039:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+80:157886:x1872862922056064:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 343us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.272046:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 809 00000100:00100000:3.0:1786109352.279528:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.279645:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922056320 00000100:00100000:1.0:1786109352.279655:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922056320 00000100:00100000:1.0:1786109352.279746:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 810 00000100:00100000:1.0:1786109352.279756:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+80:157886:x1872862922056320:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1786109352.279810:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109352.279834:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35de7 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13b8 expref: 80 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.279852:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109352.279856:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109352.279907:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dee lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.279919:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dee lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.279928:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dee lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.279938:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35df5 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 37 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.279951:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35df5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.279957:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35df5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109352.280814:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].459, 2152 off698704 00000040:00080000:1.0:1786109352.280887:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].340, 2352 off562496 00000004:00080000:1.0:1786109352.280893:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7cc49c0 with version 696 00000004:00080000:3.0:1786109352.281102:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 696 rpc_version 696 00000020:00100000:3.0:1786109352.281137:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109352.281146:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984909500 x1872862933127808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109352.281169:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933127808:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109352.281246:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109352.281284:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977480 going to sleep for 11 seconds 00000100:00100000:1.0:1786109352.281339:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933127808 00000100:00100000:1.0:1786109352.281345:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933127808 00000100:00100000:1.0:1786109352.281403:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12111 00000100:00100000:1.0:1786109352.281412:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933127808:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109352.281892:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933127808:12345-0@lo:1000:osp_up1-0.0 Request processed in 480us (646us total) trans 25769804470 rc 0/0 00000100:00100000:1.0:1786109352.281900:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12111 00000100:00100000:3.0:1786109352.282111:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933127808:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786109352.282257:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dfc lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.282272:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dfc lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.282283:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dfc lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.282302:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35e03 lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.282308:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35e03 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.282315:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35e03 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.282342:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.282349:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.282361:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.282377:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933127936:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109352.282559:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.282627:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4600 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.282733:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933127936 00000100:00100000:0.0:1786109352.282739:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933127936 00000100:00100000:0.0:1786109352.282817:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12112 00000100:00100000:0.0:1786109352.282828:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187899:x1872862933127936:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786109352.282843:0:177399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109352.282860:0:177399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca35e11 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35e0a expref: -99 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.282879:0:177399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca35e11 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35e0a expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.282890:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca35e11 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35e0a expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.282897:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3e:0x0].0x0 (ffff930a83abd800) 00010000:00010000:0.0:1786109352.282901:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109352.282904:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3c00, rc 0) 00000100:00100000:0.0:1786109352.282974:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187899:x1872862933127936:12345-0@lo:101:mdt00_000.0 Request processed in 149us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.282981:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12112 00000100:00100000:1.0:1786109352.283042:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933127936:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109352.283054:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35e11 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283063:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35e11 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.283088:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032626631 reply state 00000000ee9e8569 transno 326417514617 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35e03 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283099:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35e03 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283105:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3e:0x0].0x0 (ffff930ab7f80c00) 00010000:00010000:1.0:1786109352.283107:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109352.283110:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109352.283115:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35e11 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283123:0:187899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35e11 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109352.283132:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x3e:0x0] 00000004:00010000:1.0:1786109352.283137:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032626631 reply state 00000000ee9e8569 transno 326417514617 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dfc lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283143:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dfc lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283149:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dda:0x0].0x0 (ffff930ab7f80600) 00010000:00010000:1.0:1786109352.283151:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109352.283153:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1786109352.283157:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dda:0x0]: returning size 4096 00010000:00010000:1.0:1786109352.283164:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dee lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283170:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dee lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283188:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dee lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283194:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2dc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109352.283197:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dee lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283204:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dee lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283213:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109352.283215:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.283218:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dee lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283223:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35dee lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.283236:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032626631 reply state 00000000ee9e8569 transno 326417514617 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35df5 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283244:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35df5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.283250:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109352.283252:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109352.283254:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1786109352.283361:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+81:157886:x1872862922056320:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 3605us (3840us total) trans 326417514617 rc 0/0 00000100:00100000:1.0:1786109352.283369:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 810 00000100:00100000:0.0:1786109352.314699:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.314804:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922056448 00000100:00100000:3.0:1786109352.314815:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922056448 00000100:00100000:3.0:1786109352.314921:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 811 00000100:00100000:3.0:1786109352.314931:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+81:157889:x1872862922056448:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109352.314953:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.314972:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca35e18 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13bf expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315034:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35e1f lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315048:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35e1f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315057:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35e1f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315075:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e26 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 38 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315083:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e26 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315090:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e26 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315158:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca35e2d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315166:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca35e2d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315222:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca35e2d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109352.315306:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dda:0x0]: returning size 4096 00000004:00200000:3.0:1786109352.315311:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1786109352.315330:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca35e2d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315342:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35e1f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315349:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35e1f lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315355:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35e1f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315366:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295fc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.315370:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35e1f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315377:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35e1f lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315389:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.315392:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.315549:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35e1f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315557:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35e1f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315570:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e26 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315575:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e26 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315580:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e26 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315584:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295fa00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.315587:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e26 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315592:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e26 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315603:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109352.315605:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.315608:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e26 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315614:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e26 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315641:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca35e18 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13bf expref: 83 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315656:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca35e2d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13bf expref: 82 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.315664:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dda:0x0].0x0 (ffff930ab7f80600) 00010000:00010000:3.0:1786109352.315666:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109352.315669:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295fe00, rc 0) 00000100:00100000:3.0:1786109352.315769:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+82:157889:x1872862922056448:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 839us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.315777:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 811 00000100:00100000:2.0:1786109352.319114:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.319240:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922056576 00000100:00100000:3.0:1786109352.319250:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922056576 00000100:00100000:3.0:1786109352.319355:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 812 00000100:00100000:3.0:1786109352.319366:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+82:157889:x1872862922056576:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109352.319384:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.319402:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca35e34 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13c6 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.319488:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f800/0xdb52b77d7ca35e3b lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.319501:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f800/0xdb52b77d7ca35e3b lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.319511:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f800/0xdb52b77d7ca35e3b lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109352.319557:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x3e:0x0]: returning size 4096 00000004:00200000:3.0:1786109352.319561:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786109352.319596:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca35e34 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13c6 expref: 84 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.319628:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f800/0xdb52b77d7ca35e3b lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13c6 expref: 83 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.319637:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3e:0x0].0x0 (ffff930ab7f80c00) 00010000:00010000:3.0:1786109352.319640:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786109352.319644:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295f800, rc 0) 00000100:00100000:3.0:1786109352.319702:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+83:157889:x1872862922056576:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 339us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.319709:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 812 00000100:00100000:2.0:1786109352.321818:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.321888:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922056704 00000100:00100000:3.0:1786109352.321897:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922056704 00000100:00100000:3.0:1786109352.321944:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 813 00000100:00100000:3.0:1786109352.321953:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:157889:x1872862922056704:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109352.321972:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.321988:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35e42 lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13cd expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.322069:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.322083:0:187900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca35e11 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35e0a expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.322092:0:187900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.322124:0:187900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca35e11 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35e0a expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.322139:0:187900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933128064:0@lo:104: 00000100:00100000:3.0:1786109352.322191:0:187900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109352.322253:0:187900:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977480 going to sleep for 11 seconds 00000100:00100000:1.0:1786109352.322418:0:10344:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1786109352.322462:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933128064 00000100:00100000:1.0:1786109352.322467:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933128064 00000100:00100000:1.0:1786109352.322498:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5249 00000100:00100000:1.0:1786109352.322504:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1797050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933128064:12345-0@lo:104: 00010000:00010000:1.0:1786109352.322517:0:10344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35e11 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.322580:0:10344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786109352.322586:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1797050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933128064:12345-0@lo:104: Request processed in 82us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.322593:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5249 00010000:00010000:1.0:1786109352.322631:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109352.322637:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35e11 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.322645:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d200 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109352.322650:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca35e11 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.322658:0:6514:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca35e11 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.322684:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35e11 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.322689:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109352.322714:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35e11 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.322725:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2d200/0xdb52b77d7ca35e0a lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35e11 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.322741:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109352.322743:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109352.322744:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109352.322751:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109352.322761:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933128192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109352.322787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.322814:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933128192 00000100:00100000:1.0:1786109352.322818:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933128192 00010000:00010000:1.0:1786109352.322833:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca35e11 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca35e0a expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.322854:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12617 00000100:00100000:1.0:1786109352.322860:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3646:x1872862933128192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109352.322868:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1786109352.323243:0:187900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933128064:0@lo:104: 00010000:00010000:2.0:1786109352.323261:0:187900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786109352.326533:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804470 is committed 00010000:00010000:1.0:1786109352.326661:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca35e11 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca35e0a expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.326681:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3e:0x0].0x0 (ffff930a83abd800) 00010000:00010000:1.0:1786109352.326687:0:43921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.326696:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.326708:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.326779:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109352.326861:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933128192:12345-0@lo:103:ldlm_bl.0 Request processed in 3999us (4070us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.326872:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12617 00000100:00100000:3.0:1786109352.326896:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933128192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109352.326924:0:187900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.326933:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109352.326986:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x3e:0x0]: returning size 4096 00000004:00200000:2.0:1786109352.326992:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786109352.327037:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295e600/0xdb52b77d7ca35e42 lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13cd expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.327055:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13cd expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.327063:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3e:0x0].0x0 (ffff930a83abd800) 00010000:00010000:2.0:1786109352.327066:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786109352.327068:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295fa00, rc 0) 00000100:00100000:2.0:1786109352.327117:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:157889:x1872862922056704:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 5165us (5307us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.327128:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 813 00000100:00100000:0.0:1786109352.338586:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.340241:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922056960 00000100:00100000:1.0:1786109352.340254:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922056960 00000100:00100000:1.0:1786109352.340388:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 814 00000100:00100000:1.0:1786109352.340400:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+83:157889:x1872862922056960:12345-192.168.203.38@tcp:36:rmdir.0 00010000:00010000:1.0:1786109352.340471:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109352.340498:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca35e2d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13bf expref: 83 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340516:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dda:0x0].0x0 (ffff930ab7f80600) 00010000:00010000:1.0:1786109352.340521:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109352.340541:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35e50 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340554:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35e50 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340563:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35e50 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340576:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35e57 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 38 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340594:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35e57 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340602:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35e57 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340684:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35e5e lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340693:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35e5e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340701:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35e5e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340718:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340728:0:187899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f800/0xdb52b77d7ca35e3b lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13c6 expref: 82 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340736:0:187899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340768:0:187899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f800/0xdb52b77d7ca35e3b lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13c6 expref: 82 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.340782:0:187899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f800/0xdb52b77d7ca35e3b lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13c6 expref: 82 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.340801:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933128320:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109352.340891:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4240 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.355049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.355111:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933128320:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109352.355135:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.355261:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922057088 00000100:00100000:2.0:1786109352.355268:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922057088 00010000:00010000:2.0:1786109352.355299:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f800/0xdb52b77d7ca35e3b lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13c6 expref: 83 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.355363:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12618 00000100:00100000:2.0:1786109352.355372:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:397d331e-10fc-4558-be87-308c3622e8eb+83:2403:x1872862922057088:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786109352.355389:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109352.355583:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f800/0xdb52b77d7ca35e3b lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13c6 expref: 83 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.355597:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f800/0xdb52b77d7ca35e3b lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13c6 expref: 83 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.355620:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f800/0xdb52b77d7ca35e3b lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13c6 expref: 83 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.355635:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3e:0x0].0x0 (ffff930ab7f80c00) 00010000:00010000:2.0:1786109352.355640:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.355650:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.355657:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.355724:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109352.355781:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:397d331e-10fc-4558-be87-308c3622e8eb+82:2403:x1872862922057088:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 409us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.355788:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12618 00010000:00010000:1.0:1786109352.356109:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.356117:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.356158:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.356166:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.356187:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.356205:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933128448:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109352.356244:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.356304:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4240 going to sleep for 11 seconds 00000100:00100000:2.0:1786109352.356345:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933128448 00000100:00100000:2.0:1786109352.356350:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933128448 00000100:00100000:2.0:1786109352.356500:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12113 00000100:00100000:2.0:1786109352.356509:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187899:x1872862933128448:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786109352.356525:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109352.356538:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35e73 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35e6c expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.356559:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13cd expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.356567:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35e73 lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35e6c expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.356589:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13cd expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.356601:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13cd expref: 6 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.356612:0:8452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8452:1872862933128576:192.168.203.38@tcp:104: 00000100:00100000:2.0:1786109352.356714:0:8452:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.386982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.387078:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922057216 00000100:00100000:1.0:1786109352.387087:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922057216 00010000:00010000:1.0:1786109352.387127:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13cd expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.387194:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12619 00000100:00100000:1.0:1786109352.387205:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:2402:x1872862922057216:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109352.387220:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109352.387227:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 5/0,0 mode: PR/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13cd expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.387239:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13cd expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.387262:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3e:0x0].0x0 (ffff930a83abd800) 00010000:00010000:1.0:1786109352.387269:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35e73 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35e6c expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.387280:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35e73 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca35e6c expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.387289:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35e73 lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca35e6c expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.387325:0:6513:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35e73 lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35e6c expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.387341:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6513:1872862933128704:0@lo:105: 00000100:00100000:1.0:1786109352.387386:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.387604:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a978b2600 going to sleep for 11 seconds 00010000:00010000:2.0:1786109352.387724:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fa00/0xdb52b77d7ca35e49 lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13cd expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.387742:0:8452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8452:1872862933128576:192.168.203.38@tcp:104: 00010000:00010000:2.0:1786109352.387764:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35e73 lrc: 4/0,0 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35e6c expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.387773:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3e:0x0].0x0 (ffff930a83abd800) 00010000:00010000:2.0:1786109352.387776:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109352.387778:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6c600, rc 0) 00000100:00100000:0.0:1786109352.387869:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933128704 00000100:00100000:0.0:1786109352.387874:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933128704 00000100:00100000:0.0:1786109352.387950:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5250 00000100:00100000:0.0:1786109352.387959:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6513:x1872862933128704:12345-0@lo:105: 00010000:00010000:0.0:1786109352.387971:0:6509:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.387980:0:6509:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.387988:0:6509:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.387996:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.388009:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.388017:0:6509:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.388031:0:6509:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ac0b2da00) 00000100:00100000:0.0:1786109352.388080:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6513:x1872862933128704:12345-0@lo:105: Request processed in 122us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.388086:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5250 00000100:00100000:2.0:1786109352.388139:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6513:1872862933128704:0@lo:105: 00010000:00010000:2.0:1786109352.388151:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109352.388202:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922057216:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 999us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.388209:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12619 00000100:00100000:3.0:1786109352.388293:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933128448:12345-0@lo:101:mdt00_000.0 Request processed in 31784us (32047us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.388301:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12113 00000100:00100000:2.0:1786109352.388371:0:187899:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804470 gen 2 00000004:00080000:2.0:1786109352.388377:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804469 committed transno 25769804470 00000004:00080000:2.0:1786109352.388391:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804470 committed transno 25769804470 00000100:00100000:2.0:1786109352.388418:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933128448:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786109352.388467:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.389160:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933128832:0@lo:403:mdt00_000.0 00000100:00100000:2.0:1786109352.389218:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109352.389252:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933128832 00000100:00100000:2.0:1786109352.389257:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933128832 00000100:00100000:2.0:1786109352.389288:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12114 00000100:00100000:2.0:1786109352.389296:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933128832:12345-0@lo:403:mdt00_000.0 00000100:00100000:3.0:1786109352.390259:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab96439c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.392072:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933128832:12345-0@lo:403:mdt00_000.0 Request processed in 2768us (2844us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.392085:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12114 00000100:00100000:1.0:1786109352.392168:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933128832:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1786109352.393325:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].460, 656 off699360 00000040:00080000:1.0:1786109352.393755:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].341, 736 off563232 00000004:00080000:1.0:1786109352.393761:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a978b2f00 with version 697 00000004:00080000:3.0:1786109352.393842:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 697 rpc_version 697 00000020:00100000:3.0:1786109352.393875:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109352.393884:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984909180 x1872862933129088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109352.393906:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933129088:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109352.393979:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109352.394062:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977900 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.394107:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933129088 00000100:00100000:0.0:1786109352.394114:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933129088 00000100:00100000:0.0:1786109352.394204:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12115 00000100:00100000:0.0:1786109352.394214:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab5394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933129088:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109352.394511:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab5394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933129088:12345-0@lo:1000:osp_up1-0.0 Request processed in 298us (532us total) trans 25769804471 rc 0/0 00000100:00100000:0.0:1786109352.394520:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12115 00000100:00100000:2.0:1786109352.394853:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933129088:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1786109352.394931:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dda:0x0]: returning size 4096 00010000:00010000:1.0:1786109352.394953:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.394964:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.394971:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.394978:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2ce00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109352.394982:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.394991:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395005:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3e:0x0].0x0 (ffff930ab7f80c00) 00010000:00010000:1.0:1786109352.395008:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109352.395013:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395020:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35e65 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395034:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395048:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395055:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395123:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786109352.395131:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x3e:0x0] 00010000:00010000:1.0:1786109352.395139:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35e5e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395146:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35e5e lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395152:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35e5e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395157:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109352.395160:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35e5e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395167:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35e5e lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395186:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dda:0x0].0x0 (ffff930ab7f80600) 00010000:00010000:1.0:1786109352.395189:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109352.395192:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35e5e lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395198:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35e5e lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395212:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35e50 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395217:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35e50 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395222:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35e50 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395226:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109352.395229:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35e50 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395233:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35e50 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395240:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109352.395243:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.395245:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35e50 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395251:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35e50 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.395260:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4ed6de5 reply state 000000007c88b757 transno 326417514618 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35e57 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395272:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35e57 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.395281:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109352.395284:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109352.395286:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109352.395633:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+83:157889:x1872862922056960:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 55233us (57053us total) trans 326417514618 rc 0/0 00000100:00100000:1.0:1786109352.395642:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 814 00010000:00010000:0.0:1786109352.395927:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109352.395934:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.395943:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2da00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109352.395948:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109352.395957:0:29734:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.395987:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.395994:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1786109352.396045:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933129216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109352.396090:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.396164:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933129216 00000100:00100000:1.0:1786109352.396170:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933129216 00000100:00100000:1.0:1786109352.396224:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4491 00000100:00100000:1.0:1786109352.396232:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3648:x1872862933129216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109352.396243:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109352.396262:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35e73 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca35e6c expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.396275:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3e:0x0].0x0 (ffff930a83abd800) 00010000:00010000:1.0:1786109352.396283:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109352.396522:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.396531:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2da00/0xdb52b77d7ca35e6c lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35e73 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.396549:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109352.396550:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109352.396552:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109352.396725:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1872862933129216:12345-0@lo:103:ldlm_bl.0 Request processed in 493us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.396733:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4491 00000100:00100000:2.0:1786109352.396794:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933129216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109352.412959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109352.413055:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922057344 00000100:00100000:2.0:1786109352.413065:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922057344 00000100:00100000:2.0:1786109352.413165:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 815 00000100:00100000:2.0:1786109352.413186:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+83:157890:x1872862922057344:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109352.413209:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109352.413229:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35e7a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13d4 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413297:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e81 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413311:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e81 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413322:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e81 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413333:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e88 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 39 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413340:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e88 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413351:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e88 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413389:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e81 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413397:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e81 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413414:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e81 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413420:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.413423:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e81 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413467:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e81 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413480:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109352.413483:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.413487:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e81 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413492:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e81 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413503:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e88 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413508:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e88 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413514:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e88 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413518:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.413520:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e88 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413525:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e88 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413532:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109352.413535:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.413538:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e88 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413543:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e88 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413571:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35e7a lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13d4 expref: 84 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413581:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109352.413583:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.413587:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35e7a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13d4 expref: 84 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.413596:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6de00, rc 0) 00000100:00100000:2.0:1786109352.413650:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+83:157890:x1872862922057344:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 476us (699us total) trans 0 rc 301/301 00000100:00100000:2.0:1786109352.413658:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 815 00000100:00100000:3.0:1786109352.419340:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109352.419505:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922057472 00000100:00100000:2.0:1786109352.419515:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922057472 00000100:00100000:2.0:1786109352.419572:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 816 00000100:00100000:2.0:1786109352.419582:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+83:157890:x1872862922057472:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109352.419602:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109352.419621:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35e8f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13db expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419690:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e96 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419705:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e96 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419716:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e96 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419728:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e9d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 39 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419736:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e9d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419743:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e9d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419779:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e96 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419791:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e96 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419798:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e96 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419804:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.419808:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e96 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419815:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e96 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419827:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109352.419830:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.419834:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e96 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419841:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35e96 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419851:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e9d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419857:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e9d lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419862:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e9d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419867:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.419870:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e9d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419876:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e9d lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419883:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109352.419886:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.419888:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e9d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419894:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35e9d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419921:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35e8f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13db expref: 84 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419930:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109352.419932:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.419936:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35e8f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13db expref: 84 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.419944:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6de00, rc 0) 00000100:00100000:2.0:1786109352.420096:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+83:157890:x1872862922057472:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 515us (764us total) trans 0 rc 301/301 00000100:00100000:2.0:1786109352.420106:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 816 00000100:00100000:0.0:1786109352.426126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.426235:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922057600 00000100:00100000:3.0:1786109352.426244:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922057600 00000100:00100000:3.0:1786109352.426343:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 817 00000100:00100000:3.0:1786109352.426354:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+83:157890:x1872862922057600:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109352.426374:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.426395:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35ea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13e2 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.426506:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca35eab lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.426521:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca35eab lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.426532:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca35eab lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109352.426575:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:3.0:1786109352.426579:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109352.426598:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca35eab lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.426623:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13e2 expref: 85 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.426642:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca35eab lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13e2 expref: 84 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.426651:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.426654:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109352.426658:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295ea00, rc 0) 00000100:00100000:3.0:1786109352.426710:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+84:157890:x1872862922057600:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 359us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.426718:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 817 00000100:00100000:0.0:1786109352.433856:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.433961:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922057856 00000100:00100000:1.0:1786109352.433970:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922057856 00000100:00100000:1.0:1786109352.434077:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 818 00000100:00100000:1.0:1786109352.434088:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+84:157890:x1872862922057856:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1786109352.434142:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109352.434167:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca35eab lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13e2 expref: 84 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.434198:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109352.434204:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109352.434259:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35eb2 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.434271:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35eb2 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.434281:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35eb2 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.434292:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35eb9 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 39 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.434305:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35eb9 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.434312:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35eb9 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109352.435115:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].461, 2152 off701512 00000040:00080000:1.0:1786109352.435199:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].342, 2352 off565584 00000004:00080000:1.0:1786109352.435205:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a90a66240 with version 698 00000004:00080000:0.0:1786109352.435274:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 698 rpc_version 698 00000020:00100000:0.0:1786109352.435306:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109352.435314:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9309854fbb80 x1872862933129472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109352.435336:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933129472:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109352.435391:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109352.435427:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109352.435605:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933129472 00000100:00100000:1.0:1786109352.435612:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933129472 00000100:00100000:1.0:1786109352.435688:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12116 00000100:00100000:1.0:1786109352.435696:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933129472:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109352.436152:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933129472:12345-0@lo:1000:osp_up1-0.0 Request processed in 455us (759us total) trans 25769804472 rc 0/0 00000100:00100000:1.0:1786109352.436159:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12116 00000100:00100000:0.0:1786109352.436615:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933129472:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786109352.436738:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35ec0 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.436753:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35ec0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.436764:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35ec0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.436783:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35ec7 lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.436789:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35ec7 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.436796:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35ec7 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.436822:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.436831:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.436840:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.436856:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933129600:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109352.436888:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.436919:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.436975:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933129600 00000100:00100000:3.0:1786109352.436981:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933129600 00000100:00100000:3.0:1786109352.437056:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12117 00000100:00100000:3.0:1786109352.437065:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187899:x1872862933129600:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786109352.437080:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.437095:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35ed5 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35ece expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.437112:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35ed5 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35ece expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.437122:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35ed5 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35ece expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.437130:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3f:0x0].0x0 (ffff930985b9d500) 00010000:00010000:3.0:1786109352.437133:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.437136:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295fc00, rc 0) 00000100:00100000:3.0:1786109352.437191:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187899:x1872862933129600:12345-0@lo:101:mdt00_000.0 Request processed in 127us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.437197:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12117 00000100:00100000:1.0:1786109352.437245:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933129600:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109352.437257:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35ed5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437271:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35ed5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.437290:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000540bca2b reply state 000000001c8e8f99 transno 326417514619 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35ec7 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437300:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35ec7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437306:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3f:0x0].0x0 (ffff930ab7f80000) 00010000:00010000:1.0:1786109352.437308:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109352.437311:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109352.437316:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35ed5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437323:0:187899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35ed5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109352.437332:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x3f:0x0] 00000004:00010000:1.0:1786109352.437336:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000540bca2b reply state 000000001c8e8f99 transno 326417514619 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35ec0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437344:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35ec0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437350:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddb:0x0].0x0 (ffff930ab7f80400) 00010000:00010000:1.0:1786109352.437352:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109352.437354:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1786109352.437358:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1ddb:0x0]: returning size 4096 00010000:00010000:1.0:1786109352.437365:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35eb2 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437371:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35eb2 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437378:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35eb2 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437384:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109352.437389:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35eb2 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437407:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35eb2 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437418:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109352.437420:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.437424:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35eb2 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437449:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35eb2 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.437460:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000540bca2b reply state 000000001c8e8f99 transno 326417514619 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35eb9 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437468:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35eb9 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.437474:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109352.437476:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109352.437479:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1786109352.437550:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+85:157890:x1872862922057856:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 3463us (3702us total) trans 326417514619 rc 0/0 00000100:00100000:1.0:1786109352.437558:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 818 00000100:00100000:0.0:1786109352.492868:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109352.493197:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922057984 00000100:00100000:2.0:1786109352.493208:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922057984 00000100:00100000:2.0:1786109352.493302:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 819 00000100:00100000:2.0:1786109352.493312:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+85:157891:x1872862922057984:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:2.0:1786109352.493337:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109352.493358:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35edc lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13e9 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493473:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35ee3 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493487:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35ee3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493498:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35ee3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493510:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35eea lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 40 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493518:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35eea lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493526:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35eea lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493599:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35ef1 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493608:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35ef1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493615:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35ef1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109352.493818:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1ddb:0x0]: returning size 4096 00000004:00200000:2.0:1786109352.493824:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1786109352.493848:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35ef1 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493861:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35ee3 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493868:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35ee3 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493875:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35ee3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493881:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.493885:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35ee3 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493892:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35ee3 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493906:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109352.493909:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.493914:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35ee3 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493920:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca35ee3 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493935:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35eea lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493941:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35eea lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493951:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35eea lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493956:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6de00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.493959:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35eea lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493964:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35eea lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493971:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109352.493973:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.493976:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35eea lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.493982:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca35eea lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.494009:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35edc lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13e9 expref: 87 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.494021:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35ef1 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13e9 expref: 86 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.494028:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddb:0x0].0x0 (ffff930ab7f80400) 00010000:00010000:2.0:1786109352.494030:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109352.494033:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6c600, rc 0) 00000100:00100000:2.0:1786109352.494152:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+86:157891:x1872862922057984:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 840us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.494162:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 819 00000100:00100000:2.0:1786109352.506358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.506645:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922058112 00000100:00100000:3.0:1786109352.506655:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922058112 00000100:00100000:3.0:1786109352.506793:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 820 00000100:00100000:3.0:1786109352.506804:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+86:157891:x1872862922058112:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109352.506823:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.506841:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca35ef8 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13f0 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.506904:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35eff lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.507151:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35eff lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.507163:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35eff lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109352.507220:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x3f:0x0]: returning size 4096 00000004:00200000:3.0:1786109352.507225:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786109352.507263:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca35ef8 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f0 expref: 88 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.507279:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35eff lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f0 expref: 87 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.507287:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3f:0x0].0x0 (ffff930ab7f80000) 00010000:00010000:3.0:1786109352.507290:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786109352.507294:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295f000, rc 0) 00000100:00100000:3.0:1786109352.507360:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+87:157891:x1872862922058112:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 558us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.507367:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 820 00000100:00100000:0.0:1786109352.516113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.516524:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922058240 00000100:00100000:3.0:1786109352.516534:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922058240 00000100:00100000:3.0:1786109352.517017:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 821 00000100:00100000:3.0:1786109352.517029:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:157891:x1872862922058240:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109352.517049:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.517068:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f06 lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13f7 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.517125:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.517139:0:187900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35ed5 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35ece expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.517147:0:187900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.517217:0:187900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35ed5 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35ece expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.517234:0:187900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933129728:0@lo:104: 00000100:00100000:3.0:1786109352.517283:0:187900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109352.517337:0:187900:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac09773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.517868:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933129728 00000100:00100000:0.0:1786109352.517875:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933129728 00000100:00100000:0.0:1786109352.517925:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5251 00000100:00100000:0.0:1786109352.517934:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933129728:12345-0@lo:104: 00010000:00010000:0.0:1786109352.517948:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35ed5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.518418:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786109352.518458:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933129728:12345-0@lo:104: Request processed in 492us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.518467:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5251 00010000:00010000:1.0:1786109352.518583:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109352.518591:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35ed5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.518601:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c600 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109352.518607:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca35ed5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.518616:0:6515:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca35ed5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.518645:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35ed5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.518653:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109352.518684:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35ed5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.518693:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0b2c600/0xdb52b77d7ca35ece lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35ed5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.518710:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109352.518712:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109352.518714:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109352.518760:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933129856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109352.518798:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.518865:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933129856 00000100:00100000:1.0:1786109352.518870:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933129856 00010000:00010000:1.0:1786109352.518891:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35ed5 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca35ece expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.518955:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12620 00000100:00100000:1.0:1786109352.519041:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3649:x1872862933129856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109352.519052:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786109352.520728:0:187900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933129728:0@lo:104: 00010000:00010000:3.0:1786109352.520751:0:187900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786109352.522780:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804472 is committed 00010000:00010000:1.0:1786109352.522904:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35ed5 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca35ece expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.522925:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3f:0x0].0x0 (ffff930985b9d500) 00010000:00010000:1.0:1786109352.522932:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.522941:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.522949:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.523060:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109352.523356:0:187900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.523365:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109352.529726:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x3f:0x0]: returning size 4096 00000004:00200000:3.0:1786109352.529739:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786109352.529806:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f06 lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f7 expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.529833:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f7 expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.529843:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3f:0x0].0x0 (ffff930985b9d500) 00010000:00010000:3.0:1786109352.529846:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786109352.529851:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295f400, rc 0) 00000100:00100000:3.0:1786109352.529943:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:157891:x1872862922058240:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 12915us (13837us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.529952:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 821 00000100:00100000:1.0:1786109352.530114:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933129856:12345-0@lo:103:ldlm_bl.0 Request processed in 11076us (11313us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.530896:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933129856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109352.531065:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12620 00000100:00100000:0.0:1786109352.532870:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.532952:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922058496 00000100:00100000:1.0:1786109352.532974:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922058496 00000100:00100000:1.0:1786109352.533031:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 822 00000100:00100000:1.0:1786109352.533042:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+87:157891:x1872862922058496:12345-192.168.203.38@tcp:36:rmdir.0 00010000:00010000:1.0:1786109352.533092:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109352.533118:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca35ef1 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13e9 expref: 87 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533151:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddb:0x0].0x0 (ffff930ab7f80400) 00010000:00010000:1.0:1786109352.533157:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109352.533199:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35f14 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533212:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35f14 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533220:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35f14 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533288:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35f1b lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 40 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533301:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35f1b lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533309:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35f1b lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533392:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35f22 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533400:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35f22 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533408:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35f22 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533423:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533470:0:187899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35eff lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f0 expref: 86 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533480:0:187899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533513:0:187899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35eff lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f0 expref: 86 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.533527:0:187899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35eff lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f0 expref: 86 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.533542:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933129984:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109352.533625:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34540 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.537980:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.538018:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933129984:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109352.538048:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.538643:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922058624 00000100:00100000:3.0:1786109352.538653:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922058624 00010000:00010000:3.0:1786109352.538922:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35eff lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f0 expref: 87 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.539146:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12621 00000100:00100000:2.0:1786109352.539159:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+87:2402:x1872862922058624:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786109352.539349:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109352.539358:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35eff lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f0 expref: 87 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.539372:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35eff lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f0 expref: 87 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.539468:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35eff lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f0 expref: 87 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.539487:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3f:0x0].0x0 (ffff930ab7f80000) 00010000:00010000:2.0:1786109352.539492:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.539502:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.539510:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.539542:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109352.539668:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.539874:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+86:2402:x1872862922058624:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 717us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.539883:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12621 00010000:00010000:1.0:1786109352.539940:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.539988:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.539995:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.540005:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.540024:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933130112:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109352.540070:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.540249:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34540 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.540320:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933130112 00000100:00100000:3.0:1786109352.540328:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933130112 00000100:00100000:3.0:1786109352.540371:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12118 00000100:00100000:3.0:1786109352.540379:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187899:x1872862933130112:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786109352.540407:0:179257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.540422:0:179257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f37 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35f30 expref: -99 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.540477:0:179257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f7 expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.540486:0:179257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f37 lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35f30 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.540510:0:179257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f7 expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.540523:0:179257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f7 expref: 6 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.540536:0:179257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:179257:1872862933130240:192.168.203.38@tcp:104: 00000100:00100000:3.0:1786109352.540590:0:179257:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac09773c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.545310:0:179257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:179257:1872862933130240:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109352.545344:0:179257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f37 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35f30 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.545357:0:179257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3f:0x0].0x0 (ffff930985b9d500) 00010000:00010000:3.0:1786109352.545360:0:179257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109352.545364:0:179257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f37 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35f30 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.545374:0:179257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f37 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35f30 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.545382:0:179257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295f200, rc 0) 00000100:00100000:0.0:1786109352.546792:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933130112:12345-0@lo:101:mdt00_000.0 Request processed in 6404us (6712us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.546804:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12118 00000100:00100000:1.0:1786109352.546902:0:187899:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804472 gen 2 00000004:00080000:1.0:1786109352.546921:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804471 committed transno 25769804472 00000004:00080000:1.0:1786109352.546941:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804472 committed transno 25769804472 00000100:00100000:1.0:1786109352.546959:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933130112:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109352.546979:0:187899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.546990:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109352.548322:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.549246:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922058752 00000100:00100000:1.0:1786109352.549256:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922058752 00010000:00010000:1.0:1786109352.549301:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f7 expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.549406:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12622 00000100:00100000:1.0:1786109352.549416:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:397d331e-10fc-4558-be87-308c3622e8eb+7:2402:x1872862922058752:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109352.549638:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109352.549647:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f7 expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.549664:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f7 expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.549686:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f0d lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x3f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13f7 expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.549704:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3f:0x0].0x0 (ffff930985b9d500) 00010000:00010000:1.0:1786109352.549710:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f37 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35f30 expref: 6 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.549720:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f37 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca35f30 expref: 6 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.549728:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f37 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca35f30 expref: 6 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.549760:0:9538:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f37 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35f30 expref: 6 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.549775:0:9538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9538:1872862933130368:0@lo:105: 00000100:00100000:1.0:1786109352.549826:0:9538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.549871:0:9538:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34540 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.550744:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933130368 00000100:00100000:0.0:1786109352.550752:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933130368 00000100:00100000:0.0:1786109352.550796:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5252 00000100:00100000:0.0:1786109352.550804:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9538:x1872862933130368:12345-0@lo:105: 00010000:00010000:0.0:1786109352.550816:0:6509:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.550825:0:6509:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.550834:0:6509:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.550842:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.550849:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.550858:0:6509:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.551372:0:6509:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930a80030200) 00000100:00100000:0.0:1786109352.551532:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9538:x1872862933130368:12345-0@lo:105: Request processed in 728us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.551540:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5252 00000100:00100000:1.0:1786109352.551754:0:9538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9538:1872862933130368:0@lo:105: 00010000:00010000:1.0:1786109352.551776:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109352.551816:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922058752:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 2401us (3499us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.551827:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12622 00010000:00010000:3.0:1786109352.553027:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.553041:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.565093:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933130496:0@lo:403:mdt00_000.0 00000100:00100000:3.0:1786109352.565168:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109352.565766:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac09773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.565847:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933130496 00000100:00100000:0.0:1786109352.565855:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933130496 00000100:00100000:0.0:1786109352.565924:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12119 00000100:00100000:0.0:1786109352.565932:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933130496:12345-0@lo:403:mdt00_000.0 00000100:00100000:0.0:1786109352.571188:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933130496:12345-0@lo:403:mdt00_000.0 Request processed in 5238us (6000us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.571203:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12119 00000100:00100000:1.0:1786109352.571825:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933130496:0@lo:403:mdt00_000.0 00000040:00080000:0.0:1786109352.575891:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].462, 656 off702168 00000040:00080000:0.0:1786109352.576076:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].343, 736 off566320 00000004:00080000:0.0:1786109352.576082:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098502f6c0 with version 699 00000004:00080000:1.0:1786109352.577075:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 699 rpc_version 699 00000020:00100000:0.0:1786109352.577209:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109352.577221:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930985eb8e00 x1872862933130752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109352.577245:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933130752:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109352.577315:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109352.577980:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098bef0540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109352.578092:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933130752 00000100:00100000:1.0:1786109352.578100:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933130752 00000100:00100000:1.0:1786109352.578156:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12120 00000100:00100000:1.0:1786109352.578165:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933130752:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109352.579558:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933130752:12345-0@lo:1000:osp_up1-0.0 Request processed in 1390us (2238us total) trans 25769804473 rc 0/0 00000100:00100000:1.0:1786109352.579570:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12120 00000100:00100000:3.0:1786109352.580850:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933130752:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1786109352.580928:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1ddb:0x0]: returning size 4096 00010000:00010000:0.0:1786109352.580961:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.580971:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.580978:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.580988:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109352.580993:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581001:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581016:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3f:0x0].0x0 (ffff930ab7f80000) 00010000:00010000:0.0:1786109352.581019:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109352.581024:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581029:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d400/0xdb52b77d7ca35f29 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581044:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581052:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581058:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581126:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786109352.581136:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x3f:0x0] 00010000:00010000:0.0:1786109352.581144:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35f22 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581150:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35f22 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581157:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35f22 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581162:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109352.581166:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35f22 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581182:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35f22 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581191:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddb:0x0].0x0 (ffff930ab7f80400) 00010000:00010000:0.0:1786109352.581194:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109352.581196:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35f22 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581201:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d600/0xdb52b77d7ca35f22 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581215:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35f14 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581221:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35f14 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581227:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35f14 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581232:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109352.581235:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35f14 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581244:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35f14 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581251:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109352.581253:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109352.581256:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35f14 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581261:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c600/0xdb52b77d7ca35f14 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109352.581270:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9592df0 reply state 00000000c3114c89 transno 326417514620 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35f1b lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581281:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35f1b lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.581288:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109352.581291:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109352.581293:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109352.581377:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+87:157891:x1872862922058496:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 48335us (48511us total) trans 326417514620 rc 0/0 00000100:00100000:0.0:1786109352.581384:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 822 00010000:00010000:1.0:1786109352.581876:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109352.581884:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.581893:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030200 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109352.581897:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.581905:0:10402:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.581942:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.581949:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1786109352.582005:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933130880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109352.582060:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786109352.582152:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.582167:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930a80030200/0xdb52b77d7ca35f30 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35f37 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.582197:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109352.582199:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109352.582201:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109352.582276:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933130880 00000100:00100000:0.0:1786109352.582283:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933130880 00000100:00100000:0.0:1786109352.582337:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4492 00000100:00100000:0.0:1786109352.582346:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1872862933130880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109352.582358:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109352.582377:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f37 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca35f30 expref: 8 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.582390:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x3f:0x0].0x0 (ffff930985b9d500) 00010000:00010000:0.0:1786109352.582543:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109352.582783:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1872862933130880:12345-0@lo:103:ldlm_bl.0 Request processed in 438us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.582790:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4492 00000100:00100000:2.0:1786109352.582849:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933130880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109352.629415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109352.629636:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922058880 00000100:00100000:2.0:1786109352.629645:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922058880 00000100:00100000:0.0:1786109352.629848:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 823 00000100:00100000:0.0:1786109352.629860:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+87:157895:x1872862922058880:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109352.629885:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109352.629906:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f3e lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a13fe expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.629975:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f45 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.629988:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f45 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630000:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f45 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630012:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f4c lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 41 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630020:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f4c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630026:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f4c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630071:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f45 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630077:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f45 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630082:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f45 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630087:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109352.630091:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f45 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630097:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f45 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630109:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109352.630112:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109352.630116:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f45 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630120:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f45 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630131:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f4c lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630137:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f4c lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630141:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f4c lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630146:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109352.630149:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f4c lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630155:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f4c lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630161:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109352.630163:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109352.630166:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f4c lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630242:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f4c lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630269:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f3e lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13fe expref: 88 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630279:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109352.630281:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109352.630285:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f3e lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a13fe expref: 88 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.630294:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2c00, rc 0) 00000100:00100000:0.0:1786109352.630360:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+87:157895:x1872862922058880:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 503us (953us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109352.630368:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 823 00000100:00100000:2.0:1786109352.637293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.637393:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922059008 00000100:00100000:3.0:1786109352.637411:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922059008 00000100:00100000:3.0:1786109352.637691:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 824 00000100:00100000:3.0:1786109352.637702:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+87:157895:x1872862922059008:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109352.637722:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.637741:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f53 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1405 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637813:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f5a lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637825:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f5a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637835:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f5a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637844:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f61 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 41 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637851:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f61 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637856:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f61 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637891:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f5a lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637898:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f5a lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637904:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f5a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637911:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295f400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.637914:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f5a lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637926:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f5a lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637937:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.637940:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.637944:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f5a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637950:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35f5a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637963:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f61 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637969:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f61 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637974:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f61 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637979:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295f000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.637982:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f61 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637988:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f61 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.637994:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109352.637997:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.638000:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f61 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.638006:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f61 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.638031:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f53 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1405 expref: 88 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.638039:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.638041:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.638045:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f53 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1405 expref: 88 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.638052:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295f200, rc 0) 00000100:00100000:3.0:1786109352.638178:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+87:157895:x1872862922059008:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 468us (884us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109352.638186:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 824 00000100:00100000:1.0:1786109352.645189:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.645296:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922059136 00000100:00100000:3.0:1786109352.645305:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922059136 00000100:00100000:3.0:1786109352.645412:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 825 00000100:00100000:3.0:1786109352.645424:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+87:157895:x1872862922059136:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109352.645513:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.645536:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a140c expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.645661:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f6f lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.645676:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f6f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.645688:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f6f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109352.645730:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:3.0:1786109352.645734:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109352.645753:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f6f lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.645776:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca35f68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a140c expref: 89 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.645792:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f6f lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a140c expref: 88 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.645799:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.645801:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109352.645805:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295f000, rc 0) 00000100:00100000:3.0:1786109352.645865:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+88:157895:x1872862922059136:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 444us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.645872:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 825 00000100:00100000:2.0:1786109352.662741:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109352.662864:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922059392 00000100:00100000:0.0:1786109352.662875:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922059392 00000100:00100000:0.0:1786109352.662937:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 826 00000100:00100000:0.0:1786109352.662947:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+88:157895:x1872862922059392:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:0.0:1786109352.663002:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109352.663027:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f000/0xdb52b77d7ca35f6f lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a140c expref: 88 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.663046:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109352.663051:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109352.663105:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f76 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.663118:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f76 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.663127:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f76 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.663138:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f7d lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 41 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.663151:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f7d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.663157:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f7d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109352.664272:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].463, 2152 off704320 00000040:00080000:1.0:1786109352.664346:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].344, 2352 off568672 00000004:00080000:1.0:1786109352.664352:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098bef0300 with version 700 00000004:00080000:0.0:1786109352.664421:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 700 rpc_version 700 00000020:00100000:0.0:1786109352.664498:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109352.664508:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab1c28000 x1872862933131136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109352.664531:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c28000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933131136:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109352.664592:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109352.664624:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098bef0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.664751:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933131136 00000100:00100000:3.0:1786109352.664757:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933131136 00000100:00100000:3.0:1786109352.664805:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12121 00000100:00100000:3.0:1786109352.664814:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933131136:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109352.665150:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933131136:12345-0@lo:1000:osp_up1-0.0 Request processed in 337us (556us total) trans 25769804474 rc 0/0 00000100:00100000:3.0:1786109352.665158:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12121 00000100:00100000:0.0:1786109352.665289:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c28000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933131136:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786109352.665516:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35f84 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.665529:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35f84 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.665539:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35f84 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.665556:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35f8b lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.665564:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35f8b lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.665570:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35f8b lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.665609:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.665621:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.665632:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.665645:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933131264:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109352.665673:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.665694:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34600 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.665767:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933131264 00000100:00100000:0.0:1786109352.665772:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933131264 00000100:00100000:0.0:1786109352.665798:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12122 00000100:00100000:0.0:1786109352.665805:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187899:x1872862933131264:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786109352.665819:0:177399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109352.665833:0:177399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f99 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35f92 expref: -99 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.665852:0:177399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f99 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35f92 expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.665863:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f99 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35f92 expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.665872:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x40:0x0].0x0 (ffff930a83abdd00) 00010000:00010000:0.0:1786109352.665875:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109352.665879:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3200, rc 0) 00000100:00100000:0.0:1786109352.665909:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187899:x1872862933131264:12345-0@lo:101:mdt00_000.0 Request processed in 104us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.665915:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12122 00000100:00100000:1.0:1786109352.666080:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933131264:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109352.666091:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35f99 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666100:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35f99 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.666119:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8523105 reply state 00000000a7a394a3 transno 326417514621 ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35f8b lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666131:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35f8b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666137:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x40:0x0].0x0 (ffff930ab7f80a00) 00010000:00010000:1.0:1786109352.666139:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109352.666142:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109352.666148:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35f99 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666156:0:187899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35f99 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109352.666165:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x40:0x0] 00000004:00010000:1.0:1786109352.666182:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8523105 reply state 00000000a7a394a3 transno 326417514621 ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35f84 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666191:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35f84 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666197:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddc:0x0].0x0 (ffff930ab7f80700) 00010000:00010000:1.0:1786109352.666199:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109352.666200:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1786109352.666205:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1ddc:0x0]: returning size 4096 00010000:00010000:1.0:1786109352.666212:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f76 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666218:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f76 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666224:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f76 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666229:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109352.666232:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f76 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666239:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f76 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666249:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109352.666251:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109352.666254:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f76 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666259:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca35f76 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.666270:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8523105 reply state 00000000a7a394a3 transno 326417514621 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f7d lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666277:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f7d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.666283:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109352.666284:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109352.666286:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1786109352.666355:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+89:157895:x1872862922059392:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 3407us (3620us total) trans 326417514621 rc 0/0 00000100:00100000:1.0:1786109352.666362:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 826 00000100:00100000:2.0:1786109352.692098:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109352.692281:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922059520 00000100:00100000:0.0:1786109352.692291:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922059520 00000100:00100000:0.0:1786109352.692795:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 827 00000100:00100000:0.0:1786109352.692808:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+89:157898:x1872862922059520:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109352.692831:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109352.692850:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca35fa0 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1413 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.693760:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca35fa7 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.693778:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca35fa7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.693788:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca35fa7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.693802:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35fae lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 42 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.693809:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35fae lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.693815:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35fae lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.693890:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35fb5 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.693897:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35fb5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.693903:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35fb5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109352.694011:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1ddc:0x0]: returning size 4096 00000004:00200000:0.0:1786109352.694016:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1786109352.694036:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35fb5 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694047:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca35fa7 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694053:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca35fa7 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694060:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca35fa7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694066:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109352.694070:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca35fa7 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694079:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca35fa7 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694091:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:0.0:1786109352.694094:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109352.694099:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca35fa7 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694105:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca35fa7 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694118:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35fae lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694128:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35fae lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694134:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35fae lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694140:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109352.694142:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35fae lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694148:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35fae lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694155:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:0.0:1786109352.694157:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109352.694160:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35fae lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694165:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2e00/0xdb52b77d7ca35fae lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694208:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca35fa0 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1413 expref: 91 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694222:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35fb5 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1413 expref: 90 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.694229:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddc:0x0].0x0 (ffff930ab7f80700) 00010000:00010000:0.0:1786109352.694231:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109352.694234:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3e00, rc 0) 00000100:00100000:0.0:1786109352.694316:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+90:157898:x1872862922059520:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 1511us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.694324:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 827 00000100:00100000:0.0:1786109352.698706:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.698804:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922059648 00000100:00100000:3.0:1786109352.698814:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922059648 00000100:00100000:3.0:1786109352.698977:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 828 00000100:00100000:3.0:1786109352.698989:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+90:157898:x1872862922059648:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109352.699009:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.699029:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca35fbc lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a141a expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.699087:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35fc3 lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.699099:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35fc3 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.699110:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35fc3 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109352.699162:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x40:0x0]: returning size 4096 00000004:00200000:3.0:1786109352.699167:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786109352.700048:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca35fbc lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a141a expref: 92 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.700070:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35fc3 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a141a expref: 91 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.700078:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x40:0x0].0x0 (ffff930ab7f80a00) 00010000:00010000:3.0:1786109352.700081:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786109352.700085:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295f400, rc 0) 00000100:00100000:3.0:1786109352.700143:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+91:157898:x1872862922059648:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 1156us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.700153:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 828 00000100:00100000:2.0:1786109352.704045:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.704290:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922059776 00000100:00100000:3.0:1786109352.704300:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922059776 00000100:00100000:3.0:1786109352.704360:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 829 00000100:00100000:3.0:1786109352.704369:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:157898:x1872862922059776:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109352.704390:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.704410:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35fca lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1421 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.705211:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.705227:0:187900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f99 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35f92 expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.705236:0:187900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.705269:0:187900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f99 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca35f92 expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.705285:0:187900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933131392:0@lo:104: 00000100:00100000:2.0:1786109352.705334:0:187900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109352.705391:0:187900:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643240 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.705791:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933131392 00000100:00100000:0.0:1786109352.705798:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933131392 00000100:00100000:0.0:1786109352.705834:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5253 00000100:00100000:0.0:1786109352.705842:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933131392:12345-0@lo:104: 00010000:00010000:0.0:1786109352.705856:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35f99 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.706477:0:187900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933131392:0@lo:104: 00010000:00010000:2.0:1786109352.706497:0:187900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.706587:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786109352.706594:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933131392:12345-0@lo:104: Request processed in 753us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.706602:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5253 00010000:00010000:1.0:1786109352.706720:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109352.706727:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca35f99 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.706735:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf800 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109352.706741:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca35f99 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.706750:0:6514:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca35f99 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.706781:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35f99 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.706791:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109352.706822:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35f99 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.706829:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf800/0xdb52b77d7ca35f92 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca35f99 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.706848:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109352.706849:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109352.706851:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109352.707484:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933131520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109352.707531:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.707639:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933131520 00000100:00100000:1.0:1786109352.707645:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933131520 00010000:00010000:1.0:1786109352.707687:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f99 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca35f92 expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.707720:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12623 00000100:00100000:1.0:1786109352.707729:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3647:x1872862933131520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109352.707740:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109352.710846:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786109352.713510:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804474 is committed 00010000:00010000:1.0:1786109352.713709:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca35f99 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca35f92 expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.713727:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x40:0x0].0x0 (ffff930a83abdd00) 00010000:00010000:1.0:1786109352.713732:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.713743:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.713757:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.713844:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109352.713929:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933131520:12345-0@lo:103:ldlm_bl.0 Request processed in 6199us (6396us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.713939:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12623 00000100:00100000:0.0:1786109352.714086:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933131520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109352.714140:0:187900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.714148:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109352.714212:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x40:0x0]: returning size 4096 00000004:00200000:3.0:1786109352.714217:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786109352.714264:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca35fca lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1421 expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.714280:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1421 expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.714288:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x40:0x0].0x0 (ffff930a83abdd00) 00010000:00010000:3.0:1786109352.714291:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786109352.714294:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d600, rc 0) 00000100:00100000:3.0:1786109352.714385:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:157898:x1872862922059776:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 10017us (10347us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.714396:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 829 00000100:00100000:2.0:1786109352.728538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.728703:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922060032 00000100:00100000:1.0:1786109352.728712:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922060032 00000100:00100000:1.0:1786109352.728811:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 830 00000100:00100000:1.0:1786109352.728821:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+91:157898:x1872862922060032:12345-192.168.203.38@tcp:36:rmdir.0 00010000:00010000:1.0:1786109352.728876:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109352.728902:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3e00/0xdb52b77d7ca35fb5 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1413 expref: 91 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.728919:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddc:0x0].0x0 (ffff930ab7f80700) 00010000:00010000:1.0:1786109352.728924:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109352.728945:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf800/0xdb52b77d7ca35fd8 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.728958:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf800/0xdb52b77d7ca35fd8 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.728967:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf800/0xdb52b77d7ca35fd8 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.728978:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca35fdf lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 42 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.728995:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca35fdf lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.729001:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca35fdf lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.729077:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace000/0xdb52b77d7ca35fe6 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.729085:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace000/0xdb52b77d7ca35fe6 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.729092:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace000/0xdb52b77d7ca35fe6 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.729108:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.729117:0:187899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35fc3 lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a141a expref: 90 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.729124:0:187899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.729154:0:187899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35fc3 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a141a expref: 90 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.729167:0:187899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35fc3 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a141a expref: 90 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.729200:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933131648:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109352.729296:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d340c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.744570:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109352.744654:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922060160 00000100:00100000:2.0:1786109352.744663:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922060160 00010000:00010000:2.0:1786109352.744702:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35fc3 lrc: 5/0,0 mode: PR/PR res: [0x2000255c0:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a141a expref: 91 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.744748:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12624 00000100:00100000:2.0:1786109352.744758:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:397d331e-10fc-4558-be87-308c3622e8eb+91:2402:x1872862922060160:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786109352.744772:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109352.744778:0:43921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35fc3 lrc: 5/0,0 mode: PR/PR res: [0x2000255c0:0x40:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a141a expref: 91 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.744791:0:43921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35fc3 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x40:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a141a expref: 91 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.744815:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x40:0x0].0x0 (ffff930ab7f80a00) 00010000:00010000:2.0:1786109352.744819:0:43921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.744830:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.744837:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.744860:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109352.744916:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:397d331e-10fc-4558-be87-308c3622e8eb+91:2402:x1872862922060160:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 159us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.744924:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12624 00010000:00010000:1.0:1786109352.745369:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f400/0xdb52b77d7ca35fc3 lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a141a expref: 90 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.745388:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933131648:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109352.745588:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.745596:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.745602:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.745646:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.745654:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.745663:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.745681:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933131776:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109352.745723:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.745756:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d340c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.745810:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933131776 00000100:00100000:0.0:1786109352.745815:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933131776 00000100:00100000:0.0:1786109352.745854:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12123 00000100:00100000:0.0:1786109352.745862:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187899:x1872862933131776:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786109352.745876:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109352.745889:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35ffb lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca35ff4 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.745912:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1421 expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.745922:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35ffb lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca35ff4 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.745947:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1421 expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.745960:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1421 expref: 6 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109352.745971:0:8451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1e64000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8451:1872862933131904:192.168.203.38@tcp:104: 00000100:00100000:0.0:1786109352.746038:0:8451:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aa65cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1786109352.756925:0:8451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1e64000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8451:1872862933131904:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109352.756964:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35ffb lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35ff4 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.756977:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x40:0x0].0x0 (ffff930a83abdd00) 00010000:00010000:1.0:1786109352.756980:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109352.756984:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35ffb lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35ff4 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.756994:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35ffb lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35ff4 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.757001:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3600, rc 0) 00000100:00100000:1.0:1786109352.757122:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933131776:12345-0@lo:101:mdt00_000.0 Request processed in 11260us (11397us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.757130:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12123 00000100:00100000:2.0:1786109352.757209:0:187899:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804474 gen 2 00000004:00080000:2.0:1786109352.757215:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804473 committed transno 25769804474 00000004:00080000:2.0:1786109352.757234:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804474 committed transno 25769804474 00000100:00100000:2.0:1786109352.757246:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933131776:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786109352.757264:0:187899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.757274:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109352.760099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109352.760460:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922060288 00000100:00100000:1.0:1786109352.760470:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922060288 00010000:00010000:1.0:1786109352.760510:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1421 expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.760555:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12625 00000100:00100000:1.0:1786109352.760565:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:2403:x1872862922060288:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109352.760581:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109352.760588:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1421 expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.760599:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1421 expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.760622:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca35fd1 lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x40:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1421 expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.760639:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x40:0x0].0x0 (ffff930a83abdd00) 00010000:00010000:1.0:1786109352.760646:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35ffb lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35ff4 expref: 6 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.760657:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35ffb lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca35ff4 expref: 6 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.760665:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35ffb lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca35ff4 expref: 6 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.761247:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35ffb lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca35ff4 expref: 6 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.761264:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6512:1872862933132032:0@lo:105: 00000100:00100000:1.0:1786109352.761317:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.761492:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34600 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.761617:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933132032 00000100:00100000:3.0:1786109352.761622:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933132032 00000100:00100000:3.0:1786109352.761664:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5254 00000100:00100000:3.0:1786109352.761672:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6512:x1872862933132032:12345-0@lo:105: 00010000:00010000:3.0:1786109352.761803:0:6509:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.761813:0:6509:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.761832:0:6509:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.761840:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.761846:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.761854:0:6509:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.761882:0:6509:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ac0acf200) 00010000:00010000:1.0:1786109352.762080:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.762090:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.762882:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933132160:0@lo:403:mdt00_000.0 00000100:00100000:1.0:1786109352.764277:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109352.764507:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.764654:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6512:x1872862933132032:12345-0@lo:105: Request processed in 2982us (3334us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.764666:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5254 00000100:00100000:1.0:1786109352.764939:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6512:1872862933132032:0@lo:105: 00010000:00010000:1.0:1786109352.764962:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109352.765010:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922060288:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 4445us (4920us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.765020:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12625 00000100:00100000:0.0:1786109352.767940:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933132160 00000100:00100000:0.0:1786109352.767956:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933132160 00000100:00100000:0.0:1786109352.768248:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12124 00000100:00100000:0.0:1786109352.768259:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933132160:12345-0@lo:403:mdt00_000.0 00000100:00100000:0.0:1786109352.770982:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933132160:12345-0@lo:403:mdt00_000.0 Request processed in 2716us (6699us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.770996:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12124 00000100:00100000:1.0:1786109352.771105:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933132160:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1786109352.772407:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].464, 656 off704976 00000040:00080000:1.0:1786109352.772586:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].345, 736 off569408 00000004:00080000:1.0:1786109352.772592:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d340c0 with version 701 00000004:00080000:0.0:1786109352.772906:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 701 rpc_version 701 00000020:00100000:0.0:1786109352.772939:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109352.772948:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1143800 x1872862933132416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109352.772971:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1143800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933132416:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109352.773028:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109352.773060:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aa65cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1786109352.773185:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933132416 00000100:00100000:1.0:1786109352.773192:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933132416 00000100:00100000:1.0:1786109352.773274:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12125 00000100:00100000:1.0:1786109352.773284:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933132416:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109352.773716:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933132416:12345-0@lo:1000:osp_up1-0.0 Request processed in 432us (686us total) trans 25769804475 rc 0/0 00000100:00100000:1.0:1786109352.773724:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12125 00000100:00100000:3.0:1786109352.773883:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1143800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933132416:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1786109352.773951:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1ddc:0x0]: returning size 4096 00010000:00010000:2.0:1786109352.773978:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.773988:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.773995:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774001:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acea00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.774005:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774017:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774032:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x40:0x0].0x0 (ffff930ab7f80a00) 00010000:00010000:2.0:1786109352.774035:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109352.774040:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774046:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acea00/0xdb52b77d7ca35fed lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774060:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774068:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774074:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774101:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786109352.774109:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x40:0x0] 00010000:00010000:2.0:1786109352.774117:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace000/0xdb52b77d7ca35fe6 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774123:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace000/0xdb52b77d7ca35fe6 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774127:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace000/0xdb52b77d7ca35fe6 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774136:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0ace000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.774138:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace000/0xdb52b77d7ca35fe6 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774144:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace000/0xdb52b77d7ca35fe6 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774152:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddc:0x0].0x0 (ffff930ab7f80700) 00010000:00010000:2.0:1786109352.774154:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109352.774157:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace000/0xdb52b77d7ca35fe6 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774162:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace000/0xdb52b77d7ca35fe6 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774187:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf800/0xdb52b77d7ca35fd8 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774193:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf800/0xdb52b77d7ca35fd8 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774197:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf800/0xdb52b77d7ca35fd8 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774201:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109352.774204:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf800/0xdb52b77d7ca35fd8 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774209:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf800/0xdb52b77d7ca35fd8 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774220:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109352.774222:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109352.774225:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf800/0xdb52b77d7ca35fd8 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774230:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf800/0xdb52b77d7ca35fd8 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109352.774240:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000558f07cc reply state 00000000f770dc84 transno 326417514622 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca35fdf lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774252:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca35fdf lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.774259:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109352.774262:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109352.774264:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109352.774414:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109352.774421:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.774447:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf200 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:3.0:1786109352.774452:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109352.774460:0:6515:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.774489:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.774495:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109352.774514:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.774522:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf200/0xdb52b77d7ca35ff4 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca35ffb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.774538:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109352.774540:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109352.774542:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109352.774554:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933132544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109352.774641:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+91:157898:x1872862922060032:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 45819us (46110us total) trans 326417514622 rc 0/0 00000100:00100000:2.0:1786109352.774650:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 830 00000100:00100000:3.0:1786109352.775122:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109352.775190:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933132544 00000100:00100000:0.0:1786109352.775196:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933132544 00000100:00100000:0.0:1786109352.775250:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4493 00000100:00100000:0.0:1786109352.775257:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3648:x1872862933132544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109352.775269:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109352.775287:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca35ffb lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca35ff4 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.775299:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x40:0x0].0x0 (ffff930a83abdd00) 00010000:00010000:0.0:1786109352.775313:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109352.775357:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3648:x1872862933132544:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.775364:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4493 00000100:00100000:2.0:1786109352.775541:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933132544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109352.823816:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.823928:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922060416 00000100:00100000:3.0:1786109352.823938:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922060416 00000100:00100000:3.0:1786109352.824054:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 831 00000100:00100000:3.0:1786109352.824064:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+91:157902:x1872862922060416:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109352.824089:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.824109:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca36002 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1428 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.824878:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36009 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.824895:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36009 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.824907:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36009 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.824921:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36010 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 43 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.824930:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36010 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.824937:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36010 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.824984:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36009 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.824992:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36009 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.824998:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36009 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825006:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295f200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.825010:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36009 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825017:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36009 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825029:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.825032:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.825036:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36009 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825042:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36009 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825056:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36010 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825062:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36010 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825068:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36010 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825073:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295ea00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.825076:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36010 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825082:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36010 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825094:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109352.825097:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.825100:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36010 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825106:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36010 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825138:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca36002 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1428 expref: 92 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825147:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.825149:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.825152:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca36002 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1428 expref: 92 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.825161:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295fc00, rc 0) 00000100:00100000:3.0:1786109352.825234:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+91:157902:x1872862922060416:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1171us (1427us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109352.825242:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 831 00000100:00100000:2.0:1786109352.831720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.831814:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922060544 00000100:00100000:3.0:1786109352.831825:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922060544 00000100:00100000:3.0:1786109352.831888:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 832 00000100:00100000:3.0:1786109352.831899:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+91:157902:x1872862922060544:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109352.831920:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.831942:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca36017 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a142f expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832038:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca3601e lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832051:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca3601e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832061:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca3601e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832072:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36025 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 43 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832079:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36025 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832085:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36025 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832122:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca3601e lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832129:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca3601e lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832136:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca3601e lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832143:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295ea00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.832147:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca3601e lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832158:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca3601e lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832187:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.832191:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.832196:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca3601e lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832201:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca3601e lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832214:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36025 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832220:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36025 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832225:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36025 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832229:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295f200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.832232:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36025 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832237:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36025 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832244:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109352.832246:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.832248:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36025 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832254:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36025 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832280:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca36017 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a142f expref: 92 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832291:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.832293:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.832297:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca36017 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a142f expref: 92 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.832306:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295fc00, rc 0) 00000100:00100000:3.0:1786109352.832372:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+91:157902:x1872862922060544:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 475us (661us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109352.832379:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 832 00000100:00100000:0.0:1786109352.845062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109352.845167:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922060672 00000100:00100000:2.0:1786109352.845187:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922060672 00000100:00100000:2.0:1786109352.845280:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 833 00000100:00100000:2.0:1786109352.845291:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+91:157902:x1872862922060672:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109352.845321:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109352.845339:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca3602c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1436 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.845399:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36033 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.845412:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36033 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.845424:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36033 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109352.845488:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:2.0:1786109352.845492:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109352.845510:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36033 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.845535:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca3602c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1436 expref: 93 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.845552:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36033 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1436 expref: 92 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.845561:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109352.845564:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109352.845567:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d200, rc 0) 00000100:00100000:2.0:1786109352.845667:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+92:157902:x1872862922060672:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 377us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.845674:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 833 00000100:00100000:0.0:1786109352.851730:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.851859:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922060928 00000100:00100000:3.0:1786109352.851869:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922060928 00000100:00100000:3.0:1786109352.851962:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 834 00000100:00100000:3.0:1786109352.851972:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+92:157902:x1872862922060928:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:3.0:1786109352.852028:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109352.852052:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36033 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1436 expref: 92 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.852070:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.852075:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109352.852128:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3603a lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.852142:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3603a lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.852153:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3603a lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.852164:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36041 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 43 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.852193:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36041 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.852200:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36041 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786109352.853135:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].465, 2152 off707128 00000040:00080000:3.0:1786109352.853287:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].346, 2352 off571760 00000004:00080000:3.0:1786109352.853294:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ac09773c0 with version 702 00000004:00080000:0.0:1786109352.853385:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 702 rpc_version 702 00000020:00100000:0.0:1786109352.853623:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109352.853634:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098c388a80 x1872862933132800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109352.853659:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933132800:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109352.853720:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109352.853792:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f480 going to sleep for 11 seconds 00000100:00100000:1.0:1786109352.853838:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933132800 00000100:00100000:1.0:1786109352.853844:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933132800 00000100:00100000:1.0:1786109352.853922:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12126 00000100:00100000:1.0:1786109352.853931:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933132800:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109352.854411:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933132800:12345-0@lo:1000:osp_up1-0.0 Request processed in 480us (689us total) trans 25769804476 rc 0/0 00000100:00100000:1.0:1786109352.854419:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12126 00000100:00100000:0.0:1786109352.854719:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933132800:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1786109352.854849:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36048 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.854864:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36048 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.854875:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36048 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.854894:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca3604f lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.854901:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca3604f lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.854908:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca3604f lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.854937:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.854944:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.854953:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.854967:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933132928:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1786109352.854998:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109352.855028:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109352.855076:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933132928 00000100:00100000:0.0:1786109352.855081:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933132928 00000100:00100000:0.0:1786109352.855129:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12127 00000100:00100000:0.0:1786109352.855137:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188678:x1872862933132928:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109352.855152:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109352.855167:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca3605d lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36056 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.855202:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca3605d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36056 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.855213:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca3605d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36056 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.855221:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x41:0x0].0x0 (ffff930a83e02200) 00010000:00010000:0.0:1786109352.855224:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109352.855228:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3600, rc 0) 00000100:00100000:0.0:1786109352.855340:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188678:x1872862933132928:12345-0@lo:101:mdt00_003.0 Request processed in 204us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.855346:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12127 00000100:00100000:3.0:1786109352.855607:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933132928:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786109352.855620:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3605d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855631:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3605d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109352.855650:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000572b8ece reply state 00000000d7e88cd0 transno 326417514623 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca3604f lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855661:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca3604f lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855667:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x41:0x0].0x0 (ffff930985b9d800) 00010000:00010000:3.0:1786109352.855669:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109352.855672:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109352.855677:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3605d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855685:0:188678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3605d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109352.855694:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x41:0x0] 00000004:00010000:3.0:1786109352.855700:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000572b8ece reply state 00000000d7e88cd0 transno 326417514623 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36048 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855708:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36048 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855714:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddd:0x0].0x0 (ffff930985b9da00) 00010000:00010000:3.0:1786109352.855717:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109352.855718:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1786109352.855723:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1ddd:0x0]: returning size 4096 00010000:00010000:3.0:1786109352.855730:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3603a lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855736:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3603a lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855742:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3603a lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855748:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295fc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.855753:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3603a lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855764:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3603a lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855774:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.855776:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.855779:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3603a lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855786:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3603a lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109352.855799:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000572b8ece reply state 00000000d7e88cd0 transno 326417514623 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36041 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855808:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36041 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.855815:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109352.855817:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109352.855819:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1786109352.855928:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+93:157902:x1872862922060928:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 3956us (4207us total) trans 326417514623 rc 0/0 00000100:00100000:3.0:1786109352.855936:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 834 00000100:00100000:0.0:1786109352.871246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.871375:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922061056 00000100:00100000:3.0:1786109352.871384:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922061056 00000100:00100000:3.0:1786109352.871624:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 835 00000100:00100000:3.0:1786109352.871634:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+93:157906:x1872862922061056:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:3.0:1786109352.871659:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.871679:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca36064 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a143d expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.871741:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca3606b lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.871756:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca3606b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.871768:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca3606b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.871779:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca36072 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 44 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.871786:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca36072 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.871792:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca36072 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.871864:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca36079 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.871872:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca36079 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.871878:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca36079 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109352.871953:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1ddd:0x0]: returning size 4096 00000004:00200000:3.0:1786109352.871958:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1786109352.871977:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca36079 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.871989:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca3606b lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.871995:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca3606b lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872001:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca3606b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872007:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295fe00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.872011:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca3606b lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872019:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca3606b lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872031:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109352.872034:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.872038:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca3606b lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872044:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca3606b lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872056:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca36072 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872061:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca36072 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872067:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca36072 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872073:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109352.872076:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca36072 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872083:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca36072 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872090:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109352.872093:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109352.872096:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca36072 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872102:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca36072 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872128:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca36064 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a143d expref: 95 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872141:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca36079 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a143d expref: 94 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.872148:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddd:0x0].0x0 (ffff930985b9da00) 00010000:00010000:3.0:1786109352.872150:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109352.872153:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295ec00, rc 0) 00000100:00100000:3.0:1786109352.872310:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+94:157906:x1872862922061056:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 678us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.872318:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 835 00000100:00100000:0.0:1786109352.878045:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109352.878187:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922061184 00000100:00100000:2.0:1786109352.878198:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922061184 00000100:00100000:2.0:1786109352.878292:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 836 00000100:00100000:2.0:1786109352.878301:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+94:157906:x1872862922061184:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:2.0:1786109352.878319:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109352.878338:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca36080 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1444 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.878403:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36087 lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x41:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.878417:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36087 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.878462:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36087 lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109352.878509:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x41:0x0]: returning size 4096 00000004:00200000:2.0:1786109352.878513:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786109352.878547:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca36080 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1444 expref: 96 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.878562:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36087 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1444 expref: 95 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.878571:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x41:0x0].0x0 (ffff930985b9d800) 00010000:00010000:2.0:1786109352.878574:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786109352.878577:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d200, rc 0) 00000100:00100000:2.0:1786109352.878625:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+95:157906:x1872862922061184:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 325us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.878635:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 836 00000100:00100000:0.0:1786109352.892940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109352.893033:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922061312 00000100:00100000:2.0:1786109352.893044:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922061312 00000100:00100000:2.0:1786109352.893375:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 837 00000100:00100000:2.0:1786109352.893387:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:157906:x1872862922061312:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:2.0:1786109352.893421:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109352.894258:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2800/0xdb52b77d7ca3608e lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a144b expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.894421:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.894595:0:187900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca3605d lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36056 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.894611:0:187900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.894647:0:187900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca3605d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca36056 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109352.894663:0:187900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c389500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933133056:0@lo:104: 00000100:00100000:0.0:1786109352.894715:0:187900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109352.895274:0:187900:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f480 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.895324:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933133056 00000100:00100000:3.0:1786109352.895330:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933133056 00000100:00100000:3.0:1786109352.895383:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5255 00000100:00100000:3.0:1786109352.895396:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933133056:12345-0@lo:104: 00010000:00010000:3.0:1786109352.895410:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca3605d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.899270:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786109352.899286:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:187900:x1872862933133056:12345-0@lo:104: Request processed in 3891us (4565us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.899297:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5255 00010000:00010000:1.0:1786109352.899662:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109352.899672:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca3605d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.899685:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295f800 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109352.899691:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca3605d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109352.899701:0:10402:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca3605d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.899741:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca3605d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.899748:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109352.899775:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca3605d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.899782:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295f800/0xdb52b77d7ca36056 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca3605d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.899802:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109352.899804:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109352.899805:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109352.899812:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109352.900187:0:187900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c389500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:187900:1872862933133056:0@lo:104: 00010000:00010000:0.0:1786109352.900212:0:187900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109352.900317:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933133184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109352.901142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109352.901256:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933133184 00000100:00100000:3.0:1786109352.901263:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933133184 00010000:00010000:3.0:1786109352.901295:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca3605d lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca36056 expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.901923:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12626 00000100:00100000:3.0:1786109352.901935:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3648:x1872862933133184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109352.901949:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1786109352.916708:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804476 is committed 00010000:00010000:3.0:1786109352.916882:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3600/0xdb52b77d7ca3605d lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca36056 expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.916903:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x41:0x0].0x0 (ffff930a83e02200) 00010000:00010000:3.0:1786109352.916908:0:43921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.916918:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.916925:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.917014:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109352.917105:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933133184:12345-0@lo:103:ldlm_bl.0 Request processed in 15172us (15964us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.917115:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12626 00000100:00100000:1.0:1786109352.917262:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933133184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109352.917323:0:187900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.917331:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109352.917387:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x41:0x0]: returning size 4096 00000004:00200000:0.0:1786109352.917646:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109352.917698:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2800/0xdb52b77d7ca3608e lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a144b expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.917713:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a144b expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.917725:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x41:0x0].0x0 (ffff930a83e02200) 00010000:00010000:0.0:1786109352.917728:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109352.917731:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3200, rc 0) 00000100:00100000:0.0:1786109352.917827:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+7:157906:x1872862922061312:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 24443us (24895us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109352.917834:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 837 00000100:00100000:0.0:1786109352.956505:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109352.956735:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922061568 00000100:00100000:3.0:1786109352.956746:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922061568 00000100:00100000:2.0:1786109352.956943:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 838 00000100:00100000:2.0:1786109352.956954:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+95:157906:x1872862922061568:12345-192.168.203.38@tcp:36:rmdir.0 00010000:00010000:2.0:1786109352.957260:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109352.957288:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ec00/0xdb52b77d7ca36079 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a143d expref: 95 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957309:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddd:0x0].0x0 (ffff930985b9da00) 00010000:00010000:2.0:1786109352.957314:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109352.957335:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca3609c lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957348:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca3609c lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957358:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca3609c lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957368:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca360a3 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 44 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957380:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca360a3 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957550:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca360a3 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957626:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca360aa lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957753:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca360aa lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957762:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca360aa lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957782:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957792:0:188678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36087 lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1444 expref: 94 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957801:0:188678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957837:0:188678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36087 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1444 expref: 94 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.957852:0:188678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36087 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1444 expref: 94 pid: 187899 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.957866:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933133312:192.168.203.38@tcp:104: 00000100:00100000:2.0:1786109352.957960:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109352.988226:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109352.988334:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:188678:1872862933133312:192.168.203.38@tcp:104: 00000100:00100000:3.0:1786109352.988356:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922061696 00010000:00010000:0.0:1786109352.988366:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.988372:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922061696 00010000:00010000:3.0:1786109352.988485:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36087 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1444 expref: 95 pid: 187899 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.988536:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12627 00000100:00100000:3.0:1786109352.988548:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:397d331e-10fc-4558-be87-308c3622e8eb+95:2402:x1872862922061696:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109352.988567:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109352.988576:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36087 lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x41:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1444 expref: 95 pid: 187899 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.988592:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36087 lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x41:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1444 expref: 95 pid: 187899 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.988620:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca36087 lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x41:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1444 expref: 95 pid: 187899 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.988721:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x41:0x0].0x0 (ffff930985b9d800) 00010000:00010000:3.0:1786109352.988728:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.988745:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.988754:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.988791:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109352.988828:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.988840:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.988890:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:397d331e-10fc-4558-be87-308c3622e8eb+94:2402:x1872862922061696:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 343us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.988900:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12627 00010000:00010000:0.0:1786109352.989330:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.989340:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.989352:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109352.989374:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933133440:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1786109352.989595:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109352.989661:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f480 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.989707:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933133440 00000100:00100000:3.0:1786109352.989715:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933133440 00000100:00100000:3.0:1786109352.989812:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12128 00000100:00100000:3.0:1786109352.989822:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:188678:x1872862933133440:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786109352.989839:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109352.989853:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca360bf lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca360b8 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.989878:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a144b expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.989889:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca360bf lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca360b8 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.989914:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a144b expref: 6 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.989927:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a144b expref: 6 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109352.989939:0:8452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8452:1872862933133568:192.168.203.38@tcp:104: 00000100:00100000:3.0:1786109352.990055:0:8452:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109352.991845:0:8452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:8452:1872862933133568:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109352.991879:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca360bf lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca360b8 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.991891:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x41:0x0].0x0 (ffff930a83e02200) 00010000:00010000:3.0:1786109352.991894:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109352.991898:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca360bf lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca360b8 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.991908:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca360bf lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca360b8 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109352.991916:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295fc00, rc 0) 00000100:00100000:3.0:1786109352.992043:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933133440:12345-0@lo:101:mdt00_003.0 Request processed in 2222us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.992052:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12128 00000100:00100000:0.0:1786109352.992115:0:188678:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804476 gen 2 00000004:00080000:0.0:1786109352.992122:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804475 committed transno 25769804476 00000004:00080000:0.0:1786109352.992141:0:188678:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804476 committed transno 25769804476 00000100:00100000:0.0:1786109352.992160:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c38b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933133440:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109352.992186:0:188678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.992196:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.993821:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109352.993903:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922061824 00000100:00100000:0.0:1786109352.993910:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922061824 00010000:00010000:0.0:1786109352.993944:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a144b expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109352.993995:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12628 00000100:00100000:0.0:1786109352.994004:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:397d331e-10fc-4558-be87-308c3622e8eb+7:2402:x1872862922061824:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109352.994019:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109352.994025:0:177416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a144b expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.994037:0:177416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a144b expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.994057:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36095 lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x41:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a144b expref: 7 pid: 187900 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.994076:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x41:0x0].0x0 (ffff930a83e02200) 00010000:00010000:0.0:1786109352.994082:0:177416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca360bf lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca360b8 expref: 6 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.994093:0:177416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca360bf lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca360b8 expref: 6 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.994101:0:177416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca360bf lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca360b8 expref: 6 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109352.994127:0:177416:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca360bf lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca360b8 expref: 6 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109352.994139:0:177416:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:177416:1872862933133696:0@lo:105: 00000100:00100000:0.0:1786109352.994192:0:177416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109352.994297:0:177416:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f480 going to sleep for 11 seconds 00000100:00100000:1.0:1786109352.994679:0:6509:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1786109352.994690:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933133696 00000100:00100000:1.0:1786109352.994695:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933133696 00000100:00100000:1.0:1786109352.994756:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5256 00000100:00100000:1.0:1786109352.994763:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c815050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:177416:x1872862933133696:12345-0@lo:105: 00010000:00010000:1.0:1786109352.994774:0:6509:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.994784:0:6509:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.994792:0:6509:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.994799:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.994807:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.994815:0:6509:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109352.994840:0:6509:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ac16c3800) 00010000:00010000:2.0:1786109352.994907:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109352.994916:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109352.995620:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933133824:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1786109352.995668:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109352.995708:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933133824 00000100:00100000:2.0:1786109352.995712:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933133824 00000100:00100000:2.0:1786109352.995747:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12129 00000100:00100000:2.0:1786109352.995755:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933133824:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1786109352.996282:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c815050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:177416:x1872862933133696:12345-0@lo:105: Request processed in 1517us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109352.996291:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5256 00000100:00100000:2.0:1786109352.997736:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:188678:x1872862933133824:12345-0@lo:403:mdt00_003.0 Request processed in 1975us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109352.997747:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12129 00000100:00100000:2.0:1786109352.997790:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109352.997817:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933133824:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1786109352.998379:0:177416:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:177416:1872862933133696:0@lo:105: 00010000:00010000:3.0:1786109352.998506:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109352.999200:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922061824:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 5192us (5382us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109352.999209:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12628 00000040:00080000:2.0:1786109352.999362:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].466, 656 off707784 00000040:00080000:2.0:1786109352.999682:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].347, 736 off572496 00000004:00080000:2.0:1786109352.999689:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab9643e40 with version 703 00000004:00080000:3.0:1786109353.000179:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 703 rpc_version 703 00000020:00100000:3.0:1786109353.000213:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109353.000222:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984909180 x1872862933134080/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109353.000244:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933134080:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109353.000298:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109353.000373:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109353.000681:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933134080 00000100:00100000:1.0:1786109353.000689:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933134080 00000100:00100000:1.0:1786109353.000743:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12130 00000100:00100000:1.0:1786109353.000752:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933134080:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109353.000985:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933134080:12345-0@lo:1000:osp_up1-0.0 Request processed in 233us (686us total) trans 25769804477 rc 0/0 00000100:00100000:1.0:1786109353.000993:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12130 00000100:00100000:2.0:1786109353.001100:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933134080:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1786109353.001203:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1ddd:0x0]: returning size 4096 00010000:00010000:1.0:1786109353.001224:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001235:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001243:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001250:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109353.001255:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001263:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001279:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x41:0x0].0x0 (ffff930985b9d800) 00010000:00010000:1.0:1786109353.001283:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109353.001288:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001294:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca360b1 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001309:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001338:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001345:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001366:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786109353.001374:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x41:0x0] 00010000:00010000:1.0:1786109353.001381:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca360aa lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001387:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca360aa lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001406:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca360aa lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001412:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6de00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109353.001415:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca360aa lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.001422:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca360aa lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.001570:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109353.001577:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.001585:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3800 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109353.001589:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109353.001598:0:6514:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.001630:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.001638:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109353.001661:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.001669:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac16c3800/0xdb52b77d7ca360b8 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca360bf expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.001686:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109353.001688:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109353.001689:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109353.001697:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109353.001708:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933134208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109353.001744:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109353.001778:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933134208 00000100:00100000:0.0:1786109353.001784:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933134208 00000100:00100000:0.0:1786109353.001818:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4494 00000100:00100000:0.0:1786109353.001826:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3647:x1872862933134208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109353.001837:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109353.001854:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab295fc00/0xdb52b77d7ca360bf lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca360b8 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.001866:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x41:0x0].0x0 (ffff930a83e02200) 00010000:00010000:0.0:1786109353.001875:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109353.001904:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1872862933134208:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109353.001912:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4494 00000100:00100000:0.0:1786109353.001944:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933134208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109353.002108:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddd:0x0].0x0 (ffff930985b9da00) 00010000:00010000:1.0:1786109353.002112:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109353.002116:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca360aa lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.002124:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca360aa lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.002141:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca3609c lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.002148:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca3609c lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.002154:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca3609c lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.002160:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109353.002162:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca3609c lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.002182:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca3609c lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.002191:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109353.002193:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109353.002197:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca3609c lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.002202:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca3609c lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109353.002214:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3492f7a reply state 000000003648596e transno 326417514624 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca360a3 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.002226:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca360a3 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.002234:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109353.002236:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109353.002239:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109353.002309:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+95:157906:x1872862922061568:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 45355us (45811us total) trans 326417514624 rc 0/0 00000100:00100000:1.0:1786109353.002316:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 838 00000100:00100000:2.0:1786109353.044032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109353.044142:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922061952 00000100:00100000:3.0:1786109353.044158:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922061952 00000100:00100000:3.0:1786109353.044347:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 839 00000100:00100000:3.0:1786109353.044361:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+95:157913:x1872862922061952:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109353.044490:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109353.044516:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca360c6 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1452 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044597:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca360cd lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044615:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca360cd lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044629:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca360cd lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044745:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca360d4 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 45 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044756:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca360d4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044763:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca360d4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044819:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca360cd lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044827:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca360cd lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044835:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca360cd lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044852:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295fe00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109353.044857:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca360cd lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044863:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca360cd lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044877:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109353.044880:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109353.044886:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca360cd lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044892:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fe00/0xdb52b77d7ca360cd lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044921:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca360d4 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044928:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca360d4 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044934:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca360d4 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044940:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109353.044944:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca360d4 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044950:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca360d4 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044958:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109353.044960:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109353.044964:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca360d4 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.044971:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca360d4 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.045005:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca360c6 lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1452 expref: 96 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.045015:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109353.045017:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109353.045021:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca360c6 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1452 expref: 96 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.045029:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295e600, rc 0) 00000100:00100000:3.0:1786109353.045195:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+95:157913:x1872862922061952:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 836us (1170us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109353.045205:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 839 00000100:00080000:0.0:1786109353.045242:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109353.056732:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109353.056874:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922062080 00000100:00100000:1.0:1786109353.056889:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922062080 00000100:00100000:1.0:1786109353.056999:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 840 00000100:00100000:1.0:1786109353.057012:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+95:157913:x1872862922062080:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109353.057039:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109353.057065:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca360db lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1459 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057150:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf400/0xdb52b77d7ca360e2 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057215:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf400/0xdb52b77d7ca360e2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057229:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf400/0xdb52b77d7ca360e2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057243:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca360e9 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 45 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057252:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca360e9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057259:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca360e9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057319:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf400/0xdb52b77d7ca360e2 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057327:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf400/0xdb52b77d7ca360e2 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057334:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf400/0xdb52b77d7ca360e2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057342:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109353.057347:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf400/0xdb52b77d7ca360e2 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057356:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf400/0xdb52b77d7ca360e2 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057370:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109353.057374:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109353.057379:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf400/0xdb52b77d7ca360e2 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057385:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf400/0xdb52b77d7ca360e2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057413:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca360e9 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057420:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca360e9 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057426:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca360e9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057602:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0ace600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109353.057606:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca360e9 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057614:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca360e9 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057623:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109353.057626:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109353.057630:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca360e9 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057636:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca360e9 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057678:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca360db lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1459 expref: 96 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057690:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109353.057692:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109353.057696:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca360db lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1459 expref: 96 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.057705:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0acfa00, rc 0) 00000100:00100000:2.0:1786109353.057861:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+95:157913:x1872862922062080:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 850us (1141us total) trans 0 rc 301/301 00000100:00100000:2.0:1786109353.057874:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 840 00000100:00100000:3.0:1786109353.096730:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109353.096848:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922062208 00000100:00100000:1.0:1786109353.096862:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922062208 00000100:00100000:1.0:1786109353.096974:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 841 00000100:00100000:1.0:1786109353.096987:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+95:157913:x1872862922062208:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109353.097012:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109353.097037:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf400/0xdb52b77d7ca360f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1460 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.097123:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acec00/0xdb52b77d7ca360f7 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.097139:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acec00/0xdb52b77d7ca360f7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.097153:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acec00/0xdb52b77d7ca360f7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109353.097260:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:1.0:1786109353.097266:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786109353.097290:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acec00/0xdb52b77d7ca360f7 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.097320:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf400/0xdb52b77d7ca360f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1460 expref: 97 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.097340:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acec00/0xdb52b77d7ca360f7 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1460 expref: 96 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.097349:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109353.097353:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109353.097357:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0acec00, rc 0) 00000100:00100000:1.0:1786109353.097527:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+96:157913:x1872862922062208:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 541us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109353.097540:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 841 00000100:00100000:0.0:1786109353.108152:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109353.108305:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922062464 00000100:00100000:2.0:1786109353.108320:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922062464 00000100:00100000:2.0:1786109353.108507:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 842 00000100:00100000:2.0:1786109353.108520:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+96:157913:x1872862922062464:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:2.0:1786109353.108593:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109353.108626:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acec00/0xdb52b77d7ca360f7 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1460 expref: 96 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.108815:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109353.108821:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109353.108911:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca360fe lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.108927:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca360fe lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.108937:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca360fe lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.108949:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca36105 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 45 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.108965:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca36105 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.108971:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca36105 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109353.110014:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].467, 2152 off709936 00000040:00080000:2.0:1786109353.110180:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].348, 2352 off574848 00000004:00080000:2.0:1786109353.110190:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab96433c0 with version 704 00000004:00080000:3.0:1786109353.110346:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 704 rpc_version 704 00000020:00100000:3.0:1786109353.110422:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109353.110555:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984909500 x1872862933134464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109353.110584:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933134464:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109353.110673:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109353.110718:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109353.110825:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933134464 00000100:00100000:2.0:1786109353.110835:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933134464 00000100:00100000:2.0:1786109353.110921:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12131 00000100:00100000:2.0:1786109353.110932:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933134464:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109353.111953:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933134464:12345-0@lo:1000:osp_up1-0.0 Request processed in 1005us (1262us total) trans 25769804478 rc 0/0 00000100:00100000:2.0:1786109353.111966:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12131 00000100:00100000:3.0:1786109353.112495:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933134464:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1786109353.112656:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca3610c lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.112674:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca3610c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.112688:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca3610c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.112710:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca36113 lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.112718:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca36113 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.112724:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca36113 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.112766:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.112774:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.112789:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109353.112811:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933134592:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1786109353.112868:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109353.112906:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a905900 going to sleep for 11 seconds 00000100:00100000:2.0:1786109353.113086:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109353.113181:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933134592 00000100:00100000:0.0:1786109353.113189:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933134592 00000100:00100000:0.0:1786109353.113253:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12132 00000100:00100000:0.0:1786109353.113265:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab5396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:188678:x1872862933134592:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109353.113288:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109353.113312:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36121 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3611a expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.113340:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36121 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3611a expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.113354:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36121 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3611a expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.113363:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x42:0x0].0x0 (ffff930a83abda00) 00010000:00010000:0.0:1786109353.113366:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109353.113370:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3200, rc 0) 00000100:00100000:0.0:1786109353.113416:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab5396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:188678:x1872862933134592:12345-0@lo:101:mdt00_003.0 Request processed in 155us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109353.113423:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12132 00000100:00100000:3.0:1786109353.114001:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922062592 00000100:00100000:3.0:1786109353.114009:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922062592 00000100:00100000:3.0:1786109353.114100:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 843 00000100:00100000:3.0:1786109353.114110:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+97:157909:x1872862922062592:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:3.0:1786109353.114145:0:187901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444945920 avail 1298706432 00000100:00100000:3.0:1786109353.114238:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+97:157909:x1872862922062592:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 130us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109353.114246:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 843 00000100:00100000:2.0:1786109353.114606:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:188678:1872862933134592:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786109353.114631:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36121 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114645:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36121 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109353.114674:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3794135 reply state 00000000f1438a3a transno 326417514625 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca36113 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114690:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca36113 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114698:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x42:0x0].0x0 (ffff930985b9d700) 00010000:00010000:2.0:1786109353.114701:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109353.114705:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109353.114712:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36121 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114720:0:188678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36121 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109353.114734:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x42:0x0] 00000004:00010000:2.0:1786109353.114740:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3794135 reply state 00000000f1438a3a transno 326417514625 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca3610c lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114749:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca3610c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114756:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dde:0x0].0x0 (ffff930985b9db00) 00010000:00010000:2.0:1786109353.114758:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109353.114759:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1786109353.114766:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dde:0x0]: returning size 4096 00010000:00010000:2.0:1786109353.114775:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca360fe lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114782:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca360fe lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114789:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca360fe lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114796:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109353.114801:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca360fe lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114810:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca360fe lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114822:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109353.114825:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109353.114828:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca360fe lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114833:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca360fe lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109353.114849:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3794135 reply state 00000000f1438a3a transno 326417514625 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca36105 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114858:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca36105 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.114864:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109353.114867:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109353.114868:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1786109353.114940:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+97:157913:x1872862922062464:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 6423us (6803us total) trans 326417514625 rc 0/0 00000100:00100000:2.0:1786109353.114948:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 842 00000100:00100000:2.0:1786109353.121925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109353.122042:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922062720 00000100:00100000:0.0:1786109353.122056:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922062720 00000100:00100000:0.0:1786109353.122182:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 844 00000100:00100000:0.0:1786109353.122197:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:157909:x1872862922062720:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:0.0:1786109353.122248:0:187899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1786109353.122349:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:157909:x1872862922062720:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 154us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109353.122358:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 844 00000100:00100000:0.0:1786109353.146626:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109353.146774:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922062848 00000100:00100000:2.0:1786109353.146792:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922062848 00000100:00100000:2.0:1786109353.146948:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5701 00000100:00100000:2.0:1786109353.146963:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+5:157909:x1872862922062848:12345-192.168.203.38@tcp:13:lfs.0 00000100:00100000:0.0:1786109353.146988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00002000:00000024:2.0:1786109353.147009:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109353.147076:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922062976 00000100:00100000:3.0:1786109353.147087:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922062976 00000100:00100000:2.0:1786109353.147115:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+5:157909:x1872862922062848:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 156us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.147131:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5701 00000100:00100000:3.0:1786109353.147150:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 845 00000100:00100000:3.0:1786109353.147162:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+97:157925:x1872862922062976:12345-192.168.203.38@tcp:101:rmdir.0 00000100:00080000:1.0:1786109353.147192:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786109353.147519:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109353.147540:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca36128 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1467 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147612:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca3612f lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147626:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca3612f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147638:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca3612f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147647:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36136 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 46 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147654:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36136 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147660:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36136 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147732:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3613d lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147741:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3613d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147748:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3613d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109353.147824:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dde:0x0]: returning size 4096 00000004:00200000:3.0:1786109353.147829:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1786109353.147848:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3613d lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147859:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca3612f lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147864:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca3612f lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147874:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca3612f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147879:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109353.147883:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca3612f lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147890:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca3612f lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147901:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109353.147904:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109353.147909:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca3612f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147914:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca3612f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147927:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36136 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147934:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36136 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147940:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36136 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147945:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295f600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109353.147948:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36136 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147957:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36136 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147965:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109353.147967:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109353.147969:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36136 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.147974:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36136 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.148007:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca36128 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1467 expref: 99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.148021:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3613d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1467 expref: 98 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.148028:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dde:0x0].0x0 (ffff930985b9db00) 00010000:00010000:3.0:1786109353.148031:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109353.148033:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295fc00, rc 0) 00000100:00100000:3.0:1786109353.148161:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+98:157925:x1872862922062976:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 1000us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109353.148180:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 845 00000100:00100000:0.0:1786109353.152272:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109353.152609:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922063104 00000100:00100000:2.0:1786109353.152618:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922063104 00000100:00100000:2.0:1786109353.152691:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5702 00000100:00100000:2.0:1786109353.152703:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+5:157909:x1872862922063104:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1786109353.152734:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109353.152795:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+5:157909:x1872862922063104:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 95us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.152802:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5702 00000100:00080000:1.0:1786109353.153265:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109353.155595:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109353.155723:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922063232 00000100:00100000:1.0:1786109353.155732:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922063232 00000100:00100000:0.0:1786109353.155903:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 846 00000100:00100000:0.0:1786109353.155917:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+98:157925:x1872862922063232:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:0.0:1786109353.155938:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109353.155958:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca36144 lrc: 2/0,0 mode: --/CR res: [0x2000255c0:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a146e expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.156015:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3614b lrc: 3/1,0 mode: --/PR res: [0x2000255c0:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.156027:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3614b lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.156038:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3614b lrc: 3/1,0 mode: PR/PR res: [0x2000255c0:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109353.156089:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000255c0:0x42:0x0]: returning size 4096 00000004:00200000:0.0:1786109353.156094:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786109353.156129:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca36144 lrc: 0/0,0 mode: --/CR res: [0x2000255c0:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a146e expref: 100 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.156150:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3614b lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a146e expref: 99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.156157:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x42:0x0].0x0 (ffff930985b9d700) 00010000:00010000:0.0:1786109353.156160:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109353.156162:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2000, rc 0) 00000100:00100000:0.0:1786109353.156272:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+99:157925:x1872862922063232:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 360us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109353.156280:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 846 00000100:00100000:0.0:1786109353.160092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109353.160196:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922063360 00000100:00100000:2.0:1786109353.160206:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922063360 00000100:00100000:2.0:1786109353.160268:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 847 00000100:00100000:2.0:1786109353.160278:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:157925:x1872862922063360:12345-192.168.203.38@tcp:101:rmdir.0 00010000:00010000:2.0:1786109353.160298:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109353.160316:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76600/0xdb52b77d7ca36152 lrc: 2/0,0 mode: --/CR res: [0x240002ef8:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1475 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.160387:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.160401:0:188678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36121 lrc: 2/0,0 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3611a expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.160409:0:188678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 4/1,0 mode: --/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.160533:0:188678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36121 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca3611a expref: 8 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109353.160548:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188678:1872862933134720:0@lo:104: 00000100:00100000:2.0:1786109353.160590:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109353.160715:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109353.160891:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933134720 00000100:00100000:3.0:1786109353.160896:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933134720 00000100:00100000:3.0:1786109353.160962:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5257 00000100:00100000:3.0:1786109353.160970:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:188678:x1872862933134720:12345-0@lo:104: 00010000:00010000:3.0:1786109353.160984:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca36121 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.161057:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786109353.161063:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:188678:x1872862933134720:12345-0@lo:104: Request processed in 95us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109353.161070:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5257 00010000:00010000:1.0:1786109353.161117:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109353.161125:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca36121 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.161133:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295fe00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109353.161138:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca36121 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109353.161147:0:29734:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 4/0,0 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca36121 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.161185:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36121 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.161192:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109353.161215:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 1/0,0 mode: --/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36121 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.161221:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ab295fe00/0xdb52b77d7ca3611a lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36121 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.161240:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109353.161242:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109353.161243:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109353.161321:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:188678:1872862933134720:0@lo:104: 00010000:00010000:2.0:1786109353.161341:0:188678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109353.161502:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933134848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109353.161533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109353.161649:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933134848 00000100:00100000:1.0:1786109353.161653:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933134848 00010000:00010000:1.0:1786109353.161671:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36121 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca3611a expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109353.161725:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12629 00000100:00100000:1.0:1786109353.161732:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3647:x1872862933134848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109353.161742:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1786109353.164719:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804478 is committed 00010000:00010000:1.0:1786109353.164917:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36121 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca3611a expref: 7 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.164934:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x42:0x0].0x0 (ffff930a83abda00) 00010000:00010000:1.0:1786109353.164939:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 3/1,0 mode: --/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.164950:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.164956:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 4/1,0 mode: PR/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.165040:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109353.165118:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933134848:12345-0@lo:103:ldlm_bl.0 Request processed in 3384us (3582us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109353.165127:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12629 00000100:00100000:0.0:1786109353.165607:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933134848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109353.165752:0:188678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.165761:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 3/1,0 mode: PR/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109353.165814:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef8:0x42:0x0]: returning size 4096 00000004:00200000:2.0:1786109353.165819:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786109353.165925:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76600/0xdb52b77d7ca36152 lrc: 0/0,0 mode: --/CR res: [0x240002ef8:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1475 expref: 8 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.165941:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1475 expref: 7 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.165949:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x42:0x0].0x0 (ffff930a83abda00) 00010000:00010000:2.0:1786109353.165952:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786109353.165955:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76400, rc 0) 00000100:00100000:2.0:1786109353.166050:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+7:157925:x1872862922063360:12345-192.168.203.38@tcp:101:rmdir.0 Request processed in 5772us (5966us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.166059:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 847 00000100:00100000:2.0:1786109353.182794:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109353.182915:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922063616 00000100:00100000:0.0:1786109353.182923:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922063616 00000100:00100000:0.0:1786109353.183028:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 848 00000100:00100000:0.0:1786109353.183040:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+99:157925:x1872862922063616:12345-192.168.203.38@tcp:36:rmdir.0 00010000:00010000:0.0:1786109353.183098:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109353.183124:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fc00/0xdb52b77d7ca3613d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1467 expref: 99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.183142:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dde:0x0].0x0 (ffff930985b9db00) 00010000:00010000:0.0:1786109353.183146:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109353.183215:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca36160 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.183230:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca36160 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.183239:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca36160 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.183252:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36167 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 46 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.183267:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36167 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.183273:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36167 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.183352:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca3616e lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.183361:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca3616e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.183368:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca3616e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.183384:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.183405:0:187899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3614b lrc: 2/0,0 mode: PR/PR res: [0x2000255c0:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a146e expref: 98 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.183420:0:187899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 4/0,1 mode: --/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.183677:0:187899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3614b lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a146e expref: 98 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.183691:0:187899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3614b lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a146e expref: 98 pid: 187899 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109353.183711:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933134976:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109353.183991:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977600 going to sleep for 11 seconds 00000100:00100000:1.0:1786109353.193837:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:187899:1872862933134976:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109353.193866:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109353.197243:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109353.197347:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922063744 00000100:00100000:3.0:1786109353.197362:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922063744 00010000:00010000:3.0:1786109353.197406:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3614b lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a146e expref: 99 pid: 187899 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109353.197498:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12630 00000100:00100000:3.0:1786109353.197509:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+99:2404:x1872862922063744:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109353.197523:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109353.197529:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3614b lrc: 4/0,0 mode: PR/PR res: [0x2000255c0:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a146e expref: 99 pid: 187899 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.197542:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3614b lrc: 3/0,0 mode: PR/PR res: [0x2000255c0:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a146e expref: 99 pid: 187899 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.197565:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3614b lrc: 0/0,0 mode: --/PR res: [0x2000255c0:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a146e expref: 99 pid: 187899 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.197579:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x42:0x0].0x0 (ffff930985b9d700) 00010000:00010000:3.0:1786109353.197584:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 3/0,1 mode: --/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.197597:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.197604:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 4/0,1 mode: EX/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.197627:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109353.197688:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+98:2404:x1872862922063744:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 180us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109353.197695:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12630 00010000:00010000:1.0:1786109353.197917:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.197926:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.197971:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.197980:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.197990:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 3/0,1 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109353.198009:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933135104:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786109353.198080:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109353.198117:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977600 going to sleep for 11 seconds 00000100:00100000:2.0:1786109353.198186:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933135104 00000100:00100000:2.0:1786109353.198191:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933135104 00000100:00100000:2.0:1786109353.198232:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12133 00000100:00100000:2.0:1786109353.198240:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187899:x1872862933135104:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786109353.198255:0:177399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109353.198268:0:177399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76c00/0xdb52b77d7ca36183 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3617c expref: -99 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.198287:0:177399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 2/0,0 mode: PR/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1475 expref: 6 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.198295:0:177399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76c00/0xdb52b77d7ca36183 lrc: 4/0,0 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3617c expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.198317:0:177399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1475 expref: 6 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.198328:0:177399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1475 expref: 6 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109353.198339:0:177399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177399:1872862933135232:192.168.203.38@tcp:104: 00000100:00100000:2.0:1786109353.198403:0:177399:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109353.201677:0:177399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001_UUID:177399:1872862933135232:192.168.203.38@tcp:104: 00010000:00010000:0.0:1786109353.201709:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76c00/0xdb52b77d7ca36183 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3617c expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.201722:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x42:0x0].0x0 (ffff930a83abda00) 00010000:00010000:0.0:1786109353.201725:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109353.201728:0:177399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76c00/0xdb52b77d7ca36183 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3617c expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.201738:0:177399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76c00/0xdb52b77d7ca36183 lrc: 3/0,0 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3617c expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.201744:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76c00, rc 0) 00000100:00100000:0.0:1786109353.201865:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933135104:12345-0@lo:101:mdt00_000.0 Request processed in 3626us (3784us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109353.201874:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12133 00000100:00100000:1.0:1786109353.201944:0:187899:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804478 gen 2 00000004:00080000:1.0:1786109353.201951:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804477 committed transno 25769804478 00000004:00080000:1.0:1786109353.201978:0:187899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804478 committed transno 25769804478 00000100:00100000:1.0:1786109353.201990:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933135104:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109353.202006:0:187899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.202016:0:187899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 4/0,1 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109353.204049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109353.204140:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922063872 00000100:00100000:0.0:1786109353.204150:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922063872 00010000:00010000:0.0:1786109353.204201:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1475 expref: 7 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109353.204275:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12631 00000100:00100000:0.0:1786109353.204286:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:397d331e-10fc-4558-be87-308c3622e8eb+7:2403:x1872862922063872:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109353.204303:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109353.204309:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 4/0,0 mode: PR/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1475 expref: 7 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.204321:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 3/0,0 mode: PR/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1475 expref: 7 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.204341:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76400/0xdb52b77d7ca36159 lrc: 0/0,0 mode: --/PR res: [0x240002ef8:0x42:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1475 expref: 7 pid: 188678 timeout: 8309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.204356:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x42:0x0].0x0 (ffff930a83abda00) 00010000:00010000:0.0:1786109353.204361:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76c00/0xdb52b77d7ca36183 lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3617c expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.204372:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76c00/0xdb52b77d7ca36183 lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca3617c expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.204380:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76c00/0xdb52b77d7ca36183 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca3617c expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.204424:0:9538:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76c00/0xdb52b77d7ca36183 lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3617c expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109353.204490:0:9538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1143800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9538:1872862933135360:0@lo:105: 00000100:00100000:0.0:1786109353.204533:0:9538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109353.204578:0:9538:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109353.204687:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933135360 00000100:00100000:2.0:1786109353.204692:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933135360 00000100:00100000:2.0:1786109353.204733:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5258 00000100:00100000:2.0:1786109353.204740:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9538:x1872862933135360:12345-0@lo:105: 00010000:00010000:2.0:1786109353.204751:0:6509:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.204760:0:6509:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.204767:0:6509:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 5/0,1 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.204774:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 5/0,1 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.204781:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.204788:0:6509:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 6/0,1 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.204806:0:6509:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ac0acf400) 00000100:00100000:2.0:1786109353.204849:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9538:x1872862933135360:12345-0@lo:105: Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.204856:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5258 00000100:00100000:2.0:1786109353.204890:0:9538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1143800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:9538:1872862933135360:0@lo:105: 00010000:00010000:2.0:1786109353.204907:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109353.204945:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922063872:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 661us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.204953:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12631 00010000:00010000:1.0:1786109353.205076:0:187899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.205087:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109353.205842:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933135488:0@lo:403:mdt00_000.0 00000100:00100000:1.0:1786109353.205886:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109353.205910:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977600 going to sleep for 11 seconds 00000100:00100000:0.0:1786109353.206005:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933135488 00000100:00100000:0.0:1786109353.206010:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933135488 00000100:00100000:0.0:1786109353.206044:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12134 00000100:00100000:0.0:1786109353.206052:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933135488:12345-0@lo:403:mdt00_000.0 00000100:00100000:0.0:1786109353.207836:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187899:x1872862933135488:12345-0@lo:403:mdt00_000.0 Request processed in 1778us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109353.207847:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12134 00000100:00100000:1.0:1786109353.208035:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933135488:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1786109353.208930:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].468, 656 off710592 00000040:00080000:1.0:1786109353.209102:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].349, 736 off575584 00000004:00080000:1.0:1786109353.209108:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ac0977600 with version 705 00000004:00080000:0.0:1786109353.209256:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 705 rpc_version 705 00000020:00100000:0.0:1786109353.209284:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109353.209292:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9309854fad80 x1872862933135744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109353.209313:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933135744:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109353.209361:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109353.209759:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109353.209830:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933135744 00000100:00100000:1.0:1786109353.209838:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933135744 00000100:00100000:1.0:1786109353.209875:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12135 00000100:00100000:1.0:1786109353.209883:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933135744:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109353.210075:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933135744:12345-0@lo:1000:osp_up1-0.0 Request processed in 193us (713us total) trans 25769804479 rc 0/0 00000100:00100000:1.0:1786109353.210083:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12135 00000100:00100000:1.0:1786109353.210127:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933135744:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1786109353.210147:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1dde:0x0]: returning size 4096 00010000:00010000:1.0:1786109353.210313:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 3/0,1 mode: EX/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210325:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 2/0,0 mode: EX/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210333:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210339:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109353.210343:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 3/0,0 mode: EX/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210351:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 4/0,0 mode: EX/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210365:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x42:0x0].0x0 (ffff930985b9d700) 00010000:00010000:1.0:1786109353.210368:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109353.210372:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 2/0,0 mode: --/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210378:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca36175 lrc: 0/0,0 mode: --/EX res: [0x2000255c0:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210545:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210554:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 4/0,1 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210565:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210623:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786109353.210633:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x42:0x0] 00010000:00010000:1.0:1786109353.210643:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca3616e lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210649:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca3616e lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210655:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca3616e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210660:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109353.210663:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca3616e lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210670:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca3616e lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210678:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dde:0x0].0x0 (ffff930985b9db00) 00010000:00010000:1.0:1786109353.210680:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109353.210683:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca3616e lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210689:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca3616e lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210702:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca36160 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210709:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca36160 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210715:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca36160 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210720:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109353.210722:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca36160 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210728:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca36160 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210734:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109353.210736:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109353.210739:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca36160 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210744:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca36160 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109353.210752:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d773f7f8 reply state 00000000c6a56c90 transno 326417514626 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36167 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210763:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36167 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.210770:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109353.210772:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109353.210774:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109353.210840:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+99:157925:x1872862922063616:12345-192.168.203.38@tcp:36:rmdir.0 Request processed in 27800us (28052us total) trans 326417514626 rc 0/0 00000100:00100000:1.0:1786109353.210847:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 848 00010000:00010000:3.0:1786109353.211178:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109353.211185:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 2/0,0 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.211193:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf400 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:3.0:1786109353.211197:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109353.211204:0:6515:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 3/0,0 mode: EX/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.211232:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 2/0,0 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.211239:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1786109353.211287:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933135872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109353.211325:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786109353.211383:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 1/0,0 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109353.211476:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933135872 00000100:00100000:0.0:1786109353.211482:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933135872 00000100:00100000:0.0:1786109353.211522:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4495 00000100:00100000:0.0:1786109353.211530:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3648:x1872862933135872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109353.211541:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109353.211557:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93098cd76c00/0xdb52b77d7ca36183 lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3617c expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109353.211570:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x42:0x0].0x0 (ffff930a83abda00) 00010000:00010000:0.0:1786109353.211578:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109353.211671:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff930ac0acf400/0xdb52b77d7ca3617c lrc: 0/0,0 mode: --/EX res: [0x240002ef8:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36183 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.211685:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109353.211687:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109353.211689:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109353.211748:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1872862933135872:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109353.211755:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4495 00000100:00100000:1.0:1786109353.211809:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933135872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109353.231953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109353.232066:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922064000 00000100:00100000:3.0:1786109353.232076:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922064000 00000100:00100000:3.0:1786109353.232178:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 849 00000100:00100000:3.0:1786109353.232189:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+99:157930:x1872862922064000:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109353.232216:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109353.232235:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca3618a lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a147c expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232298:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36191 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232313:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36191 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232323:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36191 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232335:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca36198 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 47 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232342:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca36198 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232348:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca36198 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232389:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36191 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232409:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36191 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232416:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36191 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232423:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295f600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109353.232427:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36191 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232471:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36191 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232482:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109353.232485:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109353.232490:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36191 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232495:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f600/0xdb52b77d7ca36191 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232508:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca36198 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232513:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca36198 lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232518:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca36198 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232524:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109353.232527:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca36198 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232534:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca36198 lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232540:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:3.0:1786109353.232543:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109353.232546:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca36198 lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232551:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e800/0xdb52b77d7ca36198 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232580:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca3618a lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a147c expref: 100 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232591:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:3.0:1786109353.232593:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109353.232596:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e000/0xdb52b77d7ca3618a lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a147c expref: 100 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109353.232604:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295e000, rc 0) 00000100:00100000:3.0:1786109353.232658:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+99:157930:x1872862922064000:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 471us (715us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109353.232666:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 849 00000100:00100000:0.0:1786109353.236876:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109353.236959:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922064128 00000100:00100000:1.0:1786109353.236967:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922064128 00000100:00100000:1.0:1786109353.237102:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 850 00000100:00100000:1.0:1786109353.237114:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+99:157930:x1872862922064128:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109353.237136:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109353.237155:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca3619f lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1483 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237243:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361a6 lrc: 3/1,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237257:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361a6 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237268:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361a6 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237278:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361ad lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 47 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237284:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361ad lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237290:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361ad lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237331:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361a6 lrc: 3/1,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237338:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361a6 lrc: 2/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237344:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361a6 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237350:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0ace600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109353.237354:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361a6 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237361:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361a6 lrc: 4/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237373:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109353.237376:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109353.237380:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361a6 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237386:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361a6 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237398:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361ad lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237404:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361ad lrc: 2/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237411:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361ad lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237417:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acee00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109353.237419:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361ad lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237425:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361ad lrc: 4/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237663:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:1.0:1786109353.237666:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109353.237669:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361ad lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237675:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361ad lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237703:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca3619f lrc: 1/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1483 expref: 100 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237712:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109353.237715:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109353.237718:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca3619f lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1483 expref: 100 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.237726:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0acfa00, rc 0) 00000100:00100000:1.0:1786109353.237826:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+99:157930:x1872862922064128:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 714us (958us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109353.237833:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 850 00000100:00100000:0.0:1786109353.242408:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109353.242677:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922064256 00000100:00100000:2.0:1786109353.242688:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922064256 00000100:00100000:2.0:1786109353.242787:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 851 00000100:00100000:2.0:1786109353.242799:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+99:157930:x1872862922064256:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109353.242824:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109353.242846:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a148a expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.242921:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca361bb lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.242936:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca361bb lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.242947:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca361bb lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109353.243068:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00200000:2.0:1786109353.243072:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109353.243095:0:188678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca361bb lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.243124:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a148a expref: 101 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.243142:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca361bb lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a148a expref: 100 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.243153:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109353.243156:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109353.243160:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76000, rc 0) 00000100:00100000:2.0:1786109353.243236:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+100:157930:x1872862922064256:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 439us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.243243:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 851 00000100:00100000:2.0:1786109353.273426:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109353.274112:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922064512 00000100:00100000:1.0:1786109353.274122:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922064512 00000100:00100000:1.0:1786109353.274530:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 852 00000100:00100000:1.0:1786109353.274543:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+100:157930:x1872862922064512:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1786109353.274603:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109353.274633:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca361bb lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a148a expref: 100 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.274652:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:1.0:1786109353.274657:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109353.274711:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca361c2 lrc: 3/0,1 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.274723:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca361c2 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.274734:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca361c2 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.274745:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361c9 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x0/0x0 rrc: 47 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.274759:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361c9 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.274766:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361c9 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109353.279250:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000255c0:0x1:0x0].469, 2152 off712744 00000040:00080000:1.0:1786109353.279338:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002ef8:0x1:0x0].350, 2352 off577936 00000004:00080000:1.0:1786109353.279345:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a84108a80 with version 706 00000004:00080000:3.0:1786109353.280976:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 706 rpc_version 706 00000020:00100000:3.0:1786109353.281219:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109353.281230:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098490b480 x1872862933136128/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109353.281257:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933136128:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109353.281332:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109353.281419:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a905900 going to sleep for 11 seconds 00000100:00100000:0.0:1786109353.282234:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933136128 00000100:00100000:0.0:1786109353.282245:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933136128 00000100:00100000:0.0:1786109353.282578:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12136 00000100:00100000:0.0:1786109353.282590:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933136128:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109353.284265:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933136128:12345-0@lo:1000:osp_up1-0.0 Request processed in 1672us (2927us total) trans 25769804480 rc 0/0 00000100:00100000:0.0:1786109353.284278:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12136 00000100:00100000:3.0:1786109353.285226:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933136128:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1786109353.285406:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361d0 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1ddf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.285422:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361d0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1ddf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.285447:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361d0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1ddf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.285469:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361d7 lrc: 3/0,1 mode: --/PW res: [0x2000255c0:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.285477:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361d7 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.285484:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361d7 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.285522:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76400/0xdb52b77d7ca361de lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.285529:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76400/0xdb52b77d7ca361de lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.285538:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76400/0xdb52b77d7ca361de lrc: 3/0,1 mode: --/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109353.285557:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933136256:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1786109353.285609:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109353.285640:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109353.285657:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933136256 00000100:00100000:1.0:1786109353.285666:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933136256 00000100:00100000:1.0:1786109353.285767:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12137 00000100:00100000:1.0:1786109353.285777:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187899:x1872862933136256:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786109353.285797:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109353.285811:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361e5 lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca361de expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.285903:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361e5 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca361de expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.285916:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361e5 lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca361de expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109353.285925:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x43:0x0].0x0 (ffff930ab7f80100) 00010000:00010000:1.0:1786109353.285928:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109353.285931:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0ace600, rc 0) 00000100:00100000:1.0:1786109353.285974:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187899:x1872862933136256:12345-0@lo:101:mdt00_000.0 Request processed in 199us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109353.285981:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12137 00000100:00100000:2.0:1786109353.286088:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:187899:1872862933136256:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786109353.286101:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76400/0xdb52b77d7ca361de lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca361e5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286110:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76400/0xdb52b77d7ca361de lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca361e5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109353.286129:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a992128 reply state 000000005f93b563 transno 326417514627 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361d7 lrc: 3/0,1 mode: PW/PW res: [0x2000255c0:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286140:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361d7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286146:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x43:0x0].0x0 (ffff930984516100) 00010000:00010000:2.0:1786109353.286149:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109353.286151:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109353.286157:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76400/0xdb52b77d7ca361de lrc: 4/0,1 mode: PW/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca361e5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286164:0:187899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76400/0xdb52b77d7ca361de lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca361e5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109353.286190:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240002ef8:0x43:0x0] 00000004:00010000:2.0:1786109353.286196:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a992128 reply state 000000005f93b563 transno 326417514627 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361d0 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1ddf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286203:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361d0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1ddf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286208:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddf:0x0].0x0 (ffff930984516500) 00010000:00010000:2.0:1786109353.286210:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109353.286212:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1786109353.286217:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1ddf:0x0]: returning size 4096 00010000:00010000:2.0:1786109353.286224:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca361c2 lrc: 3/0,1 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286230:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca361c2 lrc: 2/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286235:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca361c2 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286241:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acfa00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109353.286246:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca361c2 lrc: 3/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286253:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca361c2 lrc: 4/0,0 mode: CW/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286261:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83e02600) 00010000:00010000:2.0:1786109353.286263:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109353.286266:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca361c2 lrc: 2/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286272:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfa00/0xdb52b77d7ca361c2 lrc: 0/0,0 mode: --/CW res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109353.286284:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a992128 reply state 000000005f93b563 transno 326417514627 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361c9 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286292:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361c9 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109353.286298:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109353.286300:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109353.286302:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1786109353.287480:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+101:157930:x1872862922064512:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 12932us (14054us total) trans 326417514627 rc 0/0 00000100:00100000:2.0:1786109353.287490:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 852 00000100:00100000:2.0:1786109353.733562:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933136384:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.733641:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109353.733760:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933136640:0@lo:400:kworker.0 00000100:00100000:1.0:1786109353.733795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109353.733825:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933137152:0@lo:400:kworker.0 00000100:00100000:1.0:1786109353.733849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109353.733869:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933137664:0@lo:400:kworker.0 00000100:00100000:1.0:1786109353.733889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109353.733915:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1786109353.733921:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933136512:0@lo:400:kworker.0 00000100:00100000:1.0:1786109353.733944:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109353.733963:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933137024:0@lo:400:kworker.0 00000100:00100000:1.0:1786109353.733984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109353.734000:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933137536:0@lo:400:kworker.0 00000100:00100000:1.0:1786109353.734019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109353.734046:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933137152 00000100:00100000:1.0:1786109353.734053:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933137152 00000100:00100000:1.0:1786109353.734102:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933137664 00000100:00100000:1.0:1786109353.734105:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933137664 00000100:00100000:1.0:1786109353.734129:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6804 00000100:00100000:1.0:1786109353.734137:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933137152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109353.734259:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933137024 00000100:00100000:0.0:1786109353.734264:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933137024 00000100:00100000:0.0:1786109353.734297:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933137536 00000100:00100000:0.0:1786109353.734300:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933137536 00000100:00100000:3.0:1786109353.734303:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933136768:0@lo:400:kworker.0 00000100:00100000:0.0:1786109353.734324:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12138 00000100:00100000:0.0:1786109353.734340:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933137024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.735229:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933136896:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.735267:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109353.735289:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933137408:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.735311:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109353.735327:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933137920:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.735348:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109353.735380:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6805 00000100:00100000:2.0:1786109353.735390:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933137664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.735454:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933137664:12345-0@lo:400:kworker.0 Request processed in 43us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.735462:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6805 00000100:00100000:2.0:1786109353.735516:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933138048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109353.735544:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109353.735594:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933137664:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.735619:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933136640 00000100:00100000:2.0:1786109353.735623:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933136640 00000100:00100000:2.0:1786109353.735647:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933136512 00000100:00100000:2.0:1786109353.735650:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933136512 00000100:00100000:2.0:1786109353.735663:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933136896 00000100:00100000:2.0:1786109353.735666:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933136896 00000100:00100000:2.0:1786109353.735679:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933137408 00000100:00100000:2.0:1786109353.735682:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933137408 00000100:00100000:2.0:1786109353.735691:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933137920 00000100:00100000:2.0:1786109353.735693:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933137920 00000100:00100000:2.0:1786109353.735704:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786109353.735711:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933136640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.735749:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933136640:12345-0@lo:400:kworker.0 Request processed in 39us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.735756:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786109353.735781:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933136640:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.735800:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786109353.735807:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933136512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.735840:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933136512:12345-0@lo:400:kworker.0 Request processed in 34us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.735847:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786109353.735871:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933136512:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.735889:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786109353.735896:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933136896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.735928:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933136896:12345-0@lo:400:kworker.0 Request processed in 33us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.735934:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786109353.735956:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933136896:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.735972:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786109353.735977:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933137408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.736008:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933137408:12345-0@lo:400:kworker.0 Request processed in 31us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.736014:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786109353.736038:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933137408:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.736054:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786109353.736060:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933137920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.736092:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933137920:12345-0@lo:400:kworker.0 Request processed in 33us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.736098:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786109353.736119:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933137920:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.736205:0:187888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933136384 00000100:00100000:2.0:1786109353.736208:0:187888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933136384 00000100:00100000:2.0:1786109353.736233:0:187888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1786109353.736238:0:187888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933136384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.736271:0:187888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933136384:12345-0@lo:400:kworker.0 Request processed in 33us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.736277:0:187888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1786109353.736305:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109353.736313:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933138176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109353.736336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109353.736366:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933136384:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.736396:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933138048 00000100:00100000:2.0:1786109353.736400:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933138048 00000100:00100000:2.0:1786109353.736423:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5703 00000100:00100000:2.0:1786109353.736455:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933138048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109353.736471:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109353.736507:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933138048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.736514:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5703 00000100:00100000:2.0:1786109353.736547:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933138048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109353.736565:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933138176 00000100:00100000:2.0:1786109353.736568:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933138176 00000100:00100000:2.0:1786109353.736586:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12139 00000100:00100000:2.0:1786109353.736592:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:3647:x1872862933137536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.736633:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:3647:x1872862933137536:12345-0@lo:400:kworker.0 Request processed in 41us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.736640:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12139 00000100:00100000:2.0:1786109353.736652:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12140 00000100:00100000:2.0:1786109353.736658:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1872862933138176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109353.736682:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444945920 avail 1298706432 00000100:00100000:2.0:1786109353.736714:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1872862933138176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109353.736719:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12140 00000100:00100000:2.0:1786109353.736744:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933138176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109353.736766:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933137536:0@lo:400:kworker.0 00000100:00100000:1.0:1786109353.737016:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933137152:12345-0@lo:400:kworker.0 Request processed in 2877us (3163us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109353.737024:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6804 00000100:00080000:1.0:1786109353.737048:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786109353.737052:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109353.737055:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109353.737090:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109353.737098:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933138304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109353.737125:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109353.737150:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933138304 00000100:00100000:1.0:1786109353.737154:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933138304 00000100:00100000:2.0:1786109353.737196:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933137152:0@lo:400:kworker.0 00000100:00100000:1.0:1786109353.737303:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5704 00000100:00100000:1.0:1786109353.737309:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933138304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109353.737321:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109353.737354:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933138304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109353.737364:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5704 00000100:00100000:1.0:1786109353.737398:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933138304:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1786109353.737530:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786109353.761382:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109353.761558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109353.761661:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933137280:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.761698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109353.761717:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933137792:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.761739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109353.761811:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933137024:12345-0@lo:400:kworker.0 Request processed in 27478us (27824us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109353.761822:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12138 00000100:00100000:3.0:1786109353.761903:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933137280 00000100:00100000:3.0:1786109353.761911:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933137280 00000100:00100000:3.0:1786109353.761980:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933137792 00000100:00100000:3.0:1786109353.761983:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933137792 00000100:00100000:3.0:1786109353.762004:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6806 00000100:00100000:3.0:1786109353.762013:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933137280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109353.762063:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933137280:12345-0@lo:400:kworker.0 Request processed in 51us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109353.762069:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6806 00000100:00100000:3.0:1786109353.762081:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6807 00000100:00100000:3.0:1786109353.762102:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933137792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109353.762132:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933137792:12345-0@lo:400:kworker.0 Request processed in 46us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109353.762137:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6807 00000100:00100000:3.0:1786109353.762193:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933137024:0@lo:400:kworker.0 00000100:00080000:2.0:1786109353.762300:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109353.762324:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933137280:0@lo:400:kworker.0 00000100:00100000:2.0:1786109353.762334:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933137792:0@lo:400:kworker.0 00000100:00100000:1.0:1786109353.762381:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933136768 00000100:00100000:1.0:1786109353.762386:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933136768 00000100:00100000:1.0:1786109353.762501:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786109353.762509:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933136768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109353.762634:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933136768:12345-0@lo:400:kworker.0 Request processed in 125us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109353.762640:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1786109353.762691:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109353.764397:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933136768:0@lo:400:kworker.0 00010000:00010000:0.0:1786109354.187118:0:187883:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76400/0xdb52b77d7ca361de lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca361e5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109354.187137:0:187883:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76400/0xdb52b77d7ca361de lrc: 3/0,0 mode: PW/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca361e5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109354.187191:0:187883:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76400/0xdb52b77d7ca361de lrc: 2/0,0 mode: --/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca361e5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109354.187198:0:187883:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109354.187238:0:187883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff93098cd76400/0xdb52b77d7ca361de lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca361e5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786109354.187261:0:187883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 326417514627 is committed 00000020:00080000:0.0:1786109354.187275:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab9643000 refcount 2 committed 0 result 0 batchid 322122568690 00000020:00080000:0.0:1786109354.187280:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8f9a300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab96433c0 00000020:00080000:0.0:1786109354.187284:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].348 00000020:00080000:0.0:1786109354.187286:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8f9a100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930a8614ce00 00000020:00080000:0.0:1786109354.187289:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].467 00000020:00080000:0.0:1786109354.187298:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab9643240 refcount 2 committed 0 result 0 batchid 322122568689 00000020:00080000:0.0:1786109354.187301:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8f9a700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab9643e40 00000020:00080000:0.0:1786109354.187304:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].347 00000020:00080000:0.0:1786109354.187306:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8f9a800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930a8614ca00 00000020:00080000:0.0:1786109354.187318:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].466 00000020:00080000:0.0:1786109354.187323:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ac0977480 refcount 2 committed 0 result 0 batchid 322122568688 00000020:00080000:0.0:1786109354.187325:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930981d5a900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ac09773c0 00000020:00080000:0.0:1786109354.187328:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].346 00000020:00080000:0.0:1786109354.187330:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0972d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab8fe2a00 00000020:00080000:0.0:1786109354.187333:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].465 00000020:00080000:0.0:1786109354.187337:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930987d34600 refcount 2 committed 0 result 0 batchid 322122568687 00000020:00080000:0.0:1786109354.187339:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a8a7cbb00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930987d340c0 00000020:00080000:0.0:1786109354.187341:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].345 00000020:00080000:0.0:1786109354.187343:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a8a7cbe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab7ef2400 00000020:00080000:0.0:1786109354.187346:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].464 00000020:00080000:0.0:1786109354.187350:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93098bef0480 refcount 2 committed 0 result 0 batchid 322122568686 00000020:00080000:0.0:1786109354.187353:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a87b87700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93098bef0300 00000020:00080000:0.0:1786109354.187355:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].344 00000020:00080000:0.0:1786109354.187357:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a87b87500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098c0eb200 00000020:00080000:0.0:1786109354.187367:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].463 00000020:00080000:0.0:1786109354.187373:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93098502ff00 refcount 2 committed 0 result 0 batchid 322122568685 00000020:00080000:0.0:1786109354.187376:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a87b87c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93098502f6c0 00000020:00080000:0.0:1786109354.187379:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].343 00000020:00080000:0.0:1786109354.187381:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a87b87400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098c0eac00 00000020:00080000:0.0:1786109354.187383:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].462 00000020:00080000:0.0:1786109354.187387:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab9687840 refcount 2 committed 0 result 0 batchid 322122568684 00000020:00080000:0.0:1786109354.187390:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab2ac2c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930a90a66240 00000020:00080000:0.0:1786109354.187392:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].342 00000020:00080000:0.0:1786109354.187394:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab2ac2900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab2a6c600 00000020:00080000:0.0:1786109354.187396:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].461 00000020:00080000:0.0:1786109354.187400:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930a978b2600 refcount 2 committed 0 result 0 batchid 322122568683 00000020:00080000:0.0:1786109354.187403:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab2ac2b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930a978b2f00 00000020:00080000:0.0:1786109354.187405:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].341 00000020:00080000:0.0:1786109354.187407:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab2ac2300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ac0862200 00000020:00080000:0.0:1786109354.187409:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].460 00000020:00080000:0.0:1786109354.187413:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab7cc4c00 refcount 2 committed 0 result 0 batchid 322122568682 00000020:00080000:0.0:1786109354.187415:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab2ac2f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab7cc49c0 00000020:00080000:0.0:1786109354.187417:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].340 00000020:00080000:0.0:1786109354.187419:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab2ac2a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098d52de00 00000020:00080000:0.0:1786109354.187422:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].459 00000020:00080000:0.0:1786109354.187427:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab9643d80 refcount 2 committed 0 result 0 batchid 322122568681 00000020:00080000:0.0:1786109354.187451:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8f9ac00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab96439c0 00000020:00080000:0.0:1786109354.187454:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].339 00000020:00080000:0.0:1786109354.187458:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8f9ad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930a8614d600 00000020:00080000:0.0:1786109354.187461:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].458 00000020:00080000:0.0:1786109354.187468:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930a978b20c0 refcount 2 committed 0 result 0 batchid 322122568680 00000020:00080000:0.0:1786109354.187470:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8f9ab00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab967fcc0 00000020:00080000:0.0:1786109354.187473:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].338 00000020:00080000:0.0:1786109354.187475:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8f9af00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098c551c00 00000020:00080000:0.0:1786109354.187478:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].457 00000020:00080000:0.0:1786109354.187484:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930aa0c643c0 refcount 2 committed 0 result 0 batchid 322122568679 00000020:00080000:0.0:1786109354.187487:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8f9ae00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93098bef0d80 00000020:00080000:0.0:1786109354.187490:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].336 00000100:00100000:1.0:1786109354.187491:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:0.0:1786109354.187493:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8f9a500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098c551800 00000020:00080000:0.0:1786109354.187497:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].456 00000020:00080000:0.0:1786109354.187503:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93098a905a80 refcount 2 committed 0 result 0 batchid 322122568678 00000020:00080000:0.0:1786109354.187506:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0ca9d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930a8a5d99c0 00000020:00080000:0.0:1786109354.187508:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].335 00000020:00080000:0.0:1786109354.187510:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0ca9a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098a634400 00000020:00080000:0.0:1786109354.187512:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].455 00000020:00080000:0.0:1786109354.187518:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab8c48a80 refcount 2 committed 0 result 0 batchid 322122568677 00000020:00080000:0.0:1786109354.187520:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0ca9500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab8c48cc0 00000020:00080000:0.0:1786109354.187523:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].334 00000020:00080000:0.0:1786109354.187524:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0ca9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098a635e00 00000020:00080000:0.0:1786109354.187527:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].454 00000020:00080000:0.0:1786109354.187532:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab7cc4780 refcount 2 committed 0 result 0 batchid 322122568676 00000020:00080000:0.0:1786109354.187534:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aaffa5300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab7cc4600 00000020:00080000:0.0:1786109354.187537:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].333 00000020:00080000:0.0:1786109354.187538:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aaffa5900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098c550c00 00000020:00080000:0.0:1786109354.187540:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].453 00000020:00080000:0.0:1786109354.187544:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab7cc43c0 refcount 2 committed 0 result 0 batchid 322122568675 00000020:00080000:0.0:1786109354.187546:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aaffa5a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab7cc4900 00000020:00080000:0.0:1786109354.187548:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].332 00000020:00080000:0.0:1786109354.187550:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aaffa5400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098c551a00 00000020:00080000:0.0:1786109354.187552:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].451 00000020:00080000:0.0:1786109354.187556:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930a97c2e300 refcount 2 committed 0 result 0 batchid 322122568674 00000020:00080000:0.0:1786109354.187558:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0ca9b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930a97c2ef00 00000020:00080000:0.0:1786109354.187560:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].331 00000020:00080000:0.0:1786109354.187562:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0ca9400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098d52d400 00000020:00080000:0.0:1786109354.187564:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].450 00000020:00080000:0.0:1786109354.187568:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ac0977f00 refcount 2 committed 0 result 0 batchid 322122568673 00000020:00080000:0.0:1786109354.187571:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a90360000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93098a905a80 00000020:00080000:0.0:1786109354.187573:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].330 00000020:00080000:0.0:1786109354.187575:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab8fc7100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab2a6d400 00000020:00080000:0.0:1786109354.187578:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].449 00000020:00080000:0.0:1786109354.187582:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930984d1ecc0 refcount 2 committed 0 result 0 batchid 322122568672 00000020:00080000:0.0:1786109354.187585:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0d5fc00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930984d1e300 00000020:00080000:0.0:1786109354.187587:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].329 00000020:00080000:0.0:1786109354.187590:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0d5f300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab2a6c800 00000020:00080000:0.0:1786109354.187592:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].448 00000020:00080000:0.0:1786109354.187596:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930984d1ee40 refcount 2 committed 0 result 0 batchid 322122568671 00000020:00080000:0.0:1786109354.187598:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930984d1e480 00000020:00080000:0.0:1786109354.187600:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].328 00000020:00080000:0.0:1786109354.187602:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab2a6ce00 00000020:00080000:0.0:1786109354.187604:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].447 00000020:00080000:0.0:1786109354.187608:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab9687240 refcount 2 committed 0 result 0 batchid 322122568670 00000020:00080000:0.0:1786109354.187611:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a87b87900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab9687c00 00000020:00080000:0.0:1786109354.187613:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].327 00000020:00080000:0.0:1786109354.187615:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a87b87600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098c0ea200 00000020:00080000:0.0:1786109354.187617:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].446 00000020:00080000:0.0:1786109354.187622:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930987d34840 refcount 2 committed 0 result 0 batchid 322122568669 00000020:00080000:0.0:1786109354.187624:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930987d34d80 00000020:00080000:0.0:1786109354.187626:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].326 00000020:00080000:0.0:1786109354.187628:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab2a6d200 00000020:00080000:0.0:1786109354.187631:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].445 00000020:00080000:0.0:1786109354.187634:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab7cc4300 refcount 2 committed 0 result 0 batchid 322122568668 00000020:00080000:0.0:1786109354.187637:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aaffa5500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab7cc4c00 00000020:00080000:0.0:1786109354.187640:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].325 00000020:00080000:0.0:1786109354.187642:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aaffa5b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930aaffe6000 00000020:00080000:0.0:1786109354.187657:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].444 00000020:00080000:0.0:1786109354.187662:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930a856af840 refcount 2 committed 0 result 0 batchid 322122568667 00000020:00080000:0.0:1786109354.187665:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aaffa5e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930a901c9f00 00000020:00080000:0.0:1786109354.187668:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].324 00000020:00080000:0.0:1786109354.187670:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aaffa5f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930aaffe6400 00000020:00080000:0.0:1786109354.187673:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].443 00000020:00080000:0.0:1786109354.187676:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93098502fcc0 refcount 2 committed 0 result 0 batchid 322122568666 00000020:00080000:0.0:1786109354.187679:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aaffa5800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93098502f480 00000020:00080000:0.0:1786109354.187682:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].323 00000020:00080000:0.0:1786109354.187684:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aa6220000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930aaffe7800 00000020:00080000:0.0:1786109354.187687:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].442 00000020:00080000:0.0:1786109354.187692:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab96879c0 refcount 2 committed 0 result 0 batchid 322122568665 00000020:00080000:0.0:1786109354.187694:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a87b87d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab9687000 00000020:00080000:0.0:1786109354.187696:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].322 00000020:00080000:0.0:1786109354.187698:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a87b87300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098c0ea000 00000020:00080000:0.0:1786109354.187701:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].441 00000020:00080000:0.0:1786109354.187705:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930984d1e3c0 refcount 2 committed 0 result 0 batchid 322122568664 00000020:00080000:0.0:1786109354.187707:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930984d1e840 00000020:00080000:0.0:1786109354.187710:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].321 00000020:00080000:0.0:1786109354.187711:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930a901f4a00 00000020:00080000:0.0:1786109354.187714:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].440 00000020:00080000:0.0:1786109354.187718:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930984d1e9c0 refcount 2 committed 0 result 0 batchid 322122568663 00000020:00080000:0.0:1786109354.187720:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930984d1e600 00000020:00080000:0.0:1786109354.187723:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].320 00000020:00080000:0.0:1786109354.187725:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930a901f4400 00000020:00080000:0.0:1786109354.187728:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].439 00000020:00080000:0.0:1786109354.187733:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930a97c2ea80 refcount 2 committed 0 result 0 batchid 322122568662 00000020:00080000:0.0:1786109354.187737:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0d5fe00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930a97c2e300 00000100:00100000:1.0:1786109354.187740:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933138432:0@lo:103:jbd2/dm-0-8.0 00000020:00080000:0.0:1786109354.187741:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].319 00000020:00080000:0.0:1786109354.187747:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0d5f100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098c551200 00000020:00080000:0.0:1786109354.187751:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].438 00000020:00080000:0.0:1786109354.187757:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930a901c9e40 refcount 2 committed 0 result 0 batchid 322122568661 00000020:00080000:0.0:1786109354.187759:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93098ab959c0 00000020:00080000:0.0:1786109354.187763:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].318 00000020:00080000:0.0:1786109354.187764:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab997ac00 00000020:00080000:0.0:1786109354.187768:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].437 00000020:00080000:0.0:1786109354.187773:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930987d34e40 refcount 2 committed 0 result 0 batchid 322122568660 00000020:00080000:0.0:1786109354.187776:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a97f63900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930987d340c0 00000020:00080000:0.0:1786109354.187778:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].317 00000020:00080000:0.0:1786109354.187780:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a97f63f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab2b75a00 00000020:00080000:0.0:1786109354.187783:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].436 00000020:00080000:0.0:1786109354.187789:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93098c0a5900 refcount 2 committed 0 result 0 batchid 322122568659 00000020:00080000:0.0:1786109354.187792:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93098c0a53c0 00000020:00080000:0.0:1786109354.187795:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].315 00000020:00080000:0.0:1786109354.187798:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ac0863a00 00000020:00080000:0.0:1786109354.187800:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].435 00000020:00080000:0.0:1786109354.187805:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930a901c9b40 refcount 2 committed 0 result 0 batchid 322122568658 00000020:00080000:0.0:1786109354.187808:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930981d5af00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930a901c9e40 00000020:00080000:0.0:1786109354.187811:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].314 00000100:00100000:1.0:1786109354.187817:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1786109354.187817:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930981d5a800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098d52d200 00000020:00080000:0.0:1786109354.187823:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].434 00000020:00080000:0.0:1786109354.187830:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930a901c9480 refcount 2 committed 0 result 0 batchid 322122568657 00000020:00080000:0.0:1786109354.187833:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930981d5a300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930a901c9a80 00000020:00080000:0.0:1786109354.187836:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].313 00000020:00080000:0.0:1786109354.187838:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930981d5a200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098d52ce00 00000020:00080000:0.0:1786109354.187840:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].433 00000020:00080000:0.0:1786109354.187846:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930a97c2e3c0 refcount 2 committed 0 result 0 batchid 322122568656 00000020:00080000:0.0:1786109354.187849:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0d5f200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930a97c2e9c0 00000020:00080000:0.0:1786109354.187852:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].312 00000020:00080000:0.0:1786109354.187855:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0d5fb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098c550a00 00000020:00080000:0.0:1786109354.187858:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].432 00000020:00080000:0.0:1786109354.187863:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930987d34c00 refcount 2 committed 0 result 0 batchid 322122568655 00000020:00080000:0.0:1786109354.187866:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0e88300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930987d34480 00000020:00080000:0.0:1786109354.187869:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].311 00000020:00080000:0.0:1786109354.187871:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0e88400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab2b75e00 00000020:00080000:0.0:1786109354.187874:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].431 00000020:00080000:0.0:1786109354.187879:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930a97c2ec00 refcount 2 committed 0 result 0 batchid 322122568654 00000020:00080000:0.0:1786109354.187882:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0d5ff00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930a97c2e480 00000020:00080000:0.0:1786109354.187884:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].310 00000020:00080000:0.0:1786109354.187886:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0d5fd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930983c70600 00000020:00080000:0.0:1786109354.187889:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].430 00000020:00080000:0.0:1786109354.187895:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930987d34000 refcount 2 committed 0 result 0 batchid 322122568653 00000020:00080000:0.0:1786109354.187897:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0e88200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930987d34480 00000020:00080000:0.0:1786109354.187900:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].309 00000020:00080000:0.0:1786109354.187901:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0e88c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab2b74e00 00000020:00080000:0.0:1786109354.187904:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].428 00000020:00080000:0.0:1786109354.187909:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930a97c2e840 refcount 2 committed 0 result 0 batchid 322122568652 00000020:00080000:0.0:1786109354.187912:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0d5f600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930a97c2e300 00000020:00080000:0.0:1786109354.187915:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].308 00000020:00080000:0.0:1786109354.187916:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0d5f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93098c550800 00000020:00080000:0.0:1786109354.187919:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].427 00000020:00080000:0.0:1786109354.187923:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ab8c483c0 refcount 2 committed 0 result 0 batchid 322122568651 00000020:00080000:0.0:1786109354.187926:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ab8c48540 00000020:00080000:0.0:1786109354.187929:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].307 00000020:00080000:0.0:1786109354.187931:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930983c71800 00000020:00080000:0.0:1786109354.187933:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].426 00000020:00080000:0.0:1786109354.187938:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93098bef0240 refcount 2 committed 0 result 0 batchid 322122568650 00000020:00080000:0.0:1786109354.187941:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93098bef0d80 00000020:00080000:0.0:1786109354.187943:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].306 00000020:00080000:0.0:1786109354.187945:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a891f4000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930983c71c00 00000020:00080000:0.0:1786109354.187948:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].425 00000020:00080000:0.0:1786109354.187952:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930987d34240 refcount 2 committed 0 result 0 batchid 322122568649 00000020:00080000:0.0:1786109354.187954:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0e88600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930987d340c0 00000020:00080000:0.0:1786109354.187957:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].305 00000020:00080000:0.0:1786109354.187958:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0e88700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab2b75800 00000020:00080000:0.0:1786109354.187961:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].424 00000020:00080000:0.0:1786109354.187965:0:187883:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 322122568646 batchid updated 00000020:00080000:0.0:1786109354.187971:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93098ab95240 refcount 2 committed 0 result 0 batchid 322122568648 00000020:00080000:0.0:1786109354.187973:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0972600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93098ab950c0 00000020:00080000:0.0:1786109354.187976:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].304 00000020:00080000:0.0:1786109354.187978:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac0972f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab2840200 00000020:00080000:0.0:1786109354.187980:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].423 00000020:00080000:0.0:1786109354.187985:0:187883:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930987d34cc0 refcount 2 committed 0 result 0 batchid 322122568647 00000020:00080000:0.0:1786109354.187987:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab1ab9100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930987d34840 00000020:00080000:0.0:1786109354.187990:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].303 00000020:00080000:0.0:1786109354.187992:0:187883:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab1ab9a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab2b74200 00000020:00080000:0.0:1786109354.187994:0:187883:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].422 00000020:00080000:0.0:1786109354.188034:0:187883:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 322122568644 batchid updated 00000020:00080000:0.0:1786109354.188065:0:187973:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 322122568690 committed batchid 322122568646 00000004:00080000:0.0:1786109354.188154:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098502f6c0 with version 707 00000100:00100000:3.0:1786109354.188216:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933138432 00000100:00100000:3.0:1786109354.188224:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933138432 00000100:00100000:3.0:1786109354.188279:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4496 00000100:00100000:3.0:1786109354.188289:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3648:x1872862933138432:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1786109354.188300:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109354.188320:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac0ace600/0xdb52b77d7ca361e5 lrc: 0/0,0 mode: --/PW res: [0x240002ef8:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca361de expref: 9 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109354.188335:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef8:0x43:0x0].0x0 (ffff930ab7f80100) 00010000:00010000:3.0:1786109354.188343:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109354.188388:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3648:x1872862933138432:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 100us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109354.188395:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4496 00000100:00100000:1.0:1786109354.188491:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933138432:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1786109354.188565:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca3508f lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188574:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca3508f lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188581:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca3508f lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188586:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.188591:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca3508f lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188598:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca3508f lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188608:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.188610:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.188614:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca3508f lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188620:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca3508f lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 47 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188635:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca350f1 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188641:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca350f1 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188647:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca350f1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188652:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.188654:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca350f1 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188659:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca350f1 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188666:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.188668:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.188671:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca350f1 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188676:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030e00/0xdb52b77d7ca350f1 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 46 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188687:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030600/0xdb52b77d7ca350f8 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188693:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030600/0xdb52b77d7ca350f8 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188698:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030600/0xdb52b77d7ca350f8 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188703:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.188706:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030600/0xdb52b77d7ca350f8 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188712:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030600/0xdb52b77d7ca350f8 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188719:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dc9:0x0].0x0 (ffff93098c4ae800) 00010000:00010000:2.0:1786109354.188721:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.188724:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030600/0xdb52b77d7ca350f8 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188730:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030600/0xdb52b77d7ca350f8 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188742:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80031000/0xdb52b77d7ca350ff lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188753:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a80031000/0xdb52b77d7ca350ff lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188759:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a80031000/0xdb52b77d7ca350ff lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188763:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80031000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.188766:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80031000/0xdb52b77d7ca350ff lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188771:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80031000/0xdb52b77d7ca350ff lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188777:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2d:0x0].0x0 (ffff93098c4ae700) 00010000:00010000:2.0:1786109354.188779:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.188781:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a80031000/0xdb52b77d7ca350ff lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188787:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a80031000/0xdb52b77d7ca350ff lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188802:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca35153 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188808:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca35153 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188813:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca35153 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188818:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628bc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.188821:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca35153 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188827:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca35153 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188833:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.188835:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.188837:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca35153 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188843:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca35153 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188853:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca351b5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188858:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca351b5 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188864:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca351b5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188869:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.188871:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca351b5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188876:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca351b5 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188883:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.188885:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.188887:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca351b5 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188893:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca351b5 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188901:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca351bc lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188907:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca351bc lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188913:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca351bc lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188918:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.188921:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca351bc lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188926:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca351bc lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188933:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dca:0x0].0x0 (ffff930984516800) 00010000:00010000:2.0:1786109354.188935:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.188937:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca351bc lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188943:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b600/0xdb52b77d7ca351bc lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188956:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca351c3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188965:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca351c3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188971:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca351c3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188975:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ba00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.188978:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca351c3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188985:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca351c3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.188992:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2e:0x0].0x0 (ffff930984516b00) 00010000:00010000:2.0:1786109354.188994:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.188997:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca351c3 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189002:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca351c3 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189016:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca35217 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189022:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca35217 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189027:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca35217 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189031:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189034:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca35217 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189040:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca35217 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189047:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.189049:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189052:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca35217 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189058:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca35217 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189078:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35279 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189084:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35279 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189089:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35279 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189094:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189097:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35279 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189102:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35279 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189108:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.189110:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189113:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35279 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189118:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca35279 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 42 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189126:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca35280 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189131:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca35280 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189136:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca35280 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189140:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189143:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca35280 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189148:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca35280 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189154:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcb:0x0].0x0 (ffff930985b9dd00) 00010000:00010000:2.0:1786109354.189156:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189158:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca35280 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189177:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca35280 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189188:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77600/0xdb52b77d7ca35287 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189198:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77600/0xdb52b77d7ca35287 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189203:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77600/0xdb52b77d7ca35287 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189207:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189210:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77600/0xdb52b77d7ca35287 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189215:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77600/0xdb52b77d7ca35287 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189221:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x2f:0x0].0x0 (ffff930985b9d200) 00010000:00010000:2.0:1786109354.189223:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189225:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77600/0xdb52b77d7ca35287 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189231:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77600/0xdb52b77d7ca35287 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189252:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca352db lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189259:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca352db lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189264:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca352db lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189269:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189272:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca352db lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189278:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca352db lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189285:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.189287:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189290:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca352db lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189296:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca352db lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 41 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189307:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3533d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189313:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3533d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189319:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3533d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189324:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189326:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3533d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189332:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3533d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189339:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.189341:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189344:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3533d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189350:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3533d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189357:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35344 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189362:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35344 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189367:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35344 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189372:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628be00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189374:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35344 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189379:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35344 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189385:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcc:0x0].0x0 (ffff930984516c00) 00010000:00010000:2.0:1786109354.189387:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189390:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35344 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189395:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca35344 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189406:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca3534b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189415:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca3534b lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189421:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca3534b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189425:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189428:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca3534b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189467:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca3534b lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189475:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x30:0x0].0x0 (ffff930984516200) 00010000:00010000:2.0:1786109354.189477:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189480:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca3534b lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189485:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca3534b lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189500:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3539f lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189506:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3539f lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189511:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3539f lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189516:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189519:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3539f lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189524:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3539f lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189531:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.189533:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189536:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3539f lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189541:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3539f lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 39 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189553:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35401 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189558:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35401 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189563:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35401 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189569:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189571:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35401 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189576:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35401 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189583:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.189586:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189589:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35401 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189594:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca35401 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 38 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189606:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca35408 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189612:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca35408 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189617:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca35408 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189623:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189625:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca35408 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189632:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca35408 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189640:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcd:0x0].0x0 (ffff93098c4ae100) 00010000:00010000:2.0:1786109354.189642:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189645:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca35408 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189650:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34400/0xdb52b77d7ca35408 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189662:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca3540f lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189671:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca3540f lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189676:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca3540f lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189681:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189684:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca3540f lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189690:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca3540f lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189697:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x31:0x0].0x0 (ffff93098c4aeb00) 00010000:00010000:2.0:1786109354.189699:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189702:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca3540f lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189708:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34c00/0xdb52b77d7ca3540f lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189721:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca35463 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189728:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca35463 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189732:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca35463 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189737:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628aa00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189739:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca35463 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189744:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca35463 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189750:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.189752:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189754:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca35463 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189759:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca35463 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 37 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189767:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca354c5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189772:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca354c5 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189777:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca354c5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189781:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189784:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca354c5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189790:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca354c5 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189796:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.189798:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189800:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca354c5 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189805:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35c00/0xdb52b77d7ca354c5 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189813:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca354cc lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189819:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca354cc lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189824:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca354cc lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189829:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189832:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca354cc lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189837:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca354cc lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189843:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dce:0x0].0x0 (ffff930a83abd300) 00010000:00010000:2.0:1786109354.189846:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189848:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca354cc lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189855:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca354cc lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189867:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354d3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189875:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354d3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189880:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354d3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189885:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189888:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354d3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189893:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354d3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189900:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x32:0x0].0x0 (ffff930a83abd500) 00010000:00010000:2.0:1786109354.189902:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189905:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354d3 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189910:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca354d3 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189921:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35527 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189928:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35527 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189934:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35527 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189939:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189942:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35527 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189948:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35527 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189955:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.189958:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.189961:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35527 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189966:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca35527 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189976:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35589 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189981:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35589 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189986:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35589 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189991:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.189993:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35589 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.189998:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35589 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190005:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.190007:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190010:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35589 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190015:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca35589 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 34 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190024:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34000/0xdb52b77d7ca35590 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190029:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34000/0xdb52b77d7ca35590 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190034:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34000/0xdb52b77d7ca35590 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190039:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190041:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34000/0xdb52b77d7ca35590 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190046:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34000/0xdb52b77d7ca35590 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190053:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dcf:0x0].0x0 (ffff93098c4ae900) 00010000:00010000:2.0:1786109354.190055:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190058:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34000/0xdb52b77d7ca35590 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190064:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34000/0xdb52b77d7ca35590 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190075:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35597 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190084:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35597 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190090:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35597 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190095:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190098:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35597 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190104:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35597 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190111:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x33:0x0].0x0 (ffff93098c4aea00) 00010000:00010000:2.0:1786109354.190114:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190116:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35597 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190121:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35400/0xdb52b77d7ca35597 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190133:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355eb lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190139:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355eb lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190144:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355eb lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190148:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190151:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355eb lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190156:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355eb lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1786109354.190211:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568611 cancel update log [0x240002ef8:0x1:0x0].265: rc = 0 00000020:00080000:0.0:1786109354.190303:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568611 cancel update log [0x2000255c0:0x1:0x0].385: rc = 0 00000004:00080000:0.0:1786109354.190340:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d34f00 with version 708 00010000:00010000:2.0:1786109354.190369:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.190372:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190376:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355eb lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190381:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35200/0xdb52b77d7ca355eb lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 33 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190394:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3564d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190400:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3564d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190406:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3564d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190411:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190414:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3564d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190419:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3564d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190427:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.190446:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190450:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3564d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190455:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3564d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190465:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35654 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190471:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35654 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190477:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35654 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190482:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ae00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190485:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35654 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190491:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35654 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190497:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd0:0x0].0x0 (ffff930aa0ddd900) 00010000:00010000:2.0:1786109354.190500:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190502:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35654 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190507:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca35654 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190521:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3565b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190530:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3565b lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190535:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3565b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190540:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190542:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3565b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190548:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3565b lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190555:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x34:0x0].0x0 (ffff930aa0dddd00) 00010000:00010000:2.0:1786109354.190557:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190559:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3565b lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190565:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3565b lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190580:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca356af lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190586:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca356af lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190591:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca356af lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190596:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6ce00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190599:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca356af lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190605:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca356af lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190613:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.190616:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190619:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca356af lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190625:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca356af lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190634:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35711 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190640:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35711 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190646:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35711 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190651:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190653:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35711 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190658:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35711 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190665:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.190667:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190670:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35711 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190675:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76800/0xdb52b77d7ca35711 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 30 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190684:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca35718 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190689:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca35718 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190696:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca35718 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190701:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190704:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca35718 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190710:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca35718 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190716:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd1:0x0].0x0 (ffff930aa62cf200) 00010000:00010000:2.0:1786109354.190718:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190721:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca35718 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190726:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca35718 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190751:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3571f lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190761:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3571f lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190766:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3571f lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190771:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190774:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3571f lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190779:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3571f lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190787:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x35:0x0].0x0 (ffff930aa62cfe00) 00010000:00010000:2.0:1786109354.190789:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190792:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3571f lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190798:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3571f lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190815:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca35773 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190822:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca35773 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190828:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca35773 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190834:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190837:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca35773 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190843:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca35773 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190851:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.190853:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190856:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca35773 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190861:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca35773 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 29 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190872:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca357d5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190878:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca357d5 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190883:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca357d5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190888:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190890:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca357d5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190896:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca357d5 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190903:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.190905:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190908:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca357d5 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190914:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34200/0xdb52b77d7ca357d5 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 28 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190923:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca357dc lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190929:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca357dc lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190934:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca357dc lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190939:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190941:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca357dc lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190946:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca357dc lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190953:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd2:0x0].0x0 (ffff930aa65d7b00) 00010000:00010000:2.0:1786109354.190956:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.190958:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca357dc lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190964:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34a00/0xdb52b77d7ca357dc lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190976:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca357e3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190986:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca357e3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190991:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca357e3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.190996:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.190999:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca357e3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191004:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca357e3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191012:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x36:0x0].0x0 (ffff930aa65d7500) 00010000:00010000:2.0:1786109354.191015:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191017:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca357e3 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191022:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35600/0xdb52b77d7ca357e3 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191034:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35837 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191040:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35837 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191045:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35837 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191051:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191054:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35837 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191060:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35837 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191068:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.191070:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191073:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35837 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191078:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35a00/0xdb52b77d7ca35837 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 27 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191088:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c800/0xdb52b77d7ca35899 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191095:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c800/0xdb52b77d7ca35899 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191101:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c800/0xdb52b77d7ca35899 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191106:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191109:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c800/0xdb52b77d7ca35899 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191114:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c800/0xdb52b77d7ca35899 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191122:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.191124:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191127:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c800/0xdb52b77d7ca35899 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191133:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c800/0xdb52b77d7ca35899 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 26 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191143:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca358a0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191149:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca358a0 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191155:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca358a0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191291:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191295:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca358a0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191302:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca358a0 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191310:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd3:0x0].0x0 (ffff930a90808f00) 00010000:00010000:2.0:1786109354.191312:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191316:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca358a0 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191322:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca358a0 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191336:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca358a7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191347:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca358a7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191352:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca358a7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191357:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191360:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca358a7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191366:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca358a7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191373:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x37:0x0].0x0 (ffff930a90808100) 00010000:00010000:2.0:1786109354.191375:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191378:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca358a7 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191398:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca358a7 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191413:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca358fb lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191418:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca358fb lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191424:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca358fb lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191468:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191473:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca358fb lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191480:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca358fb lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191491:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.191494:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191497:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca358fb lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191502:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77800/0xdb52b77d7ca358fb lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 25 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191514:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca3595d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191519:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca3595d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191525:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca3595d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191530:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191533:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca3595d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191539:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca3595d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191546:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.191548:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191553:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca3595d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191558:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca3595d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 24 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191566:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35964 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191572:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35964 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191578:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35964 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191583:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191585:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35964 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191590:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35964 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191597:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd4:0x0].0x0 (ffff930a90808e00) 00010000:00010000:2.0:1786109354.191599:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191602:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35964 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191606:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca35964 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191617:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3596b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191625:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3596b lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191630:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3596b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191634:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191637:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3596b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191643:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3596b lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191650:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x38:0x0].0x0 (ffff930a90808800) 00010000:00010000:2.0:1786109354.191652:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191654:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3596b lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191659:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca3596b lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191671:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca359bf lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191677:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca359bf lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191682:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca359bf lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191688:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2de00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191691:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca359bf lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191697:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca359bf lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191705:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.191707:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191710:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca359bf lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191714:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2de00/0xdb52b77d7ca359bf lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191723:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35a21 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191728:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35a21 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191734:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35a21 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191738:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c35000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191740:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35a21 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191745:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35a21 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191752:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.191754:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191756:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35a21 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191762:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c35000/0xdb52b77d7ca35a21 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191771:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6da00/0xdb52b77d7ca35a28 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191776:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6da00/0xdb52b77d7ca35a28 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191781:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6da00/0xdb52b77d7ca35a28 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191785:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6da00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191787:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6da00/0xdb52b77d7ca35a28 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191792:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6da00/0xdb52b77d7ca35a28 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191798:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd5:0x0].0x0 (ffff930984516400) 00010000:00010000:2.0:1786109354.191800:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191802:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6da00/0xdb52b77d7ca35a28 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191807:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6da00/0xdb52b77d7ca35a28 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191819:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca35a2f lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191828:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca35a2f lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191834:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca35a2f lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191838:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191840:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca35a2f lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191846:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca35a2f lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191853:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x39:0x0].0x0 (ffff930984516d00) 00010000:00010000:2.0:1786109354.191855:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191858:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca35a2f lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191863:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca35a2f lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191875:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca35a83 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191880:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca35a83 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191886:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca35a83 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191890:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191893:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca35a83 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191899:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca35a83 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191906:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.191908:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191911:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca35a83 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191916:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca35a83 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191926:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca35ae5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191933:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca35ae5 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191938:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca35ae5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191943:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191945:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca35ae5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191951:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca35ae5 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191957:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.191959:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.191962:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca35ae5 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191968:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca35ae5 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191976:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca35aec lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191981:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca35aec lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191986:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca35aec lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191991:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6dc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.191994:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca35aec lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.191999:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca35aec lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192005:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd6:0x0].0x0 (ffff930984516e00) 00010000:00010000:2.0:1786109354.192007:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.192010:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca35aec lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192015:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca35aec lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192026:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca35af3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192034:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca35af3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192039:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca35af3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192044:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.192047:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca35af3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192052:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca35af3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192060:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3a:0x0].0x0 (ffff930984516600) 00010000:00010000:2.0:1786109354.192062:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.192064:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca35af3 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192070:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca35af3 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192083:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca35b47 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192089:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca35b47 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192095:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca35b47 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192100:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.192103:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca35b47 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192108:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca35b47 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192115:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.192117:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.192119:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca35b47 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192124:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca35b47 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192133:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35ba9 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192139:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35ba9 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192144:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35ba9 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192149:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2ca00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.192152:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35ba9 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.192158:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35ba9 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109354.192529:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 707 rpc_version 707 00000020:00100000:3.0:1786109354.192569:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109354.192580:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984908e00 x1872862933138688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109354.192602:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933138688:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.192667:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109354.192710:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109354.192752:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933138688 00000100:00100000:3.0:1786109354.192760:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933138688 00000100:00100000:3.0:1786109354.192805:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12141 00000100:00100000:3.0:1786109354.192813:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933138688:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.192975:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187949:x1872862933138688:12345-0@lo:1000:osp_up1-0.0 Request processed in 162us (306us total) trans 25769804481 rc 0/0 00000100:00100000:3.0:1786109354.192983:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12141 00000100:00100000:1.0:1786109354.193108:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933138688:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109354.193120:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 708 rpc_version 708 00010000:00010000:2.0:1786109354.193146:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.193149:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.193154:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35ba9 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.193171:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ca00/0xdb52b77d7ca35ba9 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.193183:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35bb0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.193192:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35bb0 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.193198:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35bb0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.193202:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.193205:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35bb0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195379:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35bb0 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195407:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd7:0x0].0x0 (ffff93098c4ae300) 00010000:00010000:2.0:1786109354.195410:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.195416:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35bb0 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195423:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d000/0xdb52b77d7ca35bb0 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195472:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35bb7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195484:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35bb7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195490:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35bb7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195496:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.195500:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35bb7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195506:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35bb7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195513:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3b:0x0].0x0 (ffff93098c4ae400) 00010000:00010000:2.0:1786109354.195515:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.195518:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35bb7 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195524:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c400/0xdb52b77d7ca35bb7 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195545:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca35c0b lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195552:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca35c0b lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195557:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca35c0b lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195561:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6cc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.195564:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca35c0b lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195569:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca35c0b lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195576:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.195578:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.195580:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca35c0b lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195585:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca35c0b lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195595:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c6d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195601:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c6d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195606:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c6d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195611:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.195613:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c6d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195619:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c6d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195625:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.195627:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.195631:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c6d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.195637:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca35c6d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196073:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c74 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196081:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c74 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196086:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c74 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196091:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.196095:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c74 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196100:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c74 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196109:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd8:0x0].0x0 (ffff930a90808b00) 00010000:00010000:2.0:1786109354.196111:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.196114:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c74 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196120:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca35c74 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196138:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c7b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196148:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c7b lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196153:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c7b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196157:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.196171:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c7b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196177:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c7b lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196184:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3c:0x0].0x0 (ffff930a90808000) 00010000:00010000:2.0:1786109354.196186:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.196189:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c7b lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196194:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca35c7b lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196220:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35ccf lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196226:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35ccf lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196231:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35ccf lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196235:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab1c34e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.196238:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35ccf lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196243:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35ccf lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196250:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.196252:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.196254:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35ccf lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196259:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab1c34e00/0xdb52b77d7ca35ccf lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196269:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca35d31 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196275:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca35d31 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196279:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca35d31 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196283:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295ee00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.196286:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca35d31 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196291:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca35d31 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196297:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.196299:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.196302:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca35d31 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196307:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ee00/0xdb52b77d7ca35d31 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196583:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35d38 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196589:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35d38 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196595:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35d38 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196600:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6ca00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.196603:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35d38 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196609:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35d38 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196619:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dd9:0x0].0x0 (ffff930984516900) 00010000:00010000:2.0:1786109354.196621:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.196625:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35d38 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.196630:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca35d38 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dd9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197077:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35d3f lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197091:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35d3f lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197096:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35d3f lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197102:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.197105:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35d3f lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197110:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35d3f lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197119:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3d:0x0].0x0 (ffff930984516300) 00010000:00010000:2.0:1786109354.197122:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.197125:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35d3f lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197131:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca35d3f lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197148:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca35d93 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197154:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca35d93 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197172:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca35d93 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197177:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.197181:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca35d93 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197187:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca35d93 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197195:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.197197:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.197200:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca35d93 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197211:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e400/0xdb52b77d7ca35d93 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197223:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35df5 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197229:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35df5 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197235:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35df5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197240:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.197243:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35df5 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197249:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35df5 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197256:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.197263:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.197267:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35df5 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197272:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d800/0xdb52b77d7ca35df5 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197282:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dfc lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197288:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dfc lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197294:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dfc lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197299:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2cc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.197302:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dfc lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197308:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dfc lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197955:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dda:0x0].0x0 (ffff930ab7f80600) 00010000:00010000:2.0:1786109354.197958:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.197962:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dfc lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197968:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca35dfc lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dda:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197983:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35e03 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.197994:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35e03 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198000:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35e03 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198005:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.198008:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35e03 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198014:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35e03 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198022:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3e:0x0].0x0 (ffff930ab7f80c00) 00010000:00010000:2.0:1786109354.198024:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.198026:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35e03 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198031:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca35e03 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198045:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35e57 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198052:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35e57 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198058:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35e57 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198064:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2dc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.198067:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35e57 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198073:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35e57 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198083:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.198086:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.198089:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35e57 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198095:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca35e57 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198110:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35eb9 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198116:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35eb9 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198122:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35eb9 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198128:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.198131:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35eb9 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198137:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35eb9 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198147:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.198150:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.198172:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35eb9 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198179:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca35eb9 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198191:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35ec0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198197:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35ec0 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198203:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35ec0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198208:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2ce00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.198211:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35ec0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198218:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35ec0 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198229:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddb:0x0].0x0 (ffff930ab7f80400) 00010000:00010000:2.0:1786109354.198231:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.198234:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35ec0 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198240:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2ce00/0xdb52b77d7ca35ec0 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1ddb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198260:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35ec7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198271:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35ec7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198276:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35ec7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198280:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2da00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.198283:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35ec7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198289:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35ec7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198297:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x3f:0x0].0x0 (ffff930ab7f80000) 00010000:00010000:2.0:1786109354.198299:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.198302:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35ec7 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198307:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2da00/0xdb52b77d7ca35ec7 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198331:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35f1b lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198337:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35f1b lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198342:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35f1b lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198346:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.198350:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35f1b lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198355:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35f1b lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198362:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.198370:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.198373:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35f1b lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.198378:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca35f1b lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1786109354.200803:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109354.200823:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930aa60a0380 x1872862933138944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109354.200853:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933138944:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.200923:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1786109354.201469:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568612 cancel update log [0x240002ef8:0x1:0x0].266: rc = 0 00000020:00080000:0.0:1786109354.201568:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568612 cancel update log [0x2000255c0:0x1:0x0].386: rc = 0 00000100:00100000:3.0:1786109354.201589:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933138944 00000100:00100000:3.0:1786109354.201598:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933138944 00000004:00080000:0.0:1786109354.201617:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a90a66240 with version 709 00000020:00080000:0.0:1786109354.201622:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568613 cancel update log [0x240002ef8:0x1:0x0].267: rc = 0 00000020:00080000:0.0:1786109354.201648:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568613 cancel update log [0x2000255c0:0x1:0x0].387: rc = 0 00000100:00100000:3.0:1786109354.201652:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12142 00000100:00100000:3.0:1786109354.201663:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187949:x1872862933138944:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1786109354.201882:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f7d lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201890:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f7d lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201897:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f7d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201903:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.201908:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f7d lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201914:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f7d lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201929:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.201932:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.201937:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f7d lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201943:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca35f7d lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201954:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35f84 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201960:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35f84 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201966:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35f84 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201971:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.201974:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35f84 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201979:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35f84 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201986:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddc:0x0].0x0 (ffff930ab7f80700) 00010000:00010000:2.0:1786109354.201988:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.201991:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35f84 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.201997:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030c00/0xdb52b77d7ca35f84 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1ddc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202016:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35f8b lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202026:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35f8b lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202030:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35f8b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202035:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.202037:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35f8b lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202042:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35f8b lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202049:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x40:0x0].0x0 (ffff930ab7f80a00) 00010000:00010000:2.0:1786109354.202051:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.202054:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35f8b lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202060:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a80030200/0xdb52b77d7ca35f8b lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202075:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca35fdf lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202082:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca35fdf lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202088:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca35fdf lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202093:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0ace400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.202096:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca35fdf lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109354.202100:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a89d6d180 going to sleep for 11 seconds 00010000:00010000:2.0:1786109354.202103:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca35fdf lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202119:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.202121:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.202124:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca35fdf lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202129:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca35fdf lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202140:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36041 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202146:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36041 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202152:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36041 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202158:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295f200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.202175:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36041 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202182:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36041 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202189:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.202192:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.202195:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36041 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202200:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295f200/0xdb52b77d7ca36041 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202210:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36048 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202216:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36048 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202221:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36048 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202226:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295ea00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.202229:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36048 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202235:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36048 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202241:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddd:0x0].0x0 (ffff930985b9da00) 00010000:00010000:2.0:1786109354.202244:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.202246:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36048 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202251:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295ea00/0xdb52b77d7ca36048 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1ddd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202267:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca3604f lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202276:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca3604f lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202281:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca3604f lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202286:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295fa00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.202289:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca3604f lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.202295:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca3604f lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109354.202318:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187949:x1872862933138944:12345-0@lo:1000:osp_up1-0.0 Request processed in 655us (1392us total) trans 25769804482 rc 0/0 00000100:00100000:3.0:1786109354.202327:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12142 00000100:00100000:1.0:1786109354.202873:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933138944:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109354.202887:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 709 rpc_version 709 00000020:00100000:1.0:1786109354.202910:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109354.202916:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930aa60a2300 x1872862933139200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109354.202934:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933139200:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.202987:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109354.203065:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48840 going to sleep for 11 seconds 00000004:00080000:0.0:1786109354.203085:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098bef0300 with version 710 00000020:00080000:0.0:1786109354.203090:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568614 cancel update log [0x240002ef8:0x1:0x0].268: rc = 0 00000100:00100000:3.0:1786109354.203104:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933139200 00000100:00100000:3.0:1786109354.203110:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933139200 00000020:00080000:0.0:1786109354.203140:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568614 cancel update log [0x2000255c0:0x1:0x0].388: rc = 0 00000100:00100000:3.0:1786109354.203288:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12143 00000100:00100000:3.0:1786109354.203298:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187949:x1872862933139200:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.203417:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:187949:x1872862933139200:12345-0@lo:1000:osp_up1-0.0 Request processed in 119us (428us total) trans 25769804483 rc 0/0 00000100:00100000:3.0:1786109354.203424:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12143 00000004:00080000:0.0:1786109354.203847:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098bef0d80 with version 711 00000020:00080000:0.0:1786109354.203855:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568615 cancel update log [0x240002ef8:0x1:0x0].269: rc = 0 00000020:00080000:0.0:1786109354.203888:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568615 cancel update log [0x2000255c0:0x1:0x0].389: rc = 0 00000100:00100000:1.0:1786109354.203902:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933139200:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109354.203914:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 710 rpc_version 710 00000004:00080000:0.0:1786109354.203915:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e180 with version 712 00000020:00080000:0.0:1786109354.203921:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568616 cancel update log [0x240002ef8:0x1:0x0].270: rc = 0 00000020:00100000:1.0:1786109354.203930:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109354.203939:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930aa60a3800 x1872862933139456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:0.0:1786109354.203944:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568616 cancel update log [0x2000255c0:0x1:0x0].390: rc = 0 00000100:00100000:1.0:1786109354.203956:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933139456:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786109354.203970:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e300 with version 713 00000020:00080000:0.0:1786109354.203974:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568617 cancel update log [0x240002ef8:0x1:0x0].271: rc = 0 00000100:00100000:1.0:1786109354.203991:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1786109354.203997:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568617 cancel update log [0x2000255c0:0x1:0x0].391: rc = 0 00000100:00100000:1.0:1786109354.204014:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48840 going to sleep for 11 seconds 00000004:00080000:0.0:1786109354.204025:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e480 with version 714 00000020:00080000:0.0:1786109354.204030:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568618 cancel update log [0x240002ef8:0x1:0x0].272: rc = 0 00000100:00100000:1.0:1786109354.204032:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933139456 00000020:00080000:0.0:1786109354.204051:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568618 cancel update log [0x2000255c0:0x1:0x0].392: rc = 0 00000004:00080000:0.0:1786109354.204097:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e840 with version 715 00000020:00080000:0.0:1786109354.204101:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568619 cancel update log [0x240002ef8:0x1:0x0].273: rc = 0 00000020:00080000:0.0:1786109354.204123:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568619 cancel update log [0x2000255c0:0x1:0x0].393: rc = 0 00000004:00080000:0.0:1786109354.204141:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098bef0cc0 with version 716 00000020:00080000:0.0:1786109354.204144:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568620 cancel update log [0x240002ef8:0x1:0x0].275: rc = 0 00000100:00100000:1.0:1786109354.204249:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933139456 00000100:00100000:1.0:1786109354.204292:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12144 00000100:00100000:1.0:1786109354.204299:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:187949:x1872862933139456:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.204708:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:187949:x1872862933139456:12345-0@lo:1000:osp_up1-0.0 Request processed in 409us (717us total) trans 25769804484 rc 0/0 00000100:00100000:1.0:1786109354.204715:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12144 00000100:00100000:3.0:1786109354.204786:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933139456:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109354.204793:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 711 rpc_version 711 00000020:00100000:3.0:1786109354.204804:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109354.204809:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984909180 x1872862933139712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109354.204822:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933139712:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.204848:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109354.204978:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109354.205021:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933139712 00000100:00100000:1.0:1786109354.205025:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933139712 00010000:00010000:2.0:1786109354.205198:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x41:0x0].0x0 (ffff930985b9d800) 00010000:00010000:2.0:1786109354.205261:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.205270:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca3604f lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.205279:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295fa00/0xdb52b77d7ca3604f lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.205304:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca360a3 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.205556:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca360a3 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.205565:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca360a3 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.205573:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.205577:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca360a3 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.205585:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca360a3 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109354.205590:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12145 00000100:00100000:1.0:1786109354.205602:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:187949:x1872862933139712:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1786109354.205608:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.205612:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.205615:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca360a3 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.205621:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca360a3 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.205637:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca36105 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109354.205693:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:187949:x1872862933139712:12345-0@lo:1000:osp_up1-0.0 Request processed in 93us (843us total) trans 25769804485 rc 0/0 00000100:00100000:1.0:1786109354.205700:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12145 00000100:00100000:1.0:1786109354.206058:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933139712:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109354.206067:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 712 rpc_version 712 00000020:00100000:1.0:1786109354.206080:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109354.206085:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930aa60a1500 x1872862933139968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109354.206098:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933139968:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.206123:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786109354.206183:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca36105 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.206193:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca36105 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.206198:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.206201:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca36105 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.206283:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca36105 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.206293:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.206296:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.206299:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca36105 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.206306:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77000/0xdb52b77d7ca36105 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109354.206339:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48000 going to sleep for 11 seconds 00000020:00080000:0.0:1786109354.206526:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568620 cancel update log [0x2000255c0:0x1:0x0].394: rc = 0 00000004:00080000:0.0:1786109354.206572:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098ab95600 with version 717 00000020:00080000:0.0:1786109354.206576:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568621 cancel update log [0x240002ef8:0x1:0x0].276: rc = 0 00000020:00080000:0.0:1786109354.206607:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568621 cancel update log [0x2000255c0:0x1:0x0].395: rc = 0 00000004:00080000:0.0:1786109354.206626:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098ab95480 with version 718 00000020:00080000:0.0:1786109354.206629:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568622 cancel update log [0x240002ef8:0x1:0x0].277: rc = 0 00010000:00010000:2.0:1786109354.207225:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca3610c lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207232:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca3610c lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207238:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca3610c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207243:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.207247:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca3610c lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207253:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca3610c lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207263:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1dde:0x0].0x0 (ffff930985b9db00) 00010000:00010000:2.0:1786109354.207266:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.207270:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca3610c lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207275:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e600/0xdb52b77d7ca3610c lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1dde:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207292:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca36113 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207301:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca36113 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207307:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca36113 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207504:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295e200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.207509:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca36113 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207516:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca36113 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109354.207525:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933139968 00010000:00010000:2.0:1786109354.207526:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x42:0x0].0x0 (ffff930985b9d700) 00010000:00010000:2.0:1786109354.207531:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109354.207533:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933139968 00010000:00010000:2.0:1786109354.207535:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca36113 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207543:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab295e200/0xdb52b77d7ca36113 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207564:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36167 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207570:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36167 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207576:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36167 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207580:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.207584:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36167 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207591:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36167 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207599:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.207601:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.207604:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36167 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207611:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36167 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109354.207622:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12146 00010000:00010000:2.0:1786109354.207623:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361c9 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.207632:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361c9 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109354.207635:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:187949:x1872862933139968:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.207765:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:187949:x1872862933139968:12345-0@lo:1000:osp_up1-0.0 Request processed in 133us (1640us total) trans 25769804486 rc 0/0 00000100:00100000:3.0:1786109354.207774:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12146 00000100:00100000:1.0:1786109354.207965:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933139968:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109354.207977:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 713 rpc_version 713 00000020:00100000:1.0:1786109354.207996:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109354.208003:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d89b100 x1872862933140224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109354.208020:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933140224:0@lo:1000:osp_up1-0.0 00000020:00080000:0.0:1786109354.208097:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568622 cancel update log [0x2000255c0:0x1:0x0].396: rc = 0 00000100:00100000:1.0:1786109354.208108:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109354.208140:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48000 going to sleep for 11 seconds 00000004:00080000:0.0:1786109354.208141:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098ab95b40 with version 719 00000020:00080000:0.0:1786109354.208148:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568623 cancel update log [0x240002ef8:0x1:0x0].278: rc = 0 00000100:00100000:3.0:1786109354.208183:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933140224 00000100:00100000:3.0:1786109354.208187:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933140224 00000020:00080000:0.0:1786109354.208597:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568623 cancel update log [0x2000255c0:0x1:0x0].397: rc = 0 00000004:00080000:0.0:1786109354.208621:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098c0a5c00 with version 720 00000020:00080000:0.0:1786109354.208624:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568624 cancel update log [0x240002ef8:0x1:0x0].279: rc = 0 00000020:00080000:0.0:1786109354.208643:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568624 cancel update log [0x2000255c0:0x1:0x0].398: rc = 0 00010000:00010000:2.0:1786109354.208825:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361c9 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208834:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acee00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.208838:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361c9 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208846:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361c9 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208859:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x1ccea250 (ffff930aa62cf600) 00010000:00010000:2.0:1786109354.208862:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.208865:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361c9 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208872:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca361c9 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x191b:0x0].0x1ccea250 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109354.208891:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12147 00000100:00100000:3.0:1786109354.208903:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:187949:x1872862933140224:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1786109354.208907:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361d0 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1ddf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208915:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361d0 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208921:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361d0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208927:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.208930:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361d0 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208936:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361d0 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1ddf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208945:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1ddf:0x0].0x0 (ffff930984516500) 00010000:00010000:2.0:1786109354.208947:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.208950:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361d0 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1ddf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208955:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77400/0xdb52b77d7ca361d0 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1ddf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208975:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361d7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000255c0:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208986:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361d7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000255c0:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208992:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361d7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.208997:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109354.209000:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361d7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000255c0:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.209008:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361d7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000255c0:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109354.209011:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:187949:x1872862933140224:12345-0@lo:1000:osp_up1-0.0 Request processed in 110us (901us total) trans 25769804487 rc 0/0 00010000:00010000:2.0:1786109354.209023:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000255c0:0x43:0x0].0x0 (ffff930984516100) 00000100:00100000:3.0:1786109354.209024:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12147 00010000:00010000:2.0:1786109354.209029:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109354.209034:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361d7 lrc: 2/0,0 mode: --/TXN res: [0x2000255c0:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109354.209039:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361d7 lrc: 0/0,0 mode: --/TXN res: [0x2000255c0:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109354.209623:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933140224:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109354.209633:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 714 rpc_version 714 00000020:00100000:1.0:1786109354.209651:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109354.209657:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d89a680 x1872862933140480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109354.209672:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89a680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933140480:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.209704:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109354.209724:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48000 going to sleep for 11 seconds 00000100:00100000:1.0:1786109354.209737:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933140480 00000100:00100000:1.0:1786109354.209742:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933140480 00000100:00100000:1.0:1786109354.209772:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12148 00000100:00100000:1.0:1786109354.209780:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:187949:x1872862933140480:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.209889:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187949:x1872862933140480:12345-0@lo:1000:osp_up1-0.0 Request processed in 110us (184us total) trans 25769804488 rc 0/0 00000100:00100000:1.0:1786109354.209896:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12148 00000100:00100000:1.0:1786109354.209930:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89a680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933140480:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109354.209939:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 715 rpc_version 715 00000020:00100000:1.0:1786109354.209954:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109354.209961:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d899c00 x1872862933140736/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109354.209975:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933140736:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786109354.209984:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098c0a5180 with version 721 00000020:00080000:0.0:1786109354.209989:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568625 cancel update log [0x240002ef8:0x1:0x0].280: rc = 0 00000100:00100000:1.0:1786109354.210006:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109354.210024:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48000 going to sleep for 11 seconds 00000020:00080000:0.0:1786109354.210028:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568625 cancel update log [0x2000255c0:0x1:0x0].399: rc = 0 00000004:00080000:0.0:1786109354.210049:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098c0a5a80 with version 722 00000020:00080000:0.0:1786109354.210052:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568626 cancel update log [0x240002ef8:0x1:0x0].281: rc = 0 00000020:00080000:0.0:1786109354.210071:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568626 cancel update log [0x2000255c0:0x1:0x0].400: rc = 0 00000004:00080000:0.0:1786109354.210116:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43600 with version 723 00000020:00080000:0.0:1786109354.210120:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568627 cancel update log [0x240002ef8:0x1:0x0].282: rc = 0 00000020:00080000:0.0:1786109354.210143:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568627 cancel update log [0x2000255c0:0x1:0x0].401: rc = 0 00000100:00100000:1.0:1786109354.210581:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933140736 00000100:00100000:1.0:1786109354.210586:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933140736 00000100:00100000:1.0:1786109354.210611:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12149 00000100:00100000:1.0:1786109354.210618:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187949:x1872862933140736:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.210705:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:187949:x1872862933140736:12345-0@lo:1000:osp_up1-0.0 Request processed in 87us (699us total) trans 25769804489 rc 0/0 00000100:00100000:1.0:1786109354.210712:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12149 00000100:00100000:1.0:1786109354.210747:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933140736:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109354.210755:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 716 rpc_version 716 00000020:00100000:1.0:1786109354.210885:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109354.210892:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d89aa00 x1872862933140992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109354.210907:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89aa00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933140992:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.210931:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109354.210992:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48000 going to sleep for 11 seconds 00000004:00080000:0.0:1786109354.211223:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43840 with version 724 00000020:00080000:0.0:1786109354.211232:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568628 cancel update log [0x240002ef8:0x1:0x0].283: rc = 0 00000020:00080000:0.0:1786109354.211268:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568628 cancel update log [0x2000255c0:0x1:0x0].402: rc = 0 00000004:00080000:0.0:1786109354.211288:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e439c0 with version 725 00000020:00080000:0.0:1786109354.211291:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568629 cancel update log [0x240002ef8:0x1:0x0].284: rc = 0 00000020:00080000:0.0:1786109354.211306:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568629 cancel update log [0x2000255c0:0x1:0x0].403: rc = 0 00000100:00100000:2.0:1786109354.211603:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933140992 00000100:00100000:2.0:1786109354.211608:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933140992 00000004:00080000:0.0:1786109354.212240:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43cc0 with version 726 00000020:00080000:0.0:1786109354.212245:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568630 cancel update log [0x240002ef8:0x1:0x0].285: rc = 0 00000020:00080000:0.0:1786109354.212282:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568630 cancel update log [0x2000255c0:0x1:0x0].404: rc = 0 00000100:00100000:2.0:1786109354.212505:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12150 00000100:00100000:2.0:1786109354.212520:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:187949:x1872862933140992:12345-0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786109354.212893:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43e40 with version 727 00000020:00080000:0.0:1786109354.212900:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568631 cancel update log [0x240002ef8:0x1:0x0].286: rc = 0 00000020:00080000:0.0:1786109354.212939:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568631 cancel update log [0x2000255c0:0x1:0x0].405: rc = 0 00000004:00080000:0.0:1786109354.212968:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43180 with version 728 00000020:00080000:0.0:1786109354.212972:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568632 cancel update log [0x240002ef8:0x1:0x0].287: rc = 0 00000020:00080000:0.0:1786109354.212997:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568632 cancel update log [0x2000255c0:0x1:0x0].407: rc = 0 00000004:00080000:0.0:1786109354.213023:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43d80 with version 729 00000020:00080000:0.0:1786109354.213028:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568633 cancel update log [0x240002ef8:0x1:0x0].288: rc = 0 00000020:00080000:0.0:1786109354.213053:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568633 cancel update log [0x2000255c0:0x1:0x0].408: rc = 0 00000004:00080000:0.0:1786109354.213082:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e430c0 with version 730 00000020:00080000:0.0:1786109354.213087:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568634 cancel update log [0x240002ef8:0x1:0x0].289: rc = 0 00000020:00080000:0.0:1786109354.213111:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568634 cancel update log [0x2000255c0:0x1:0x0].409: rc = 0 00000100:00100000:3.0:1786109354.213629:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89aa00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933140992:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109354.213641:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 717 rpc_version 717 00000020:00100000:3.0:1786109354.213661:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109354.213667:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984908000 x1872862933141248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109354.213684:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933141248:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.214934:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187949:x1872862933140992:12345-0@lo:1000:osp_up1-0.0 Request processed in 2413us (3995us total) trans 25769804490 rc 0/0 00000100:00100000:3.0:1786109354.214937:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109354.214949:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12150 00000100:00100000:3.0:1786109354.215128:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687c00 going to sleep for 11 seconds 00000004:00080000:0.0:1786109354.215448:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43780 with version 731 00000020:00080000:0.0:1786109354.215455:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568635 cancel update log [0x240002ef8:0x1:0x0].290: rc = 0 00000020:00080000:0.0:1786109354.215518:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568635 cancel update log [0x2000255c0:0x1:0x0].410: rc = 0 00000004:00080000:0.0:1786109354.215571:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a978b2780 with version 732 00000020:00080000:0.0:1786109354.215575:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568636 cancel update log [0x240002ef8:0x1:0x0].291: rc = 0 00000020:00080000:0.0:1786109354.215599:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568636 cancel update log [0x2000255c0:0x1:0x0].411: rc = 0 00000004:00080000:0.0:1786109354.215620:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ac0977780 with version 733 00000020:00080000:0.0:1786109354.215624:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568637 cancel update log [0x240002ef8:0x1:0x0].292: rc = 0 00000020:00080000:0.0:1786109354.216067:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568637 cancel update log [0x2000255c0:0x1:0x0].412: rc = 0 00000004:00080000:0.0:1786109354.216100:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ac0977a80 with version 734 00000020:00080000:0.0:1786109354.216104:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568638 cancel update log [0x240002ef8:0x1:0x0].293: rc = 0 00000020:00080000:0.0:1786109354.216127:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568638 cancel update log [0x2000255c0:0x1:0x0].413: rc = 0 00000004:00080000:0.0:1786109354.216143:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098bef0a80 with version 735 00000020:00080000:0.0:1786109354.216145:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568639 cancel update log [0x240002ef8:0x1:0x0].294: rc = 0 00000020:00080000:0.0:1786109354.216169:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568639 cancel update log [0x2000255c0:0x1:0x0].414: rc = 0 00000004:00080000:0.0:1786109354.216188:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab9177b40 with version 736 00000020:00080000:0.0:1786109354.216191:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568640 cancel update log [0x240002ef8:0x1:0x0].296: rc = 0 00000020:00080000:0.0:1786109354.216466:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568640 cancel update log [0x2000255c0:0x1:0x0].415: rc = 0 00000004:00080000:0.0:1786109354.216731:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab9177300 with version 737 00000020:00080000:0.0:1786109354.216734:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568641 cancel update log [0x240002ef8:0x1:0x0].297: rc = 0 00000020:00080000:0.0:1786109354.216901:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568641 cancel update log [0x2000255c0:0x1:0x0].416: rc = 0 00000004:00080000:0.0:1786109354.216924:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab9177240 with version 738 00000020:00080000:0.0:1786109354.216927:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568642 cancel update log [0x240002ef8:0x1:0x0].298: rc = 0 00000020:00080000:0.0:1786109354.216946:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568642 cancel update log [0x2000255c0:0x1:0x0].417: rc = 0 00000004:00080000:0.0:1786109354.216988:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab9177a80 with version 739 00000020:00080000:0.0:1786109354.216992:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568643 cancel update log [0x240002ef8:0x1:0x0].299: rc = 0 00000020:00080000:0.0:1786109354.217015:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568643 cancel update log [0x2000255c0:0x1:0x0].418: rc = 0 00000004:00080000:0.0:1786109354.217037:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab91773c0 with version 740 00000020:00080000:0.0:1786109354.217040:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568644 cancel update log [0x240002ef8:0x1:0x0].300: rc = 0 00000020:00080000:0.0:1786109354.217059:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568644 cancel update log [0x2000255c0:0x1:0x0].419: rc = 0 00000004:00080000:0.0:1786109354.217715:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098c0a59c0 with version 741 00000020:00080000:0.0:1786109354.217720:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568645 cancel update log [0x240002ef8:0x1:0x0].301: rc = 0 00000020:00080000:0.0:1786109354.217748:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568645 cancel update log [0x2000255c0:0x1:0x0].420: rc = 0 00000004:00080000:0.0:1786109354.218060:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930986604300 with version 742 00000020:00080000:0.0:1786109354.218066:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568646 cancel update log [0x240002ef8:0x1:0x0].302: rc = 0 00000020:00080000:0.0:1786109354.218096:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568646 cancel update log [0x2000255c0:0x1:0x0].421: rc = 0 00000020:00080000:0.0:1786109354.218103:0:187973:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 322122568646 00000100:00100000:2.0:1786109354.218379:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933141248 00000100:00100000:2.0:1786109354.218976:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933141248 00000100:00100000:2.0:1786109354.219034:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12151 00000100:00100000:2.0:1786109354.219045:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187949:x1872862933141248:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.220698:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187949:x1872862933141248:12345-0@lo:1000:osp_up1-0.0 Request processed in 1649us (5757us total) trans 25769804491 rc 0/0 00000100:00100000:2.0:1786109354.220710:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12151 00000100:00100000:3.0:1786109354.220797:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933141248:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109354.220810:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 718 rpc_version 718 00000020:00100000:3.0:1786109354.220835:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109354.220842:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098490bb80 x1872862933141504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109354.220861:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933141504:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.220899:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109354.220930:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109354.221342:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933141504 00000100:00100000:1.0:1786109354.221350:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933141504 00000100:00100000:1.0:1786109354.221578:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12152 00000100:00100000:1.0:1786109354.221587:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187949:x1872862933141504:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.222086:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187949:x1872862933141504:12345-0@lo:1000:osp_up1-0.0 Request processed in 500us (1185us total) trans 25769804492 rc 0/0 00000100:00100000:1.0:1786109354.222094:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12152 00000100:00100000:3.0:1786109354.222233:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933141504:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109354.222242:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 719 rpc_version 719 00000020:00100000:3.0:1786109354.222256:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109354.222262:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098490a300 x1872862933141760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109354.222276:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933141760:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.222304:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109354.222798:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109354.223215:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933141760 00000100:00100000:0.0:1786109354.223222:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933141760 00000100:00100000:0.0:1786109354.223262:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12153 00000100:00100000:0.0:1786109354.223270:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187949:x1872862933141760:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109354.224260:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187949:x1872862933141760:12345-0@lo:1000:osp_up1-0.0 Request processed in 987us (1951us total) trans 25769804493 rc 0/0 00000100:00100000:0.0:1786109354.224270:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12153 00000100:00100000:3.0:1786109354.224760:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933141760:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109354.224773:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 720 rpc_version 720 00000020:00100000:3.0:1786109354.224798:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109354.224804:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098490ad80 x1872862933142016/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109354.224822:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933142016:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.224867:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109354.224893:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.225466:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933142016 00000100:00100000:2.0:1786109354.225473:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933142016 00000100:00100000:2.0:1786109354.225510:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12154 00000100:00100000:2.0:1786109354.225518:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187949:x1872862933142016:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.225651:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187949:x1872862933142016:12345-0@lo:1000:osp_up1-0.0 Request processed in 133us (782us total) trans 25769804494 rc 0/0 00000100:00100000:2.0:1786109354.225658:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12154 00000100:00100000:3.0:1786109354.225935:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933142016:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109354.225945:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 721 rpc_version 721 00000020:00100000:3.0:1786109354.225961:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109354.225967:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098c344380 x1872862933142272/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109354.225983:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c344380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933142272:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.226008:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109354.226035:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.226260:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933142272 00000100:00100000:2.0:1786109354.226264:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933142272 00000100:00100000:2.0:1786109354.226344:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12155 00000100:00100000:2.0:1786109354.226366:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187949:x1872862933142272:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.226517:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187949:x1872862933142272:12345-0@lo:1000:osp_up1-0.0 Request processed in 163us (505us total) trans 25769804495 rc 0/0 00000100:00100000:2.0:1786109354.226527:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12155 00000100:00100000:3.0:1786109354.226596:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c344380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933142272:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109354.226605:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 722 rpc_version 722 00000020:00100000:3.0:1786109354.226620:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109354.226625:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098c344e00 x1872862933142528/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109354.226637:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c344e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933142528:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.226660:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109354.226676:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109354.227777:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933142528 00000100:00100000:0.0:1786109354.227785:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933142528 00000100:00100000:2.0:1786109354.228025:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12156 00000100:00100000:2.0:1786109354.228035:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187949:x1872862933142528:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.228312:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187949:x1872862933142528:12345-0@lo:1000:osp_up1-0.0 Request processed in 276us (1648us total) trans 25769804496 rc 0/0 00000100:00100000:2.0:1786109354.228321:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12156 00000100:00100000:1.0:1786109354.228544:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c344e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933142528:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109354.228556:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 723 rpc_version 723 00000020:00100000:1.0:1786109354.228576:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109354.228583:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d89bb80 x1872862933142784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109354.228603:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933142784:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.228639:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109354.229476:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48780 going to sleep for 11 seconds 00000100:00100000:3.0:1786109354.230739:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933142784 00000100:00100000:3.0:1786109354.230750:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933142784 00000100:00100000:3.0:1786109354.230878:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12157 00000100:00100000:3.0:1786109354.230889:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187949:x1872862933142784:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.231074:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187949:x1872862933142784:12345-0@lo:1000:osp_up1-0.0 Request processed in 187us (2433us total) trans 25769804497 rc 0/0 00000100:00100000:3.0:1786109354.231082:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12157 00000100:00100000:0.0:1786109354.231380:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933142784:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786109354.231404:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 724 rpc_version 724 00000020:00100000:0.0:1786109354.231426:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109354.232460:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a97c4d500 x1872862933143040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109354.232488:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933143040:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109354.232542:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109354.232901:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930986604b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.234908:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933143040 00000100:00100000:2.0:1786109354.234919:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933143040 00000100:00100000:2.0:1786109354.235082:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12158 00000100:00100000:2.0:1786109354.235092:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187949:x1872862933143040:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.235621:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187949:x1872862933143040:12345-0@lo:1000:osp_up1-0.0 Request processed in 528us (3075us total) trans 25769804498 rc 0/0 00000100:00100000:2.0:1786109354.235630:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12158 00000100:00100000:1.0:1786109354.236363:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4d500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933143040:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109354.236377:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 725 rpc_version 725 00000020:00100000:1.0:1786109354.236400:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109354.236406:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d89b800 x1872862933143296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109354.236428:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933143296:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.236488:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109354.237351:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c48780 going to sleep for 11 seconds 00000100:00100000:0.0:1786109354.237395:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933143296 00000100:00100000:0.0:1786109354.237402:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933143296 00000100:00100000:0.0:1786109354.237462:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12159 00000100:00100000:0.0:1786109354.237474:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187949:x1872862933143296:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109354.237626:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187949:x1872862933143296:12345-0@lo:1000:osp_up1-0.0 Request processed in 153us (1135us total) trans 25769804499 rc 0/0 00000100:00100000:0.0:1786109354.237637:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12159 00000100:00100000:0.0:1786109354.237932:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933143296:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786109354.237944:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 726 rpc_version 726 00000020:00100000:0.0:1786109354.237963:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109354.237970:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a97c4df80 x1872862933143552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109354.237987:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933143552:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109354.238018:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109354.238038:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930986604780 going to sleep for 11 seconds 00000100:00100000:0.0:1786109354.238062:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933143552 00000100:00100000:0.0:1786109354.238066:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933143552 00000100:00100000:0.0:1786109354.238097:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12160 00000100:00100000:0.0:1786109354.238103:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187949:x1872862933143552:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109354.239451:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:187949:x1872862933143552:12345-0@lo:1000:osp_up1-0.0 Request processed in 1325us (1410us total) trans 25769804500 rc 0/0 00000100:00100000:0.0:1786109354.239462:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12160 00000100:00100000:2.0:1786109354.239598:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933143552:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109354.239611:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 727 rpc_version 727 00000020:00100000:2.0:1786109354.239631:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109354.239637:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d8f9f80 x1872862933143808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109354.240078:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933143808:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.240123:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109354.240271:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109354.240374:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933143808 00000100:00100000:1.0:1786109354.240382:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933143808 00000100:00100000:1.0:1786109354.240810:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12161 00000100:00100000:1.0:1786109354.240821:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:187949:x1872862933143808:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.241290:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187949:x1872862933143808:12345-0@lo:1000:osp_up1-0.0 Request processed in 470us (1165us total) trans 25769804501 rc 0/0 00000100:00100000:1.0:1786109354.241298:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12161 00000100:00100000:0.0:1786109354.241693:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933143808:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786109354.241707:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 728 rpc_version 728 00000020:00100000:0.0:1786109354.241730:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109354.241736:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a97c4f100 x1872862933144064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109354.241754:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933144064:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109354.241794:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109354.242292:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930986604480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.242400:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933144064 00000100:00100000:2.0:1786109354.242407:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933144064 00000100:00100000:2.0:1786109354.242467:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12162 00000100:00100000:2.0:1786109354.242478:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187949:x1872862933144064:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.242614:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187949:x1872862933144064:12345-0@lo:1000:osp_up1-0.0 Request processed in 138us (818us total) trans 25769804502 rc 0/0 00000100:00100000:2.0:1786109354.242622:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12162 00000100:00100000:2.0:1786109354.242677:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933144064:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109354.242687:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 729 rpc_version 729 00000020:00100000:2.0:1786109354.242701:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109354.242707:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d8fa680 x1872862933144320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109354.242728:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8fa680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933144320:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.242761:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109354.242790:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933144320 00000100:00100000:2.0:1786109354.242793:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933144320 00000100:00100000:2.0:1786109354.242813:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12163 00000100:00100000:2.0:1786109354.242820:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187949:x1872862933144320:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.242899:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187949:x1872862933144320:12345-0@lo:1000:osp_up1-0.0 Request processed in 80us (137us total) trans 25769804503 rc 0/0 00000100:00100000:2.0:1786109354.242906:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12163 00000100:00100000:2.0:1786109354.242924:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.242944:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8fa680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933144320:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109354.242951:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 730 rpc_version 730 00000020:00100000:2.0:1786109354.242963:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109354.242968:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d8fb100 x1872862933144576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109354.242981:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8fb100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933144576:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.243012:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109354.243035:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933144576 00000100:00100000:2.0:1786109354.243039:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933144576 00000100:00100000:2.0:1786109354.243057:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12164 00000100:00100000:2.0:1786109354.243066:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187949:x1872862933144576:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.243139:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187949:x1872862933144576:12345-0@lo:1000:osp_up1-0.0 Request processed in 76us (126us total) trans 25769804504 rc 0/0 00000100:00100000:2.0:1786109354.243146:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12164 00000100:00100000:2.0:1786109354.245119:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.245183:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8fb100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933144576:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109354.245196:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 731 rpc_version 731 00000020:00100000:2.0:1786109354.245281:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109354.245291:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d8f8e00 x1872862933144832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109354.245310:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d8f8e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933144832:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.245358:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109354.245389:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109354.245416:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933144832 00000100:00100000:1.0:1786109354.245423:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933144832 00000100:00100000:1.0:1786109354.245594:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12165 00000100:00100000:1.0:1786109354.245605:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d8fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187949:x1872862933144832:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.247216:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d8fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:187949:x1872862933144832:12345-0@lo:1000:osp_up1-0.0 Request processed in 1606us (1849us total) trans 25769804505 rc 0/0 00000100:00100000:1.0:1786109354.247228:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12165 00000100:00100000:2.0:1786109354.247291:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d8f8e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933144832:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109354.247302:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 732 rpc_version 732 00000020:00100000:2.0:1786109354.247330:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109354.247337:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984ff1c00 x1872862933145088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109354.247354:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933145088:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.247396:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109354.247444:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109354.249564:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933145088 00000100:00100000:1.0:1786109354.249577:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933145088 00000100:00100000:1.0:1786109354.249683:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12166 00000100:00100000:1.0:1786109354.249693:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:187949:x1872862933145088:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.249880:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:187949:x1872862933145088:12345-0@lo:1000:osp_up1-0.0 Request processed in 188us (2483us total) trans 25769804506 rc 0/0 00000100:00100000:1.0:1786109354.249888:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12166 00000100:00100000:2.0:1786109354.250844:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933145088:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109354.250865:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 733 rpc_version 733 00000020:00100000:2.0:1786109354.250889:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109354.250897:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930984ff1180 x1872862933145344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109354.250916:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933145344:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.251736:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109354.252340:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109354.252566:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933145344 00000100:00100000:1.0:1786109354.252575:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933145344 00000100:00100000:0.0:1786109354.252706:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12167 00000100:00100000:0.0:1786109354.252716:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:187949:x1872862933145344:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109354.252884:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:187949:x1872862933145344:12345-0@lo:1000:osp_up1-0.0 Request processed in 168us (1149us total) trans 25769804507 rc 0/0 00000100:00100000:0.0:1786109354.252893:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12167 00000100:00100000:2.0:1786109354.253688:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933145344:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109354.253703:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 734 rpc_version 734 00000020:00100000:2.0:1786109354.253729:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109354.253737:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930985eb8e00 x1872862933145600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109354.254864:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933145600:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.255877:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109354.256238:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933145600 00000100:00100000:0.0:1786109354.256256:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933145600 00000100:00100000:0.0:1786109354.256337:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12168 00000100:00100000:0.0:1786109354.256350:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:187949:x1872862933145600:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109354.256634:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:187949:x1872862933145600:12345-0@lo:1000:osp_up1-0.0 Request processed in 285us (758us total) trans 25769804508 rc 0/0 00000100:00100000:0.0:1786109354.256643:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12168 00000100:00100000:2.0:1786109354.257029:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.257081:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930985eb8e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933145600:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109354.257095:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 735 rpc_version 735 00000020:00100000:2.0:1786109354.257122:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109354.257129:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab9663100 x1872862933145856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109354.257147:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9663100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933145856:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.259298:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109354.261170:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109354.261264:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933145856 00000100:00100000:0.0:1786109354.261273:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933145856 00000100:00100000:0.0:1786109354.261334:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12169 00000100:00100000:0.0:1786109354.261345:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:187949:x1872862933145856:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109354.267207:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:187949:x1872862933145856:12345-0@lo:1000:osp_up1-0.0 Request processed in 5854us (7906us total) trans 25769804509 rc 0/0 00000100:00100000:0.0:1786109354.267223:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12169 00000100:00100000:2.0:1786109354.267792:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9663100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933145856:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109354.268099:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 736 rpc_version 736 00000020:00100000:3.0:1786109354.268132:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109354.268139:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac0fba300 x1872862933146112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109354.268315:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fba300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933146112:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.268374:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109354.268413:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687000 going to sleep for 11 seconds 00000100:00100000:1.0:1786109354.268861:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933146112 00000100:00100000:1.0:1786109354.268869:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933146112 00000100:00100000:1.0:1786109354.268931:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12170 00000100:00100000:1.0:1786109354.268941:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:187949:x1872862933146112:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109354.269516:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+38:187949:x1872862933146112:12345-0@lo:1000:osp_up1-0.0 Request processed in 575us (1139us total) trans 25769804510 rc 0/0 00000100:00100000:1.0:1786109354.269525:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12170 00000100:00100000:3.0:1786109354.272568:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fba300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933146112:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109354.272587:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 737 rpc_version 737 00000020:00100000:3.0:1786109354.272660:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109354.272668:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac0fbb480 x1872862933146368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109354.272695:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933146368:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109354.273870:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109354.273931:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.274205:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933146368 00000100:00100000:2.0:1786109354.274213:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933146368 00000100:00100000:2.0:1786109354.274272:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12171 00000100:00100000:2.0:1786109354.274282:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+38:187949:x1872862933146368:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.274549:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:187949:x1872862933146368:12345-0@lo:1000:osp_up1-0.0 Request processed in 268us (683us total) trans 25769804511 rc 0/0 00000100:00100000:2.0:1786109354.274557:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12171 00000100:00100000:0.0:1786109354.274643:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933146368:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786109354.274653:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 738 rpc_version 738 00000020:00100000:0.0:1786109354.274670:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109354.274677:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a97c4dc00 x1872862933146624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109354.274695:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933146624:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109354.274729:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109354.275093:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930986604e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.275194:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933146624 00000100:00100000:2.0:1786109354.275199:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933146624 00000100:00100000:2.0:1786109354.276528:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12172 00000100:00100000:2.0:1786109354.276545:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:187949:x1872862933146624:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.276717:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+40:187949:x1872862933146624:12345-0@lo:1000:osp_up1-0.0 Request processed in 177us (1986us total) trans 25769804512 rc 0/0 00000100:00100000:2.0:1786109354.276725:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12172 00000100:00100000:2.0:1786109354.276789:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933146624:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109354.276803:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 739 rpc_version 739 00000020:00100000:2.0:1786109354.276823:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109354.276830:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab9660a80 x1872862933146880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109354.276848:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933146880:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.276887:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109354.276917:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933146880 00000100:00100000:2.0:1786109354.277123:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933146880 00000100:00100000:2.0:1786109354.277156:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12173 00000100:00100000:2.0:1786109354.277175:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+40:187949:x1872862933146880:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.277252:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:187949:x1872862933146880:12345-0@lo:1000:osp_up1-0.0 Request processed in 78us (364us total) trans 25769804513 rc 0/0 00000100:00100000:2.0:1786109354.277259:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12173 00000100:00100000:2.0:1786109354.277281:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.277298:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933146880:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109354.277305:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 740 rpc_version 740 00000020:00100000:2.0:1786109354.277318:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109354.277323:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab9663480 x1872862933147136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109354.277341:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9663480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933147136:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.277380:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109354.277401:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933147136 00000100:00100000:2.0:1786109354.277405:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933147136 00000100:00100000:2.0:1786109354.277427:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12174 00000100:00100000:2.0:1786109354.277462:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab5397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:187949:x1872862933147136:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.277533:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab5397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+42:187949:x1872862933147136:12345-0@lo:1000:osp_up1-0.0 Request processed in 73us (152us total) trans 25769804514 rc 0/0 00000100:00100000:2.0:1786109354.277539:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12174 00000100:00100000:2.0:1786109354.277679:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.277695:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9663480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933147136:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109354.277702:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 741 rpc_version 741 00000020:00100000:2.0:1786109354.277711:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109354.277716:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab9661c00 x1872862933147392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109354.277728:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9661c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933147392:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.277819:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109354.277843:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933147392 00000100:00100000:2.0:1786109354.277847:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933147392 00000100:00100000:2.0:1786109354.277866:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12175 00000100:00100000:2.0:1786109354.277873:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+42:187949:x1872862933147392:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.278326:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+43:187949:x1872862933147392:12345-0@lo:1000:osp_up1-0.0 Request processed in 450us (573us total) trans 25769804515 rc 0/0 00000100:00100000:2.0:1786109354.278334:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12175 00000100:00100000:2.0:1786109354.278358:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.278378:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9661c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933147392:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109354.278385:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 742 rpc_version 742 00000020:00100000:2.0:1786109354.278397:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109354.278402:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab9660e00 x1872862933147648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109354.278414:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933147648:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.278456:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109354.278476:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933147648 00000100:00100000:2.0:1786109354.278480:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933147648 00000100:00100000:2.0:1786109354.278498:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12176 00000100:00100000:2.0:1786109354.278504:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+43:187949:x1872862933147648:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109354.278568:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+44:187949:x1872862933147648:12345-0@lo:1000:osp_up1-0.0 Request processed in 63us (110us total) trans 25769804516 rc 0/0 00000100:00100000:2.0:1786109354.278573:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12176 00000100:00100000:2.0:1786109354.278588:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109354.278601:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933147648:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1786109354.845556:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109355.269142:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933147776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109355.269306:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109355.269889:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933147776 00000100:00100000:1.0:1786109355.269897:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933147776 00000100:00100000:1.0:1786109355.270262:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12177 00000100:00100000:1.0:1786109355.270276:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+44:3646:x1872862933147776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109355.270314:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:1.0:1786109355.270379:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+44:3646:x1872862933147776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109355.270386:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12177 00000100:00100000:1.0:1786109355.270588:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933147776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109355.781611:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109355.781631:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933147904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109355.782543:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933148032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109355.782609:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109355.783134:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933148032 00000100:00100000:0.0:1786109355.783143:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933148032 00000100:00100000:0.0:1786109355.783210:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5705 00000100:00100000:0.0:1786109355.783221:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933148032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109355.783248:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109355.783295:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933148032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109355.783302:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5705 00000100:00080000:0.0:1786109355.783339:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109355.783829:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109355.784942:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933148032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109355.786494:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933147904 00000100:00100000:0.0:1786109355.786505:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933147904 00000100:00100000:0.0:1786109355.786565:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5706 00000100:00100000:0.0:1786109355.786574:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933147904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109355.786604:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109355.787198:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933147904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 623us (3365us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109355.787207:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5706 00000100:00080000:3.0:1786109355.787818:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109355.787878:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933147904:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1786109355.908768:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109356.099934:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109356.099978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109356.100012:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109356.100032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109356.100056:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109356.100062:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922064768 00000100:00100000:1.0:1786109356.100071:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922064768 00000100:00100000:0.0:1786109356.100073:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922065024 00000100:00100000:0.0:1786109356.100076:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922065024 00000100:00100000:0.0:1786109356.100122:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922065152 00000100:00100000:1.0:1786109356.100123:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922064896 00000100:00100000:1.0:1786109356.100126:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922064896 00000100:00100000:0.0:1786109356.100126:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922065152 00000100:00100000:1.0:1786109356.100158:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:0.0:1786109356.100158:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6808 00000100:00100000:0.0:1786109356.100168:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922065024:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109356.100169:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+9:2403:x1872862922064768:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109356.101668:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+9:2403:x1872862922064768:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1493us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109356.101710:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922065024:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1542us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109356.101719:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6808 00000100:00100000:0.0:1786109356.101750:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6809 00000100:00100000:1.0:1786109356.101755:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:0.0:1786109356.101761:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922065152:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109356.101775:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:1.0:1786109356.101782:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922064896:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109356.101797:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922065152:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 41us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109356.101803:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6809 00000100:00100000:1.0:1786109356.101806:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922064896:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109356.101812:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00080000:1.0:1786109356.101837:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109356.101842:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109356.101845:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109356.101847:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109356.101975:0:187890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922064640 00000100:00100000:0.0:1786109356.101982:0:187890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922064640 00000100:00100000:0.0:1786109356.102018:0:187890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:0.0:1786109356.102025:0:187890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2403:x1872862922064640:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109356.102052:0:187890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2403:x1872862922064640:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109356.102058:0:187890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 101 00010000:00010000:3.0:1786109356.932613:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109357.956801:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109358.895842:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933148416:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.896225:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933148160:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.896280:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109358.896363:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933148672:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.896391:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109358.896413:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933149184:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.896472:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109358.896487:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933149696:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.896507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109358.896532:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1786109358.896636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109358.896751:0:187888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933148160 00000100:00100000:1.0:1786109358.896761:0:187888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933148160 00000100:00100000:1.0:1786109358.896820:0:187888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1786109358.896831:0:187888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933148160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109358.896905:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933148928:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.897005:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933148544:0@lo:400:kworker.0 00000100:00100000:2.0:1786109358.897037:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933150080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109358.897617:0:187888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933148160:12345-0@lo:400:kworker.0 Request processed in 785us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109358.897627:0:187888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1786109358.897672:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933148672 00000100:00100000:1.0:1786109358.897678:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933148672 00000100:00100000:1.0:1786109358.897718:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933149184 00000100:00100000:1.0:1786109358.897721:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933149184 00000100:00100000:1.0:1786109358.897734:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933149696 00000100:00100000:1.0:1786109358.897737:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933149696 00000100:00100000:1.0:1786109358.897748:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933148416 00000100:00100000:1.0:1786109358.897750:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933148416 00000100:00100000:1.0:1786109358.897767:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786109358.897774:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933148672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109358.897815:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933148672:12345-0@lo:400:kworker.0 Request processed in 41us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109358.897821:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786109358.897834:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786109358.897840:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933149184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109358.897870:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933149184:12345-0@lo:400:kworker.0 Request processed in 31us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109358.897875:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786109358.897885:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786109358.897890:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933149696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109358.897932:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933149696:12345-0@lo:400:kworker.0 Request processed in 28us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109358.897938:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786109358.897950:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786109358.897957:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933148416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109358.897987:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933148416:12345-0@lo:400:kworker.0 Request processed in 31us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109358.897993:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1786109358.898018:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109358.898249:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109358.898427:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933149440:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.898552:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109358.898559:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109358.898584:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933149056:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.898620:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109358.898626:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933150080 00000100:00100000:2.0:1786109358.898633:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933150080 00000100:00100000:2.0:1786109358.898678:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5707 00000100:00100000:2.0:1786109358.898688:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933150080:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109358.898709:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933148544 00000100:00100000:0.0:1786109358.898715:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933148544 00002000:00000024:2.0:1786109358.898722:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109358.898752:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786109358.898761:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933148544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109358.898776:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933150080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109358.898783:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5707 00000100:00100000:0.0:1786109358.898807:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933148544:12345-0@lo:400:kworker.0 Request processed in 45us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109358.898814:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786109358.898842:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933150080:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786109358.898855:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109358.898861:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109358.898887:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933148288:0@lo:400:kworker.0 00000100:00100000:2.0:1786109358.898917:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109358.898955:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933148800:0@lo:400:kworker.0 00000100:00100000:2.0:1786109358.898982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109358.899004:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933149312:0@lo:400:kworker.0 00000100:00100000:2.0:1786109358.899028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109358.899040:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933148288 00000100:00100000:0.0:1786109358.899045:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933148288 00000100:00100000:2.0:1786109358.899051:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933149824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109358.899081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109358.899088:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786109358.899098:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933148288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109358.899110:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109358.899119:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933149952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109358.899159:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109358.899376:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933148288:12345-0@lo:400:kworker.0 Request processed in 279us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109358.899383:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786109358.899406:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933148800 00000100:00100000:0.0:1786109358.899410:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933148800 00000100:00100000:0.0:1786109358.899454:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933149312 00000100:00100000:0.0:1786109358.899458:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933149312 00000100:00100000:0.0:1786109358.899469:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933149952 00000100:00100000:0.0:1786109358.899472:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933149952 00000100:00100000:0.0:1786109358.899483:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12178 00000100:00100000:0.0:1786109358.899489:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1872862933148800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109358.899525:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1872862933148800:12345-0@lo:400:kworker.0 Request processed in 36us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109358.899531:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12178 00000100:00100000:0.0:1786109358.899543:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12179 00000100:00100000:0.0:1786109358.899549:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+44:3646:x1872862933149312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109358.899582:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+44:3646:x1872862933149312:12345-0@lo:400:kworker.0 Request processed in 34us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109358.899588:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12179 00000100:00100000:0.0:1786109358.899599:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12180 00000100:00100000:0.0:1786109358.899605:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933149952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786109358.899632:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00000100:00100000:0.0:1786109358.899662:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933149952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109358.899668:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12180 00000100:00080000:0.0:1786109358.899684:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109358.899730:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933149824 00000100:00100000:0.0:1786109358.899733:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933149824 00000100:00100000:0.0:1786109358.899762:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5708 00000100:00100000:0.0:1786109358.899768:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933149824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109358.899786:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109358.899815:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933149824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109358.899820:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5708 00000100:00080000:0.0:1786109358.899837:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109358.900398:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933149568:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.900454:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109358.900489:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933148928 00000100:00100000:1.0:1786109358.900496:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933148928 00000100:00100000:0.0:1786109358.900574:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933149056 00000100:00100000:0.0:1786109358.900579:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933149056 00000100:00100000:0.0:1786109358.900610:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6810 00000100:00100000:0.0:1786109358.900618:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933148928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109358.900662:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933148928:12345-0@lo:400:kworker.0 Request processed in 45us (2414us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109358.900669:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6810 00000100:00100000:0.0:1786109358.900685:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6811 00000100:00100000:0.0:1786109358.900691:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933149056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109358.900718:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933149056:12345-0@lo:400:kworker.0 Request processed in 28us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109358.900724:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6811 00000100:00080000:0.0:1786109358.900748:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109358.900752:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109358.900899:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933148160:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.900991:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933148672:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.901011:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933149184:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.901026:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933149696:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.901061:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933148544:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.901073:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933149056:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.901097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109358.901358:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933148416:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.901371:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933148928:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.901397:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933149568 00000100:00100000:3.0:1786109358.901402:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933149568 00000100:00100000:3.0:1786109358.901459:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933149440 00000100:00100000:3.0:1786109358.901463:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933149440 00000100:00100000:3.0:1786109358.901486:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6812 00000100:00100000:3.0:1786109358.901493:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933149568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.901544:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933149568:12345-0@lo:400:kworker.0 Request processed in 51us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109358.901551:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6812 00000100:00100000:3.0:1786109358.901565:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6813 00000100:00100000:3.0:1786109358.901571:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933149440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.901605:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933149440:12345-0@lo:400:kworker.0 Request processed in 34us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109358.901613:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6813 00000100:00100000:3.0:1786109358.901641:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933149440:0@lo:400:kworker.0 00000100:00100000:3.0:1786109358.901663:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933149568:0@lo:400:kworker.0 00000100:00100000:2.0:1786109358.916201:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933148288:0@lo:400:kworker.0 00000100:00100000:2.0:1786109358.916228:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933148800:0@lo:400:kworker.0 00000100:00100000:2.0:1786109358.916245:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933149312:0@lo:400:kworker.0 00000100:00100000:2.0:1786109358.916274:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933149824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109358.916323:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933149952:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1786109358.980730:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786109359.392423:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804516 is committed 00010000:00010000:1.0:1786109360.004716:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109360.389409:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933150208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109360.389533:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109360.389645:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933150208 00000100:00100000:0.0:1786109360.389656:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933150208 00000100:00100000:0.0:1786109360.389749:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12181 00000100:00100000:0.0:1786109360.389760:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933150208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1786109360.389805:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1786109360.389953:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804516 gen 2 00000004:00080000:3.0:1786109360.389962:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804479 committed transno 25769804516 00000020:00080000:3.0:1786109360.389969:0:3649:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930ac09773c0 refcount 2 committed 0 result 0 batchid 322122568691 00000020:00080000:3.0:1786109360.389973:0:3649:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a8a7cbc00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930ac0977600 00000020:00080000:3.0:1786109360.389977:0:3649:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].349 00000020:00080000:3.0:1786109360.389979:0:3649:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a8a7cb400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab8fe0000 00000020:00080000:3.0:1786109360.389982:0:3649:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].468 00000004:00080000:3.0:1786109360.390013:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804480 committed transno 25769804516 00000020:00080000:3.0:1786109360.390018:0:3649:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff930a84108000 refcount 2 committed 0 result 0 batchid 322122568692 00000020:00080000:3.0:1786109360.390021:0:3649:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9309824d4500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff930a84108a80 00000020:00080000:3.0:1786109360.390024:0:3649:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002ef8:0x1:0x0].350 00000020:00080000:3.0:1786109360.390026:0:3649:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a8a7cbd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab8fe0e00 00000020:00080000:3.0:1786109360.390029:0:3649:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000255c0:0x1:0x0].469 00000004:00080000:3.0:1786109360.390042:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804481 committed transno 25769804516 00000004:00080000:3.0:1786109360.390054:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804482 committed transno 25769804516 00000004:00080000:3.0:1786109360.390065:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804483 committed transno 25769804516 00000004:00080000:3.0:1786109360.390079:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804484 committed transno 25769804516 00000004:00080000:3.0:1786109360.390101:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804485 committed transno 25769804516 00000100:00100000:0.0:1786109360.390107:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933150208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 347us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109360.390117:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12181 00000004:00080000:3.0:1786109360.390301:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804486 committed transno 25769804516 00000004:00080000:3.0:1786109360.390313:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804487 committed transno 25769804516 00000004:00080000:3.0:1786109360.390323:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804488 committed transno 25769804516 00000004:00080000:3.0:1786109360.390334:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804489 committed transno 25769804516 00000004:00080000:3.0:1786109360.390349:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804490 committed transno 25769804516 00000004:00080000:3.0:1786109360.390358:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804491 committed transno 25769804516 00000004:00080000:3.0:1786109360.390368:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804492 committed transno 25769804516 00000004:00080000:3.0:1786109360.390378:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804493 committed transno 25769804516 00000004:00080000:3.0:1786109360.390388:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804494 committed transno 25769804516 00000004:00080000:3.0:1786109360.390397:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804495 committed transno 25769804516 00000004:00080000:3.0:1786109360.390408:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804496 committed transno 25769804516 00000004:00080000:3.0:1786109360.390416:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804497 committed transno 25769804516 00000004:00080000:3.0:1786109360.390426:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804498 committed transno 25769804516 00000004:00080000:3.0:1786109360.390833:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804499 committed transno 25769804516 00000004:00080000:3.0:1786109360.390843:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804500 committed transno 25769804516 00000004:00080000:3.0:1786109360.390855:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804501 committed transno 25769804516 00000004:00080000:3.0:1786109360.390864:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804502 committed transno 25769804516 00000004:00080000:3.0:1786109360.390875:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804503 committed transno 25769804516 00000004:00080000:3.0:1786109360.390884:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804504 committed transno 25769804516 00000004:00080000:3.0:1786109360.390893:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804505 committed transno 25769804516 00000004:00080000:3.0:1786109360.390900:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804506 committed transno 25769804516 00000004:00080000:3.0:1786109360.390909:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804507 committed transno 25769804516 00000004:00080000:3.0:1786109360.390917:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804508 committed transno 25769804516 00000004:00080000:3.0:1786109360.390942:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804509 committed transno 25769804516 00000004:00080000:3.0:1786109360.390965:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804510 committed transno 25769804516 00000004:00080000:3.0:1786109360.390974:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804511 committed transno 25769804516 00000004:00080000:3.0:1786109360.390984:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804512 committed transno 25769804516 00000004:00080000:3.0:1786109360.390992:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804513 committed transno 25769804516 00000004:00080000:3.0:1786109360.391006:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804514 committed transno 25769804516 00000004:00080000:3.0:1786109360.391019:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804515 committed transno 25769804516 00000004:00080000:3.0:1786109360.391029:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804516 committed transno 25769804516 00000100:00100000:3.0:1786109360.391056:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933150208:0@lo:41:osp-pre-1-0.0 00000020:00080000:3.0:1786109360.391082:0:187973:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 322122568692 committed batchid 322122568646 00000020:00080000:2.0:1786109360.391477:0:187883:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 322122568690 batchid updated 00000004:00080000:3.0:1786109360.391686:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d34f00 with version 743 00000020:00080000:3.0:1786109360.391742:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568647 cancel update log [0x240002ef8:0x1:0x0].303: rc = 0 00000020:00080000:3.0:1786109360.391792:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568647 cancel update log [0x2000255c0:0x1:0x0].422: rc = 0 00000004:00080000:3.0:1786109360.391817:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d34cc0 with version 744 00000004:00080000:2.0:1786109360.391843:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 743 rpc_version 743 00000020:00100000:2.0:1786109360.391876:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109360.391886:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab9660380 x1872862933150464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109360.391911:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933150464:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.391982:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109360.392028:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109360.392097:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933150464 00000100:00100000:0.0:1786109360.392105:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933150464 00000100:00100000:0.0:1786109360.392179:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12182 00000100:00100000:0.0:1786109360.392189:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187949:x1872862933150464:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109360.392395:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933150464:12345-0@lo:1000:osp_up1-0.0 Request processed in 207us (411us total) trans 25769804517 rc 0/0 00000100:00100000:0.0:1786109360.392404:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12182 00000020:00080000:3.0:1786109360.392549:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568648 cancel update log [0x240002ef8:0x1:0x0].304: rc = 0 00000020:00080000:3.0:1786109360.392586:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568648 cancel update log [0x2000255c0:0x1:0x0].423: rc = 0 00000004:00080000:3.0:1786109360.392609:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d34480 with version 745 00000020:00080000:3.0:1786109360.392612:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568649 cancel update log [0x240002ef8:0x1:0x0].305: rc = 0 00000020:00080000:3.0:1786109360.392629:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568649 cancel update log [0x2000255c0:0x1:0x0].424: rc = 0 00000004:00080000:3.0:1786109360.392647:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d34240 with version 746 00000020:00080000:3.0:1786109360.392650:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568650 cancel update log [0x240002ef8:0x1:0x0].306: rc = 0 00000020:00080000:3.0:1786109360.392665:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568650 cancel update log [0x2000255c0:0x1:0x0].425: rc = 0 00000004:00080000:3.0:1786109360.392680:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab9177a80 with version 747 00000020:00080000:3.0:1786109360.392682:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568651 cancel update log [0x240002ef8:0x1:0x0].307: rc = 0 00000020:00080000:3.0:1786109360.392697:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568651 cancel update log [0x2000255c0:0x1:0x0].426: rc = 0 00000004:00080000:3.0:1786109360.392713:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab9177240 with version 748 00000020:00080000:3.0:1786109360.392716:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568652 cancel update log [0x240002ef8:0x1:0x0].308: rc = 0 00000020:00080000:3.0:1786109360.392732:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568652 cancel update log [0x2000255c0:0x1:0x0].427: rc = 0 00000004:00080000:3.0:1786109360.392752:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab9177300 with version 749 00000020:00080000:3.0:1786109360.392755:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568653 cancel update log [0x240002ef8:0x1:0x0].309: rc = 0 00000020:00080000:3.0:1786109360.392772:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568653 cancel update log [0x2000255c0:0x1:0x0].428: rc = 0 00000004:00080000:3.0:1786109360.392790:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab9177b40 with version 750 00000020:00080000:3.0:1786109360.392793:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568654 cancel update log [0x240002ef8:0x1:0x0].310: rc = 0 00000020:00080000:3.0:1786109360.392812:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568654 cancel update log [0x2000255c0:0x1:0x0].430: rc = 0 00000004:00080000:3.0:1786109360.392831:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab9177900 with version 751 00000020:00080000:3.0:1786109360.392834:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568655 cancel update log [0x240002ef8:0x1:0x0].311: rc = 0 00000020:00080000:3.0:1786109360.392852:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568655 cancel update log [0x2000255c0:0x1:0x0].431: rc = 0 00000004:00080000:3.0:1786109360.392893:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d34c00 with version 752 00000020:00080000:3.0:1786109360.392896:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568656 cancel update log [0x240002ef8:0x1:0x0].312: rc = 0 00000020:00080000:3.0:1786109360.392919:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568656 cancel update log [0x2000255c0:0x1:0x0].432: rc = 0 00000004:00080000:3.0:1786109360.392937:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43780 with version 753 00000020:00080000:3.0:1786109360.392939:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568657 cancel update log [0x240002ef8:0x1:0x0].313: rc = 0 00000020:00080000:3.0:1786109360.392956:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568657 cancel update log [0x2000255c0:0x1:0x0].433: rc = 0 00000004:00080000:3.0:1786109360.392974:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e430c0 with version 754 00000020:00080000:3.0:1786109360.392977:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568658 cancel update log [0x240002ef8:0x1:0x0].314: rc = 0 00000020:00080000:3.0:1786109360.392995:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568658 cancel update log [0x2000255c0:0x1:0x0].434: rc = 0 00000004:00080000:3.0:1786109360.393012:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43d80 with version 755 00000020:00080000:3.0:1786109360.393015:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568659 cancel update log [0x240002ef8:0x1:0x0].315: rc = 0 00000020:00080000:3.0:1786109360.393034:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568659 cancel update log [0x2000255c0:0x1:0x0].435: rc = 0 00000004:00080000:3.0:1786109360.393052:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43180 with version 756 00000020:00080000:3.0:1786109360.393055:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568660 cancel update log [0x240002ef8:0x1:0x0].317: rc = 0 00000020:00080000:3.0:1786109360.393073:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568660 cancel update log [0x2000255c0:0x1:0x0].436: rc = 0 00000004:00080000:3.0:1786109360.393094:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43e40 with version 757 00000020:00080000:3.0:1786109360.393096:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568661 cancel update log [0x240002ef8:0x1:0x0].318: rc = 0 00000020:00080000:3.0:1786109360.393117:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568661 cancel update log [0x2000255c0:0x1:0x0].437: rc = 0 00000004:00080000:3.0:1786109360.393152:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43cc0 with version 758 00000020:00080000:3.0:1786109360.393155:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568662 cancel update log [0x240002ef8:0x1:0x0].319: rc = 0 00000020:00080000:3.0:1786109360.393172:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568662 cancel update log [0x2000255c0:0x1:0x0].438: rc = 0 00000004:00080000:3.0:1786109360.393191:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e439c0 with version 759 00000020:00080000:3.0:1786109360.393194:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568663 cancel update log [0x240002ef8:0x1:0x0].320: rc = 0 00000020:00080000:3.0:1786109360.393214:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568663 cancel update log [0x2000255c0:0x1:0x0].439: rc = 0 00000004:00080000:3.0:1786109360.393232:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43840 with version 760 00000020:00080000:3.0:1786109360.393235:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568664 cancel update log [0x240002ef8:0x1:0x0].321: rc = 0 00000020:00080000:3.0:1786109360.393253:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568664 cancel update log [0x2000255c0:0x1:0x0].440: rc = 0 00000004:00080000:3.0:1786109360.393273:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e43600 with version 761 00000020:00080000:3.0:1786109360.393276:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568665 cancel update log [0x240002ef8:0x1:0x0].322: rc = 0 00000020:00080000:3.0:1786109360.393295:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568665 cancel update log [0x2000255c0:0x1:0x0].441: rc = 0 00000004:00080000:3.0:1786109360.393313:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d34e40 with version 762 00000020:00080000:3.0:1786109360.393316:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568666 cancel update log [0x240002ef8:0x1:0x0].323: rc = 0 00000020:00080000:3.0:1786109360.393332:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568666 cancel update log [0x2000255c0:0x1:0x0].442: rc = 0 00000004:00080000:3.0:1786109360.393506:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098c0a59c0 with version 763 00000020:00080000:3.0:1786109360.393510:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568667 cancel update log [0x240002ef8:0x1:0x0].324: rc = 0 00000020:00080000:3.0:1786109360.393532:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568667 cancel update log [0x2000255c0:0x1:0x0].443: rc = 0 00000004:00080000:3.0:1786109360.393551:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098c0a5a80 with version 764 00000020:00080000:3.0:1786109360.393554:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568668 cancel update log [0x240002ef8:0x1:0x0].325: rc = 0 00000020:00080000:3.0:1786109360.393573:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568668 cancel update log [0x2000255c0:0x1:0x0].444: rc = 0 00000004:00080000:3.0:1786109360.393593:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098c0a5180 with version 765 00000020:00080000:3.0:1786109360.393597:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568669 cancel update log [0x240002ef8:0x1:0x0].326: rc = 0 00000020:00080000:3.0:1786109360.393618:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568669 cancel update log [0x2000255c0:0x1:0x0].445: rc = 0 00000004:00080000:3.0:1786109360.393637:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098c0a5c00 with version 766 00000020:00080000:3.0:1786109360.393640:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568670 cancel update log [0x240002ef8:0x1:0x0].327: rc = 0 00000020:00080000:3.0:1786109360.393657:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568670 cancel update log [0x2000255c0:0x1:0x0].446: rc = 0 00000004:00080000:3.0:1786109360.393679:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930987d34840 with version 767 00000020:00080000:3.0:1786109360.393682:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568671 cancel update log [0x240002ef8:0x1:0x0].328: rc = 0 00000020:00080000:3.0:1786109360.393701:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568671 cancel update log [0x2000255c0:0x1:0x0].447: rc = 0 00000004:00080000:3.0:1786109360.393719:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098ab95240 with version 768 00000020:00080000:3.0:1786109360.393722:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568672 cancel update log [0x240002ef8:0x1:0x0].329: rc = 0 00000020:00080000:3.0:1786109360.393740:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568672 cancel update log [0x2000255c0:0x1:0x0].448: rc = 0 00000004:00080000:3.0:1786109360.393758:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098ab95480 with version 769 00000020:00080000:3.0:1786109360.393761:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568673 cancel update log [0x240002ef8:0x1:0x0].330: rc = 0 00000020:00080000:3.0:1786109360.393778:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568673 cancel update log [0x2000255c0:0x1:0x0].449: rc = 0 00000004:00080000:3.0:1786109360.393801:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098ab95600 with version 770 00000020:00080000:3.0:1786109360.393804:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568674 cancel update log [0x240002ef8:0x1:0x0].331: rc = 0 00000020:00080000:3.0:1786109360.393821:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568674 cancel update log [0x2000255c0:0x1:0x0].450: rc = 0 00000004:00080000:3.0:1786109360.393837:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1ecc0 with version 771 00000020:00080000:3.0:1786109360.393841:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568675 cancel update log [0x240002ef8:0x1:0x0].332: rc = 0 00000020:00080000:3.0:1786109360.393858:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568675 cancel update log [0x2000255c0:0x1:0x0].451: rc = 0 00000004:00080000:3.0:1786109360.393875:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e3c0 with version 772 00000020:00080000:3.0:1786109360.393877:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568676 cancel update log [0x240002ef8:0x1:0x0].333: rc = 0 00000020:00080000:3.0:1786109360.393893:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568676 cancel update log [0x2000255c0:0x1:0x0].453: rc = 0 00000004:00080000:3.0:1786109360.393912:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e840 with version 773 00000020:00080000:3.0:1786109360.393916:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568677 cancel update log [0x240002ef8:0x1:0x0].334: rc = 0 00000020:00080000:3.0:1786109360.393933:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568677 cancel update log [0x2000255c0:0x1:0x0].454: rc = 0 00000004:00080000:3.0:1786109360.393953:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e480 with version 774 00000020:00080000:3.0:1786109360.393955:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568678 cancel update log [0x240002ef8:0x1:0x0].335: rc = 0 00000020:00080000:3.0:1786109360.393971:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568678 cancel update log [0x2000255c0:0x1:0x0].455: rc = 0 00000004:00080000:3.0:1786109360.393992:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e300 with version 775 00000020:00080000:3.0:1786109360.393995:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568679 cancel update log [0x240002ef8:0x1:0x0].336: rc = 0 00000020:00080000:3.0:1786109360.394013:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568679 cancel update log [0x2000255c0:0x1:0x0].456: rc = 0 00000004:00080000:3.0:1786109360.394031:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1e180 with version 776 00000020:00080000:3.0:1786109360.394033:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568680 cancel update log [0x240002ef8:0x1:0x0].338: rc = 0 00000020:00080000:3.0:1786109360.394051:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568680 cancel update log [0x2000255c0:0x1:0x0].457: rc = 0 00000004:00080000:3.0:1786109360.394071:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930984d1ec00 with version 777 00000020:00080000:3.0:1786109360.394074:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568681 cancel update log [0x240002ef8:0x1:0x0].339: rc = 0 00000020:00080000:3.0:1786109360.394092:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568681 cancel update log [0x2000255c0:0x1:0x0].458: rc = 0 00000004:00080000:3.0:1786109360.394112:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930982d1c480 with version 778 00000020:00080000:3.0:1786109360.394115:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568682 cancel update log [0x240002ef8:0x1:0x0].340: rc = 0 00000100:00100000:2.0:1786109360.394225:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933150464:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109360.394243:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 744 rpc_version 744 00000020:00100000:2.0:1786109360.394268:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109360.394276:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab9660e00 x1872862933150720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109360.394297:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933150720:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.394450:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109360.394502:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000020:00080000:3.0:1786109360.394675:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568682 cancel update log [0x2000255c0:0x1:0x0].459: rc = 0 00000004:00080000:3.0:1786109360.394701:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930982d1ca80 with version 779 00000020:00080000:3.0:1786109360.394705:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568683 cancel update log [0x240002ef8:0x1:0x0].341: rc = 0 00000100:00100000:1.0:1786109360.394710:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933150720 00000100:00100000:1.0:1786109360.394720:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933150720 00000020:00080000:3.0:1786109360.394723:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568683 cancel update log [0x2000255c0:0x1:0x0].460: rc = 0 00000004:00080000:3.0:1786109360.394746:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930982d1c000 with version 780 00000020:00080000:3.0:1786109360.394750:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568684 cancel update log [0x240002ef8:0x1:0x0].342: rc = 0 00000020:00080000:3.0:1786109360.394769:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568684 cancel update log [0x2000255c0:0x1:0x0].461: rc = 0 00000004:00080000:3.0:1786109360.394795:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930982d1c840 with version 781 00000020:00080000:3.0:1786109360.394798:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568685 cancel update log [0x240002ef8:0x1:0x0].343: rc = 0 00000020:00080000:3.0:1786109360.394817:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568685 cancel update log [0x2000255c0:0x1:0x0].462: rc = 0 00000004:00080000:3.0:1786109360.394837:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930982d1c300 with version 782 00000100:00100000:1.0:1786109360.394841:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12183 00000020:00080000:3.0:1786109360.394842:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568686 cancel update log [0x240002ef8:0x1:0x0].344: rc = 0 00000100:00100000:1.0:1786109360.394857:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933150720:12345-0@lo:1000:osp_up1-0.0 00000020:00080000:3.0:1786109360.394869:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568686 cancel update log [0x2000255c0:0x1:0x0].463: rc = 0 00000004:00080000:3.0:1786109360.394894:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a83969cc0 with version 783 00000020:00080000:3.0:1786109360.394897:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568687 cancel update log [0x240002ef8:0x1:0x0].345: rc = 0 00000020:00080000:3.0:1786109360.394921:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568687 cancel update log [0x2000255c0:0x1:0x0].464: rc = 0 00000004:00080000:3.0:1786109360.394943:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a83969480 with version 784 00000020:00080000:3.0:1786109360.394946:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568688 cancel update log [0x240002ef8:0x1:0x0].346: rc = 0 00000020:00080000:3.0:1786109360.394972:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568688 cancel update log [0x2000255c0:0x1:0x0].465: rc = 0 00000004:00080000:3.0:1786109360.395015:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a83969d80 with version 785 00000020:00080000:3.0:1786109360.395019:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568689 cancel update log [0x240002ef8:0x1:0x0].347: rc = 0 00000020:00080000:3.0:1786109360.395042:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568689 cancel update log [0x2000255c0:0x1:0x0].466: rc = 0 00000100:00100000:1.0:1786109360.395048:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933150720:12345-0@lo:1000:osp_up1-0.0 Request processed in 192us (594us total) trans 25769804518 rc 0/0 00000100:00100000:1.0:1786109360.395058:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12183 00000004:00080000:3.0:1786109360.395066:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a83969000 with version 786 00000020:00080000:3.0:1786109360.395071:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568690 cancel update log [0x240002ef8:0x1:0x0].348: rc = 0 00000100:00100000:2.0:1786109360.395156:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933150720:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109360.395166:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 745 rpc_version 745 00000020:00100000:2.0:1786109360.395182:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109360.395188:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab9663480 x1872862933150976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109360.395203:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9663480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933150976:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.395232:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1786109360.395305:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568690 cancel update log [0x2000255c0:0x1:0x0].467: rc = 0 00000020:00080000:3.0:1786109360.395312:0:187973:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 322122568690 00000100:00100000:2.0:1786109360.395427:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109360.395501:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933150976 00000100:00100000:1.0:1786109360.395506:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933150976 00000100:00100000:1.0:1786109360.395557:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12184 00000100:00100000:1.0:1786109360.395566:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933150976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109360.395667:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187949:x1872862933150976:12345-0@lo:1000:osp_up1-0.0 Request processed in 102us (434us total) trans 25769804519 rc 0/0 00000100:00100000:1.0:1786109360.395675:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12184 00000100:00100000:2.0:1786109360.395750:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9663480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933150976:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109360.395757:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 746 rpc_version 746 00000020:00100000:2.0:1786109360.395773:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109360.395778:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab9663100 x1872862933151232/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109360.395792:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9663100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933151232:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.395822:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109360.395848:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109360.396074:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933151232 00000100:00100000:0.0:1786109360.396079:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933151232 00000100:00100000:1.0:1786109360.396161:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12185 00000100:00100000:1.0:1786109360.396171:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:187949:x1872862933151232:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109360.396276:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187949:x1872862933151232:12345-0@lo:1000:osp_up1-0.0 Request processed in 107us (453us total) trans 25769804520 rc 0/0 00000100:00100000:1.0:1786109360.396285:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12185 00000100:00100000:2.0:1786109360.396491:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9663100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933151232:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109360.396501:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 747 rpc_version 747 00000020:00100000:2.0:1786109360.396518:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109360.396523:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930aa60a1500 x1872862933151488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109360.396538:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933151488:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.396568:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109360.396595:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109360.396684:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933151488 00000100:00100000:0.0:1786109360.396689:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933151488 00000100:00100000:0.0:1786109360.396726:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12186 00000100:00100000:0.0:1786109360.396734:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:187949:x1872862933151488:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109360.396840:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:187949:x1872862933151488:12345-0@lo:1000:osp_up1-0.0 Request processed in 106us (271us total) trans 25769804521 rc 0/0 00000100:00100000:0.0:1786109360.396847:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12186 00000100:00100000:2.0:1786109360.397185:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933151488:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109360.397194:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 748 rpc_version 748 00000020:00100000:2.0:1786109360.397210:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109360.397220:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930aa60a2300 x1872862933151744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109360.397236:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933151744:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.397266:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109360.397297:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109360.397350:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933151744 00000100:00100000:1.0:1786109360.397356:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933151744 00000100:00100000:1.0:1786109360.397393:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12187 00000100:00100000:1.0:1786109360.397400:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:187949:x1872862933151744:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109360.397628:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:187949:x1872862933151744:12345-0@lo:1000:osp_up1-0.0 Request processed in 227us (360us total) trans 25769804522 rc 0/0 00000100:00100000:1.0:1786109360.397637:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12187 00000100:00100000:2.0:1786109360.397710:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933151744:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109360.397718:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 749 rpc_version 749 00000020:00100000:2.0:1786109360.397733:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109360.397740:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930aa60a1880 x1872862933152000/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109360.397754:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933152000:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.397781:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109360.397840:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109360.397877:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933152000 00000100:00100000:0.0:1786109360.397882:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933152000 00000100:00100000:0.0:1786109360.397950:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12188 00000100:00100000:0.0:1786109360.397957:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:187949:x1872862933152000:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109360.398085:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:187949:x1872862933152000:12345-0@lo:1000:osp_up1-0.0 Request processed in 128us (301us total) trans 25769804523 rc 0/0 00000100:00100000:0.0:1786109360.398092:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12188 00000100:00100000:2.0:1786109360.398164:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933152000:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109360.398171:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 750 rpc_version 750 00000020:00100000:2.0:1786109360.398182:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109360.398188:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930aa60a1180 x1872862933152256/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109360.398201:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933152256:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.398226:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109360.398254:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109360.398299:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933152256 00000100:00100000:1.0:1786109360.398303:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933152256 00000100:00100000:1.0:1786109360.398337:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12189 00000100:00100000:1.0:1786109360.398345:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:187949:x1872862933152256:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109360.398426:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:187949:x1872862933152256:12345-0@lo:1000:osp_up1-0.0 Request processed in 82us (199us total) trans 25769804524 rc 0/0 00000100:00100000:1.0:1786109360.398457:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12189 00000100:00100000:3.0:1786109360.398484:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933152256:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.398493:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 751 rpc_version 751 00000020:00100000:3.0:1786109360.398508:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.398514:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab7c55500 x1872862933152512/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.398530:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933152512:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.398562:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.398588:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a83969b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109360.398642:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933152512 00000100:00100000:1.0:1786109360.398647:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933152512 00000100:00100000:1.0:1786109360.398676:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12190 00000100:00100000:1.0:1786109360.398682:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:187949:x1872862933152512:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109360.398758:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:187949:x1872862933152512:12345-0@lo:1000:osp_up1-0.0 Request processed in 75us (195us total) trans 25769804525 rc 0/0 00000100:00100000:1.0:1786109360.398764:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12190 00000100:00100000:3.0:1786109360.398801:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933152512:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.398810:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 752 rpc_version 752 00000020:00100000:3.0:1786109360.398823:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.398828:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab7c55f80 x1872862933152768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.398841:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933152768:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.398866:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.398951:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34600 going to sleep for 11 seconds 00000100:00100000:2.0:1786109360.398991:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933152768 00000100:00100000:2.0:1786109360.398995:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933152768 00000100:00100000:2.0:1786109360.399030:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12191 00000100:00100000:2.0:1786109360.399038:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+15:187949:x1872862933152768:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.399226:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187949:x1872862933152768:12345-0@lo:1000:osp_up1-0.0 Request processed in 189us (358us total) trans 25769804526 rc 0/0 00000100:00100000:2.0:1786109360.399235:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12191 00000100:00100000:3.0:1786109360.399295:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933152768:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.399302:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 753 rpc_version 753 00000020:00100000:3.0:1786109360.399317:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.399322:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab7c55180 x1872862933153024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.399335:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933153024:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.399376:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.399400:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a83969b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109360.399689:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933153024 00000100:00100000:1.0:1786109360.399694:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933153024 00000100:00100000:1.0:1786109360.399727:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12192 00000100:00100000:1.0:1786109360.399733:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+16:187949:x1872862933153024:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109360.399908:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:187949:x1872862933153024:12345-0@lo:1000:osp_up1-0.0 Request processed in 174us (531us total) trans 25769804527 rc 0/0 00000100:00100000:1.0:1786109360.399916:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12192 00000100:00100000:3.0:1786109360.399966:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933153024:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.399973:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 754 rpc_version 754 00000020:00100000:3.0:1786109360.399986:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.399991:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab7c54380 x1872862933153280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.400005:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933153280:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.400044:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.400091:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34600 going to sleep for 11 seconds 00000100:00100000:0.0:1786109360.400131:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933153280 00000100:00100000:0.0:1786109360.400135:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933153280 00000100:00100000:0.0:1786109360.400208:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12193 00000100:00100000:0.0:1786109360.400215:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+17:187949:x1872862933153280:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109360.400334:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187949:x1872862933153280:12345-0@lo:1000:osp_up1-0.0 Request processed in 119us (289us total) trans 25769804528 rc 0/0 00000100:00100000:0.0:1786109360.400340:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12193 00000100:00100000:3.0:1786109360.400409:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933153280:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.400417:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 755 rpc_version 755 00000020:00100000:3.0:1786109360.400513:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.400518:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a97c4dc00 x1872862933153536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.400532:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933153536:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.400560:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.400624:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a83969b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109360.400675:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933153536 00000100:00100000:0.0:1786109360.400680:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933153536 00000100:00100000:0.0:1786109360.400745:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12194 00000100:00100000:0.0:1786109360.400752:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+18:187949:x1872862933153536:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109360.400840:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187949:x1872862933153536:12345-0@lo:1000:osp_up1-0.0 Request processed in 88us (278us total) trans 25769804529 rc 0/0 00000100:00100000:0.0:1786109360.400846:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12194 00000100:00100000:3.0:1786109360.400903:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933153536:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.400910:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 756 rpc_version 756 00000020:00100000:3.0:1786109360.400922:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.400927:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a97c4df80 x1872862933153792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.400939:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933153792:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.400964:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.401049:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34600 going to sleep for 11 seconds 00000100:00100000:2.0:1786109360.401080:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933153792 00000100:00100000:2.0:1786109360.401084:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933153792 00000100:00100000:2.0:1786109360.401105:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12195 00000100:00100000:2.0:1786109360.401113:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:187949:x1872862933153792:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.401205:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187949:x1872862933153792:12345-0@lo:1000:osp_up1-0.0 Request processed in 93us (239us total) trans 25769804530 rc 0/0 00000100:00100000:2.0:1786109360.401216:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12195 00000100:00100000:3.0:1786109360.401355:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933153792:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.401362:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 757 rpc_version 757 00000020:00100000:3.0:1786109360.401374:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.401379:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a97c4e300 x1872862933154048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.401395:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933154048:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.401421:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.401505:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a83969b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109360.401546:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933154048 00000100:00100000:2.0:1786109360.401550:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933154048 00000100:00100000:2.0:1786109360.401614:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12196 00000100:00100000:2.0:1786109360.401622:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:187949:x1872862933154048:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.401743:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187949:x1872862933154048:12345-0@lo:1000:osp_up1-0.0 Request processed in 121us (320us total) trans 25769804531 rc 0/0 00000100:00100000:2.0:1786109360.401750:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12196 00000100:00100000:3.0:1786109360.401816:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4e300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933154048:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.401824:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 758 rpc_version 758 00000020:00100000:3.0:1786109360.401836:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.401841:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a97c4f800 x1872862933154304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.401854:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4f800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933154304:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.401883:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.401945:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d34600 going to sleep for 11 seconds 00000100:00100000:2.0:1786109360.401983:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933154304 00000100:00100000:2.0:1786109360.401987:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933154304 00000100:00100000:2.0:1786109360.402050:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12197 00000100:00100000:2.0:1786109360.402058:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+21:187949:x1872862933154304:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.402154:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187949:x1872862933154304:12345-0@lo:1000:osp_up1-0.0 Request processed in 96us (270us total) trans 25769804532 rc 0/0 00000100:00100000:2.0:1786109360.402159:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12197 00000100:00100000:0.0:1786109360.402226:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4f800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933154304:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786109360.402235:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 759 rpc_version 759 00000020:00100000:0.0:1786109360.402247:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109360.402251:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a8909a300 x1872862933154560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109360.402263:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933154560:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109360.402292:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109360.402398:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a812edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.402483:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933154560 00000100:00100000:3.0:1786109360.402487:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933154560 00000100:00100000:3.0:1786109360.402510:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12198 00000100:00100000:3.0:1786109360.402516:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+22:187949:x1872862933154560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.402608:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187949:x1872862933154560:12345-0@lo:1000:osp_up1-0.0 Request processed in 91us (314us total) trans 25769804533 rc 0/0 00000100:00100000:3.0:1786109360.402615:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12198 00000100:00100000:3.0:1786109360.402645:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933154560:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.402652:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 760 rpc_version 760 00000020:00100000:3.0:1786109360.402663:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.402668:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a97c4c000 x1872862933154816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.402679:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933154816:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.402709:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.402723:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81377180 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.402733:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933154816 00000100:00100000:3.0:1786109360.402736:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933154816 00000100:00100000:3.0:1786109360.402753:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12199 00000100:00100000:3.0:1786109360.402757:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+23:187949:x1872862933154816:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.402827:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187949:x1872862933154816:12345-0@lo:1000:osp_up1-0.0 Request processed in 68us (116us total) trans 25769804534 rc 0/0 00000100:00100000:3.0:1786109360.402834:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12199 00000100:00100000:3.0:1786109360.402862:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933154816:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.402869:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 761 rpc_version 761 00000020:00100000:3.0:1786109360.402881:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.402886:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac0fbb480 x1872862933155072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.402898:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933155072:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.402922:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.402935:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.402946:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933155072 00000100:00100000:3.0:1786109360.402949:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933155072 00000100:00100000:3.0:1786109360.402964:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12200 00000100:00100000:3.0:1786109360.402969:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+24:187949:x1872862933155072:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.403032:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187949:x1872862933155072:12345-0@lo:1000:osp_up1-0.0 Request processed in 63us (109us total) trans 25769804535 rc 0/0 00000100:00100000:3.0:1786109360.403040:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12200 00000100:00100000:3.0:1786109360.403066:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933155072:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.403073:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 762 rpc_version 762 00000020:00100000:3.0:1786109360.403084:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.403089:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac0fb9500 x1872862933155328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.403101:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933155328:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.403141:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.403156:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.403166:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933155328 00000100:00100000:3.0:1786109360.403169:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933155328 00000100:00100000:3.0:1786109360.403188:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12201 00000100:00100000:3.0:1786109360.403194:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+25:187949:x1872862933155328:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.403262:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187949:x1872862933155328:12345-0@lo:1000:osp_up1-0.0 Request processed in 67us (120us total) trans 25769804536 rc 0/0 00000100:00100000:3.0:1786109360.403269:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12201 00000100:00100000:3.0:1786109360.403296:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933155328:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.403303:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 763 rpc_version 763 00000020:00100000:3.0:1786109360.403314:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.403319:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab1d6aa00 x1872862933155584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.403330:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1d6aa00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933155584:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.403355:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.403369:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.403379:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933155584 00000100:00100000:3.0:1786109360.403382:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933155584 00000100:00100000:3.0:1786109360.403399:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12202 00000100:00100000:3.0:1786109360.403405:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+26:187949:x1872862933155584:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.403500:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187949:x1872862933155584:12345-0@lo:1000:osp_up1-0.0 Request processed in 94us (143us total) trans 25769804537 rc 0/0 00000100:00100000:3.0:1786109360.403507:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12202 00000100:00100000:3.0:1786109360.403535:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1d6aa00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933155584:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.403542:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 764 rpc_version 764 00000020:00100000:3.0:1786109360.403553:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.403557:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab1d69c00 x1872862933155840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.403570:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1d69c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933155840:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.403594:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.403608:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.403617:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933155840 00000100:00100000:3.0:1786109360.403621:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933155840 00000100:00100000:3.0:1786109360.403637:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12203 00000100:00100000:3.0:1786109360.403643:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+27:187949:x1872862933155840:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.403708:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:187949:x1872862933155840:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (113us total) trans 25769804538 rc 0/0 00000100:00100000:3.0:1786109360.403714:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12203 00000100:00100000:3.0:1786109360.403741:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1d69c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933155840:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.403747:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 765 rpc_version 765 00000020:00100000:3.0:1786109360.403758:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.403763:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab1d6b480 x1872862933156096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.403774:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1d6b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933156096:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.403798:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.403812:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.403823:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933156096 00000100:00100000:3.0:1786109360.403826:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933156096 00000100:00100000:3.0:1786109360.403843:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12204 00000100:00100000:3.0:1786109360.403848:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+28:187949:x1872862933156096:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.403913:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187949:x1872862933156096:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (113us total) trans 25769804539 rc 0/0 00000100:00100000:3.0:1786109360.403920:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12204 00000100:00100000:3.0:1786109360.403946:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1d6b480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933156096:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.403952:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 766 rpc_version 766 00000020:00100000:3.0:1786109360.403964:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.403969:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab1d6ad80 x1872862933156352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.403979:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1d6ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933156352:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.404002:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.404015:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.404025:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933156352 00000100:00100000:3.0:1786109360.404027:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933156352 00000100:00100000:3.0:1786109360.404044:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12205 00000100:00100000:3.0:1786109360.404049:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+29:187949:x1872862933156352:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.404115:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187949:x1872862933156352:12345-0@lo:1000:osp_up1-0.0 Request processed in 65us (112us total) trans 25769804540 rc 0/0 00000100:00100000:3.0:1786109360.404190:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12205 00000100:00100000:3.0:1786109360.404218:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1d6ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933156352:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.404225:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 767 rpc_version 767 00000020:00100000:3.0:1786109360.404236:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.404240:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab1d6bb80 x1872862933156608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.404252:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1d6bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933156608:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.404276:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.404289:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.404299:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933156608 00000100:00100000:3.0:1786109360.404301:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933156608 00000100:00100000:3.0:1786109360.404318:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12206 00000100:00100000:3.0:1786109360.404324:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+30:187949:x1872862933156608:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.404390:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187949:x1872862933156608:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (113us total) trans 25769804541 rc 0/0 00000100:00100000:3.0:1786109360.404396:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12206 00000100:00100000:3.0:1786109360.404421:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1d6bb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933156608:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.404428:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 768 rpc_version 768 00000020:00100000:3.0:1786109360.404457:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.404461:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab1d6b800 x1872862933156864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.404474:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1d6b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933156864:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.404499:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.404513:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.404523:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933156864 00000100:00100000:3.0:1786109360.404526:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933156864 00000100:00100000:3.0:1786109360.404542:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12207 00000100:00100000:3.0:1786109360.404547:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+31:187949:x1872862933156864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.404612:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187949:x1872862933156864:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (111us total) trans 25769804542 rc 0/0 00000100:00100000:3.0:1786109360.404618:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12207 00000100:00100000:3.0:1786109360.404646:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1d6b800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933156864:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.404653:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 769 rpc_version 769 00000020:00100000:3.0:1786109360.404668:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.404672:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac0bb1880 x1872862933157120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.404683:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb1880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933157120:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.404707:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.404720:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.404730:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933157120 00000100:00100000:3.0:1786109360.404733:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933157120 00000100:00100000:3.0:1786109360.404748:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12208 00000100:00100000:3.0:1786109360.404754:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+32:187949:x1872862933157120:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.404821:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:187949:x1872862933157120:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (112us total) trans 25769804543 rc 0/0 00000100:00100000:3.0:1786109360.404828:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12208 00000100:00100000:3.0:1786109360.404855:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb1880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933157120:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.404861:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 770 rpc_version 770 00000020:00100000:3.0:1786109360.404872:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.404877:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac0bb2300 x1872862933157376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.404888:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb2300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933157376:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.404912:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.404926:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.404936:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933157376 00000100:00100000:3.0:1786109360.404939:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933157376 00000100:00100000:3.0:1786109360.404956:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12209 00000100:00100000:3.0:1786109360.404961:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+33:187949:x1872862933157376:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.405026:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:187949:x1872862933157376:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (113us total) trans 25769804544 rc 0/0 00000100:00100000:3.0:1786109360.405032:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12209 00000100:00100000:3.0:1786109360.405058:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb2300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933157376:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.405066:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 771 rpc_version 771 00000020:00100000:3.0:1786109360.405077:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.405081:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac0bb1180 x1872862933157632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.405092:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb1180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933157632:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.405473:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.405531:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109360.405620:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933157632 00000100:00100000:0.0:1786109360.405626:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933157632 00000100:00100000:2.0:1786109360.405677:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12210 00000100:00100000:2.0:1786109360.405688:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+34:187949:x1872862933157632:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.405796:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:187949:x1872862933157632:12345-0@lo:1000:osp_up1-0.0 Request processed in 110us (676us total) trans 25769804545 rc 0/0 00000100:00100000:2.0:1786109360.405803:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12210 00000100:00100000:3.0:1786109360.405878:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb1180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933157632:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.405888:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 772 rpc_version 772 00000020:00100000:3.0:1786109360.405902:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.405907:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac0bb0e00 x1872862933157888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.405920:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933157888:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.405946:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.405973:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109360.406021:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933157888 00000100:00100000:2.0:1786109360.406025:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933157888 00000100:00100000:2.0:1786109360.406062:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12211 00000100:00100000:2.0:1786109360.406069:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+35:187949:x1872862933157888:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.406166:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:187949:x1872862933157888:12345-0@lo:1000:osp_up1-0.0 Request processed in 97us (218us total) trans 25769804546 rc 0/0 00000100:00100000:2.0:1786109360.406174:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12211 00000100:00100000:3.0:1786109360.406284:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933157888:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.406292:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 773 rpc_version 773 00000020:00100000:3.0:1786109360.406305:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.406310:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac0bb2d80 x1872862933158144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.406327:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933158144:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.406354:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.406379:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109360.406427:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933158144 00000100:00100000:2.0:1786109360.406451:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933158144 00000100:00100000:2.0:1786109360.406484:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12212 00000100:00100000:2.0:1786109360.406492:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+36:187949:x1872862933158144:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109360.406655:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:187949:x1872862933158144:12345-0@lo:1000:osp_up1-0.0 Request processed in 164us (299us total) trans 25769804547 rc 0/0 00000100:00100000:2.0:1786109360.406662:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12212 00000100:00100000:3.0:1786109360.406818:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb2d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933158144:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.406827:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 774 rpc_version 774 00000020:00100000:3.0:1786109360.406843:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.406849:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac17b9500 x1872862933158400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.406863:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17b9500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933158400:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.406889:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.406942:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109360.406977:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933158400 00000100:00100000:1.0:1786109360.406981:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933158400 00000100:00100000:1.0:1786109360.407048:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12213 00000100:00100000:1.0:1786109360.407057:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+37:187949:x1872862933158400:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109360.407207:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+38:187949:x1872862933158400:12345-0@lo:1000:osp_up1-0.0 Request processed in 151us (316us total) trans 25769804548 rc 0/0 00000100:00100000:1.0:1786109360.407214:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12213 00000100:00100000:3.0:1786109360.407291:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17b9500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933158400:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.407298:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 775 rpc_version 775 00000020:00100000:3.0:1786109360.407311:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.407316:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac17b8a80 x1872862933158656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.407329:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17b8a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933158656:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.407356:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.407384:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109360.407504:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933158656 00000100:00100000:0.0:1786109360.407509:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933158656 00000100:00100000:0.0:1786109360.407580:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12214 00000100:00100000:0.0:1786109360.407587:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+38:187949:x1872862933158656:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109360.407684:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:187949:x1872862933158656:12345-0@lo:1000:osp_up1-0.0 Request processed in 98us (327us total) trans 25769804549 rc 0/0 00000100:00100000:0.0:1786109360.407691:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12214 00000100:00100000:3.0:1786109360.407806:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17b8a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933158656:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.407813:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 776 rpc_version 776 00000020:00100000:3.0:1786109360.407826:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.407831:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac17bb480 x1872862933158912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.407847:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933158912:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.407873:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.407900:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109360.407948:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933158912 00000100:00100000:0.0:1786109360.407952:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933158912 00000100:00100000:0.0:1786109360.407985:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12215 00000100:00100000:0.0:1786109360.407991:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+39:187949:x1872862933158912:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109360.408077:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+40:187949:x1872862933158912:12345-0@lo:1000:osp_up1-0.0 Request processed in 85us (202us total) trans 25769804550 rc 0/0 00000100:00100000:0.0:1786109360.408083:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12215 00000100:00100000:3.0:1786109360.408160:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933158912:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.408168:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 777 rpc_version 777 00000020:00100000:3.0:1786109360.408183:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.408188:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac17bad80 x1872862933159168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.408199:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933159168:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.408225:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.408247:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109360.408298:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933159168 00000100:00100000:1.0:1786109360.408303:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933159168 00000100:00100000:1.0:1786109360.408336:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12216 00000100:00100000:1.0:1786109360.408343:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+40:187949:x1872862933159168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109360.408415:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:187949:x1872862933159168:12345-0@lo:1000:osp_up1-0.0 Request processed in 72us (187us total) trans 25769804551 rc 0/0 00000100:00100000:1.0:1786109360.408425:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12216 00000100:00100000:3.0:1786109360.408554:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933159168:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.408562:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 778 rpc_version 778 00000020:00100000:3.0:1786109360.408574:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.408579:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac17b9180 x1872862933159424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.408591:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17b9180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933159424:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.408616:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.408642:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109360.408689:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933159424 00000100:00100000:1.0:1786109360.408694:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933159424 00000100:00100000:1.0:1786109360.408726:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12217 00000100:00100000:1.0:1786109360.408733:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+41:187949:x1872862933159424:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109360.408814:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+42:187949:x1872862933159424:12345-0@lo:1000:osp_up1-0.0 Request processed in 81us (196us total) trans 25769804552 rc 0/0 00000100:00100000:1.0:1786109360.408820:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12217 00000100:00100000:3.0:1786109360.408891:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17b9180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933159424:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.408898:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 779 rpc_version 779 00000020:00100000:3.0:1786109360.408910:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.408915:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac17b8000 x1872862933159680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.408931:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17b8000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933159680:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.408960:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.408981:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109360.409027:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933159680 00000100:00100000:1.0:1786109360.409031:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933159680 00000100:00100000:1.0:1786109360.409129:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12218 00000100:00100000:1.0:1786109360.409137:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+42:187949:x1872862933159680:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109360.409213:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+43:187949:x1872862933159680:12345-0@lo:1000:osp_up1-0.0 Request processed in 77us (252us total) trans 25769804553 rc 0/0 00000100:00100000:1.0:1786109360.409219:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12218 00000100:00100000:3.0:1786109360.409266:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17b8000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933159680:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.409273:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 780 rpc_version 780 00000020:00100000:3.0:1786109360.409285:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.409289:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f56d80 x1872862933159936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.409302:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f56d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933159936:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.409330:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.409344:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.409356:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933159936 00000100:00100000:3.0:1786109360.409359:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933159936 00000100:00100000:3.0:1786109360.409377:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12219 00000100:00100000:3.0:1786109360.409383:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+43:187949:x1872862933159936:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.409483:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+44:187949:x1872862933159936:12345-0@lo:1000:osp_up1-0.0 Request processed in 99us (152us total) trans 25769804554 rc 0/0 00000100:00100000:3.0:1786109360.409489:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12219 00000100:00100000:3.0:1786109360.409519:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f56d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933159936:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.409525:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 781 rpc_version 781 00000020:00100000:3.0:1786109360.409537:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.409542:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f55500 x1872862933160192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.409552:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f55500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933160192:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.409580:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.409594:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.409604:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933160192 00000100:00100000:3.0:1786109360.409607:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933160192 00000100:00100000:3.0:1786109360.409624:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12220 00000100:00100000:3.0:1786109360.409629:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+44:187949:x1872862933160192:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.409697:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+45:187949:x1872862933160192:12345-0@lo:1000:osp_up1-0.0 Request processed in 67us (115us total) trans 25769804555 rc 0/0 00000100:00100000:3.0:1786109360.409704:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12220 00000100:00100000:3.0:1786109360.409733:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f55500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933160192:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.409740:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 782 rpc_version 782 00000020:00100000:3.0:1786109360.409762:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.409767:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f54a80 x1872862933160448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.409779:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933160448:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.409804:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.409817:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.409827:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933160448 00000100:00100000:3.0:1786109360.409830:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933160448 00000100:00100000:3.0:1786109360.409847:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12221 00000100:00100000:3.0:1786109360.409854:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+45:187949:x1872862933160448:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.409917:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+46:187949:x1872862933160448:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (113us total) trans 25769804556 rc 0/0 00000100:00100000:3.0:1786109360.409923:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12221 00000100:00100000:3.0:1786109360.409951:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933160448:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.409957:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 783 rpc_version 783 00000020:00100000:3.0:1786109360.409968:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.409972:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f56a00 x1872862933160704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.409982:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f56a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933160704:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.410005:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.410017:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.410028:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933160704 00000100:00100000:3.0:1786109360.410032:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933160704 00000100:00100000:3.0:1786109360.410047:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12222 00000100:00100000:3.0:1786109360.410052:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+46:187949:x1872862933160704:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.410133:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+47:187949:x1872862933160704:12345-0@lo:1000:osp_up1-0.0 Request processed in 64us (111us total) trans 25769804557 rc 0/0 00000100:00100000:3.0:1786109360.410140:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12222 00000100:00100000:3.0:1786109360.410169:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f56a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933160704:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.410175:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 784 rpc_version 784 00000020:00100000:3.0:1786109360.410186:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.410191:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f55880 x1872862933160960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.410204:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933160960:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.410226:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.410240:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.410250:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933160960 00000100:00100000:3.0:1786109360.410253:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933160960 00000100:00100000:3.0:1786109360.410268:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12223 00000100:00100000:3.0:1786109360.410273:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+47:187949:x1872862933160960:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.410336:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+48:187949:x1872862933160960:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (108us total) trans 25769804558 rc 0/0 00000100:00100000:3.0:1786109360.410343:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12223 00000100:00100000:3.0:1786109360.410370:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933160960:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.410376:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 785 rpc_version 785 00000020:00100000:3.0:1786109360.410386:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.410391:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f54e00 x1872862933161216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.410404:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933161216:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.410458:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.410474:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.410484:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933161216 00000100:00100000:3.0:1786109360.410487:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933161216 00000100:00100000:3.0:1786109360.410504:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12224 00000100:00100000:3.0:1786109360.410511:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+48:187949:x1872862933161216:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.410576:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+49:187949:x1872862933161216:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (145us total) trans 25769804559 rc 0/0 00000100:00100000:3.0:1786109360.410583:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12224 00000100:00100000:3.0:1786109360.410610:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933161216:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786109360.410617:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 786 rpc_version 786 00000020:00100000:3.0:1786109360.410628:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109360.410632:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f57480 x1872862933161472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109360.410643:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f57480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933161472:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.410672:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.410684:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a92ff1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109360.410694:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933161472 00000100:00100000:3.0:1786109360.410697:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933161472 00000100:00100000:3.0:1786109360.410713:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12225 00000100:00100000:3.0:1786109360.410718:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab5396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+49:187949:x1872862933161472:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109360.410780:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab5396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+50:187949:x1872862933161472:12345-0@lo:1000:osp_up1-0.0 Request processed in 61us (106us total) trans 25769804560 rc 0/0 00000100:00100000:3.0:1786109360.410786:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12225 00000100:00100000:3.0:1786109360.411011:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f57480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933161472:0@lo:1000:osp_up1-0.0 00000001:02000400:3.0:1786109360.778208:0:189155:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 73a: open(O_CREAT), unlink, replay, reconnect before open replay, close ========================================================== 09:29:18 (1786109358) 00000100:00100000:3.0:1786109360.902156:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109360.902186:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933161600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109360.902284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109360.902425:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933161600 00000100:00100000:3.0:1786109360.902452:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933161600 00000100:00100000:3.0:1786109360.902522:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5709 00000100:00100000:3.0:1786109360.902534:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933161600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109360.902571:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109360.902624:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933161600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109360.902631:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5709 00000100:00100000:3.0:1786109360.902772:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933161600:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1786109360.902877:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109360.904140:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109360.910562:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933161728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109360.910664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109360.913415:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933161728 00000100:00100000:0.0:1786109360.913648:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933161728 00000100:00100000:1.0:1786109360.918183:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5710 00000100:00100000:1.0:1786109360.918203:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933161728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109360.918248:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00080000:3.0:1786109360.918453:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109360.918535:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933161728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 337us (7870us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109360.918544:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5710 00000100:00100000:1.0:1786109360.918616:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933161728:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1786109361.031585:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109361.058010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109361.058870:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922065408 00000100:00100000:1.0:1786109361.058887:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922065408 00000100:00100000:1.0:1786109361.059098:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 853 00000100:00100000:1.0:1786109361.059112:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+9:158506:x1872862922065408:12345-192.168.203.38@tcp:101:multiop.0 00000100:00080000:3.0:1786109361.060491:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786109361.060737:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109361.060741:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786109361.060784:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9309825f2200/0xdb52b77d7ca32dc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc49f5b9 expref: 9 pid: 187976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.060830:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a9a33ee00) 00010000:00010000:1.0:1786109361.060844:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109361.060871:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca361ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1491 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.073963:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.073993:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.074007:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.074027:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca361fa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.074033:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca361fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.074040:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca361fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109361.076273:0:187901:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x1834:0x0], count =46 00000004:00080000:2.0:1786109361.076291:0:187901:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x1834:0x0]+46 in llog 00000004:00080000:2.0:1786109361.076316:0:187901:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1862:0x0], index 1: 0 00010000:00010000:2.0:1786109361.076623:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca36201 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076642:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca36201 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076656:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca36201 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076701:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076707:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361f3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076715:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076721:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109361.076726:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076733:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361f3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076746:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab7f80b00) 00010000:00010000:2.0:1786109361.076749:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109361.076754:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361f3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076760:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76c00/0xdb52b77d7ca361f3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109361.076782:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000561158db reply state 00000000af081c99 transno 326417514628 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca361fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076794:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca361fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076800:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff930984516500) 00010000:00010000:2.0:1786109361.076802:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109361.076805:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109361.076850:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca361ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1491 expref: 11 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076873:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca36201 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1491 expref: 10 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.076882:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de0:0x0].0x0 (ffff930984516300) 00010000:00010000:2.0:1786109361.076884:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786109361.076886:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76000, rc 0) 00000100:00100000:2.0:1786109361.076982:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+11:158506:x1872862922065408:12345-192.168.203.38@tcp:101:multiop.0 Request processed in 17873us (18986us total) trans 326417514628 rc 0/0 00000100:00100000:2.0:1786109361.076993:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 853 00000100:00100000:2.0:1786109361.201425:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109361.201505:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109361.201547:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109361.201587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109361.201668:0:187890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922065536 00000100:00100000:0.0:1786109361.201683:0:187890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922065536 00000100:00100000:0.0:1786109361.201755:0:187890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:0.0:1786109361.201766:0:187890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2405:x1872862922065536:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109361.201858:0:187890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2405:x1872862922065536:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 93us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109361.201865:0:187890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:0.0:1786109361.201906:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922065792 00000100:00100000:0.0:1786109361.201909:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922065792 00000100:00100000:0.0:1786109361.201951:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922065920 00000100:00100000:0.0:1786109361.201955:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922065920 00000100:00100000:0.0:1786109361.201981:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6814 00000100:00100000:0.0:1786109361.201988:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+5:2405:x1872862922065792:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109361.202018:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+5:2405:x1872862922065792:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109361.202024:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6814 00000100:00100000:0.0:1786109361.202035:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6815 00000100:00100000:0.0:1786109361.202040:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+5:2405:x1872862922065920:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109361.202063:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+5:2405:x1872862922065920:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109361.202069:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6815 00000100:00080000:0.0:1786109361.202089:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109361.202093:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109361.202500:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922065664 00000100:00100000:1.0:1786109361.202505:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922065664 00000100:00100000:1.0:1786109361.202561:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1786109361.202569:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922065664:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109361.202618:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922065664:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 51us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109361.202626:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00080000:0.0:1786109361.203177:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109361.229201:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109361.229371:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922066048 00000100:00100000:0.0:1786109361.229385:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922066048 00000100:00100000:0.0:1786109361.229575:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 854 00000100:00100000:0.0:1786109361.229588:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+11:158513:x1872862922066048:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1786109361.229636:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109361.229667:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3600/0xdb52b77d7ca3620f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1498 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109361.229759:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36216 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109361.229776:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109361.229790:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109361.229858:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:0.0:1786109361.229919:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109361.229949:0:187899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109361.229980:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3600/0xdb52b77d7ca3620f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1498 expref: 13 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109361.230001:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36216 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1498 expref: 12 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109361.230011:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a83abd500) 00010000:00010000:0.0:1786109361.230014:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109361.230017:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3200, rc 0) 00000100:00100000:0.0:1786109361.230183:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+12:158513:x1872862922066048:12345-192.168.203.38@tcp:101:rm.0 Request processed in 597us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109361.230193:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 854 00000100:00100000:3.0:1786109361.244667:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109361.244914:0:179241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922066176 00000100:00100000:2.0:1786109361.244927:0:179241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922066176 00000100:00100000:2.0:1786109361.244994:0:179241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23059 00000100:00100000:2.0:1786109361.245005:0:179241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922066176:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1786109361.245027:0:179241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109361.245052:0:179241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce653669/0xdb52b77d7ca3621d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a149f expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786109361.245084:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1862:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109361.245108:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1862:0x0].0x0 since=8217s v=(0 0) 00010000:00010000:2.0:1786109361.245488:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1862:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109361.245504:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce653669/0xdb52b77d7ca3621d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a149f expref: 6 pid: 179241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.245530:0:179241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce653669/0xdb52b77d7ca3621d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a149f expref: 6 pid: 179241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109361.245547:0:179241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77400, rc 0) 00000100:00100000:2.0:1786109361.246308:0:179241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922066176:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1296us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109361.246319:0:179241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23059 00000100:00100000:2.0:1786109361.264338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109361.264427:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922066432 00000100:00100000:1.0:1786109361.264483:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922066432 00000100:00100000:1.0:1786109361.264552:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 855 00000100:00100000:1.0:1786109361.264564:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+12:158513:x1872862922066432:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109361.264697:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1786109361.264733:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca36201 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1491 expref: 12 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.264757:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de0:0x0].0x0 (ffff930984516300) 00010000:00010000:1.0:1786109361.264779:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca36216 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1498 expref: 11 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.264790:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a83abd500) 00010000:00010000:1.0:1786109361.264797:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109361.264830:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36224 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.264845:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36224 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.264856:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36224 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.264871:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca3622b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.264879:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca3622b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.264885:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca3622b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265002:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca36232 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265011:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca36232 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265020:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca36232 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109361.265322:0:188678:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x20001a9e3:0x1de0:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1786109361.265420:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca36232 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265526:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca36232 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265536:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca36232 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265543:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109361.265548:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca36232 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265557:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca36232 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265567:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de0:0x0].0x0 (ffff930ab7f80500) 00010000:00010000:1.0:1786109361.265570:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109361.265574:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca36232 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265580:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca36232 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265733:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36224 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265743:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36224 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265749:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36224 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265754:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acfe00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109361.265757:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36224 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265763:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36224 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265771:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab7f80300) 00010000:00010000:1.0:1786109361.265774:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109361.265777:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36224 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.265783:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36224 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109361.265796:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4b394f4 reply state 00000000993a4f1a transno 326417514629 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca3622b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.266282:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca3622b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109361.266289:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff930984516500) 00010000:00010000:1.0:1786109361.266291:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109361.266296:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109361.266468:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+12:158513:x1872862922066432:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1902us (2360us total) trans 326417514629 rc 0/0 00000100:00100000:1.0:1786109361.266477:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 855 00010000:00010000:3.0:1786109362.052887:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786109362.399513:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804560 is committed 00000001:00080000:2.0:1786109362.400147:0:187883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 326417514629 is committed 00010000:00010000:1.0:1786109362.400181:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca361fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.400196:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca361fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.400203:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca361fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.400210:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109362.400215:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca361fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.400222:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca361fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1786109362.400229:0:187883:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 322122568692 batchid updated 00010000:00010000:1.0:1786109362.400244:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff930984516500) 00010000:00010000:1.0:1786109362.400248:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109362.400259:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca361fa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.400266:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca361fa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1786109362.400282:0:187973:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 322122568692 00010000:00010000:1.0:1786109362.400287:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca3622b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.400292:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca3622b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.400301:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca3622b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.400306:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109362.400308:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca3622b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.400314:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca3622b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.400321:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff930984516500) 00010000:00010000:1.0:1786109362.400323:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109362.400326:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca3622b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.400332:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca3622b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109362.400528:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a812edd80 with version 787 00000020:00080000:0.0:1786109362.400552:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568691 cancel update log [0x240002ef8:0x1:0x0].349: rc = 0 00000004:00080000:1.0:1786109362.400576:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 787 rpc_version 787 00000020:00100000:1.0:1786109362.400620:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109362.400635:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d898000 x1872862933161984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109362.400666:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933161984:0@lo:1000:osp_up1-0.0 00000020:00080000:0.0:1786109362.400724:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568691 cancel update log [0x2000255c0:0x1:0x0].468: rc = 0 00000004:00080000:0.0:1786109362.400749:0:187973:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930a92ff1b40 with version 788 00000020:00080000:0.0:1786109362.400753:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 322122568692 cancel update log [0x240002ef8:0x1:0x0].350: rc = 0 00000020:00080000:0.0:1786109362.400772:0:187973:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 322122568692 cancel update log [0x2000255c0:0x1:0x0].469: rc = 0 00000020:00080000:0.0:1786109362.400778:0:187973:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 322122568692 00000100:00100000:1.0:1786109362.402489:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109362.402582:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933161984 00000100:00100000:3.0:1786109362.403488:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933161984 00000100:00100000:3.0:1786109362.403598:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12226 00000100:00100000:3.0:1786109362.403611:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187949:x1872862933161984:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109362.403867:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933161984:12345-0@lo:1000:osp_up1-0.0 Request processed in 259us (1394us total) trans 25769804561 rc 0/0 00000100:00100000:3.0:1786109362.403876:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12226 00000100:00100000:0.0:1786109362.430503:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab2d546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109362.430544:0:187949:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804560 gen 2 00000004:00080000:0.0:1786109362.430549:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804517 committed transno 25769804560 00000004:00080000:0.0:1786109362.430569:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804518 committed transno 25769804560 00000004:00080000:0.0:1786109362.430575:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804519 committed transno 25769804560 00000004:00080000:0.0:1786109362.430582:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804520 committed transno 25769804560 00000004:00080000:0.0:1786109362.430590:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804521 committed transno 25769804560 00000004:00080000:0.0:1786109362.430597:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804522 committed transno 25769804560 00000004:00080000:0.0:1786109362.430604:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804523 committed transno 25769804560 00000004:00080000:0.0:1786109362.430609:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804524 committed transno 25769804560 00000004:00080000:0.0:1786109362.430616:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804525 committed transno 25769804560 00000004:00080000:0.0:1786109362.430624:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804526 committed transno 25769804560 00000004:00080000:0.0:1786109362.430632:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804527 committed transno 25769804560 00000004:00080000:0.0:1786109362.430640:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804528 committed transno 25769804560 00000004:00080000:0.0:1786109362.430650:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804529 committed transno 25769804560 00000004:00080000:0.0:1786109362.430660:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804530 committed transno 25769804560 00000004:00080000:0.0:1786109362.430669:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804531 committed transno 25769804560 00000004:00080000:0.0:1786109362.430675:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804532 committed transno 25769804560 00000004:00080000:0.0:1786109362.430681:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804533 committed transno 25769804560 00000004:00080000:0.0:1786109362.430689:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804534 committed transno 25769804560 00000004:00080000:0.0:1786109362.430697:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804535 committed transno 25769804560 00000004:00080000:0.0:1786109362.430703:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804536 committed transno 25769804560 00000004:00080000:0.0:1786109362.430710:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804537 committed transno 25769804560 00000004:00080000:0.0:1786109362.430717:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804538 committed transno 25769804560 00000004:00080000:0.0:1786109362.430724:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804539 committed transno 25769804560 00000004:00080000:0.0:1786109362.430731:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804540 committed transno 25769804560 00000004:00080000:0.0:1786109362.430737:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804541 committed transno 25769804560 00000004:00080000:0.0:1786109362.430746:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804542 committed transno 25769804560 00000004:00080000:0.0:1786109362.430754:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804543 committed transno 25769804560 00000004:00080000:0.0:1786109362.430761:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804544 committed transno 25769804560 00000004:00080000:0.0:1786109362.430768:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804545 committed transno 25769804560 00000004:00080000:0.0:1786109362.430774:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804546 committed transno 25769804560 00000004:00080000:0.0:1786109362.430780:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804547 committed transno 25769804560 00000004:00080000:0.0:1786109362.430788:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804548 committed transno 25769804560 00000004:00080000:0.0:1786109362.430800:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804549 committed transno 25769804560 00000004:00080000:0.0:1786109362.430807:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804550 committed transno 25769804560 00000004:00080000:0.0:1786109362.430815:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804551 committed transno 25769804560 00000004:00080000:0.0:1786109362.430825:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804552 committed transno 25769804560 00000004:00080000:0.0:1786109362.430832:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804553 committed transno 25769804560 00000004:00080000:0.0:1786109362.430839:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804554 committed transno 25769804560 00000004:00080000:0.0:1786109362.430856:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804555 committed transno 25769804560 00000004:00080000:0.0:1786109362.430864:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804556 committed transno 25769804560 00000004:00080000:0.0:1786109362.430871:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804557 committed transno 25769804560 00000004:00080000:0.0:1786109362.430883:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804558 committed transno 25769804560 00000004:00080000:0.0:1786109362.430907:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804559 committed transno 25769804560 00000004:00080000:0.0:1786109362.430916:0:187949:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804560 committed transno 25769804560 00000100:00100000:0.0:1786109362.430929:0:187949:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff93098d898000 x1872862933161984/t25769804561(25769804561) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1786109378 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109362.430950:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933161984:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786109362.430962:0:187949:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a89d70c00 version 788 rpc_version 788 00000020:00100000:0.0:1786109362.430987:0:187949:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109362.431013:0:187949:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a8909a300 x1872862933162240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109362.431039:0:187949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933162240:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786109362.431118:0:187949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109362.431163:0:187949:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109362.431235:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933162240 00000100:00100000:1.0:1786109362.431246:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933162240 00000100:00100000:1.0:1786109362.431311:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12227 00000100:00100000:1.0:1786109362.431321:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:187949:x1872862933162240:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109362.431484:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:187949:x1872862933162240:12345-0@lo:1000:osp_up1-0.0 Request processed in 165us (377us total) trans 25769804562 rc 0/0 00000100:00100000:1.0:1786109362.431491:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12227 00000100:00100000:0.0:1786109362.431563:0:187949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:187949:1872862933162240:0@lo:1000:osp_up1-0.0 00000001:00080000:0.0:1786109362.437553:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804562 is committed 00000100:00100000:2.0:1786109362.495603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109362.495681:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922066560 00000100:00100000:1.0:1786109362.495691:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922066560 00000100:00100000:1.0:1786109362.495753:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 856 00000100:00100000:1.0:1786109362.495765:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+8:158526:x1872862922066560:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109362.495787:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109362.495806:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca36239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14a6 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.495873:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36240 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.495887:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.495898:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109362.495943:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:1.0:1786109362.495947:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786109362.495967:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36240 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.495992:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf000/0xdb52b77d7ca36239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14a6 expref: 10 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.496007:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36240 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14a6 expref: 9 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.496017:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab7f80300) 00010000:00010000:1.0:1786109362.496020:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109362.496024:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0ace800, rc 0) 00000100:00100000:1.0:1786109362.496147:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+9:158526:x1872862922066560:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 384us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109362.496155:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 856 00000100:00100000:0.0:1786109362.503941:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109362.504016:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922066688 00000100:00100000:2.0:1786109362.504029:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922066688 00000100:00100000:2.0:1786109362.505042:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 857 00000100:00100000:2.0:1786109362.505058:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+9:158526:x1872862922066688:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1786109362.505098:0:187900:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00000100:00100000:2.0:1786109362.505190:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+9:158526:x1872862922066688:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 136us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109362.505199:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 857 00000100:00100000:3.0:1786109362.513838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109362.513910:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922066816 00000100:00100000:2.0:1786109362.513922:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922066816 00000100:00100000:2.0:1786109362.513992:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 858 00000100:00100000:2.0:1786109362.514001:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:158526:x1872862922066816:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1786109362.514034:0:187899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1786109362.514119:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:158526:x1872862922066816:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 118us (2351us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109362.514126:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 858 00000100:00100000:3.0:1786109362.521399:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109362.522194:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922066944 00000100:00100000:0.0:1786109362.522207:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922066944 00000100:00100000:0.0:1786109362.522262:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5711 00000100:00100000:0.0:1786109362.522272:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+5:158526:x1872862922066944:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:0.0:1786109362.522304:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109362.522375:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+5:158526:x1872862922066944:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 104us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109362.522382:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5711 00000100:00100000:0.0:1786109362.622573:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109362.623125:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922067072 00000100:00100000:1.0:1786109362.623140:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922067072 00000100:00100000:1.0:1786109362.623213:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5712 00000100:00100000:1.0:1786109362.623225:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:158526:x1872862922067072:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109362.623269:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109362.625172:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:158526:x1872862922067072:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 1934us (2598us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109362.625189:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5712 00000100:00100000:1.0:1786109362.758593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109362.760476:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922067328 00000100:00100000:0.0:1786109362.760492:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922067328 00000100:00100000:0.0:1786109362.760570:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 859 00000100:00100000:0.0:1786109362.760593:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+9:158533:x1872862922067328:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00010000:0.0:1786109362.760666:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109362.761411:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36240 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14a6 expref: 9 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.761456:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab7f80300) 00010000:00010000:0.0:1786109362.761472:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109362.761566:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36247 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.761644:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36247 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.761657:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36247 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.761672:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3624e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.761680:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3624e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.761687:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3624e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.762317:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36247 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.762341:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36247 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.762348:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36247 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.762357:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109362.762363:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36247 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.762370:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36247 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.762381:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a83abd200) 00010000:00010000:0.0:1786109362.762383:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109362.762387:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36247 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.762393:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36247 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109362.762408:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e495bd3 reply state 0000000072dfef75 transno 326417514630 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3624e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.762420:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3624e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.762427:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a83abd800) 00010000:00010000:0.0:1786109362.762460:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109362.762463:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109362.762602:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+10:158533:x1872862922067328:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 2009us (4029us total) trans 326417514630 rc 0/0 00000100:00100000:0.0:1786109362.762611:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 859 00000100:00100000:3.0:1786109362.797125:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109362.797242:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922067456 00000100:00100000:2.0:1786109362.797255:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922067456 00000100:00100000:2.0:1786109362.803810:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 860 00000100:00100000:2.0:1786109362.803834:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+10:158536:x1872862922067456:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1786109362.803997:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109362.804029:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca36255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14ad expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.804123:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3625c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.804141:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3625c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.804161:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3625c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109362.804218:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:2.0:1786109362.804224:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109362.804251:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3625c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.804283:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76a00/0xdb52b77d7ca36255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14ad expref: 12 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.804304:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3625c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14ad expref: 11 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.804314:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0dddc00) 00010000:00010000:2.0:1786109362.804318:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109362.804323:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76200, rc 0) 00000100:00100000:2.0:1786109362.804407:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+11:158536:x1872862922067456:12345-192.168.203.38@tcp:101:rm.0 Request processed in 582us (7305us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109362.804415:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 860 00000100:00100000:0.0:1786109362.812008:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109362.812085:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922067584 00000100:00100000:1.0:1786109362.812097:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922067584 00000100:00100000:1.0:1786109362.812178:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 861 00000100:00100000:1.0:1786109362.812190:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+11:158536:x1872862922067584:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:1.0:1786109362.812216:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109362.812240:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace200/0xdb52b77d7ca36263 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14b4 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.812319:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca3626a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.812353:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca3626a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.812366:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca3626a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.812379:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca36271 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.812386:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca36271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.812393:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca36271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.812531:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca36278 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.812541:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca36278 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.812548:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca36278 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109362.813052:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1de1:0x0]: returning size 0 00000004:00200000:1.0:1786109362.813058:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786109362.813081:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca36278 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813096:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca36278 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813120:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca3626a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813128:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca3626a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813135:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca3626a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813142:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acee00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109362.813147:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca3626a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813156:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca3626a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813170:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0dddc00) 00010000:00010000:1.0:1786109362.813174:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109362.813179:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca3626a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813185:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acee00/0xdb52b77d7ca3626a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813198:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca36271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813204:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca36271 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813210:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca36271 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813215:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0ace400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109362.813218:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca36271 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813224:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca36271 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813231:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a83abd800) 00010000:00010000:1.0:1786109362.813233:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109362.813235:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca36271 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813241:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca36271 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813271:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace200/0xdb52b77d7ca36263 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14b4 expref: 13 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813286:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca36278 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14b4 expref: 12 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109362.813294:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de1:0x0].0x0 (ffff930ab7f80500) 00010000:00010000:1.0:1786109362.813296:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786109362.813299:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0ace600, rc 0) 00000100:00100000:1.0:1786109362.813503:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+12:158536:x1872862922067584:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1314us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109362.813512:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 861 00000100:00100000:0.0:1786109362.819781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109362.820094:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922067840 00000100:00100000:2.0:1786109362.820126:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922067840 00000100:00100000:2.0:1786109362.820254:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 862 00000100:00100000:2.0:1786109362.820267:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+12:158536:x1872862922067840:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109362.820385:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786109362.820507:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace600/0xdb52b77d7ca36278 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14b4 expref: 12 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.820540:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de1:0x0].0x0 (ffff930ab7f80500) 00010000:00010000:2.0:1786109362.820562:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76200/0xdb52b77d7ca3625c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14ad expref: 11 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.820572:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0dddc00) 00010000:00010000:2.0:1786109362.821539:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109362.821661:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3627f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.821689:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3627f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.821704:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3627f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.821725:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca36286 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.821734:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca36286 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.821741:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca36286 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.822181:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca3628d lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.822201:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca3628d lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.822214:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca3628d lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.825193:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca36294 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.825269:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca36294 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.825284:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca36294 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.825303:0:187901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca36294 lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.825311:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca36294 lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.825317:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca36294 lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.825356:0:187901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109362.825403:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca3628d lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.825411:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca3628d lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.825417:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca3628d lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.825424:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109362.825560:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109362.825569:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca36294 lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.825661:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109362.825678:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca36294 lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.825688:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca36294 lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.825704:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de1:0x0].0x0 (ffff930aa0ddd900) 00010000:00010000:0.0:1786109362.825721:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109362.825727:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca36294 lrc: 1/0,0 mode: --/PW res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.825733:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77a00/0xdb52b77d7ca36294 lrc: 0/0,0 mode: --/PW res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109362.825752:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109362.825754:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109362.825756:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109362.826768:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca3628d lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.826782:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca3628d lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.826798:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de1:0x0].0x0 (ffff930aa0ddd900) 00010000:00010000:2.0:1786109362.826800:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109362.826805:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca3628d lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.826811:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca3628d lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.827239:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3627f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.827248:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3627f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.827271:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3627f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.827290:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109362.827294:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3627f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.827300:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3627f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.827748:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0ddd300) 00010000:00010000:2.0:1786109362.827751:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109362.827757:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3627f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.827764:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3627f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109362.827784:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000578e414e reply state 0000000021ffd3d3 transno 326417514631 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca36286 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.827811:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca36286 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109362.827820:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a83abd800) 00010000:00010000:2.0:1786109362.827823:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109362.827827:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109362.828376:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+12:158536:x1872862922067840:12345-192.168.203.38@tcp:36:rm.0 Request processed in 8094us (8598us total) trans 326417514631 rc 0/0 00000100:00100000:2.0:1786109362.828397:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 862 00010000:00010000:0.0:1786109363.077745:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109363.972882:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933162496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109363.972979:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109363.973189:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933162368:0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.973233:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109363.973268:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933162880:0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.973311:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109363.973339:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109363.973345:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933163008:0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.973368:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109363.973399:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933162624:0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.973423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109363.973467:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109363.973473:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933162752:0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.973494:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109363.973523:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933162880 00000100:00100000:1.0:1786109363.973532:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933162880 00000100:00100000:1.0:1786109363.973589:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933163008 00000100:00100000:1.0:1786109363.973592:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933163008 00000100:00100000:1.0:1786109363.973609:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933162624 00000100:00100000:1.0:1786109363.973612:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933162624 00000100:00100000:1.0:1786109363.973626:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933162752 00000100:00100000:1.0:1786109363.973629:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933162752 00000100:00100000:1.0:1786109363.973647:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786109363.973658:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933162880:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109363.973686:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d89b800 x1872862933162880/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1786109374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109363.973732:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933162880:12345-0@lo:400:kworker.0 Request processed in 76us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109363.973741:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786109363.973760:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786109363.973767:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933163008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.973797:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933163008:12345-0@lo:400:kworker.0 Request processed in 31us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109363.973804:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786109363.973816:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786109363.973822:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933162624:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109363.973833:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d89aa00 x1872862933162624/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1786109374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109363.973863:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933162624:12345-0@lo:400:kworker.0 Request processed in 41us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109363.973869:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786109363.973880:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1786109363.973886:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933162752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.973913:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933162752:12345-0@lo:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109363.973919:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1786109363.973957:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933162752:0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.973968:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933162624:0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.974000:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933163008:0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.974011:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933162880:0@lo:400:kworker.0 00000100:00100000:2.0:1786109363.974299:0:187889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933162368 00000100:00100000:2.0:1786109363.974303:0:187889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933162368 00000100:00100000:2.0:1786109363.974339:0:187889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786109363.974347:0:187889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309863c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933162368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109363.974394:0:187889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309863c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933162368:12345-0@lo:400:kworker.0 Request processed in 48us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109363.974401:0:187889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786109363.974461:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933162368:0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.974524:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933163136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109363.974560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109363.974598:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109363.974605:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933163264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109363.974629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109363.974730:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933162496 00000100:00100000:3.0:1786109363.974735:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933162496 00000100:00100000:3.0:1786109363.974768:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12228 00000100:00100000:3.0:1786109363.974776:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933162496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786109363.974809:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00010000:00000080:3.0:1786109363.974826:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1f57800 x1872862933162496/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:589/0 lens 224/368 e 0 to 0 dl 1786109374 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109363.974865:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933162496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109363.974872:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12228 00000100:00100000:3.0:1786109363.974898:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933163136 00000100:00100000:3.0:1786109363.974902:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933163136 00000100:00100000:3.0:1786109363.974933:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933163264 00000100:00100000:3.0:1786109363.974937:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933163264 00000100:00100000:3.0:1786109363.974959:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5713 00000100:00100000:3.0:1786109363.974966:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933163136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109363.974981:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109363.975020:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933163136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109363.975026:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5713 00000100:00100000:3.0:1786109363.975038:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5714 00000100:00100000:3.0:1786109363.975044:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933163264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786109363.975056:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109363.975082:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933163264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109363.975089:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5714 00000100:00100000:3.0:1786109363.975141:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933163264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109363.975156:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933163136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109363.975188:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933162496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109363.975770:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933163392:0@lo:400:kworker.0 00000100:00100000:2.0:1786109363.975814:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109363.975889:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933163392 00000100:00100000:3.0:1786109363.975894:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933163392 00000100:00100000:3.0:1786109363.975946:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6816 00000100:00100000:3.0:1786109363.975956:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933163392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109363.976113:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933163392:12345-0@lo:400:kworker.0 Request processed in 159us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109363.976121:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6816 00000100:00100000:3.0:1786109363.976139:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933163520:0@lo:400:kworker.0 00000100:00100000:3.0:1786109363.976164:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109363.976242:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933163520 00000100:00100000:1.0:1786109363.976247:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933163520 00000100:00100000:1.0:1786109363.976285:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6817 00000100:00100000:1.0:1786109363.976292:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933163520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.976330:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933163520:12345-0@lo:400:kworker.0 Request processed in 39us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109363.976336:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6817 00000100:00100000:3.0:1786109363.976409:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933163520:0@lo:400:kworker.0 00000100:00100000:3.0:1786109363.976570:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933163648:0@lo:400:kworker.0 00000100:00100000:3.0:1786109363.976600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109363.976649:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933163648 00000100:00100000:1.0:1786109363.976652:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933163648 00000100:00100000:1.0:1786109363.976676:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786109363.976680:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933163648:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109363.976693:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1f55c00 x1872862933163648/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1786109374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109363.976809:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933163392:0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.976870:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933163648:12345-0@lo:400:kworker.0 Request processed in 188us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109363.976877:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786109363.976959:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933163904:0@lo:400:kworker.0 00000100:00100000:2.0:1786109363.976987:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109363.977050:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109363.977057:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109363.977060:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109363.977063:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109363.977141:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933163904 00000100:00100000:1.0:1786109363.977145:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933163904 00000100:00100000:1.0:1786109363.977186:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786109363.977194:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933163904:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109363.977208:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa60a2300 x1872862933163904/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1786109374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109363.977320:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933163904:12345-0@lo:400:kworker.0 Request processed in 127us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109363.977326:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786109363.977381:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933163648:0@lo:400:kworker.0 00000100:00100000:3.0:1786109363.977394:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109363.977400:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933163776:0@lo:400:kworker.0 00000100:00100000:3.0:1786109363.977467:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109363.977579:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933163776 00000100:00100000:1.0:1786109363.977584:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933163776 00000100:00100000:1.0:1786109363.977623:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12229 00000100:00100000:1.0:1786109363.977631:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933163776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109363.977676:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933163776:12345-0@lo:400:kworker.0 Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109363.977681:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12229 00000100:00100000:3.0:1786109363.977756:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804562 gen 2 00000004:00080000:3.0:1786109363.977762:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804561 committed transno 25769804562 00000004:00080000:3.0:1786109363.977780:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804562 committed transno 25769804562 00000100:00100000:3.0:1786109363.977812:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933163776:0@lo:400:kworker.0 00000100:00100000:2.0:1786109363.977878:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933163904:0@lo:400:kworker.0 00010000:00010000:3.0:1786109364.101879:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109365.129958:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109365.508976:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933164032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109365.509075:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109365.509192:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933164032 00000100:00100000:0.0:1786109365.509202:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933164032 00000100:00100000:0.0:1786109365.509274:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12230 00000100:00100000:0.0:1786109365.509285:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933164032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1786109365.509910:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1786109365.510598:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933164032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1300us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109365.510697:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933164032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109365.510736:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12230 00000100:00100000:3.0:1786109366.021852:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933164160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109366.021952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109366.022029:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933164160 00000100:00100000:3.0:1786109366.022038:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933164160 00000100:00100000:3.0:1786109366.022905:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5715 00000100:00100000:3.0:1786109366.022923:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933164160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109366.022966:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109366.023041:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933164160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109366.023049:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5715 00000100:00100000:3.0:1786109366.023140:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933164160:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1786109366.023864:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109366.024201:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933164288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109366.024266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109366.025187:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933164288 00000100:00100000:2.0:1786109366.025200:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933164288 00000100:00100000:2.0:1786109366.025269:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5716 00000100:00100000:2.0:1786109366.025283:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933164288:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1786109366.025547:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1786109366.026007:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109366.026126:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933164288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 844us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109366.026135:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5716 00000100:00100000:0.0:1786109366.026508:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933164288:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1786109366.148763:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109366.289636:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109366.289802:0:187890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922067968 00000100:00100000:1.0:1786109366.289881:0:187890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922067968 00000100:00100000:1.0:1786109366.289963:0:187890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:1.0:1786109366.289975:0:187890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309863c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922067968:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109366.290276:0:187890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309863c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922067968:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 301us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109366.290286:0:187890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:1.0:1786109366.290683:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109366.292664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109366.292725:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109366.292757:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109366.292802:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922068352 00000100:00100000:0.0:1786109366.292815:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922068352 00000100:00100000:0.0:1786109366.292884:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922068480 00000100:00100000:0.0:1786109366.292887:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922068480 00000100:00100000:0.0:1786109366.292915:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6818 00000100:00100000:0.0:1786109366.292927:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922068352:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109366.293007:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922068352:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109366.293016:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6818 00000100:00100000:0.0:1786109366.293035:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6819 00000100:00100000:0.0:1786109366.293042:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922068480:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109366.293069:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922068480:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109366.293078:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6819 00000100:00100000:1.0:1786109366.293094:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922068096 00000100:00100000:1.0:1786109366.293101:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922068096 00000100:00080000:0.0:1786109366.293115:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109366.293122:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109366.293125:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109366.293145:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922068224 00000100:00100000:1.0:1786109366.293150:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922068224 00000100:00100000:1.0:1786109366.293178:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:1.0:1786109366.293188:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+12:2403:x1872862922068096:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:1.0:1786109366.293225:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d899880 x1872862922068096/t0(0) o400->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:592/0 lens 224/224 e 0 to 0 dl 1786109377 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109366.293255:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+12:2403:x1872862922068096:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 70us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109366.293263:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:1.0:1786109366.293280:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:1.0:1786109366.293287:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922068224:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109366.293311:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922068224:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109366.293317:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00080000:0.0:1786109366.296215:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1786109367.173101:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109368.222999:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786109369.078987:0:187883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 326417514631 is committed 00010000:00010000:3.0:1786109369.080135:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3624e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080152:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3624e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080161:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3624e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080168:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109369.080173:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3624e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080181:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3624e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080199:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a83abd800) 00010000:00010000:3.0:1786109369.080203:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109369.080207:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3624e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080214:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3624e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080234:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca36286 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080240:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca36286 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080251:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca36286 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080257:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109369.080259:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca36286 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080265:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca36286 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080274:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a83abd800) 00010000:00010000:3.0:1786109369.080276:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109369.080279:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca36286 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109369.080285:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76e00/0xdb52b77d7ca36286 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109369.092928:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933164672:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.092996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109369.093054:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933165184:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.093098:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109369.093124:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933165696:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.093146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109369.093170:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1786109369.093176:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933164800:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.093199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109369.093218:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933165312:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.093242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109369.093265:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933165824:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.093288:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109369.093315:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933164672 00000100:00100000:2.0:1786109369.093323:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933164672 00000100:00100000:2.0:1786109369.093367:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933164800 00000100:00100000:2.0:1786109369.093371:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933164800 00000100:00100000:2.0:1786109369.093393:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786109369.093402:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933164672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.093485:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933164672:12345-0@lo:400:kworker.0 Request processed in 84us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109369.093493:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786109369.093511:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786109369.093517:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933164800:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109369.093529:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098c346d80 x1872862933164800/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:595/0 lens 224/224 e 0 to 0 dl 1786109380 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109369.093558:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933164800:12345-0@lo:400:kworker.0 Request processed in 42us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109369.093564:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786109369.093584:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933165184 00000100:00100000:2.0:1786109369.093588:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933165184 00000100:00100000:2.0:1786109369.093609:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933165696 00000100:00100000:2.0:1786109369.093611:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933165696 00000100:00100000:2.0:1786109369.093625:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933165312 00000100:00100000:2.0:1786109369.093628:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933165312 00000100:00100000:2.0:1786109369.093643:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933165824 00000100:00100000:2.0:1786109369.093646:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933165824 00000100:00100000:2.0:1786109369.093668:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6820 00000100:00100000:2.0:1786109369.093675:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933165184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.093707:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933165184:12345-0@lo:400:kworker.0 Request processed in 34us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109369.093713:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6820 00000100:00100000:2.0:1786109369.093725:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6821 00000100:00100000:2.0:1786109369.093732:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933165696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.093759:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933165696:12345-0@lo:400:kworker.0 Request processed in 28us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109369.093765:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6821 00000100:00100000:2.0:1786109369.093776:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6822 00000100:00100000:2.0:1786109369.093782:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933165312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.093813:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933165312:12345-0@lo:400:kworker.0 Request processed in 31us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109369.093819:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6822 00000100:00100000:2.0:1786109369.093830:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6823 00000100:00100000:2.0:1786109369.093837:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933165824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.093862:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933165824:12345-0@lo:400:kworker.0 Request processed in 26us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109369.093867:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6823 00000100:00100000:0.0:1786109369.094126:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933164544:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.094158:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109369.094179:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933165056:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.094202:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109369.094231:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933165568:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.094253:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109369.094273:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1786109369.094279:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933164416:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.094306:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109369.094334:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933164928:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.094357:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109369.094375:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933165440:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.094395:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109369.094413:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933165952:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.094452:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109369.094486:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109369.094489:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109369.094492:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109369.094494:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109369.094511:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933164544 00000100:00100000:0.0:1786109369.094515:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933164544 00000100:00100000:0.0:1786109369.094541:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933164928 00000100:00100000:0.0:1786109369.094544:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933164928 00000100:00100000:0.0:1786109369.094557:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933165440 00000100:00100000:0.0:1786109369.094560:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933165440 00000100:00100000:0.0:1786109369.094570:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933165952 00000100:00100000:0.0:1786109369.094572:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933165952 00000100:00100000:0.0:1786109369.094584:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786109369.094590:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933164544:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109369.094602:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a9780d500 x1872862933164544/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:595/0 lens 224/224 e 0 to 0 dl 1786109380 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109369.094638:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933164544:12345-0@lo:400:kworker.0 Request processed in 48us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109369.094644:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786109369.094657:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786109369.094663:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933164928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.094688:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933164928:12345-0@lo:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109369.094693:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786109369.094702:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786109369.094708:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933165440:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109369.094716:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a9780e300 x1872862933165440/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:595/0 lens 224/224 e 0 to 0 dl 1786109380 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109369.094737:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933165440:12345-0@lo:400:kworker.0 Request processed in 30us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109369.094742:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786109369.094750:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786109369.094755:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933165952:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109369.094765:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a9780c380 x1872862933165952/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:595/0 lens 224/224 e 0 to 0 dl 1786109380 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109369.094785:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933165952:12345-0@lo:400:kworker.0 Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109369.094790:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786109369.094806:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933165056 00000100:00100000:0.0:1786109369.094809:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933165056 00000100:00100000:0.0:1786109369.094830:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933165568 00000100:00100000:0.0:1786109369.094832:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933165568 00000100:00100000:0.0:1786109369.094845:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12231 00000100:00100000:0.0:1786109369.094850:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933165056:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109369.094863:0:8452:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a9780ce00 x1872862933165056/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:595/0 lens 224/224 e 0 to 0 dl 1786109380 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109369.094888:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933165056:12345-0@lo:400:kworker.0 Request processed in 37us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109369.094894:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12231 00000100:00100000:0.0:1786109369.094905:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12232 00000100:00100000:0.0:1786109369.094911:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933165568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.094935:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933165568:12345-0@lo:400:kworker.0 Request processed in 25us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109369.094941:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12232 00000100:00100000:0.0:1786109369.094962:0:187889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933164416 00000100:00100000:0.0:1786109369.094965:0:187889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933164416 00000100:00100000:0.0:1786109369.094990:0:187889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1786109369.094995:0:187889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309863c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933164416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.095022:0:187889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309863c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933164416:12345-0@lo:400:kworker.0 Request processed in 28us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109369.095028:0:187889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1786109369.095080:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109369.095083:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109369.095102:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933164416:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.095114:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933164928:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.095122:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933165440:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.095130:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933165952:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.095139:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933164544:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.095147:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933165056:0@lo:400:kworker.0 00000100:00100000:0.0:1786109369.095156:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933165568:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.095665:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933164800:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.095688:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933165312:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.095699:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933165824:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.095711:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933164672:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.095721:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933165184:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.095732:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933165696:0@lo:400:kworker.0 00000100:00100000:2.0:1786109369.096099:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933166208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109369.096137:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109369.096175:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933166208 00000100:00100000:2.0:1786109369.096180:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933166208 00000100:00100000:2.0:1786109369.096214:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5717 00000100:00100000:2.0:1786109369.096222:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933166208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109369.096246:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109369.096291:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933166208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109369.096297:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5717 00000100:00100000:2.0:1786109369.096333:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933166208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109369.096381:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109369.096392:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933166080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109369.096423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109369.096568:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933166080 00000100:00100000:2.0:1786109369.096573:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933166080 00000100:00100000:2.0:1786109369.096607:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5718 00000100:00100000:2.0:1786109369.096614:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933166080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786109369.096630:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109369.096676:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933166080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109369.096681:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5718 00000100:00100000:1.0:1786109369.096750:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933166080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109369.100576:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933166336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109369.100651:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109369.110396:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933166336 00000100:00100000:1.0:1786109369.110411:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933166336 00000100:00100000:1.0:1786109369.110480:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12233 00000100:00100000:1.0:1786109369.110490:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933166336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109369.110526:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444958208 avail 1298718720 00010000:00000080:1.0:1786109369.110542:0:8452:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098c346680 x1872862933166336/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:595/0 lens 224/368 e 0 to 0 dl 1786109380 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109369.110619:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933166336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (9967us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109369.110626:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12233 00000100:00100000:1.0:1786109369.110693:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933166336:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1786109369.307728:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786109370.122257:0:189550:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:0.0:1786109370.319487:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109370.631014:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933166464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109370.632283:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109370.632570:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933166464 00000100:00100000:3.0:1786109370.632577:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933166464 00000100:00100000:3.0:1786109370.632622:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12234 00000100:00100000:3.0:1786109370.632630:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933166464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786109370.632662:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1786109370.632706:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933166464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109370.632713:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12234 00000100:00100000:3.0:1786109370.632756:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933166464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109371.207081:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933166592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109371.207150:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109371.207208:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933166720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109371.207233:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109371.207268:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933166592 00000100:00100000:1.0:1786109371.207289:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933166592 00000100:00100000:1.0:1786109371.207340:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933166720 00000100:00100000:1.0:1786109371.207344:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933166720 00000100:00100000:1.0:1786109371.207363:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5719 00000100:00100000:1.0:1786109371.207372:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933166592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109371.207398:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109371.207463:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933166592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109371.207470:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5719 00000100:00100000:1.0:1786109371.207486:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5720 00000100:00100000:1.0:1786109371.207492:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933166720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109371.207506:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109371.207534:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933166720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109371.207539:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5720 00000100:00100000:1.0:1786109371.207583:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933166592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109371.207609:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933166720:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1786109371.207733:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109371.207737:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109371.463804:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109371.463882:0:187898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922068608 00000100:00100000:2.0:1786109371.463905:0:187898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922068608 00000100:00100000:2.0:1786109371.463963:0:187898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:2.0:1786109371.463973:0:187898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309863c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2403:x1872862922068608:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109371.464057:0:187898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309863c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2403:x1872862922068608:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 86us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109371.464065:0:187898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:0.0:1786109371.465159:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109371.465225:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109371.465254:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109371.465299:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922068992 00000100:00100000:3.0:1786109371.465306:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922068992 00000100:00100000:3.0:1786109371.465357:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6824 00000100:00100000:3.0:1786109371.465366:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922068992:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109371.465418:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922068992:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 53us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109371.465426:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6824 00000100:00080000:3.0:1786109371.465464:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786109371.465719:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109371.466715:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109371.466800:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922068736 00000100:00100000:2.0:1786109371.466807:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922068736 00000100:00100000:3.0:1786109371.466935:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922068864 00000100:00100000:3.0:1786109371.466947:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922068864 00000100:00100000:3.0:1786109371.466985:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:3.0:1786109371.467000:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+8:2402:x1872862922068736:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:3.0:1786109371.467038:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a9780ed80 x1872862922068736/t0(0) o400->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:597/0 lens 224/224 e 0 to 0 dl 1786109382 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109371.467130:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+8:2402:x1872862922068736:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 134us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109371.467139:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:3.0:1786109371.467159:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:3.0:1786109371.467167:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922068864:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109371.467203:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922068864:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109371.467214:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00080000:0.0:1786109371.468106:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109371.468112:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109371.468149:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922069120 00000100:00100000:0.0:1786109371.468156:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922069120 00000100:00100000:0.0:1786109371.468220:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6825 00000100:00100000:0.0:1786109371.468230:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922069120:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109371.468299:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922069120:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 70us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109371.468306:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6825 00000100:00080000:3.0:1786109371.470653:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786109372.484866:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109373.516382:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1786109374.098768:0:189696:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1786109374.098849:0:189696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab28bd800/0xdb52b77d7ca30962 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca30969 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.098869:0:189696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab28bd800/0xdb52b77d7ca30962 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca30969 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.098877:0:189696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab28bd800/0xdb52b77d7ca30962 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca30969 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.098886:0:189696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab28bd800/0xdb52b77d7ca30962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca30969 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.098964:0:189696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1786109374.098971:0:189696:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1786109374.099018:0:189696:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109374.099024:0:189696:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1786109374.099053:0:189696:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1786109374.099086:0:189696:0:(import.c:65:import_set_state_nolock()) ffff930983755800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1786109374.099177:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933166848:0@lo:39:umount.0 00000100:00100000:2.0:1786109374.099288:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109374.099479:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933166848 00000100:00100000:0.0:1786109374.099490:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933166848 00000100:00100000:0.0:1786109374.099553:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1786109374.099565:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872862933166848:12345-0@lo:39:umount.0 00000020:00000080:0.0:1786109374.099600:0:187900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30a1f 00000100:00080000:0.0:1786109374.099619:0:187900:0:(import.c:65:import_set_state_nolock()) ffff930a87b2a000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1786109374.099774:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109374.099785:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab28bd800/0xdb52b77d7ca30962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca30969 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.099796:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bd800 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:1.0:1786109374.099801:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab28bd800/0xdb52b77d7ca30962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca30969 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.099811:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab28bd800/0xdb52b77d7ca30962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca30969 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786109374.099823:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab28bd800/0xdb52b77d7ca30962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca30969 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109374.099829:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1786109374.099832:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1786109374.099835:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1786109374.099869:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab28bd800/0xdb52b77d7ca30962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca30969 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.099876:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1786109374.099924:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933166976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109374.099965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786109374.100024:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab28bd800/0xdb52b77d7ca30962 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca30969 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.100044:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab28bd800/0xdb52b77d7ca30962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca30969 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.100058:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109374.100060:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109374.100063:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:0.0:1786109374.100134:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098c345c00 x1872862933166848/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:600/0 lens 224/224 e 0 to 0 dl 1786109385 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109374.100188:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1872862933166848:12345-0@lo:39:umount.0 Request processed in 625us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109374.100197:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000020:00000080:0.0:1786109374.100209:0:187900:0:(genops.c:906:class_export_put()) final put ffff930a87b2f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1786109374.100276:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b2f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109374.100331:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a87b2a000 for lustre-MDT0000 00000100:00080000:0.0:1786109374.100372:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983755800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1786109374.100384:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933166848:0@lo:39:umount.0 00000100:00080000:0.0:1786109374.100410:0:189696:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109374.100413:0:189696:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1786109374.100419:0:189696:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1786109374.101096:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109374.102594:0:189696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930984c89800/0xdb52b77d7ca30897 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3089e expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102613:0:189696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930984c89800/0xdb52b77d7ca30897 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3089e expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102621:0:189696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930984c89800/0xdb52b77d7ca30897 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3089e expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102629:0:189696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930984c89800/0xdb52b77d7ca30897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3089e expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102660:0:189696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109374.102668:0:189696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930984c89400/0xdb52b77d7ca30985 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3098c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102682:0:189696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930984c89400/0xdb52b77d7ca30985 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3098c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102689:0:189696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930984c89400/0xdb52b77d7ca30985 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3098c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102695:0:189696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930984c89400/0xdb52b77d7ca30985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3098c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102715:0:189696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1786109374.102730:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109374.102737:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930984c89800/0xdb52b77d7ca30897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3089e expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.102743:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109374.102747:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930984c89800 already unused, calling callback (ffffffffc1476c20) 00010000:00010000:3.0:1786109374.102753:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930984c89400/0xdb52b77d7ca30985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3098c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786109374.102753:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930984c89800/0xdb52b77d7ca30897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3089e expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.102771:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930984c89400 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109374.102776:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930984c89400/0xdb52b77d7ca30985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3098c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102776:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930984c89800/0xdb52b77d7ca30897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca3089e expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.102795:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930984c89400/0xdb52b77d7ca30985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca3098c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786109374.102796:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930984c89800/0xdb52b77d7ca30897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca3089e expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109374.102811:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930984c89400/0xdb52b77d7ca30985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca3098c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109374.102813:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786109374.102820:0:10402:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1786109374.102825:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1786109374.102829:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1786109374.102831:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1786109374.102866:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930984c89400/0xdb52b77d7ca30985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3098c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102867:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930984c89800/0xdb52b77d7ca30897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3089e expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102882:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109374.102911:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930984c89800/0xdb52b77d7ca30897 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3089e expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102919:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930984c89800/0xdb52b77d7ca30897 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3089e expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102933:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109374.102934:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109374.102936:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109374.102947:0:189696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930984c88800/0xdb52b77d7ca30954 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3095b expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102955:0:189696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930984c88800/0xdb52b77d7ca30954 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3095b expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102962:0:189696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930984c88800/0xdb52b77d7ca30954 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3095b expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102969:0:189696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930984c88800/0xdb52b77d7ca30954 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3095b expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102983:0:189696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109374.102989:0:189696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930984c88000/0xdb52b77d7ca30889 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca30890 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.102996:0:189696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930984c88000/0xdb52b77d7ca30889 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca30890 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.103009:0:189696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930984c88000/0xdb52b77d7ca30889 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca30890 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.103015:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109374.103021:0:189696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930984c88000/0xdb52b77d7ca30889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca30890 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.103037:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930984c89400/0xdb52b77d7ca30985 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3098c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.103046:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930984c89400/0xdb52b77d7ca30985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3098c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.103063:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109374.103067:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930984c88800/0xdb52b77d7ca30954 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3095b expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.103074:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930984c88800 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109374.103077:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930984c88800/0xdb52b77d7ca30954 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3095b expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.103084:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930984c88800/0xdb52b77d7ca30954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca3095b expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109374.103091:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930984c88800/0xdb52b77d7ca30954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca3095b expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109374.103097:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1786109374.103100:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1786109374.103103:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:1.0:1786109374.103112:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933167232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109374.103119:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930984c88800/0xdb52b77d7ca30954 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3095b expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.103126:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1786109374.103209:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.103295:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109374.103302:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933167104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109374.103326:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.103360:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933166976 00000100:00100000:1.0:1786109374.103368:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933166976 00000100:00100000:1.0:1786109374.103420:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933167232 00000100:00100000:1.0:1786109374.103424:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933167232 00000100:00100000:1.0:1786109374.103464:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933167104 00000100:00100000:1.0:1786109374.103467:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933167104 00000100:00100000:1.0:1786109374.103489:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4497 00000100:00100000:1.0:1786109374.103500:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+26:3647:x1872862933166976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109374.103516:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109374.103535:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166c000/0xdb52b77d7ca30969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca30962 expref: 26 pid: 187889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.103551:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109374.103715:0:189696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1786109374.103720:0:189696:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1786109374.103723:0:189696:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1786109374.103763:0:189696:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1786109374.103768:0:189696:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1786109374.103774:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1786109374.103780:0:189696:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000004:00000080:0.0:1786109374.106171:0:189696:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:0.0:1786109374.106749:0:189696:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1786109374.106760:0:189696:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930aa6610000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786109374.106768:0:189696:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930a90aa1800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786109374.106773:0:189696:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930a87b28000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786109374.106778:0:189696:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930a97c8a000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 326417514497 stale:0 00000020:00080000:0.0:1786109374.106786:0:189696:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930a97c88800 397d331e-10fc-4558-be87-308c3622e8eb 192.168.203.38@tcp 7 (0 0 2) 0 0 0 0: 0000000000000000 326417514631 stale:0 00000020:00080000:0.0:1786109374.106792:0:189696:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9309847899c0) has exports, disconnecting them 00000020:00080000:0.0:1786109374.106798:0:189696:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930aa6610000), last request at 1786109369 00000020:00000080:0.0:1786109374.106808:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca32799 00000100:00080000:0.0:1786109374.106821:0:189696:0:(import.c:65:import_set_state_nolock()) ffff930aa6611800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1786109374.106852:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109374.106862:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930984c88000/0xdb52b77d7ca30889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca30890 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.106875:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930984c88000 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:0.0:1786109374.106879:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930984c88000/0xdb52b77d7ca30889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca30890 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.106892:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930984c88000/0xdb52b77d7ca30889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca30890 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786109374.106900:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930984c88000/0xdb52b77d7ca30889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca30890 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109374.106907:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1786109374.106910:0:10402:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1786109374.106914:0:10402:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1786109374.106961:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930984c88000/0xdb52b77d7ca30889 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca30890 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.106969:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109374.106987:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930984c88000/0xdb52b77d7ca30889 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca30890 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.106994:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930984c88000/0xdb52b77d7ca30889 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca30890 expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.107010:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109374.107012:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109374.107014:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1786109374.107107:0:189696:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930aa6610000): rc 0 00000020:00000080:0.0:1786109374.107111:0:189696:0:(genops.c:906:class_export_put()) final put ffff930aa6610000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1786109374.107124:0:189696:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930a90aa1800), last request at 1786109369 00000020:00000080:0.0:1786109374.107129:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca32768 00000100:00080000:0.0:1786109374.107136:0:189696:0:(import.c:65:import_set_state_nolock()) ffff930a90aa6000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1786109374.107152:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930aa6610000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109374.107201:0:179248:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930aa6611800 for lustre-MDT0000 00010000:00010000:0.0:1786109374.107216:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1786109374.107222:0:189696:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930a90aa1800): rc 0 00000020:00000080:0.0:1786109374.107224:0:189696:0:(genops.c:906:class_export_put()) final put ffff930a90aa1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1786109374.107233:0:189696:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930a87b28000), last request at 1786109323 00000020:00000080:0.0:1786109374.107236:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30a18 00000100:00080000:0.0:1786109374.107241:0:189696:0:(import.c:65:import_set_state_nolock()) ffff930a87b2e000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1786109374.107316:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a90aa1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109374.107376:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a90aa6000 for lustre-MDT0000 00010000:00010000:0.0:1786109374.107387:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1786109374.107395:0:189696:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930a87b28000): rc 0 00000020:00000080:0.0:1786109374.107397:0:189696:0:(genops.c:906:class_export_put()) final put ffff930a87b28000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1786109374.107405:0:189696:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930a97c8a000), last request at 1786109320 00000020:00000080:0.0:1786109374.107413:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca308dd 00000100:00080000:0.0:1786109374.107427:0:189696:0:(import.c:65:import_set_state_nolock()) ffff930ac09cf800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1786109374.107467:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b28000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109374.107517:0:179248:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a87b2e000 for lustre-MDT0000 00010000:00010000:0.0:1786109374.107553:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1786109374.107559:0:189696:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930a97c8a000): rc 0 00000020:00000080:0.0:1786109374.107561:0:189696:0:(genops.c:906:class_export_put()) final put ffff930a97c8a000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1786109374.107570:0:189696:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.38@tcp (ffff930a97c88800), last request at 1786109371 00000020:00000080:0.0:1786109374.107574:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca308d6 00000020:00010000:0.0:1786109374.107580:0:189696:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930a97c88800: total 1 00000100:00080000:0.0:1786109374.107584:0:189696:0:(import.c:65:import_set_state_nolock()) ffff930ab2a26800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1786109374.107606:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a97c8a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109374.107643:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac09cf800 for lustre-MDT0000 00000020:00010000:0.0:1786109374.107653:0:10402:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930a97c88800: total 0 00010000:00010000:0.0:1786109374.107697:0:10402:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930a97c88800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1786109374.107730:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9309825f2800/0xdb52b77d7ca32db9 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494c69 expref: 6 pid: 187976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.107750:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9309825f3200/0xdb52b77d7ca32db2 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 5 pid: 187976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109374.107771:0:10402:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930a97c88800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1786109374.114039:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930984c88800/0xdb52b77d7ca30954 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3095b expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.114063:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930984c88800/0xdb52b77d7ca30954 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3095b expref: -99 pid: 187879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.114086:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109374.114089:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109374.114095:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109374.114807:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4498 00000100:00100000:3.0:1786109374.114836:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+25:3648:x1872862933167232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109374.114866:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1786109374.114875:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+25:3647:x1872862933166976:12345-0@lo:103:ldlm_bl.0 Request processed in 11373us (14905us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109374.114886:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4497 00000100:00100000:1.0:1786109374.114920:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4499 00000100:00100000:1.0:1786109374.114930:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933167104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109374.114940:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109374.114963:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166de00/0xdb52b77d7ca3098c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca30985 expref: 24 pid: 187888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.114980:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109374.115976:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930985201800/0xdb52b77d7ca3089e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca30897 expref: 23 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109374.115994:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109374.116086:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3648:x1872862933167232:12345-0@lo:103:ldlm_bl.0 Request processed in 1264us (12876us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109374.116096:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4498 00000100:00100000:2.0:1786109374.116114:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933166976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109374.116146:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3648:x1872862933167104:12345-0@lo:103:ldlm_bl.0 Request processed in 1217us (12818us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109374.116154:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933167488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109374.116154:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4499 00000100:00100000:2.0:1786109374.116197:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.116207:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933167104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109374.116216:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933167232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109374.116240:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933167360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109374.116269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786109374.116294:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109374.116302:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109374.116314:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933167488 00000100:00100000:1.0:1786109374.116322:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933167488 00000100:00100000:1.0:1786109374.116363:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933167360 00000100:00100000:1.0:1786109374.116367:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933167360 00000100:00100000:1.0:1786109374.116383:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4500 00000100:00100000:1.0:1786109374.116391:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c347100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3647:x1872862933167488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109374.116401:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109374.116412:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930984c88600/0xdb52b77d7ca30890 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca30889 expref: 22 pid: 187889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.116424:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109374.116476:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c347100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3647:x1872862933167488:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109374.116482:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4500 00000100:00100000:2.0:1786109374.116487:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933167488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109374.116494:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4501 00000100:00100000:1.0:1786109374.116500:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:3646:x1872862933167360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109374.116507:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109374.116516:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930984c88200/0xdb52b77d7ca3095b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca30954 expref: 20 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.116526:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109374.116548:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3646:x1872862933167360:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109374.116554:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4501 00000100:00100000:1.0:1786109374.116611:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933167360:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1786109374.120658:0:189696:0:(mdd_object.c:3897:mdd_close()) Object [0x20001a9e3:0x1de0:0x0] is retained in orphan list 00000020:00080000:2.0:1786109374.120693:0:189696:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.38@tcp (ffff930a97c88800): rc 0 00000004:00000080:2.0:1786109374.120704:0:189696:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa66f00dd3ae0 00000100:00080000:2.0:1786109374.120733:0:189696:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1786109374.120739:0:189696:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804562 gen 3 00000100:00080000:2.0:1786109374.122740:0:189696:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1786109374.122788:0:189696:0:(import.c:65:import_set_state_nolock()) ffff930981e14000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1786109374.122862:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933167616:0@lo:39:umount.0 00000100:00100000:1.0:1786109374.122959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786109374.123399:0:189696:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1786109374.123404:0:189696:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738457 gen 3 00000004:00080000:1.0:1786109374.123484:0:189696:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1786109374.123550:0:189696:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1786109374.123564:0:189696:0:(import.c:65:import_set_state_nolock()) ffff930a8a47a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1786109374.123578:0:189696:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1786109374.123580:0:189696:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975818 gen 3 00000004:00080000:1.0:1786109374.123589:0:189696:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786109374.123659:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933167744:0@lo:9:umount.0 00000100:00100000:1.0:1786109374.123699:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.123778:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:0:1872862933167872:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1786109374.123803:0:189696:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1786109374.123811:0:189696:0:(import.c:65:import_set_state_nolock()) ffff930aafff6800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1786109374.123827:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933168000:0@lo:9:umount.0 00000100:00100000:1.0:1786109374.123855:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1786109374.123935:0:189696:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9309847899c0) has no exports 00000100:00100000:2.0:1786109374.124638:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933167616 00000100:00100000:2.0:1786109374.124651:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933167616 00000100:00100000:2.0:1786109374.124721:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12235 00000100:00100000:2.0:1786109374.124734:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933167616:12345-0@lo:39:umount.0 00000020:00000080:2.0:1786109374.124772:0:8452:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca307ef 00000100:00080000:2.0:1786109374.124798:0:8452:0:(import.c:65:import_set_state_nolock()) ffff930ac09ce800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786109374.124826:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769804562 00000100:00100000:2.0:1786109374.125041:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3645:x1872862933167616:12345-0@lo:39:umount.0 Request processed in 294us (2066us total) trans 25769804563 rc 0/0 00000100:00100000:2.0:1786109374.125050:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12235 00000100:00080000:2.0:1786109374.125138:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e14000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1786109374.125145:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933167616:0@lo:39:umount.0 00000100:00100000:1.0:1786109374.126509:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933167744 00000100:00100000:1.0:1786109374.126523:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933167744 00000100:00100000:1.0:1786109374.126601:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933168000 00000100:00100000:1.0:1786109374.126605:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933168000 00000100:00100000:1.0:1786109374.126642:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23060 00000100:00100000:1.0:1786109374.126654:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933167744:12345-0@lo:9:umount.0 00000020:00000080:1.0:1786109374.126689:0:179242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30931 00000100:00080000:1.0:1786109374.126699:0:179242:0:(import.c:65:import_set_state_nolock()) ffff93098617e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786109374.126757:0:179242:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738457 00000100:00100000:1.0:1786109374.127044:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+2:3645:x1872862933167744:12345-0@lo:9:umount.0 Request processed in 391us (3342us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109374.127054:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23060 00000100:00100000:1.0:1786109374.127073:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23061 00000100:00100000:1.0:1786109374.127081:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933168000:12345-0@lo:9:umount.0 00000020:00000080:1.0:1786109374.127095:0:179242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3093f 00000100:00080000:1.0:1786109374.127102:0:179242:0:(import.c:65:import_set_state_nolock()) ffff930ab7c41800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786109374.127136:0:179242:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975818 00000100:00100000:1.0:1786109374.127232:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+2:3645:x1872862933168000:12345-0@lo:9:umount.0 Request processed in 152us (3375us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109374.127239:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23061 00010000:00010000:1.0:1786109374.128093:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109374.128101:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109374.128175:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109374.128182:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109374.128235:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930aafff6800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1786109374.128266:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1786109374.128269:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786109374.128275:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933168000:0@lo:9:umount.0 00000100:00080000:2.0:1786109374.128292:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:0.0:1786109374.129676:0:10402:0:(genops.c:906:class_export_put()) final put ffff930a97c88800/397d331e-10fc-4558-be87-308c3622e8eb 00000020:00000080:0.0:1786109374.129722:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930a97c88800/397d331e-10fc-4558-be87-308c3622e8eb for lustre-MDT0000 00000020:00000080:0.0:1786109374.129781:0:179248:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab2a26800 for lustre-MDT0000 00010000:00010000:0.0:1786109374.129796:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109374.129799:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109374.129801:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1786109374.129857:0:189696:0:(update_recovery.c:483:dtrq_destroy()) destroy x1872862921722240 t322122568379 00000020:00080000:1.0:1786109374.129869:0:189696:0:(update_recovery.c:483:dtrq_destroy()) destroy x1872862921721344 t322122568378 00000020:00080000:1.0:1786109374.129873:0:189696:0:(update_recovery.c:483:dtrq_destroy()) destroy x1872862921720704 t322122568377 00000020:00080000:1.0:1786109374.129877:0:189696:0:(update_recovery.c:483:dtrq_destroy()) destroy x1872862921719808 t322122568376 00000020:00080000:1.0:1786109374.129880:0:189696:0:(update_recovery.c:483:dtrq_destroy()) destroy x1872862921719168 t322122568375 00000020:00080000:1.0:1786109374.129883:0:189696:0:(update_recovery.c:483:dtrq_destroy()) destroy x1872862921718272 t322122568374 00000040:00080000:1.0:1786109374.130498:0:189696:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400007ec:0x1:0x0] first idx 6, last_idx 8 00000040:00080000:1.0:1786109374.130547:0:189696:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400007ec:0x1:0x0] first idx 7, last_idx 8 00010000:00010000:3.0:1786109374.130690:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786109374.131002:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1786109374.131081:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786109374.131094:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933167744:0@lo:9:umount.0 00000020:00080000:1.0:1786109374.131384:0:189696:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9309847899c0) has no exports 00000020:00000080:1.0:1786109374.177952:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca308f2 00000020:00000080:1.0:1786109374.177974:0:189696:0:(genops.c:906:class_export_put()) final put ffff930ac0c8f800/lustre-QMT0000_UUID 00000020:01000000:1.0:1786109374.178123:0:189696:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1786109374.178191:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0c8f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1786109374.178228:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109374.178244:0:189696:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1786109374.178318:0:189696:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9309827299c0) has no exports 00000020:00000080:0.0:1786109374.178992:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca308eb 00000020:00000080:0.0:1786109374.179001:0:189696:0:(genops.c:906:class_export_put()) final put ffff930ac1269800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786109374.179139:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac1269800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786109374.179221:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109374.179232:0:189696:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1786109374.179236:0:189696:0:(genops.c:906:class_export_put()) final put ffff930a9788e000/lustre-QMT0000_UUID 00000020:00000080:0.0:1786109374.179239:0:189696:0:(genops.c:865:class_export_destroy()) destroying export ffff930a9788e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1786109374.179244:0:189696:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1786109374.179728:0:189696:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9309837cb240 - data ffff930aa7cf3af8/ffff930a87b57000 00000020:01000000:0.0:1786109374.179903:0:189696:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ab8cd1b40 - data ffff930abf92bca8/ffff930aa4e8a800 00000100:00100000:3.0:1786109374.214241:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109374.214280:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933168128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109374.214374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109374.214481:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933168128 00000100:00100000:3.0:1786109374.214490:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933168128 00000100:00100000:3.0:1786109374.214534:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12236 00000100:00100000:3.0:1786109374.214542:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1872862933168128:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1786109374.214551:0:8451:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1786109374.214591:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1872862933168128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (217us total) trans 0 rc -107/-107 00000100:00100000:3.0:1786109374.214598:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12236 00000100:02020000:3.0:1786109374.214638:0:3648:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1786109374.214643:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1786109374.214648:0:3648:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1786109374.214653:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1786109374.214662:0:3648:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109374.214666:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8180 00000100:00080000:3.0:1786109374.214673:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109374.214703:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1f56d80 x1872862933168256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109374.214985:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933168256:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1786109374.215017:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109374.215064:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933168256 00000100:00100000:2.0:1786109374.215068:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933168256 00000100:00100000:2.0:1786109374.215091:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12237 00000100:00100000:2.0:1786109374.215097:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933168256:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1786109374.215119:0:8452:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1786109374.216380:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933168384:0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.216471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.216504:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933168896:0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.216530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.216553:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786109374.216559:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933168512:0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.216580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.216598:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933169024:0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.216619:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.216649:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933168768:0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.216672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.216690:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786109374.216695:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933168640:0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.216714:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.216730:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933169152:0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.216751:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.216776:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933168384 00000100:00100000:1.0:1786109374.216784:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933168384 00000100:00100000:1.0:1786109374.216816:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933168512 00000100:00100000:1.0:1786109374.216819:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933168512 00000100:00100000:1.0:1786109374.216847:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933168768 00000100:00100000:1.0:1786109374.216850:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933168768 00000100:00100000:1.0:1786109374.216861:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933168640 00000100:00100000:1.0:1786109374.216863:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933168640 00000100:00100000:1.0:1786109374.216870:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933169152 00000100:00100000:1.0:1786109374.216872:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933169152 00000100:00100000:1.0:1786109374.216882:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786109374.216889:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933168512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.216941:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933168512:12345-0@lo:400:kworker.0 Request processed in 52us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109374.216947:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786109374.216963:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786109374.216968:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933168768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.216992:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933168768:12345-0@lo:400:kworker.0 Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109374.216997:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786109374.217005:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:1.0:1786109374.217009:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1872862933168384:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1786109374.217014:0:187901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109374.217051:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1872862933168384:12345-0@lo:400:kworker.0 Request processed in 40us (580us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109374.217056:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:1.0:1786109374.217067:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1786109374.217070:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1872862933168640:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1786109374.217074:0:187901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109374.217095:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1872862933168640:12345-0@lo:400:kworker.0 Request processed in 23us (381us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109374.217101:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1786109374.217110:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1786109374.217115:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1872862933169152:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1786109374.217119:0:187901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109374.217139:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1872862933169152:12345-0@lo:400:kworker.0 Request processed in 23us (387us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109374.217144:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1786109374.217162:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933168896 00000100:00100000:1.0:1786109374.217166:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933168896 00000100:00100000:1.0:1786109374.217194:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933169024 00000100:00100000:1.0:1786109374.217196:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933169024 00000100:00100000:1.0:1786109374.217214:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6826 00000100:00100000:1.0:1786109374.217220:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933168896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.217251:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933168896:12345-0@lo:400:kworker.0 Request processed in 32us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109374.217257:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6826 00000100:00100000:1.0:1786109374.217266:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6827 00000100:00100000:1.0:1786109374.217271:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933169024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.217291:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933169024:12345-0@lo:400:kworker.0 Request processed in 20us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109374.217296:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6827 00000100:00080000:1.0:1786109374.217328:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109374.217333:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109374.217335:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109374.217358:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786109374.217364:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1786109374.217368:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1786109374.217373:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109374.217377:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8193 00000100:00080000:1.0:1786109374.217382:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109374.217405:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9289880 x1872862933169280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109374.217426:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933168640:0@lo:400:kworker.0 00000100:00080000:1.0:1786109374.217462:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786109374.217465:0:3649:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1786109374.217468:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1786109374.217471:0:3649:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109374.217475:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8180 00000100:00080000:1.0:1786109374.217479:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109374.217490:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9289500 x1872862933169408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109374.217500:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933169152:0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.217512:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933168768:0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.217543:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933168512:0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.217551:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933169024:0@lo:400:kworker.0 00000100:00080000:1.0:1786109374.217558:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786109374.217561:0:3646:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1786109374.217564:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1786109374.217566:0:3646:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109374.217569:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8193 00000100:00080000:1.0:1786109374.217572:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109374.217583:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab928ad80 x1872862933169536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109374.217592:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933168384:0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.217600:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933168896:0@lo:400:kworker.0 00000100:00100000:1.0:1786109374.217629:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933169280:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1786109374.217653:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.217668:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933169408:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1786109374.217682:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.217692:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab928ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933169536:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1786109374.217707:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109374.217731:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933169280 00000100:00100000:1.0:1786109374.217735:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933169280 00000100:00100000:1.0:1786109374.217752:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933169408 00000100:00100000:1.0:1786109374.217754:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933169408 00000100:00100000:1.0:1786109374.217761:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933169536 00000100:00100000:1.0:1786109374.217764:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933169536 00000100:00100000:1.0:1786109374.217773:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1786109374.217778:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933169280:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1786109374.217796:0:187899:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1786109374.217829:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933169280:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 50us (175us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109374.217835:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1786109374.217846:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1786109374.217850:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933169408:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1786109374.217857:0:187899:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1786109374.217875:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933169408:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 25us (192us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109374.217880:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1786109374.217887:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1786109374.217891:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933169536:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1786109374.217897:0:187899:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1786109374.217913:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933169536:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 21us (205us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109374.217918:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00080000:1.0:1786109374.217940:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109374.217944:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109374.217947:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933169280:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1786109374.217953:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109374.217955:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109374.217958:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933169408:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1786109374.217963:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109374.217966:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109374.217968:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab928ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933169536:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1786109374.233126:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933168256:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 18012us (18092us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109374.233144:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12237 00000100:00080000:3.0:1786109374.235143:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109374.235164:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109374.235172:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933168256:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1786109374.245413:0:189696:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1786109374.245427:0:189696:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804562 gen 4 00000100:00100000:1.0:1786109374.245468:0:189696:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff93098c344a80 x1872862933167616/t25769804563(25769804563) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109384 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109374.245502:0:189696:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1786109374.247386:0:189696:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1786109374.247395:0:189696:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738457 gen 4 00000004:00080000:1.0:1786109374.247416:0:189696:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786109374.247419:0:189696:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1786109374.247787:0:187951:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1786109374.247794:0:187951:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x130:0x0] index 1 count 1 00000040:00080000:2.0:1786109374.247806:0:187951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 76 count 2 00000100:00080000:1.0:1786109374.248592:0:189696:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1786109374.248597:0:189696:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975818 gen 4 00000004:00080000:1.0:1786109374.248650:0:189696:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786109374.248653:0:189696:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1786109374.249751:0:187953:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1786109374.249758:0:187953:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x132:0x0] index 1 count 1 00000040:00080000:2.0:1786109374.249783:0:187953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 76 count 2 00000020:00000080:1.0:1786109374.250995:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca308ac 00000020:00000080:1.0:1786109374.251009:0:189696:0:(genops.c:906:class_export_put()) final put ffff930ab198b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1786109374.251786:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca308c1 00000020:00000080:1.0:1786109374.251794:0:189696:0:(genops.c:906:class_export_put()) final put ffff930a87b2b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1786109374.251800:0:189696:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1786109374.251806:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109374.251820:0:189696:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786109374.251825:0:189696:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff93098478cd40) has no exports 00000004:01000000:1.0:1786109374.252016:0:189696:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1786109374.252151:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30938 00000020:00000080:1.0:1786109374.252157:0:189696:0:(genops.c:906:class_export_put()) final put ffff930985b78000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1786109374.252162:0:189696:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1786109374.252166:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109374.252176:0:189696:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1786109374.252180:0:189696:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff930984ea99c0) has no exports 00000020:00000080:1.0:1786109374.252186:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3092a 00000020:00000080:1.0:1786109374.252190:0:189696:0:(genops.c:906:class_export_put()) final put ffff930aafff7000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786109374.252508:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab198b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1786109374.252519:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b2b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1786109374.252523:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930985b78000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1786109374.252528:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930aafff7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1786109374.252807:0:189696:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1786109374.252813:0:189696:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1786109374.252818:0:189696:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975818 gen 5 00000004:00080000:1.0:1786109374.252824:0:189696:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786109374.252828:0:189696:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786109374.252912:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109374.252923:0:189696:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786109374.252929:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3091c 00000020:00000080:1.0:1786109374.252935:0:189696:0:(genops.c:906:class_export_put()) final put ffff930ac0af6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786109374.253281:0:179248:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930aafff6800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1786109374.253289:0:179248:0:(genops.c:906:class_export_put()) final put ffff930ac0af6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786109374.253292:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0af6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1786109374.253299:0:179248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1786109374.253652:0:189696:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1786109374.253657:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109374.253665:0:189696:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1786109374.253669:0:189696:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff93098272cd40) has no exports 00000020:00000080:1.0:1786109374.253675:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30915 00000020:00000080:1.0:1786109374.253679:0:189696:0:(genops.c:906:class_export_put()) final put ffff930a8a47d000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1786109374.254098:0:189696:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1786109374.254102:0:189696:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1786109374.254106:0:189696:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738457 gen 5 00000004:00080000:1.0:1786109374.254111:0:189696:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786109374.254112:0:189696:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786109374.254164:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109374.254173:0:189696:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1786109374.254187:0:189696:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1786109374.254194:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30907 00000020:00000080:1.0:1786109374.254199:0:189696:0:(genops.c:906:class_export_put()) final put ffff930ac126f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1786109374.254204:0:189696:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1786109374.254208:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109374.254212:0:189696:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1786109374.254214:0:189696:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff930984ea8000) has no exports 00000020:00000080:1.0:1786109374.254219:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30900 00000020:00000080:1.0:1786109374.254222:0:189696:0:(genops.c:906:class_export_put()) final put ffff930981e17800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786109374.254330:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0af6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1786109374.254338:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930a8a47d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1786109374.254342:0:179248:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a8a47a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1786109374.254347:0:179248:0:(genops.c:906:class_export_put()) final put ffff930ac126a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786109374.254349:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac126a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1786109374.254354:0:179248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786109374.254411:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac126f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1786109374.254417:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930981e17800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1786109374.341210:0:189696:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1786109374.341222:0:189696:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1786109374.341238:0:189696:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804562 gen 5 00000100:00100000:3.0:1786109374.341260:0:189696:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786109374.341328:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109374.341347:0:189696:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109374.341384:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109374.341389:0:189696:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109374.341397:0:189696:0:(genops.c:906:class_export_put()) final put ffff930ab198c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786109374.341403:0:189696:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab198c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1786109374.341417:0:189696:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109374.342356:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca308c8 00000020:00000080:3.0:1786109374.342369:0:189696:0:(genops.c:906:class_export_put()) final put ffff930a87b2a800/lustre-MDD0000_UUID 00000020:01000000:3.0:1786109374.342378:0:189696:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1786109374.342382:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109374.342390:0:189696:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1786109374.342395:0:189696:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9309852119c0) has no exports 00000020:00000080:3.0:1786109374.342422:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109374.342547:0:189696:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1786109374.342554:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca308cf 00000020:00000080:3.0:1786109374.342560:0:189696:0:(genops.c:906:class_export_put()) final put ffff930a87b2d000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1786109374.342568:0:189696:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93098c88e000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1786109374.342572:0:189696:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93098c88e000 3 00000020:01000004:3.0:1786109374.342576:0:189696:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93098c88e000 from lustre-MDT0000 00000020:00000080:3.0:1786109374.342598:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109374.342604:0:189696:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1786109374.342607:0:189696:0:(genops.c:906:class_export_put()) final put ffff930ab198e800/lustre-MDT0000_UUID 00000020:00000080:3.0:1786109374.342609:0:189696:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab198e800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1786109374.342621:0:189696:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1786109374.342660:0:189696:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1786109374.342666:0:189696:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1786109374.342670:0:189696:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1786109374.342673:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109374.342677:0:189696:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1786109374.342684:0:189696:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff930ab1990800 aeab97cc-8463-4daa-a678-1bb2ad93cc69 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786109374.342694:0:189696:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff93098e166800 fea1ac35-e793-43ec-a86d-d40dc5658dad 192.168.203.38@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786109374.342699:0:189696:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff930ab7c499c0) has exports, disconnecting them 00000020:00080000:3.0:1786109374.342704:0:189696:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff930ab1990800), last request at 1786109319 00000020:00000080:3.0:1786109374.342736:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3077f 00000020:00010000:3.0:1786109374.342741:0:189696:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930ab1990800: total 2 00000100:00080000:3.0:1786109374.342746:0:189696:0:(import.c:65:import_set_state_nolock()) ffff930ab1994000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1786109374.342772:0:189696:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab1990800): rc 0 00000020:00080000:3.0:1786109374.342776:0:189696:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.38@tcp (ffff93098e166800), last request at 1786109315 00000020:00000080:3.0:1786109374.342840:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3075c 00000020:00010000:3.0:1786109374.342844:0:189696:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93098e166800: total 2 00000100:00080000:3.0:1786109374.342847:0:189696:0:(import.c:65:import_set_state_nolock()) ffff93098e163800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1786109374.342857:0:189696:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.38@tcp (ffff93098e166800): rc 0 00000020:00080000:3.0:1786109374.342861:0:189696:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff930ab7c499c0) has no exports 00000100:00100000:2.0:1786109374.343207:0:187898:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff930985c0ae00:187898] 3 exiting: rc = 0 00000020:00000080:2.0:1786109374.343820:0:179248:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930981e14000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1786109374.343829:0:179248:0:(genops.c:906:class_export_put()) final put ffff930ac0b3c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786109374.343831:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0b3c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1786109374.343837:0:179248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786109374.343916:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b2a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1786109374.343921:0:179248:0:(genops.c:906:class_export_put()) final put ffff930ab198d000/lustre-MDD0000_UUID 00000020:00000080:2.0:1786109374.343923:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab198d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1786109374.343927:0:179248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1786109374.343955:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b2d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1786109374.345646:0:29734:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930ab1990800: total 0 00010000:00010000:1.0:1786109374.345718:0:29734:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930ab1990800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1786109374.345763:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab28bd400/0xdb52b77d7ca309d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca309cb expref: 14 pid: 187890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345787:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab28bce00/0xdb52b77d7ca309e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca309d9 expref: 13 pid: 187890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345800:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab28bc800/0xdb52b77d7ca309fc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca309f5 expref: 12 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345818:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930985200000/0xdb52b77d7ca3085f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca30858 expref: 11 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345829:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab28bc600/0xdb52b77d7ca3086d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca30866 expref: 10 pid: 187890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345841:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166ce00/0xdb52b77d7ca309ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca309e7 expref: 9 pid: 187888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345853:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930985200c00/0xdb52b77d7ca309a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca309a1 expref: 8 pid: 187889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345866:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab28bc200/0xdb52b77d7ca30a0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca30a03 expref: 7 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345878:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930985200200/0xdb52b77d7ca3099a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca30993 expref: 6 pid: 187889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345891:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930985201600/0xdb52b77d7ca307b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca307b0 expref: 5 pid: 187888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345902:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930984c89c00/0xdb52b77d7ca309b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca309af expref: 4 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345915:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930985200600/0xdb52b77d7ca309c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca309bd expref: 3 pid: 187889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345927:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166ca00/0xdb52b77d7ca307a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca307a2 expref: 2 pid: 187890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.345940:0:29734:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930ab1990800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1786109374.345959:0:29734:0:(genops.c:906:class_export_put()) final put ffff930ab1990800/aeab97cc-8463-4daa-a678-1bb2ad93cc69 00000020:00010000:1.0:1786109374.346159:0:29734:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93098e166800: total 1 00010000:00010000:1.0:1786109374.346164:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109374.346187:0:29734:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93098e166800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1786109374.346208:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930984c88c00/0xdb52b77d7ca3076a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a09e0 expref: 5 pid: 187890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.346224:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930984c88e00/0xdb52b77d7ca30778 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a09ee expref: 4 pid: 187890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.346875:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166c800/0xdb52b77d7ca30771 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a09e7 expref: 3 pid: 187888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.346895:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab28bda00/0xdb52b77d7ca30a11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a09f5 expref: 2 pid: 187898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109374.346907:0:29734:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93098e166800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1786109374.346924:0:29734:0:(genops.c:906:class_export_put()) final put ffff93098e166800/fea1ac35-e793-43ec-a86d-d40dc5658dad 00000020:00000080:2.0:1786109374.347016:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab1990800/aeab97cc-8463-4daa-a678-1bb2ad93cc69 for MGS 00000100:00100000:0.0:1786109374.347215:0:187889:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff930ab95ac400:187889] 1 exiting: rc = 0 00000100:00100000:0.0:1786109374.347366:0:187888:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff930ab2921200:187888] 0 exiting: rc = 1 00000020:00000080:2.0:1786109374.348580:0:179248:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab1994000 for MGS 00010000:00010000:1.0:1786109374.348841:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109374.348845:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109374.348848:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109374.348857:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109374.348903:0:187890:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff930ab2921e00:187890] 2 exiting: rc = 0 00000020:00000080:1.0:1786109374.348993:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e166800/fea1ac35-e793-43ec-a86d-d40dc5658dad for MGS 00000020:00000080:1.0:1786109374.349019:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098e163800 for MGS 00000100:00100000:3.0:1786109374.350012:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350035:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350132:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350140:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350147:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350155:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350161:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350167:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350174:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350183:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350190:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350198:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350207:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350213:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350219:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350226:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350246:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350264:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350271:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350278:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350285:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350292:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.350298:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351359:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351369:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351384:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351391:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351397:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351403:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351410:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351416:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351811:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351821:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351835:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351841:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351847:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351854:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351862:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351868:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351875:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351880:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351886:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351892:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351897:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351904:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351909:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351915:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351921:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351927:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351935:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351941:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351947:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351953:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351959:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351965:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351970:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351978:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351985:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351991:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.351996:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.352002:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.352009:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.352016:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109374.352023:0:189696:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1786109374.369859:0:189696:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ac1192300 - data ffff930abfbad6c0/ffff930985aa6c00 00000020:01000000:3.0:1786109374.370592:0:189696:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930aa67e4f00 - data ffff930abfb21510/ffff930a89da5800 00000020:00000080:3.0:1786109374.388529:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3074e 00000020:00000080:3.0:1786109374.388550:0:189696:0:(genops.c:906:class_export_put()) final put ffff93098e163000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1786109374.388577:0:189696:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93098c88e000 from MGS, refs=2 00000020:01000004:3.0:1786109374.388583:0:189696:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93098c88e000 2 00000020:01000004:3.0:1786109374.388586:0:189696:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93098c88e000 from MGS 00000020:00000080:3.0:1786109374.388654:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109374.388667:0:189696:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1786109374.388670:0:189696:0:(genops.c:906:class_export_put()) final put ffff93098e162800/MGS 00000020:00000080:3.0:1786109374.388674:0:189696:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e162800/MGS for MGS 00000020:01000000:3.0:1786109374.388685:0:189696:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1786109374.388795:0:189696:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1786109374.388800:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109374.390188:0:189696:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1786109374.391181:0:189696:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff930986178000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786109374.391190:0:189696:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff930982728000) has exports, disconnecting them 00000020:00080000:3.0:1786109374.391195:0:189696:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff930986178000), last request at 1786109320 00000020:00000080:3.0:1786109374.391201:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30977 00000020:00080000:3.0:1786109374.391224:0:189696:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930986178000): rc 0 00000020:00000080:3.0:1786109374.391231:0:189696:0:(genops.c:906:class_export_put()) final put ffff930986178000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1786109374.394141:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e163000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1786109374.394172:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930986178000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1786109374.415608:0:189696:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1786109374.415621:0:189696:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786109374.415627:0:189696:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1786109374.415636:0:189696:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1786109374.416728:0:179248:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930983755800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1786109374.416932:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786109374.416950:0:189696:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1786109374.416957:0:189696:0:(genops.c:906:class_export_put()) final put ffff930986179000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1786109374.416963:0:189696:0:(genops.c:865:class_export_destroy()) destroying export ffff930986179000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1786109374.416982:0:189696:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1786109374.417099:0:189696:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93098c88e000 1 00000020:00000080:2.0:1786109374.417107:0:189696:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30740 00000020:00000080:2.0:1786109374.417115:0:189696:0:(genops.c:906:class_export_put()) final put ffff93098e166000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1786109374.417132:0:189696:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1786109374.417143:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e166000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1786109374.417155:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786109374.417160:0:189696:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1786109374.417165:0:189696:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff930ac11b0000) has no exports 00010000:00010000:0.0:1786109374.532966:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786109374.539160:0:189696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786109374.539179:0:189696:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1786109374.539186:0:189696:0:(genops.c:906:class_export_put()) final put ffff93098c889800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786109374.539192:0:189696:0:(genops.c:865:class_export_destroy()) destroying export ffff93098c889800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1786109374.539204:0:189696:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1786109374.539427:0:189696:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93098c88e800 00000020:02000400:2.0:1786109374.539616:0:189696:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1786109375.556529:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109376.260616:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933169664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109376.260915:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109376.260978:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933169792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109376.261003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109376.261047:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933169664 00000100:00100000:1.0:1786109376.261054:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933169664 00000100:00100000:1.0:1786109376.261093:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933169792 00000100:00100000:1.0:1786109376.261095:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933169792 00000100:00100000:1.0:1786109376.261112:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5721 00000100:00100000:1.0:1786109376.261120:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933169664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109376.261145:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109376.261182:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933169664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109376.261189:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5721 00000100:00100000:1.0:1786109376.261203:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5722 00000100:00100000:1.0:1786109376.261208:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933169792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109376.261562:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109376.261601:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933169792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 392us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109376.261607:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5722 00000100:00080000:1.0:1786109376.261627:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109376.261631:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109376.261669:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933169792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109376.261899:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933169664:0@lo:13:osp-pre-0-1.0 00000400:00000100:0.0:1786109376.574359:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922069248 offset 0 length 224: 4 00000100:00100000:0.0:1786109376.575355:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109376.575391:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109376.575419:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109376.575493:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922069504 00000100:00100000:2.0:1786109376.575506:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922069504 00000100:00100000:2.0:1786109376.575568:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922069376 00000100:00100000:2.0:1786109376.575571:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922069376 00000100:00100000:2.0:1786109376.575585:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1786109376.575595:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922069504:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109376.575652:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109376.575690:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922069760 00000100:00100000:0.0:1786109376.575694:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922069760 00000100:00100000:0.0:1786109376.575726:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922069632 00000100:00100000:0.0:1786109376.575728:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922069632 00000100:00100000:0.0:1786109376.575761:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6828 00000100:00100000:1.0:1786109376.576369:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 870 00000100:00100000:1.0:1786109376.576377:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1872862922069376:12345-192.168.203.38@tcp:400:kworker.0 00000020:00080000:1.0:1786109376.576385:0:187900:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.38@tcp 00000100:00100000:1.0:1786109376.576461:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1872862922069376:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 84us (1041us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109376.576469:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 870 00000100:00080000:1.0:1786109376.576509:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109376.576513:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109376.576516:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109376.576536:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6829 00000100:00100000:1.0:1786109376.576545:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922069632:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109376.576577:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922069632:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109376.576588:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6829 00000100:00100000:2.0:1786109376.576629:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922069504:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1035us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109376.576636:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:0.0:1786109376.576712:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922069760:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109376.576743:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922069760:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 976us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109376.576763:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6828 00010000:00010000:1.0:1786109376.584550:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109376.599264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109376.599424:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922069888 00000100:00100000:1.0:1786109376.599492:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922069888 00000100:00100000:1.0:1786109376.599575:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 871 00000100:00100000:1.0:1786109376.599584:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922069888:12345-192.168.203.38@tcp:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1786109376.599607:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109376.599667:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922069888:12345-192.168.203.38@tcp:38:ptlrpcd_00_00.0 Request processed in 82us (410us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109376.599674:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 871 00010000:00010000:1.0:1786109377.605272:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109378.628659:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109379.332688:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933169920:0@lo:400:kworker.0 00000400:00000100:1.0:1786109379.332748:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933169920 offset 0 length 224: 4 00000100:00080000:3.0:1786109379.332836:0:179248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109379.332842:0:179248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109379.332845:0:179248:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109379.332850:0:179248:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8230 00000100:00080000:3.0:1786109379.332855:0:179248:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1786109379.332860:0:179248:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109379.332884:0:179248:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1f55880 x1872862933170048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109379.332929:0:179248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109379.332933:0:179248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109379.332935:0:179248:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109379.332938:0:179248:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8230 00000100:00080000:3.0:1786109379.332942:0:179248:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1786109379.332945:0:179248:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109379.332956:0:179248:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1f54700 x1872862933170304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109379.332972:0:179248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109379.332975:0:179248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109379.332977:0:179248:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109379.332980:0:179248:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8230 00000100:00080000:3.0:1786109379.332982:0:179248:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1786109379.332986:0:179248:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109379.333042:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933170176:0@lo:400:kworker.0 00000100:00100000:2.0:1786109379.333083:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109379.333111:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109379.333116:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933170432:0@lo:400:kworker.0 00000100:00100000:2.0:1786109379.333136:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109379.333165:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933170176 00000100:00100000:2.0:1786109379.333171:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933170176 00000100:00100000:2.0:1786109379.333220:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933170432 00000100:00100000:2.0:1786109379.333223:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933170432 00000100:00100000:2.0:1786109379.333249:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1786109379.333258:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933170176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109379.333309:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933170176:12345-0@lo:400:kworker.0 Request processed in 52us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109379.333316:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1786109379.333333:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786109379.333340:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933170432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109379.333368:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933170432:12345-0@lo:400:kworker.0 Request processed in 29us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109379.333373:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786109379.333411:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933170432:0@lo:400:kworker.0 00000100:00100000:2.0:1786109379.333424:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933170176:0@lo:400:kworker.0 00000100:00080000:1.0:1786109379.333638:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109379.333705:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933170048:0@lo:38:kworker.0 00000100:00100000:0.0:1786109379.333736:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109379.333769:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933170304:0@lo:38:kworker.0 00000100:00100000:0.0:1786109379.333791:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109379.333871:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933170048 00000100:00100000:1.0:1786109379.333876:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933170048 00000100:00100000:1.0:1786109379.333908:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933170304 00000100:00100000:1.0:1786109379.333911:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933170304 00000100:00100000:1.0:1786109379.333925:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1786109379.333930:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933170048:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109379.333949:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109379.333986:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933170048:12345-0@lo:38:kworker.0 Request processed in 54us (248us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109379.334048:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1786109379.334095:0:179248:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9663100 x1872862933170560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109379.334132:0:179248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109379.334136:0:179248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109379.334138:0:179248:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109379.334142:0:179248:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8230 00000100:00080000:2.0:1786109379.334145:0:179248:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109379.334149:0:179248:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109379.334164:0:179248:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0fdfb80 x1872862933170944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109379.334187:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933170688:0@lo:400:kworker.0 00000100:00100000:2.0:1786109379.334215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109379.334235:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109379.334240:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933170816:0@lo:400:kworker.0 00000100:00100000:2.0:1786109379.334259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109379.334334:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933170688 00000100:00100000:3.0:1786109379.334339:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933170688 00000100:00100000:3.0:1786109379.334380:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933170816 00000100:00100000:3.0:1786109379.334383:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933170816 00000100:00100000:3.0:1786109379.334405:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6830 00000100:00100000:3.0:1786109379.334412:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933170688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109379.334475:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933170688:12345-0@lo:400:kworker.0 Request processed in 64us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109379.334481:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6830 00000100:00100000:3.0:1786109379.334494:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6831 00000100:00100000:3.0:1786109379.334500:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933170816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109379.334528:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933170816:12345-0@lo:400:kworker.0 Request processed in 29us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109379.334534:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6831 00000100:00100000:3.0:1786109379.334572:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933170816:0@lo:400:kworker.0 00000100:00100000:3.0:1786109379.334582:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933170688:0@lo:400:kworker.0 00000100:00080000:2.0:1786109379.334636:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109379.334640:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109379.334704:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1786109379.334710:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933170304:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109379.334722:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109379.334754:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933170304:12345-0@lo:38:kworker.0 Request processed in 43us (962us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109379.334761:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1786109379.334783:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933170560:0@lo:38:kworker.0 00000100:00100000:0.0:1786109379.334808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109379.334879:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933170944:0@lo:38:kworker.0 00000100:00100000:0.0:1786109379.334901:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109379.334925:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109379.334929:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109379.334933:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933170048:0@lo:38:kworker.0 00000100:00080000:0.0:1786109379.334942:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109379.334945:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109379.334948:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933170304:0@lo:38:kworker.0 00000100:00100000:0.0:1786109379.334971:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933170944 00000100:00100000:0.0:1786109379.334974:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933170944 00000100:00100000:0.0:1786109379.334990:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1786109379.335063:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933170944:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109379.335074:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109379.335106:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933170944:12345-0@lo:38:kworker.0 Request processed in 42us (203us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109379.335134:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933170560 00000100:00100000:2.0:1786109379.335138:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933170560 00000100:00100000:2.0:1786109379.335162:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12238 00000100:00100000:2.0:1786109379.335168:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933170560:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109379.335179:0:8451:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109379.335210:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933170560:12345-0@lo:38:kworker.0 Request processed in 41us (400us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109379.335216:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12238 00000100:00080000:1.0:1786109379.335312:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109379.335317:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109379.335320:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933170560:0@lo:38:kworker.0 00000100:00080000:1.0:1786109379.335329:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109379.335331:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109379.335334:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933170944:0@lo:38:kworker.0 00000100:00100000:0.0:1786109379.335525:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00010000:00010000:3.0:1786109379.653484:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786109380.361473:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786109380.361482:0:9518:0:(genops.c:906:class_export_put()) final put ffff930ab7c43800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1786109380.361707:0:184688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786109380.361711:0:184688:0:(genops.c:906:class_export_put()) final put ffff93098617f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786109380.361870:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab7c43800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1786109380.361923:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff93098617f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1786109380.361939:0:179248:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab7c41800 for lustre-OST0001 00000020:00000080:1.0:1786109380.361945:0:179248:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098617e000 for lustre-OST0000 00000001:00100000:0.0:1786109380.362506:0:187891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1786109380.362528:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804563 is committed 00000020:00000080:0.0:1786109380.362532:0:187891:0:(genops.c:906:class_export_put()) final put ffff930ab1991800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786109380.362612:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab1991800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1786109380.363032:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac09ce800 for lustre-MDT0001 00010000:00010000:2.0:1786109380.720094:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109381.381666:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933171072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109381.381735:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109381.381880:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933171072 00000100:00100000:3.0:1786109381.381889:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933171072 00000100:00100000:3.0:1786109381.381952:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5723 00000100:00100000:3.0:1786109381.381961:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933171072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109381.381999:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109381.382045:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933171072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109381.382052:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5723 00000100:00100000:3.0:1786109381.382090:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933171072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109381.382656:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933171200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109381.382690:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109381.382779:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109381.382801:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933171200 00000100:00100000:0.0:1786109381.382806:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933171200 00000100:00100000:0.0:1786109381.382849:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5724 00000100:00100000:0.0:1786109381.382856:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933171200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109381.382873:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109381.382910:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933171200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109381.382916:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5724 00000100:00100000:0.0:1786109381.382952:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933171200:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1786109381.383415:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000400:00000100:1.0:1786109381.652145:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922070016 offset 0 length 224: 4 00000100:00100000:1.0:1786109381.652185:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109381.652230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109381.652268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109381.652635:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922070144 00000100:00100000:2.0:1786109381.652646:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922070144 00000100:00100000:2.0:1786109381.652690:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 875 00000100:00100000:2.0:1786109381.652698:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1872862922070144:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:2.0:1786109381.652720:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109381.652774:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1872862922070144:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 75us (589us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109381.652781:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 875 00000100:00100000:0.0:1786109381.653062:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922070400 00000100:00100000:0.0:1786109381.653067:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922070400 00000100:00100000:0.0:1786109381.653173:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922070528 00000100:00100000:0.0:1786109381.653176:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922070528 00000100:00100000:0.0:1786109381.653196:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6832 00000100:00100000:0.0:1786109381.653217:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922070528:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109381.653255:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922070528:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 40us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109381.653261:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6832 00000100:00100000:0.0:1786109381.653275:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23062 00000100:00100000:0.0:1786109381.653280:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:397d331e-10fc-4558-be87-308c3622e8eb+5:2401:x1872862922070400:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:0.0:1786109381.653296:0:8441:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3307c 00000100:00080000:0.0:1786109381.653304:0:8441:0:(import.c:65:import_set_state_nolock()) ffff930ab2abb000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1786109381.654240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109381.654425:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922070272 00000100:00100000:1.0:1786109381.654457:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922070272 00000100:00100000:1.0:1786109381.654500:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:1.0:1786109381.654509:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922070272:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109381.654552:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922070272:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 45us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109381.654558:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00010000:00010000:1.0:1786109381.654576:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109381.654861:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109381.654866:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109381.654869:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1786109381.656224:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738457 00000100:00100000:2.0:1786109381.657102:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:397d331e-10fc-4558-be87-308c3622e8eb+2:2401:x1872862922070400:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 3804us (4854us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109381.657113:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23062 00010000:00010000:0.0:1786109381.765450:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109382.788606:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109383.835482:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109384.452630:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109384.452637:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109384.452641:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109384.452649:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8235 00000100:00080000:0.0:1786109384.452655:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109384.452661:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109384.452683:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098490bb80 x1872862933171456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109384.452717:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109384.452721:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109384.452722:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109384.452726:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8235 00000100:00080000:0.0:1786109384.452729:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109384.452732:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109384.452745:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1706300 x1872862933171712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109384.452764:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933171456:0@lo:38:kworker.0 00000100:00080000:0.0:1786109384.452772:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109384.452776:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109384.452778:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109384.452781:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8235 00000100:00080000:0.0:1786109384.452784:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109384.452788:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109384.452803:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1705c00 x1872862933171968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109384.452839:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933171840:0@lo:400:kworker.0 00000100:00100000:2.0:1786109384.452841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109384.452841:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109384.452851:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109384.452853:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109384.452858:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8235 00000100:00080000:0.0:1786109384.452861:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109384.452865:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109384.452879:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1704a80 x1872862933172352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109384.452924:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933171584:0@lo:400:kworker.0 00000100:00100000:2.0:1786109384.452927:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933171712:0@lo:38:kworker.0 00000100:00100000:0.0:1786109384.453038:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933172096:0@lo:400:kworker.0 00000100:00100000:3.0:1786109384.453092:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109384.453096:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109384.453167:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933172096 00000100:00100000:0.0:1786109384.453174:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933172096 00000100:00100000:0.0:1786109384.453226:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6833 00000100:00100000:0.0:1786109384.453236:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933172096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109384.453287:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933172096:12345-0@lo:400:kworker.0 Request processed in 51us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109384.453294:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6833 00000100:00100000:3.0:1786109384.453305:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933171328:0@lo:400:kworker.0 00000400:00000100:3.0:1786109384.453334:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933171328 offset 0 length 224: 4 00000100:00100000:0.0:1786109384.453340:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933172096:0@lo:400:kworker.0 00000100:00100000:3.0:1786109384.453365:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933172224:0@lo:400:kworker.0 00000100:00100000:0.0:1786109384.453392:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933171456 00000100:00100000:3.0:1786109384.453395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109384.453397:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933171456 00000100:00100000:0.0:1786109384.453424:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933171840 00000100:00100000:0.0:1786109384.453427:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933171840 00000100:00100000:0.0:1786109384.453483:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786109384.453491:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933171840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109384.453503:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:3.0:1786109384.453509:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933171456:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109384.453530:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109384.453536:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933171840:12345-0@lo:400:kworker.0 Request processed in 44us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109384.453544:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786109384.453568:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933171456:12345-0@lo:38:kworker.0 Request processed in 57us (730us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109384.453576:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:0.0:1786109384.453579:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933171840:0@lo:400:kworker.0 00000100:00100000:0.0:1786109384.453614:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933172224 00000100:00100000:0.0:1786109384.453618:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933172224 00000100:00100000:0.0:1786109384.453651:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6834 00000100:00100000:0.0:1786109384.453663:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933172224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109384.453707:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933172224:12345-0@lo:400:kworker.0 Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109384.453713:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6834 00000100:00100000:0.0:1786109384.453737:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933172224:0@lo:400:kworker.0 00000100:00100000:2.0:1786109384.455636:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109384.455690:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933171968:0@lo:38:kworker.0 00000100:00100000:2.0:1786109384.455738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109384.455761:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933172352:0@lo:38:kworker.0 00000100:00100000:2.0:1786109384.455786:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109384.455830:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933171968 00000100:00080000:2.0:1786109384.455836:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109384.455843:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109384.455846:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933171968 00000100:00100000:2.0:1786109384.455850:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933171456:0@lo:38:kworker.0 00000100:00080000:2.0:1786109384.455895:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109384.455901:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109384.455906:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109384.455923:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12239 00000100:00100000:1.0:1786109384.455932:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933171712 00000100:00100000:3.0:1786109384.455935:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933171968:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1786109384.455942:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933171712 00000100:00100000:2.0:1786109384.455971:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933172352 00000100:00100000:2.0:1786109384.455977:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933172352 00010000:00020000:3.0:1786109384.455980:0:8452:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109384.456008:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:2.0:1786109384.456017:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933171712:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109384.456037:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109384.456121:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1786109384.456127:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933172352:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109384.456136:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109384.456149:0:187900:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1786109384.456159:0:187900:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1786109384.456220:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933171968:12345-0@lo:38:kworker.0 Request processed in 283us (478us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109384.456230:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12239 00000100:00100000:2.0:1786109384.456242:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933171712:12345-0@lo:38:kworker.0 Request processed in 221us (610us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109384.456252:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00080000:2.0:1786109384.456287:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109384.456293:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109384.456296:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933171712:0@lo:38:kworker.0 00000100:00080000:2.0:1786109384.456307:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109384.456311:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109384.456313:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933171968:0@lo:38:kworker.0 00000100:00100000:2.0:1786109384.456369:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109384.456410:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933171584 00000100:00100000:3.0:1786109384.456418:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933171584 00000100:00100000:3.0:1786109384.456549:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1786109384.456550:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109384.456560:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933171584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109384.456710:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933171584:12345-0@lo:400:kworker.0 Request processed in 152us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109384.456719:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786109384.456813:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933172352:12345-0@lo:38:kworker.0 Request processed in 683us (1024us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109384.456822:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00080000:2.0:1786109384.456869:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1786109384.456871:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933171584:0@lo:400:kworker.0 00000100:00080000:2.0:1786109384.456875:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109384.456882:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933172352:0@lo:38:kworker.0 00010000:00010000:1.0:1786109384.836853:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109385.860691:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109386.501302:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109386.501320:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933172480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109386.501386:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109386.501389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109386.501400:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933172608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109386.501461:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109386.501586:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933172480 00000100:00100000:3.0:1786109386.501594:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933172480 00000100:00100000:3.0:1786109386.501661:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933172608 00000100:00100000:3.0:1786109386.501664:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933172608 00000100:00100000:3.0:1786109386.501690:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5725 00000100:00100000:3.0:1786109386.501700:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933172480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109386.501728:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109386.501757:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5726 00000100:00100000:1.0:1786109386.501770:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab3142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933172608:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109386.501779:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933172480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109386.501786:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5725 00002000:00000024:1.0:1786109386.501791:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109386.501835:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933172480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109386.501838:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab3142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933172608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109386.501847:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5726 00000100:00080000:0.0:1786109386.503054:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109386.503061:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109386.503141:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933172608:0@lo:13:osp-pre-1-1.0 00000400:00000100:1.0:1786109386.768515:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922070656 offset 0 length 224: 4 00000100:00100000:1.0:1786109386.768559:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109386.768607:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109386.768641:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109386.768797:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922070784 00000100:00100000:0.0:1786109386.768807:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922070784 00000100:00100000:0.0:1786109386.768881:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922070912 00000100:00100000:0.0:1786109386.768885:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922070912 00000100:00100000:3.0:1786109386.768906:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922071040 00000100:00100000:3.0:1786109386.768913:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922071040 00000100:00080000:0.0:1786109386.768913:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109386.768963:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:0.0:1786109386.768975:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922070912:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109386.768977:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6835 00000100:00100000:3.0:1786109386.768992:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922071040:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109386.769063:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922070912:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 82us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109386.769071:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:2.0:1786109386.769115:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 879 00000100:00100000:2.0:1786109386.769121:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922070784:12345-192.168.203.38@tcp:38:kworker.0 00000100:00100000:3.0:1786109386.769140:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922071040:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 151us (532us total) trans 0 rc 0/0 00010000:00020000:2.0:1786109386.769142:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109386.769150:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6835 00000100:00080000:3.0:1786109386.769214:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109386.769257:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922070784:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 133us (697us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109386.769265:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 879 00010000:00010000:3.0:1786109386.885926:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786109387.529032:0:184688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 397d331e-10fc-4558-be87-308c3622e8eb 00000020:00000080:2.0:1786109387.529042:0:184688:0:(genops.c:906:class_export_put()) final put ffff930ab2abf000/397d331e-10fc-4558-be87-308c3622e8eb 00000020:00000080:1.0:1786109387.529724:0:179248:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2abf000/397d331e-10fc-4558-be87-308c3622e8eb for lustre-OST0000 00000020:00000080:1.0:1786109387.529782:0:179248:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab2abb000 for lustre-OST0000 00010000:00010000:2.0:1786109387.910117:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109388.937340:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109389.575192:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109389.575198:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109389.575202:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109389.575209:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8241 00000100:00080000:2.0:1786109389.575214:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786109389.575220:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109389.575238:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0fdf100 x1872862933172864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109389.575265:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109389.575268:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109389.575270:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109389.575273:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8241 00000100:00080000:2.0:1786109389.575275:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786109389.575278:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109389.575288:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0fdc380 x1872862933173120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109389.575302:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109389.575304:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109389.575306:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109389.575309:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8241 00000100:00080000:2.0:1786109389.575312:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786109389.575315:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109389.575323:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0fdfb80 x1872862933173376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109389.575341:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109389.575344:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109389.575346:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109389.575349:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8241 00000100:00080000:2.0:1786109389.575351:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786109389.575353:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109389.575360:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098490bb80 x1872862933173760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109389.575382:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933172736:0@lo:400:kworker.0 00000400:00000100:2.0:1786109389.575425:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933172736 offset 0 length 224: 4 00000100:00100000:2.0:1786109389.575490:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933173632:0@lo:400:kworker.0 00000100:00100000:2.0:1786109389.575521:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109389.575541:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109389.575545:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933173504:0@lo:400:kworker.0 00000100:00100000:2.0:1786109389.575561:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109389.575581:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933172864:0@lo:38:kworker.0 00000100:00100000:2.0:1786109389.575603:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109389.575616:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933173120:0@lo:38:kworker.0 00000100:00100000:2.0:1786109389.575631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109389.575644:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933173376:0@lo:38:kworker.0 00000100:00100000:2.0:1786109389.575725:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109389.575742:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933173760:0@lo:38:kworker.0 00000100:00100000:2.0:1786109389.575820:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109389.575846:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933172992:0@lo:400:kworker.0 00000100:00100000:2.0:1786109389.575865:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109389.575881:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109389.575885:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933173248:0@lo:400:kworker.0 00000100:00100000:2.0:1786109389.575902:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109389.575943:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933173632 00000100:00100000:2.0:1786109389.575949:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933173632 00000100:00100000:2.0:1786109389.575995:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933173504 00000100:00100000:2.0:1786109389.575998:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933173504 00000100:00100000:2.0:1786109389.576030:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6836 00000100:00100000:2.0:1786109389.576039:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933173632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109389.576085:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933173632:12345-0@lo:400:kworker.0 Request processed in 48us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109389.576093:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6836 00000100:00100000:2.0:1786109389.576112:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6837 00000100:00100000:2.0:1786109389.576118:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933173504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109389.576146:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933173504:12345-0@lo:400:kworker.0 Request processed in 28us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109389.576151:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6837 00000100:00100000:2.0:1786109389.576173:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933172864 00000100:00100000:2.0:1786109389.576176:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933172864 00000100:00100000:2.0:1786109389.576189:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933173120 00000100:00100000:2.0:1786109389.576191:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933173120 00000100:00100000:2.0:1786109389.576196:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933173760 00000100:00100000:2.0:1786109389.576198:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933173760 00000100:00100000:2.0:1786109389.576204:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933172992 00000100:00100000:2.0:1786109389.576206:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933172992 00000100:00100000:2.0:1786109389.576220:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933173248 00000100:00100000:2.0:1786109389.576222:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933173248 00000100:00100000:2.0:1786109389.576235:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786109389.576240:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933172992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109389.576275:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933172992:12345-0@lo:400:kworker.0 Request processed in 35us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109389.576281:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786109389.576292:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1786109389.576298:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933173248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109389.576323:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933173248:12345-0@lo:400:kworker.0 Request processed in 25us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109389.576328:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1786109389.576339:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1786109389.576343:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933172864:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109389.576361:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109389.576387:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933172864:12345-0@lo:38:kworker.0 Request processed in 43us (784us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109389.576393:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1786109389.576402:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1786109389.576406:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933173120:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109389.576414:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109389.576447:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933173120:12345-0@lo:38:kworker.0 Request processed in 23us (798us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109389.576455:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1786109389.576464:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:2.0:1786109389.576467:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933173760:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109389.576476:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109389.576493:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933173760:12345-0@lo:38:kworker.0 Request processed in 25us (673us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109389.576498:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:2.0:1786109389.576512:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933173376 00000100:00100000:2.0:1786109389.576516:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933173376 00000100:00100000:2.0:1786109389.576532:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12240 00000100:00100000:2.0:1786109389.576536:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933173376:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109389.576545:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109389.576564:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933173376:12345-0@lo:38:kworker.0 Request processed in 27us (840us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109389.576569:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12240 00000100:00080000:2.0:1786109389.576588:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109389.576592:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109389.576593:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109389.576628:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933173248:0@lo:400:kworker.0 00000100:00100000:2.0:1786109389.576637:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933172992:0@lo:400:kworker.0 00000100:00080000:2.0:1786109389.577198:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109389.577206:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109389.577210:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933172864:0@lo:38:kworker.0 00000100:00080000:2.0:1786109389.577224:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109389.577227:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109389.577231:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933173120:0@lo:38:kworker.0 00000100:00080000:2.0:1786109389.577237:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109389.577240:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109389.577242:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933173376:0@lo:38:kworker.0 00000100:00080000:2.0:1786109389.577249:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109389.577251:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109389.577254:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933173760:0@lo:38:kworker.0 00000100:00100000:2.0:1786109389.577284:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933173504:0@lo:400:kworker.0 00000100:00100000:2.0:1786109389.577294:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933173632:0@lo:400:kworker.0 00010000:00010000:0.0:1786109389.956669:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109390.980959:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109391.620598:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109391.620616:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933173888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109391.620677:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109391.620732:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933173888 00000100:00100000:3.0:1786109391.620742:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933173888 00000100:00100000:3.0:1786109391.620847:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933174016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109391.620881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109391.620935:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933174016 00000100:00100000:3.0:1786109391.620940:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933174016 00000100:00100000:3.0:1786109391.620995:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5727 00000100:00100000:3.0:1786109391.621005:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933174016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109391.621034:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109391.621078:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933174016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109391.621085:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5727 00000100:00080000:3.0:1786109391.621107:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109391.621147:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933174016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109391.621298:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5728 00000100:00100000:2.0:1786109391.621305:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933173888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109391.621320:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109391.621350:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933173888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109391.621357:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5728 00000100:00080000:3.0:1786109391.622844:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109391.622906:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933173888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109391.936801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109391.936858:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109391.936893:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000400:00000100:3.0:1786109391.937539:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922071680 offset 0 length 520: 4 00000100:00100000:3.0:1786109391.937578:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922071424 00000100:00100000:3.0:1786109391.937587:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922071424 00000100:00100000:3.0:1786109391.937655:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922071296 00000100:00100000:3.0:1786109391.937659:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922071296 00000100:00100000:3.0:1786109391.937681:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:3.0:1786109391.937693:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922071424:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109391.937768:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922071424:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 77us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109391.937776:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:3.0:1786109391.937795:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 883 00000100:00100000:3.0:1786109391.937801:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922071296:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:3.0:1786109391.937822:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109391.937833:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922071552 00000100:00100000:3.0:1786109391.937850:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922071296:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 47us (956us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109391.937852:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922071552 00000100:00100000:3.0:1786109391.937861:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 883 00000100:00100000:0.0:1786109391.937922:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6838 00000100:00100000:0.0:1786109391.937930:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922071552:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109391.937962:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922071552:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109391.937968:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6838 00000100:00080000:3.0:1786109391.938924:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109391.938931:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1786109392.005592:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109393.030580:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109394.053716:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109394.697446:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109394.697455:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109394.697460:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109394.697472:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8246 00000100:00080000:0.0:1786109394.697478:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109394.697486:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109394.697513:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1706a00 x1872862933174272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109394.697543:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109394.697547:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109394.697549:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109394.697553:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8246 00000100:00080000:0.0:1786109394.697556:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109394.697560:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109394.697572:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1707800 x1872862933174528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109394.697599:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109394.697603:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109394.697605:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109394.697609:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8246 00000100:00080000:0.0:1786109394.697611:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109394.697615:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109394.698460:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1705880 x1872862933174784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109394.698491:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109394.698495:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109394.698497:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109394.698500:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8246 00000100:00080000:0.0:1786109394.698504:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109394.698508:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109394.698525:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7e5df80 x1872862933175168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109394.698567:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933174144:0@lo:400:kworker.0 00000100:00100000:1.0:1786109394.699203:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933174272:0@lo:38:kworker.0 00000400:00000100:0.0:1786109394.699253:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933174144 offset 0 length 224: 4 00000100:00100000:1.0:1786109394.700214:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109394.700309:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933174528:0@lo:38:kworker.0 00000100:00100000:1.0:1786109394.700343:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109394.700369:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933174784:0@lo:38:kworker.0 00000100:00100000:1.0:1786109394.700397:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109394.700444:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933175168:0@lo:38:kworker.0 00000100:00100000:1.0:1786109394.700473:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109394.700522:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933174400:0@lo:400:kworker.0 00000100:00100000:1.0:1786109394.700551:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109394.700591:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933174784 00000100:00100000:1.0:1786109394.700601:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933174784 00000100:00100000:0.0:1786109394.701168:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933175040:0@lo:400:kworker.0 00000100:00100000:0.0:1786109394.701206:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109394.701251:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933174656:0@lo:400:kworker.0 00000100:00100000:0.0:1786109394.701278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109394.701302:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109394.701310:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933174912:0@lo:400:kworker.0 00000100:00100000:0.0:1786109394.701332:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109394.701370:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933174272 00000100:00100000:0.0:1786109394.701375:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933174272 00000100:00100000:0.0:1786109394.701397:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933174528 00000100:00100000:0.0:1786109394.701399:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933174528 00000100:00100000:0.0:1786109394.701408:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933175168 00000100:00100000:0.0:1786109394.701410:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933175168 00000100:00100000:0.0:1786109394.701419:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933174400 00000100:00100000:0.0:1786109394.701421:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933174400 00000100:00100000:0.0:1786109394.701475:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933174656 00000100:00100000:0.0:1786109394.701479:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933174656 00000100:00100000:0.0:1786109394.701499:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786109394.701510:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933174400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109394.701576:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933174400:12345-0@lo:400:kworker.0 Request processed in 68us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109394.701583:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786109394.701602:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786109394.701608:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933174656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109394.703721:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12241 00000100:00100000:1.0:1786109394.703737:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933174784:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109394.703766:0:8451:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109394.703870:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933174784:12345-0@lo:38:kworker.0 Request processed in 133us (3471us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109394.703878:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12241 00000100:00100000:1.0:1786109394.703931:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:1.0:1786109394.703937:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933174272:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109394.703948:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109394.703978:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933174272:12345-0@lo:38:kworker.0 Request processed in 40us (3768us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109394.703984:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:1.0:1786109394.704001:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1786109394.704005:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933174528:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1786109394.705101:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933174656:12345-0@lo:400:kworker.0 Request processed in 3019us (3348us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109394.705173:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786109394.705209:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1786109394.705216:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933175168:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109394.705235:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109394.705283:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933175168:12345-0@lo:38:kworker.0 Request processed in 66us (4809us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109394.705290:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1786109394.705321:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933175040 00000100:00100000:0.0:1786109394.705330:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933175040 00000100:00100000:0.0:1786109394.705385:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933174912 00000100:00100000:0.0:1786109394.705388:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933174912 00000100:00100000:0.0:1786109394.705415:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6839 00000100:00100000:0.0:1786109394.705422:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933175040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109394.705500:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933175040:12345-0@lo:400:kworker.0 Request processed in 78us (4293us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109394.705508:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6839 00000100:00100000:0.0:1786109394.705520:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6840 00000100:00100000:0.0:1786109394.705527:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933174912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109394.705559:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933174912:12345-0@lo:400:kworker.0 Request processed in 33us (4226us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109394.705565:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6840 00000100:00080000:0.0:1786109394.705590:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109394.705595:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109394.705598:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00020000:1.0:1786109394.706458:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109394.706526:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933174528:12345-0@lo:38:kworker.0 Request processed in 2515us (6179us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109394.706537:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00080000:1.0:1786109394.706606:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109394.706613:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109394.706617:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933174272:0@lo:38:kworker.0 00000100:00100000:0.0:1786109394.708770:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933174912:0@lo:400:kworker.0 00000100:00100000:0.0:1786109394.708818:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933174656:0@lo:400:kworker.0 00000100:00100000:0.0:1786109394.708918:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933175040:0@lo:400:kworker.0 00000100:00100000:0.0:1786109394.708956:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933174400:0@lo:400:kworker.0 00000100:00080000:1.0:1786109394.709082:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109394.709090:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109394.709094:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933174528:0@lo:38:kworker.0 00000100:00080000:1.0:1786109394.709108:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109394.709125:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109394.709128:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933174784:0@lo:38:kworker.0 00000100:00080000:1.0:1786109394.709141:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109394.709144:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109394.709147:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933175168:0@lo:38:kworker.0 00010000:00010000:0.0:1786109395.083255:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1786109395.724402:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109379/real 1786109379] req@ffff930ac1f54a80 x1872862933169920/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109395 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109395.724474:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff930ac1f54a80 x1872862933169920/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109395 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109395.724487:0:3647:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1786109395.724491:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1786109395.724495:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.138@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1786109395.724497:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1786109395.724501:0:3647:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930ac1f54a80 x1872862933169920/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109395 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109395.724510:0:3647:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930984908380 x1872862933171328/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109400 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109395.724518:0:3647:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930ac0fded80 x1872862933172736/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109405 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109395.724532:0:3647:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930ac1706680 x1872862933174144/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109410 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1786109395.724542:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1786109395.724545:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1786109395.724547:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1786109395.724549:0:3647:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1786109395.724583:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933169920:0@lo:400:kworker.0 00000100:00100000:0.0:1786109395.724761:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933172736:0@lo:400:kworker.0 00000100:00080000:0.0:1786109395.724787:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109395.724793:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1786109395.724797:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109395.724803:0:183576:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8176 00000100:00080000:0.0:1786109395.724814:0:183576:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109395.724851:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7e5fb80 x1872862933175296/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109395.724875:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109395.724879:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109395.724881:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109395.724896:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8251 00000100:00080000:0.0:1786109395.724899:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109395.724903:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109395.724920:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7e5e680 x1872862933175424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109395.724944:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109395.724947:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109395.724949:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109395.724953:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8251 00000100:00080000:0.0:1786109395.724955:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109395.724959:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109395.724970:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7e5f480 x1872862933175680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109395.724989:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109395.724993:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109395.724995:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109395.724998:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8251 00000100:00080000:0.0:1786109395.725000:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109395.725004:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109395.725016:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7e5e300 x1872862933175936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109395.725039:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109395.725043:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109395.725045:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109395.725048:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8251 00000100:00080000:0.0:1786109395.725051:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109395.725054:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109395.725066:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7e5df80 x1872862933176320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109395.725093:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933175296:0@lo:250:kworker.0 00000100:00100000:1.0:1786109395.728515:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933175552:0@lo:400:kworker.0 00000100:00100000:2.0:1786109395.728617:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933171328:0@lo:400:kworker.0 00000400:00000100:0.0:1786109395.729854:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933175296 offset 0 length 520: 4 00000100:00100000:0.0:1786109395.729938:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933175424:0@lo:38:kworker.0 00000100:00100000:0.0:1786109395.729985:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109395.730011:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933175680:0@lo:38:kworker.0 00000100:00100000:0.0:1786109395.730035:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109395.730053:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933175936:0@lo:38:kworker.0 00000100:00100000:0.0:1786109395.730078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109395.730228:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933176320:0@lo:38:kworker.0 00000100:00100000:0.0:1786109395.730260:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109395.730319:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933176064:0@lo:400:kworker.0 00000100:00100000:0.0:1786109395.730351:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109395.730375:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109395.730382:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933175808:0@lo:400:kworker.0 00000100:00100000:0.0:1786109395.730402:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109395.730455:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933175424 00000100:00100000:0.0:1786109395.730465:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933175424 00000100:00100000:0.0:1786109395.730503:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933175680 00000100:00100000:0.0:1786109395.730506:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933175680 00000100:00100000:0.0:1786109395.730514:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933176320 00000100:00100000:0.0:1786109395.730516:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933176320 00000100:00100000:0.0:1786109395.730523:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933175808 00000100:00100000:0.0:1786109395.730525:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933175808 00000100:00100000:0.0:1786109395.730556:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786109395.730567:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933175808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109395.730719:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933175808:12345-0@lo:400:kworker.0 Request processed in 153us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109395.730727:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786109395.730746:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:0.0:1786109395.730751:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933175424:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109395.730773:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109395.730805:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933175424:12345-0@lo:38:kworker.0 Request processed in 52us (820us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109395.730811:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:0.0:1786109395.730822:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:0.0:1786109395.730827:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933175680:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109395.730836:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109395.730858:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933175680:12345-0@lo:38:kworker.0 Request processed in 30us (822us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109395.730863:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:0.0:1786109395.730874:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1786109395.730877:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933176320:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109395.730900:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109395.730927:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933176320:12345-0@lo:38:kworker.0 Request processed in 48us (667us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109395.730933:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1786109395.730959:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933175936 00000100:00100000:0.0:1786109395.730964:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933175936 00000100:00100000:0.0:1786109395.730985:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12242 00000100:00100000:0.0:1786109395.730990:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933175936:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109395.730998:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109395.731023:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933175936:12345-0@lo:38:kworker.0 Request processed in 32us (944us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109395.731029:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12242 00000100:00100000:0.0:1786109395.731049:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933176064 00000100:00100000:0.0:1786109395.731053:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933176064 00000100:00100000:0.0:1786109395.731079:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6841 00000100:00100000:0.0:1786109395.731085:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933176064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109395.731305:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933176192:0@lo:400:kworker.0 00000100:00100000:2.0:1786109395.733849:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109395.733932:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933174144:0@lo:400:kworker.0 00000100:00100000:2.0:1786109395.735070:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933176192 00000100:00100000:2.0:1786109395.735085:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933176192 00000100:00100000:2.0:1786109395.735284:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6842 00000100:00100000:2.0:1786109395.735296:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933176192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109395.735404:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933176192:12345-0@lo:400:kworker.0 Request processed in 110us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109395.735411:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6842 00000100:00100000:2.0:1786109395.735508:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933176192:0@lo:400:kworker.0 00000100:00100000:0.0:1786109395.735776:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933176064:12345-0@lo:400:kworker.0 Request processed in 4687us (5421us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109395.735786:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6841 00000100:00100000:0.0:1786109395.735824:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933175808:0@lo:400:kworker.0 00000100:00100000:0.0:1786109395.735838:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933176064:0@lo:400:kworker.0 00000100:00080000:0.0:1786109395.735875:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109395.735881:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109395.735896:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933175424:0@lo:38:kworker.0 00000100:00080000:0.0:1786109395.735912:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109395.735915:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109395.735919:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933175680:0@lo:38:kworker.0 00000100:00080000:0.0:1786109395.735929:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109395.735932:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109395.735935:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933175936:0@lo:38:kworker.0 00000100:00080000:0.0:1786109395.735947:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109395.735951:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109395.735954:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933176320:0@lo:38:kworker.0 00000100:00100000:1.0:1786109395.736241:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109395.737076:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933175552 00000100:00100000:0.0:1786109395.737085:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933175552 00000100:00100000:0.0:1786109395.737332:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786109395.737344:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933175552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109395.737420:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933175552:12345-0@lo:400:kworker.0 Request processed in 79us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109395.737448:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786109395.737490:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933175552:0@lo:400:kworker.0 00010000:00010000:1.0:1786109396.103875:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109396.740654:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933176448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109396.740750:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109396.740789:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933176448 00000100:00100000:2.0:1786109396.740801:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933176448 00000100:00100000:1.0:1786109396.740909:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109396.740922:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933176576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109396.740954:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109396.740988:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933176576 00000100:00100000:1.0:1786109396.740992:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933176576 00000100:00100000:1.0:1786109396.741060:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5729 00000100:00100000:1.0:1786109396.741073:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933176576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109396.741111:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109396.741165:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933176576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109396.741173:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5729 00000100:00100000:1.0:1786109396.741192:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5730 00000100:00100000:1.0:1786109396.741200:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933176448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109396.741218:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109396.741251:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933176448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109396.741257:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5730 00000100:00080000:1.0:1786109396.741572:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109396.741577:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109396.741625:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933176576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109396.741659:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933176448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109397.007743:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109397.007904:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109397.007971:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922072064 00000100:00100000:1.0:1786109397.007983:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922072064 00000100:00100000:1.0:1786109397.008169:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6843 00000100:00100000:1.0:1786109397.008184:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922072064:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109397.008686:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922072064:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 503us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109397.008697:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6843 00000100:00100000:0.0:1786109397.009257:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922071936 00000100:00100000:0.0:1786109397.009266:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922071936 00000100:00080000:2.0:1786109397.010071:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109397.010146:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109397.010263:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:0.0:1786109397.010276:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922071936:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109397.011469:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922071936:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1185us (3912us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109397.011482:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:2.0:1786109397.012170:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109397.012472:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922071808 00000100:00100000:0.0:1786109397.012483:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922071808 00000100:00100000:0.0:1786109397.012527:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 890 00000100:00100000:0.0:1786109397.012537:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922071808:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:0.0:1786109397.012740:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109397.012893:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922071808:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 354us (725us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109397.012902:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 890 00010000:00010000:3.0:1786109397.124623:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1786109398.037902:0:190316:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1786109398.037911:0:190316:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1786109398.037912:0:190316:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1786109398.038046:0:190316:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff930ab28f1800 00000020:01000004:0.0:1786109398.038066:0:190316:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1786109398.038085:0:190316:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1786109398.038165:0:190316:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9309827299c0) 00000020:00000080:0.0:1786109398.038188:0:190316:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1786109398.148130:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1786109398.148422:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00010000:00010000:2.0:1786109398.148705:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1786109398.150114:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1786109398.150373:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1786109398.150890:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1786109398.151132:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1786109398.151383:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1786109398.151702:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1786109398.151897:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1786109398.152160:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1786109398.152364:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1786109398.152602:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1786109398.152823:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1786109398.153098:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1786109398.156821:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1786109398.157891:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.158153:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.158351:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.158645:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.158976:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.159210:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.159454:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.159692:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.159895:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.160121:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.160344:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.160551:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.160768:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.161012:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.161251:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.161476:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.161697:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.161935:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.162171:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.162400:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.162744:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.162958:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.163184:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.163419:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.163704:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.163902:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.164083:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.164329:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.164627:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.164912:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.165141:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1786109398.165458:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1786109398.167257:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1786109398.167713:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1786109398.167983:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1786109398.168407:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1786109398.168764:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1786109398.168988:0:190316:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:0.0:1786109398.169768:0:190316:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1786109398.170052:0:190316:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1786109398.170062:0:190316:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1786109398.170076:0:190316:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca362a2 00000020:01000004:0.0:1786109398.170084:0:190316:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1786109398.170113:0:190316:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1786109398.170120:0:190316:0:(tgt_mount.c:101:server_register_mount()) register mount ffff930ab28f1800 from MGS 00000020:01000004:0.0:1786109398.170125:0:190316:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1786109398.170137:0:190316:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93098272b380) 00000020:00000080:0.0:1786109398.170155:0:190316:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:0.0:1786109398.170231:0:190316:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930ab28f1800 from MGS, refs=2 00080000:01000000:0.0:1786109398.170236:0:190316:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1786109398.170241:0:190316:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca362b0 00010000:00010000:0.0:1786109398.170379:0:190316:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1786109398.175016:0:190316:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1786109398.175933:0:190320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1786109398.175988:0:190316:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1786109398.176027:0:190316:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1786109398.176719:0:190316:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1786109398.177084:0:190316:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786109398.177263:0:190316:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1786109398.177270:0:190316:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1786109398.177976:0:190316:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1786109398.177985:0:190316:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1786109398.178306:0:190316:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1786109398.178312:0:190316:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1786109398.181255:0:190316:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1786109398.181293:0:190316:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1786109398.181295:0:190316:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1786109398.181300:0:190316:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1786109398.181306:0:190316:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff930a8a640000 already not connected (conn 13792, was 0): CONNECTING 00000100:00100000:2.0:1786109398.181313:0:190316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:0.0:1786109399.172989:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109400.203058:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786109400.842119:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109400.842133:0:183576:0:(pinger.c:247:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1786109400.842137:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109400.842142:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109400.842148:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109400.842159:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8252 00000100:00080000:3.0:1786109400.842165:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109400.842174:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109400.842230:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9660a80 x1872862933176704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109400.842363:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933176704:0@lo:38:kworker.0 00000100:00100000:2.0:1786109400.842493:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109400.842783:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933176832:0@lo:400:kworker.0 00000100:00100000:1.0:1786109400.842817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786109400.842936:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109400.842941:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109400.842944:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109400.842948:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8252 00000100:00080000:3.0:1786109400.842951:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109400.842955:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109400.842973:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9662300 x1872862933176960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109400.843000:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109400.843004:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109400.843006:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109400.843010:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8252 00000100:00080000:3.0:1786109400.843013:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109400.843016:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109400.843030:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9663100 x1872862933177216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109400.843176:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933177088:0@lo:400:kworker.0 00000100:00100000:0.0:1786109400.843213:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109400.843286:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933176960:0@lo:38:kworker.0 00000100:00100000:2.0:1786109400.843311:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109400.843330:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933177216:0@lo:38:kworker.0 00000100:00100000:2.0:1786109400.843354:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786109400.843390:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109400.843395:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109400.843398:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109400.843402:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8252 00000100:00080000:3.0:1786109400.843405:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109400.843409:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109400.843424:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098c344a80 x1872862933177600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109400.843499:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109400.843506:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933177344:0@lo:400:kworker.0 00000100:00100000:0.0:1786109400.843536:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109400.843622:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933176704 00000100:00100000:1.0:1786109400.843631:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933176704 00000100:00100000:1.0:1786109400.843662:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933176832 00000100:00100000:1.0:1786109400.843664:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933176832 00000100:00100000:1.0:1786109400.843695:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933177088 00000100:00100000:1.0:1786109400.843697:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933177088 00000100:00100000:1.0:1786109400.843710:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933176960 00000100:00100000:1.0:1786109400.843712:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933176960 00000100:00100000:1.0:1786109400.843725:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786109400.843734:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933176832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109400.843807:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933176832:12345-0@lo:400:kworker.0 Request processed in 73us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109400.843814:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786109400.843831:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786109400.843836:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933177088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109400.843875:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933177088:12345-0@lo:400:kworker.0 Request processed in 38us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109400.843880:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786109400.843892:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1786109400.843896:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933176704:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109400.843919:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109400.843949:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933176704:12345-0@lo:38:kworker.0 Request processed in 52us (1457us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109400.843955:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1786109400.843966:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:1.0:1786109400.843970:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933176960:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109400.843979:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109400.844000:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933176960:12345-0@lo:38:kworker.0 Request processed in 30us (689us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109400.844006:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:1.0:1786109400.844031:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933177216 00000100:00100000:1.0:1786109400.844035:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933177216 00000100:00100000:1.0:1786109400.844055:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12243 00000100:00100000:1.0:1786109400.844060:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933177216:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109400.844069:0:8451:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1786109400.844356:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109400.844363:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109400.844367:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933176704:0@lo:38:kworker.0 00000100:00100000:2.0:1786109400.844390:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933177600:0@lo:38:kworker.0 00000100:00100000:2.0:1786109400.844418:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109400.844469:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109400.844474:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109400.844477:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933176960:0@lo:38:kworker.0 00000100:00100000:2.0:1786109400.844503:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933177600 00000100:00100000:2.0:1786109400.844507:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933177600 00000100:00100000:2.0:1786109400.844526:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1786109400.844531:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933177600:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109400.844541:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109400.844951:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933177472:0@lo:400:kworker.0 00000100:00100000:3.0:1786109400.844990:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109400.845041:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933177344 00000100:00100000:3.0:1786109400.845046:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933177344 00000100:00100000:3.0:1786109400.845085:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933177472 00000100:00100000:3.0:1786109400.845088:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933177472 00000100:00100000:3.0:1786109400.845115:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6844 00000100:00100000:3.0:1786109400.845123:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933177344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109400.845166:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933177344:12345-0@lo:400:kworker.0 Request processed in 44us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109400.845171:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6844 00000100:00100000:3.0:1786109400.845186:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6845 00000100:00100000:3.0:1786109400.845192:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933177472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109400.845224:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933177472:12345-0@lo:400:kworker.0 Request processed in 32us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109400.845230:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6845 00000100:00100000:3.0:1786109400.845272:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933177472:0@lo:400:kworker.0 00000100:00100000:2.0:1786109400.845363:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933177600:12345-0@lo:38:kworker.0 Request processed in 829us (943us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109400.845370:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00080000:2.0:1786109400.845423:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109400.845428:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109400.845457:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109400.845488:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933176832:0@lo:400:kworker.0 00000100:00100000:1.0:1786109400.845704:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933177216:12345-0@lo:38:kworker.0 Request processed in 1642us (2348us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109400.845714:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12243 00000100:00080000:3.0:1786109400.845802:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109400.845807:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109400.845810:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933177600:0@lo:38:kworker.0 00000100:00080000:3.0:1786109400.845822:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109400.845825:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109400.845829:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933177216:0@lo:38:kworker.0 00000100:00100000:2.0:1786109400.846012:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933177344:0@lo:400:kworker.0 00000100:00100000:2.0:1786109400.846028:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933177088:0@lo:400:kworker.0 00010000:00010000:3.0:1786109401.220718:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109401.860851:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933177728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109401.860951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109401.861021:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933177728 00000100:00100000:1.0:1786109401.861043:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933177728 00000100:00100000:1.0:1786109401.861108:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5731 00000100:00100000:2.0:1786109401.861117:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933177856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109401.861123:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933177728:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109401.861151:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1786109401.861167:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109401.861192:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933177856 00000100:00100000:2.0:1786109401.861197:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933177856 00000100:00100000:2.0:1786109401.861312:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5732 00000100:00100000:2.0:1786109401.861320:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933177856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109401.861340:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109401.861386:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933177856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109401.861393:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5732 00000100:00100000:2.0:1786109401.861522:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933177856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109401.861816:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933177728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 697us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109401.861824:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5731 00000100:00100000:0.0:1786109401.861882:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933177728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109402.131392:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109402.131493:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109402.131514:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922072448 00000100:00100000:0.0:1786109402.131530:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922072448 00000100:00100000:2.0:1786109402.131623:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109402.131637:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:0.0:1786109402.131653:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922072448:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109402.131677:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922072320 00000100:00100000:2.0:1786109402.131691:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922072320 00000100:00080000:1.0:1786109402.131717:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109402.131735:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 894 00000100:00100000:2.0:1786109402.131745:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1872862922072320:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:2.0:1786109402.131774:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109402.131876:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922072192 00000100:00100000:3.0:1786109402.131881:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922072192 00000100:00100000:3.0:1786109402.131915:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:3.0:1786109402.131920:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982458450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1872862922072192:12345-192.168.203.38@tcp:250:kworker.0 00010000:00080000:3.0:1786109402.131946:0:190321:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from fea1ac35-e793-43ec-a86d-d40dc5658dad@192.168.203.38@tcp t0 exp 0000000000000000 cur 8258 last 0 00000020:00000080:3.0:1786109402.131994:0:190321:0:(genops.c:1406:class_connect()) connect: client fea1ac35-e793-43ec-a86d-d40dc5658dad, cookie 0xdb52b77d7ca362b7 00000100:00100000:0.0:1786109402.132156:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922072448:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 506us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109402.132164:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1872862922072320:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 411us (572us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109402.132172:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:2.0:1786109402.132189:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 894 00000100:00080000:3.0:1786109402.132361:0:190321:0:(import.c:65:import_set_state_nolock()) ffff930ab282a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786109402.132582:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982458450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+5:2401:x1872862922072192:12345-192.168.203.38@tcp:250:kworker.0 Request processed in 659us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109402.132591:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1786109402.136976:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109402.137128:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922072576 00000100:00100000:0.0:1786109402.137143:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922072576 00000100:00100000:0.0:1786109402.137238:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6846 00000100:00100000:0.0:1786109402.137250:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922072576:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:1.0:1786109402.137288:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109402.137345:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922072576:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 96us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109402.137353:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6846 00010000:00010000:2.0:1786109402.247834:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109403.268731:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109403.663377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109403.663487:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922072704 00000100:00100000:2.0:1786109403.663496:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922072704 00000100:00100000:2.0:1786109403.663588:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:2.0:1786109403.663599:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098245ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+5:15195:x1872862922072704:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109403.663618:0:190323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109403.663639:0:190323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca362be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14bb expref: -99 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109403.663667:0:190323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca362be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14bb expref: 6 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109403.663680:0:190323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca362be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14bb expref: 6 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109403.663689:0:190323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77000, rc 0) 00000100:00100000:2.0:1786109403.663756:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098245ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+6:15195:x1872862922072704:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 159us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109403.663763:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:3.0:1786109403.667046:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109403.667154:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922072832 00000100:00100000:2.0:1786109403.667163:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922072832 00000100:00100000:2.0:1786109403.667248:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1786109403.667258:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+6:15195:x1872862922072832:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 00000100:00100000:2.0:1786109403.667350:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+6:15195:x1872862922072832:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 Request processed in 92us (313us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786109403.667357:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:1.0:1786109403.669695:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109403.669783:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922072960 00000100:00100000:2.0:1786109403.669791:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922072960 00000100:00100000:2.0:1786109403.669876:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:2.0:1786109403.669887:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098245a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+6:15195:x1872862922072960:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109403.669902:0:190323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109403.669921:0:190323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca362c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14c2 expref: -99 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109403.669947:0:190323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca362c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14c2 expref: 7 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109403.669958:0:190323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca362c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14c2 expref: 7 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109403.669967:0:190323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76000, rc 0) 00000100:00100000:2.0:1786109403.670023:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098245a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+7:15195:x1872862922072960:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 138us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109403.670029:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1786109403.676411:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109403.676550:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922073088 00000100:00100000:2.0:1786109403.676560:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922073088 00000100:00100000:2.0:1786109403.676614:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:2.0:1786109403.676623:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+7:15195:x1872862922073088:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1786109403.677059:0:190326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1786109403.677150:0:190321:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 317 20000000:01000000:1.0:1786109403.691668:0:190327:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1786109403.691680:0:190327:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1786109403.691683:0:190327:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1786109403.691686:0:190327:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1786109403.692026:0:190327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1786109403.692311:0:190321:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1786109403.692405:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+8:15195:x1872862922073088:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 15777us (15999us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109403.692466:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:0.0:1786109403.694848:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109403.695139:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922073216 00000100:00100000:2.0:1786109403.695153:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922073216 00000100:00100000:2.0:1786109403.695280:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1786109403.695292:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+8:15195:x1872862922073216:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109403.695567:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+8:15195:x1872862922073216:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 276us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109403.695575:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1786109403.699540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109403.700264:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922073344 00000100:00100000:2.0:1786109403.700273:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922073344 00000100:00100000:2.0:1786109403.700323:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1786109403.700345:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+8:15195:x1872862922073344:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109403.700361:0:190321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109403.700380:0:190321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd76e00/0xdb52b77d7ca362cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14c9 expref: -99 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109403.700407:0:190321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd76e00/0xdb52b77d7ca362cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14c9 expref: 9 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109403.700664:0:190321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd76e00/0xdb52b77d7ca362cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14c9 expref: 9 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109403.700674:0:190321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76e00, rc 0) 00000100:00100000:2.0:1786109403.700764:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922073344:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 432us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109403.700771:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:0.0:1786109403.715102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109403.717621:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922073472 00000100:00100000:2.0:1786109403.717636:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922073472 00000100:00100000:2.0:1786109403.717717:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1786109403.717728:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922073472:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109403.717931:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922073472:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 203us (2842us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109403.717940:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:0.0:1786109403.727131:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109403.727223:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922073600 00000100:00100000:2.0:1786109403.727233:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922073600 00000100:00100000:2.0:1786109403.727291:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1786109403.727301:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922073600:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109403.727489:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922073600:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 189us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109403.727497:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1786109403.737669:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109403.737756:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922073728 00000100:00100000:3.0:1786109403.737767:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922073728 00000100:00100000:3.0:1786109403.737842:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1786109403.737854:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922073728:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109403.737872:0:190322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109403.737895:0:190322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab295f600/0xdb52b77d7ca362d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14d0 expref: -99 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109403.737926:0:190322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab295f600/0xdb52b77d7ca362d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14d0 expref: 10 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109403.737938:0:190322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab295f600/0xdb52b77d7ca362d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14d0 expref: 10 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109403.737947:0:190322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295f600, rc 0) 00000100:00100000:3.0:1786109403.738009:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922073728:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 157us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109403.738016:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1786109403.744777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109403.744876:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922073856 00000100:00100000:3.0:1786109403.744886:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922073856 00000100:00100000:3.0:1786109403.744949:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1786109403.744960:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab92ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922073856:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109403.745175:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab92ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922073856:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 216us (407us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786109403.745184:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00010000:00010000:1.0:1786109404.339357:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109405.380598:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786109405.957883:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109405.957891:0:183576:0:(pinger.c:247:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1786109405.957894:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109405.957897:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109405.957900:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109405.957909:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8257 00000100:00080000:3.0:1786109405.957914:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1786109405.957920:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109405.957952:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1f54000 x1872862933177984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109405.957997:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109405.958000:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109405.958002:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109405.958005:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8257 00000100:00080000:3.0:1786109405.958008:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1786109405.958011:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109405.958020:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1f55f80 x1872862933178240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109405.958047:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109405.958050:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109405.958052:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109405.958055:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8257 00000100:00080000:3.0:1786109405.958057:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1786109405.958060:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109405.958072:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1f54e00 x1872862933178496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109405.958093:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109405.958096:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109405.958097:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109405.958101:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8257 00000100:00080000:3.0:1786109405.958103:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1786109405.958106:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109405.958116:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1f54380 x1872862933178880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109405.958148:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933178368:0@lo:400:kworker.0 00000100:00100000:1.0:1786109405.958552:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933178112:0@lo:400:kworker.0 00000100:00100000:1.0:1786109405.958623:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933178752:0@lo:400:kworker.0 00000100:00100000:1.0:1786109405.958734:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109405.959716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109405.959739:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109395/real 1786109395] req@ffff930ab7e5fb80 x1872862933175296/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786109405 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109405.959760:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff930ab7e5fb80 x1872862933175296/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786109405 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109405.959765:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109405.959773:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933178624:0@lo:400:kworker.0 00000100:00100000:2.0:1786109405.959774:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933177984:0@lo:38:kworker.0 00000100:00100000:3.0:1786109405.959808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109405.959808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109405.959842:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933178240:0@lo:38:kworker.0 00000100:00100000:3.0:1786109405.959848:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109405.959866:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109405.959880:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933178368 00000100:00100000:2.0:1786109405.959882:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933178496:0@lo:38:kworker.0 00000100:00100000:3.0:1786109405.959887:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933178368 00000100:00100000:2.0:1786109405.959902:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109405.959930:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933178880:0@lo:38:kworker.0 00000100:00100000:3.0:1786109405.959934:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933177984 00000100:00100000:3.0:1786109405.959936:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933177984 00000100:00100000:3.0:1786109405.959945:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933178112 00000100:00100000:3.0:1786109405.959947:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933178112 00000100:00100000:2.0:1786109405.959950:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109405.959959:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933178240 00000100:00080000:2.0:1786109405.959961:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1786109405.959962:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933178240 00000100:00100000:3.0:1786109405.959968:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933178880 00000100:00100000:3.0:1786109405.959970:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933178880 00000100:00100000:3.0:1786109405.960025:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1786109405.960034:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933178368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109405.960093:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933178368:12345-0@lo:400:kworker.0 Request processed in 61us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109405.960100:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1786109405.960115:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1786109405.960121:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933178112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109405.960147:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933178112:12345-0@lo:400:kworker.0 Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109405.960152:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1786109405.960162:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1786109405.960166:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933177984:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109405.960184:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109405.960209:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933177984:12345-0@lo:38:kworker.0 Request processed in 41us (400us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109405.960214:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1786109405.960304:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:3.0:1786109405.960329:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933178240:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109405.960339:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109405.960367:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933178240:12345-0@lo:38:kworker.0 Request processed in 38us (500us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109405.960372:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:3.0:1786109405.960384:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1786109405.960387:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933178880:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109405.960396:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109405.960418:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933178880:12345-0@lo:38:kworker.0 Request processed in 29us (467us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109405.960424:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00080000:3.0:1786109405.960521:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109405.960553:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933178112:0@lo:400:kworker.0 00000100:00100000:3.0:1786109405.960584:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933178368:0@lo:400:kworker.0 00000100:00100000:0.0:1786109405.961838:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933178752 00000100:00100000:0.0:1786109405.961849:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933178752 00000100:00100000:0.0:1786109405.961901:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933178624 00000100:00100000:0.0:1786109405.961905:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933178624 00000100:00100000:0.0:1786109405.961931:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6847 00000100:00100000:0.0:1786109405.961940:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933178752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109405.962014:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933178752:12345-0@lo:400:kworker.0 Request processed in 75us (3280us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109405.962020:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6847 00000100:00100000:0.0:1786109405.962034:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6848 00000100:00100000:0.0:1786109405.962039:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933178624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109405.962074:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933178624:12345-0@lo:400:kworker.0 Request processed in 34us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109405.962079:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6848 00000100:00100000:0.0:1786109405.962129:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933178624:0@lo:400:kworker.0 00000100:00100000:0.0:1786109405.962178:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933178752:0@lo:400:kworker.0 00000100:00100000:0.0:1786109405.962234:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933178496 00000100:00100000:0.0:1786109405.962238:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933178496 00000100:00100000:0.0:1786109405.962260:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12244 00000100:00100000:0.0:1786109405.962264:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933178496:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109405.962282:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109405.962317:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933178496:12345-0@lo:38:kworker.0 Request processed in 50us (2412us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109405.962322:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12244 00000100:00080000:0.0:1786109405.962351:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109405.962355:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109405.962492:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1786109405.962501:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933175296:0@lo:250:kworker.0 00000100:00080000:2.0:1786109405.962530:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109405.962535:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109405.962538:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933177984:0@lo:38:kworker.0 00000100:00080000:2.0:1786109405.962546:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109405.962549:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109405.962551:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933178240:0@lo:38:kworker.0 00000100:00080000:2.0:1786109405.962559:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109405.962561:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109405.962564:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933178496:0@lo:38:kworker.0 00000100:00080000:2.0:1786109405.962572:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109405.962575:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109405.962577:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933178880:0@lo:38:kworker.0 10000000:01000000:2.0:1786109405.962601:0:190316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1786109405.962615:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930984c89a00/0xdb52b77d7ca309f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca309fc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962626:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930984c89a00/0xdb52b77d7ca309f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca309fc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.962633:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1786109405.962642:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.962650:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930984c89a00/0xdb52b77d7ca309f5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca309fc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.962684:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930984c89e00/0xdb52b77d7ca307b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca307b7 expref: -99 pid: 187882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962691:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930984c89e00/0xdb52b77d7ca307b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca307b7 expref: -99 pid: 187882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.962696:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109405.962699:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.962702:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930984c89e00/0xdb52b77d7ca307b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca307b7 expref: -99 pid: 187882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.962709:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930984c88a00/0xdb52b77d7ca30866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3086d expref: -99 pid: 187882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962715:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930984c88a00/0xdb52b77d7ca30866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3086d expref: -99 pid: 187882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.962720:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109405.962723:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.962726:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930984c88a00/0xdb52b77d7ca30866 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3086d expref: -99 pid: 187882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.962734:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930984c88400/0xdb52b77d7ca309a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca309a8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962739:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930984c88400/0xdb52b77d7ca309a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca309a8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.962744:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109405.962748:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.962751:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930984c88400/0xdb52b77d7ca309a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca309a8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.962759:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930985201200/0xdb52b77d7ca309af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca309b6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962765:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930985201200/0xdb52b77d7ca309af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca309b6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.962770:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109405.962772:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.962776:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930985201200/0xdb52b77d7ca309af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca309b6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.962783:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930985200a00/0xdb52b77d7ca309cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca309d2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962789:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930985200a00/0xdb52b77d7ca309cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca309d2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.962794:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109405.962796:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.962799:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930985200a00/0xdb52b77d7ca309cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca309d2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.962807:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca309d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca309e0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962813:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca309d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca309e0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.962836:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109405.962839:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.962842:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca309d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca309e0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.962852:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab28bc000/0xdb52b77d7ca30a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca30a0a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962859:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab28bc000/0xdb52b77d7ca30a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca30a0a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.962864:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109405.962867:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.962870:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab28bc000/0xdb52b77d7ca30a03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca30a0a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.962879:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930984c89200/0xdb52b77d7ca30993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3099a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962885:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930984c89200/0xdb52b77d7ca30993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3099a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.962890:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109405.962893:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.962896:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930984c89200/0xdb52b77d7ca30993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3099a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.962908:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab28bde00/0xdb52b77d7ca307a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca307a9 expref: -99 pid: 187882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962920:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab28bde00/0xdb52b77d7ca307a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca307a9 expref: -99 pid: 187882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.962925:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109405.962928:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.962930:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab28bde00/0xdb52b77d7ca307a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca307a9 expref: -99 pid: 187882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.962940:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab28bc400/0xdb52b77d7ca30858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3085f expref: -99 pid: 187882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962946:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab28bc400/0xdb52b77d7ca30858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3085f expref: -99 pid: 187882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.962951:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786109405.962953:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.962956:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab28bc400/0xdb52b77d7ca30858 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3085f expref: -99 pid: 187882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.962963:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab28bd600/0xdb52b77d7ca309bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca309c4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962969:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab28bd600/0xdb52b77d7ca309bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca309c4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.962973:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786109405.962976:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.962979:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab28bd600/0xdb52b77d7ca309bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca309c4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.962990:0:190316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab28bd000/0xdb52b77d7ca309e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca309ee expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109405.962996:0:190316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab28bd000/0xdb52b77d7ca309e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca309ee expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109405.963001:0:190316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786109405.963003:0:190316:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109405.963006:0:190316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab28bd000/0xdb52b77d7ca309e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca309ee expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786109405.963018:0:190316:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff930a8a640000 already not connected (conn 13792, was 0): DISCONN 00000100:00080000:2.0:1786109405.963022:0:190316:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109405.963026:0:190316:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8252 00000100:00080000:2.0:1786109405.963029:0:190316:0:(import.c:589:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109405.963033:0:190316:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109405.963054:0:190316:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0fdfb80 x1872862933179008/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109405.963070:0:190316:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1786109405.963090:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933179008:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1786109405.963125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109405.963171:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933179008 00000100:00100000:2.0:1786109405.963174:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933179008 00000100:00100000:2.0:1786109405.963193:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786109405.963199:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab92ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1872862933179008:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1786109405.963215:0:190321:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from aeab97cc-8463-4daa-a678-1bb2ad93cc69@0@lo t0 exp 0000000000000000 cur 8262 last 0 00000020:00000080:2.0:1786109405.963238:0:190321:0:(genops.c:1406:class_connect()) connect: client aeab97cc-8463-4daa-a678-1bb2ad93cc69, cookie 0xdb52b77d7ca362da 00000100:00080000:2.0:1786109405.963359:0:190321:0:(import.c:65:import_set_state_nolock()) ffff930ab2abb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109405.963402:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab92ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+5:3645:x1872862933179008:12345-0@lo:250:mount.lustre.0 Request processed in 202us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109405.963409:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786109405.963468:0:3645:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.138@tcp: committing for last_committed 0 gen 77 00000100:00080000:2.0:1786109405.963475:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.138@tcp: connect to target with instance 0 00000100:00080000:2.0:1786109405.963480:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1786109405.963483:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1786109405.963486:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1786109405.963488:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1786109405.963565:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1786109405.963572:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933179008:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1786109405.963595:0:190316:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1786109405.963604:0:190316:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1786109405.963638:0:190316:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1786109405.963643:0:190316:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1786109405.963741:0:190316:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786109405.963780:0:190316:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1786109405.963784:0:190316:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786109405.963786:0:190316:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109405.963787:0:190316:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109405.963788:0:190316:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109405.963789:0:190316:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109405.963791:0:190316:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109405.963792:0:190316:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109405.963793:0:190316:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109405.963795:0:190316:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109405.963796:0:190316:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786109405.963798:0:190316:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1786109405.963800:0:190316:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786109405.963801:0:190316:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109405.963803:0:190316:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109405.963804:0:190316:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109405.963805:0:190316:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109405.963806:0:190316:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109405.963807:0:190316:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109405.963808:0:190316:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109405.963809:0:190316:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109405.963810:0:190316:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786109405.963833:0:190316:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1786109405.963844:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933179136:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786109405.963874:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109405.963888:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309867cf600 going to sleep for 11 seconds 00000020:01000000:2.0:1786109405.963917:0:171804:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.138@tcp 10000000:01000000:2.0:1786109405.963928:0:171804:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1786109405.963931:0:171804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1786109405.963932:0:171804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786109405.963933:0:171804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109405.963935:0:171804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109405.963936:0:171804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109405.963937:0:171804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109405.963938:0:171804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786109405.963939:0:171804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109405.963940:0:171804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1786109405.963961:0:171804:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1786109405.963965:0:171804:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1786109405.963967:0:171804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1786109405.963968:0:171804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786109405.963969:0:171804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109405.963970:0:171804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109405.963971:0:171804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109405.963972:0:171804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109405.963973:0:171804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786109405.963974:0:171804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109405.963975:0:171804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1786109405.963988:0:171804:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1786109405.963992:0:171804:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1786109405.963993:0:171804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1786109405.963994:0:171804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1786109405.963996:0:171804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109405.963997:0:171804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109405.963998:0:171804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109405.964000:0:171804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109405.964001:0:171804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109405.964002:0:171804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109405.964003:0:171804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1786109405.964011:0:171804:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1786109405.964030:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933179520:0@lo:253:kworker.0 00000100:00100000:2.0:1786109405.964056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109405.964072:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109405.964077:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933179392:0@lo:253:kworker.0 00000100:00100000:2.0:1786109405.964102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109405.964122:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933179136 00000100:00100000:2.0:1786109405.964125:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933179136 00000100:00100000:2.0:1786109405.964145:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933179520 00000100:00100000:2.0:1786109405.964148:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933179520 00000100:00100000:2.0:1786109405.964157:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933179392 00000100:00100000:2.0:1786109405.964159:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933179392 00000100:00100000:2.0:1786109405.964169:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786109405.964175:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:190316:x1872862933179136:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1786109405.964203:0:190321:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1786109405.964206:0:190321:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1786109405.964209:0:190321:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1786109405.964215:0:190321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1786109405.964284:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786109405.964292:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:3647:x1872862933179520:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1786109405.964308:0:190322:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1786109405.964319:0:190322:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1786109405.964472:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933179264:0@lo:253:kworker.0 00000100:00100000:2.0:1786109405.964507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109405.964545:0:190323:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1786109405.964553:0:190323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1786109405.964703:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:190316:x1872862933179136:12345-0@lo:253:mount.lustre.0 Request processed in 526us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109405.964711:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786109405.964731:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933179264 00000100:00100000:2.0:1786109405.964734:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933179264 00000100:00100000:2.0:1786109405.964749:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786109405.964755:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:3647:x1872862933179392:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1786109405.964795:0:190321:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1786109405.964835:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933179136:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1786109405.964844:0:190316:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1786109405.964846:0:190316:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786109405.964848:0:190316:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109405.964849:0:190316:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109405.964850:0:190316:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109405.964851:0:190316:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109405.964853:0:190316:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109405.964854:0:190316:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109405.964855:0:190316:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109405.964856:0:190316:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109405.964858:0:190316:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786109405.964885:0:190316:0:(tgt_mount.c:101:server_register_mount()) register mount ffff930ab28f1800 from lustre-MDT0000 10000000:01000000:2.0:1786109405.964909:0:190316:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1786109405.964912:0:190316:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1786109405.964921:0:190316:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff930ab28f1800 10000000:01000000:2.0:1786109405.964925:0:190316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1786109405.964928:0:190316:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff930ab28f1800 10000000:01000000:2.0:1786109405.964930:0:190316:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1786109405.964934:0:190316:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff930ab28f1800 from 1 10000000:01000000:2.0:1786109405.964936:0:190316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1786109405.964967:0:190316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.964977:0:190316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109405.964986:0:190316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109405.964999:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933179648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1786109405.965027:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109405.965038:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309867cf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109405.965105:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933179648 00000100:00100000:2.0:1786109405.965109:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933179648 00000100:00100000:1.0:1786109405.965287:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786109405.965296:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:3649:x1872862933179264:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1786109405.965313:0:190329:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1786109405.967460:0:190321:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1786109405.967634:0:190322:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1786109405.967677:0:190322:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1786109405.967766:0:190326:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786109405.967771:0:190326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786109405.967793:0:190326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.967811:0:190326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca362be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14bb expref: 9 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.967831:0:190326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.967870:0:190326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca362be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14bb expref: 9 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.967885:0:190326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca362be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14bb expref: 9 pid: 190323 timeout: 8362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109405.967900:0:190326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:190326:1872862933179776:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109405.968049:0:190326:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985db9d80 going to sleep for 11 seconds 20000000:01000000:0.0:1786109405.971948:0:190321:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786109405.971959:0:190321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1786109405.972290:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:3647:x1872862933179520:12345-0@lo:253:kworker.0 Request processed in 7993us (8227us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109405.972303:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786109405.972358:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786109405.972364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109405.972370:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:190316:x1872862933179648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786109405.972387:0:190322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109405.972404:0:190322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab295e000/0xdb52b77d7ca362ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca362e1 expref: -99 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109405.972407:0:190326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:190326:1872862933179776:192.168.203.38@tcp:104: 00010000:00010000:0.0:1786109405.972449:0:190326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109405.972453:0:190322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab295e000/0xdb52b77d7ca362ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca362e1 expref: 8 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109405.972465:0:190322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab295e000/0xdb52b77d7ca362ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca362e1 expref: 8 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109405.972474:0:190322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295e000, rc 0) 00000100:00100000:1.0:1786109405.972532:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922073984 00000100:00100000:1.0:1786109405.972539:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922073984 00010000:00010000:1.0:1786109405.972565:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca362be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14bb expref: 10 pid: 190323 timeout: 8362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109405.972590:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12632 00000100:00100000:1.0:1786109405.972597:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922073984:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109405.972607:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109405.972613:0:43921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca362be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14bb expref: 10 pid: 190323 timeout: 8362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.972623:0:43921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca362be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14bb expref: 10 pid: 190323 timeout: 8362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.972643:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca362be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14bb expref: 10 pid: 190323 timeout: 8362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.972656:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.972662:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786109405.972674:0:43921:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004903890s 00010000:00010000:1.0:1786109405.972678:0:43921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.972684:0:43921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.972691:0:43921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109405.972692:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:190316:x1872862933179648:12345-0@lo:101:mount.lustre.0 Request processed in 326us (7663us total) trans 0 rc 0/0 00010000:00010000:1.0:1786109405.972698:0:43921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109405.972699:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1786109405.972704:0:43921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109405.972708:0:43921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.972720:0:43921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1786109405.972733:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00010000:00010000:1.0:1786109405.972733:0:43921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1786109405.972735:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1786109405.972737:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109405.972738:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109405.972739:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109405.972741:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109405.972742:0:3647:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00010000:00010000:1.0:1786109405.972742:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:01000004:3.0:1786109405.972744:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109405.972746:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1786109405.972748:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933179520:0@lo:253:kworker.0 00000100:00100000:1.0:1786109405.972776:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:2402:x1872862922073984:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 179us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109405.972783:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12632 20000000:01000000:1.0:1786109405.972808:0:190329:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1786109405.972826:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933179648:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109405.972838:0:190316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.972846:0:190316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109405.972859:0:190316:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1786109405.972911:0:190316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.972924:0:190316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.972931:0:190326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109405.972931:0:190316:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 00010000:00010000:1.0:1786109405.972937:0:190326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109405.972937:0:190316:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786109405.972942:0:190316:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff930ab28f1800 00010000:00010000:1.0:1786109405.972943:0:190326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0acf600/0xdb52b77d7ca362e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109405.972946:0:190316:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1786109405.972949:0:190316:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1786109405.972952:0:190316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786109405.972974:0:190316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.972981:0:190316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.972989:0:190316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109405.973007:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933179904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109405.973041:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109405.973148:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a82b69540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109405.973188:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933179904 00000100:00100000:1.0:1786109405.973192:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933179904 00000100:00100000:1.0:1786109405.973231:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786109405.973238:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:190316:x1872862933179904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109405.973246:0:190323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109405.973255:0:190323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0acfc00/0xdb52b77d7ca362fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca362f6 expref: -99 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.973270:0:190323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0acfc00/0xdb52b77d7ca362fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca362f6 expref: 9 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.973278:0:190323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0acfc00/0xdb52b77d7ca362fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca362f6 expref: 9 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109405.973284:0:190323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0acfc00, rc 0) 00000100:00100000:1.0:1786109405.973331:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:190316:x1872862933179904:12345-0@lo:101:mount.lustre.0 Request processed in 93us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109405.973337:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786109405.973475:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933179904:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786109405.973486:0:190316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109405.973494:0:190316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109405.973553:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933180032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109405.973579:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109405.973594:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff930983e3f480 going to sleep for 11 seconds 00000100:00100000:1.0:1786109405.973666:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933180032 00000100:00100000:1.0:1786109405.973670:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933180032 00000100:00100000:1.0:1786109405.973690:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786109405.973696:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:190316:x1872862933180032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109405.973901:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:190316:x1872862933180032:12345-0@lo:501:mount.lustre.0 Request processed in 203us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109405.973908:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786109405.974087:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:3647:x1872862933179392:12345-0@lo:253:kworker.0 Request processed in 9330us (9983us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109405.974095:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:0.0:1786109405.974174:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1786109405.974176:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786109405.974178:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109405.974179:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109405.974180:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109405.974182:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109405.974183:0:3647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786109405.974184:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109405.974185:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1786109405.974188:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933179392:0@lo:253:kworker.0 20000000:01000000:1.0:1786109405.975366:0:190329:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1786109405.975386:0:190329:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1786109405.975522:0:190326:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1786109405.975528:0:190326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1786109405.975550:0:190326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca36304 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.975564:0:190326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca36304 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786109405.975571:0:190326:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004903890s 00010000:00010000:0.0:1786109405.975575:0:190326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca36304 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.975582:0:190326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca36304 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.975588:0:190326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca36304 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.975596:0:190326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca36304 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.975602:0:190326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109405.975606:0:190326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca36304 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.975612:0:190326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca36304 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.975624:0:190326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca36304 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.975630:0:190326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca36304 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109405.975636:0:190326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca36304 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109405.975865:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:3649:x1872862933179264:12345-0@lo:253:kworker.0 Request processed in 10568us (11355us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109405.975873:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000004:0.0:1786109405.975951:0:3649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1786109405.975954:0:3649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786109405.975955:0:3649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109405.975956:0:3649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109405.975957:0:3649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109405.975959:0:3649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109405.975960:0:3649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786109405.975961:0:3649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109405.975963:0:3649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1786109405.975966:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933179264:0@lo:253:kworker.0 00000100:00100000:3.0:1786109405.976333:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933180032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109405.976382:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933180160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109405.976589:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109405.976660:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff930983e3f480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109405.976712:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933180160 00000100:00100000:0.0:1786109405.976718:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933180160 00000100:00100000:0.0:1786109405.976793:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786109405.976804:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:190316:x1872862933180160:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109405.977494:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:190316:x1872862933180160:12345-0@lo:503:mount.lustre.0 Request processed in 690us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109405.977504:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786109405.977600:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933180160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109405.978169:0:190330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190330:1872862933180288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109405.978216:0:190330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109405.978296:0:190330:0:(client.c:2702:ptlrpc_set_wait()) set ffff930983e3fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1786109405.978341:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933180288 00000100:00100000:2.0:1786109405.978347:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933180288 00000100:00100000:2.0:1786109405.978416:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786109405.978426:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:190330:x1872862933180288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786109405.979241:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:190330:x1872862933180288:12345-0@lo:502:llog_process_th.0 Request processed in 807us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109405.979250:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1786109405.979364:0:190330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190330:1872862933180288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786109405.979392:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109405.979403:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109405.979406:0:190330:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1786109405.979411:0:190330:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1786109405.979414:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109405.979542:0:190330:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff930ab99d0000) 00000020:00000080:3.0:1786109405.979567:0:190330:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1786109405.979573:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1786109405.979646:0:190330:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1786109405.979654:0:190330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36312 00000020:00000080:3.0:1786109405.979867:0:190330:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1786109405.979871:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109405.979875:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109405.979876:0:190330:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1786109405.979879:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109405.979882:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109405.979884:0:190330:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1786109405.979887:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109405.979894:0:190330:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff930ab99d4d40) 00000020:00000080:3.0:1786109405.979907:0:190330:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1786109405.979912:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1786109405.979913:0:190330:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1786109405.979916:0:190330:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1786109405.979921:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1786109405.979970:0:190330:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930ab28f1800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1786109405.979982:0:190330:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff930ab99d19c0) 00000020:00000080:3.0:1786109405.979993:0:190330:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1786109405.980115:0:190330:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1786109405.980121:0:190330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca36327 00000020:00000080:3.0:1786109405.980217:0:190330:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1786109405.980224:0:190330:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1786109405.980229:0:190330:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdb52b77d7ca3632e 00080000:01000000:3.0:1786109405.980233:0:190330:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1786109405.980237:0:190330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36335 00010000:00010000:2.0:1786109406.029767:0:190330:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1786109406.029915:0:190330:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 397d331e-10fc-4558-be87-308c3622e8eb idx: 0 lr: 322122568681 srv lr: 326417514496 lx: 0 gen 18 00000001:00080000:2.0:1786109406.029957:0:190330:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 322122568361 srv lr: 326417514496 lx: 0 gen 23 00000001:00000004:2.0:1786109406.029987:0:190330:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 77, last_transno is 326417514496 00000001:00080000:2.0:1786109406.030104:0:190330:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1786109406.030156:0:190330:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9309867cf480: xid 1872862932692352, transno 326417514497, client gen 23, slot idx 0 00000001:00080000:2.0:1786109406.030165:0:190330:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9309867cf900: xid 1872862922066432, transno 326417514629, client gen 18, slot idx 1 00000001:00080000:2.0:1786109406.030169:0:190330:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9309867cf540: xid 1872862922065408, transno 326417514628, client gen 18, slot idx 2 00000001:00080000:2.0:1786109406.030174:0:190330:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9309867cfe40: xid 1872862921767040, transno 322122568437, client gen 18, slot idx 3 00000001:00080000:2.0:1786109406.030178:0:190330:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9309867cfcc0: xid 1872862932692096, transno 322122568361, client gen 23, slot idx 4 00000001:00080000:2.0:1786109406.030182:0:190330:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9309867cf3c0: xid 1872862932691584, transno 322122568360, client gen 23, slot idx 5 00000001:00080000:2.0:1786109406.030187:0:190330:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9309867cf6c0: xid 1872862920179840, transno 322122566376, client gen 18, slot idx 7 00000020:00000080:2.0:1786109406.030739:0:190330:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff930984ea8000) 00000020:00000080:2.0:1786109406.030757:0:190330:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1786109406.030836:0:190330:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1786109406.030842:0:190330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36351 00000020:00000080:3.0:1786109406.031296:0:190330:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1786109406.035237:0:190330:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdb52b77d7ca36358 00000020:00000080:0.0:1786109406.035676:0:190330:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1786109406.035687:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109406.035693:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.035695:0:190330:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1786109406.035698:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1786109406.035701:0:190330:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1786109406.035702:0:190330:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786109406.035704:0:190330:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786109406.035705:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1786109406.035708:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.035709:0:190330:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1786109406.035712:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786109406.035718:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.035719:0:190330:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1786109406.035724:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1786109406.035770:0:190330:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1786109406.035790:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109406.035793:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.035795:0:190330:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1786109406.035797:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786109406.035800:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.035801:0:190330:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1786109406.035804:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1786109406.035809:0:190330:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:0.0:1786109406.035844:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786109406.035858:0:190330:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff930982728000) 00000020:00000080:0.0:1786109406.035876:0:190330:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1786109406.035881:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1786109406.035939:0:190330:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1786109406.035945:0:190330:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1786109406.035952:0:190330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36366 00010000:00080000:0.0:1786109406.035982:0:190330:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93098e162800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1786109406.039942:0:190330:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1786109406.044205:0:190330:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109406.044220:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1786109406.044262:0:190330:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1786109406.044287:0:190330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca3636d 00000100:00080000:0.0:1786109406.044297:0:190330:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786109406.044303:0:190330:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93098e162800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109406.044333:0:190330:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098ba4d180 x1872862933180416/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109406.044370:0:190330:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1786109406.044467:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109406.044471:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.044473:0:190330:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1786109406.044476:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1786109406.044479:0:190330:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1786109406.044480:0:190330:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786109406.044482:0:190330:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786109406.044483:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1786109406.044486:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.044487:0:190330:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1786109406.044490:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786109406.044495:0:190330:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1786109406.044498:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.044499:0:190330:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1786109406.044502:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1786109406.044505:0:190330:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:0.0:1786109406.044526:0:190330:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1786109406.044529:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786109406.044541:0:190330:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93098272cd40) 00000020:00000080:0.0:1786109406.044558:0:190330:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1786109406.044563:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1786109406.044621:0:190330:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1786109406.044627:0:190330:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:0.0:1786109406.044633:0:190330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca3637b 00010000:00080000:0.0:1786109406.044663:0:190330:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930981dbd000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.138@tcp at head 00000100:00100000:1.0:1786109406.045022:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933180416:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1786109406.045101:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.045257:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933180416 00000100:00100000:2.0:1786109406.045265:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933180416 00000100:00100000:2.0:1786109406.045306:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12245 00000100:00100000:2.0:1786109406.045314:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933180416:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1786109406.045337:0:8452:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8262 last 0 00000020:00000080:2.0:1786109406.045373:0:8452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca36382 00000004:00100000:2.0:1786109406.045387:0:8452:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786109406.045499:0:8452:0:(import.c:65:import_set_state_nolock()) ffff930ac125d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109406.045556:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933180416:12345-0@lo:38:llog_process_th.0 Request processed in 241us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109406.045563:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12245 00010000:00010000:0.0:1786109406.045669:0:190330:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1786109406.045880:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786109406.045889:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 6 00000100:00080000:1.0:1786109406.045897:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1786109406.045901:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1786109406.045903:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098e162800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1786109406.045924:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933180416:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1786109406.046123:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933180544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109406.046154:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.046562:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933180544 00000100:00100000:2.0:1786109406.046568:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933180544 00000100:00100000:2.0:1786109406.046615:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12246 00000100:00100000:2.0:1786109406.046623:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933180544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109406.046652:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1786109406.046694:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933180544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109406.046700:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12246 00000100:00100000:1.0:1786109406.046770:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933180544:0@lo:41:osp-pre-1-0.0 00000040:01000000:0.0:1786109406.047113:0:190330:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1786109406.047139:0:190330:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1786109406.047418:0:190330:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 75, last_idx 76 00000040:00080000:0.0:1786109406.048223:0:190330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786109406.048253:0:190330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].77, 64 off13120 00000040:00080000:0.0:1786109406.048399:0:190330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x134:0x0].1, 64 off8256 00000040:00080000:3.0:1786109406.049569:0:190336:0:(llog.c:805:llog_process_thread()) index: 76, lh_last_idx: 77 synced_idx: 0 lgh_last_idx: 77 00000040:00080000:3.0:1786109406.049576:0:190336:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x130:0x0] at index 76 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1786109406.049729:0:190336:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 76, last_idx 77 00000040:00080000:3.0:1786109406.049749:0:190336:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x130:0x0] at index 76 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1786109406.049888:0:190336:0:(llog.c:805:llog_process_thread()) index: 77, lh_last_idx: 77 synced_idx: 77 lgh_last_idx: 77 00000040:00080000:3.0:1786109406.049892:0:190336:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x134:0x0] at index 77 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1786109406.050793:0:190330:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109406.050805:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1786109406.050855:0:190330:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1786109406.050879:0:190330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca36389 00000100:00080000:0.0:1786109406.050889:0:190330:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786109406.050894:0:190330:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff930981dbd000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109406.050929:0:190330:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098ba4ca80 x1872862933180672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109406.050995:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933180672:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1786109406.051109:0:190330:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1786109406.051212:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109406.051216:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.051218:0:190330:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1786109406.051221:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1786109406.051224:0:190330:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1786109406.051226:0:190330:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786109406.051227:0:190330:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786109406.051229:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1786109406.051232:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.051233:0:190330:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1786109406.051235:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786109406.051240:0:190330:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1786109406.051243:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.051244:0:190330:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1786109406.051247:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1786109406.051251:0:190330:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:0.0:1786109406.051270:0:190330:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1786109406.051272:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786109406.051283:0:190330:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff930a97cb8000) 00000020:00000080:0.0:1786109406.051301:0:190330:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1786109406.051306:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1786109406.051365:0:190330:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1786109406.051370:0:190330:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:0.0:1786109406.051376:0:190330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36397 00010000:00080000:0.0:1786109406.051406:0:190330:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93098e164800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1786109406.051610:0:190330:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1786109406.051672:0:190330:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1786109406.051688:0:190330:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1786109406.051871:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109406.051943:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933180672 00000100:00100000:1.0:1786109406.051950:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933180672 00000100:00100000:1.0:1786109406.051981:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23063 00000100:00100000:1.0:1786109406.051988:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3645:x1872862933180672:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1786109406.052014:0:179239:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8262 last 0 00000020:00000080:1.0:1786109406.052034:0:179239:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca3639e 00002000:00100000:1.0:1786109406.052053:0:179239:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff930ac0c88800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1786109406.052057:0:179239:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1786109406.052060:0:179239:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1786109406.052122:0:179239:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1786109406.052141:0:179239:0:(import.c:65:import_set_state_nolock()) ffff930ac0c8d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786109406.052193:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933180672:12345-0@lo:8:llog_process_th.0 Request processed in 203us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109406.052200:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23063 00000100:00100000:1.0:1786109406.052241:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786109406.052250:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 8 00000100:00080000:1.0:1786109406.052257:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1786109406.052260:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1786109406.052263:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981dbd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1786109406.052273:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1786109406.052278:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933180672:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1786109406.052301:0:190336:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1786109406.052346:0:190336:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8262718914542ns, next at 0ns, rc = 0 00080000:00080000:1.0:1786109406.052352:0:190336:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1786109406.052643:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933180800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109406.052682:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109406.052718:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933180800 00000100:00100000:0.0:1786109406.052722:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933180800 00000100:00100000:0.0:1786109406.052769:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5733 00000100:00100000:0.0:1786109406.052777:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933180800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109406.052793:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109406.052837:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933180800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.052843:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5733 00000100:00100000:0.0:1786109406.052885:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933180800:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786109406.052928:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1786109406.053154:0:190330:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 75, last_idx 76 00000040:00080000:0.0:1786109406.053811:0:190330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786109406.053850:0:190330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].77, 64 off13120 00000040:00080000:0.0:1786109406.053956:0:190330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x136:0x0].1, 64 off8256 00000040:00080000:3.0:1786109406.054425:0:190338:0:(llog.c:805:llog_process_thread()) index: 76, lh_last_idx: 77 synced_idx: 0 lgh_last_idx: 77 00000040:00080000:3.0:1786109406.054451:0:190338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x132:0x0] at index 76 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1786109406.054559:0:190338:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 76, last_idx 77 00000040:00080000:3.0:1786109406.054572:0:190338:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x132:0x0] at index 76 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1786109406.054671:0:190338:0:(llog.c:805:llog_process_thread()) index: 77, lh_last_idx: 77 synced_idx: 77 lgh_last_idx: 77 00000040:00080000:3.0:1786109406.054674:0:190338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x136:0x0] at index 77 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1786109406.055281:0:190330:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109406.055290:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1786109406.055322:0:190330:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1786109406.055344:0:190330:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca363a5 00000100:00080000:0.0:1786109406.055353:0:190330:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786109406.055358:0:190330:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93098e164800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109406.055388:0:190330:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098ba4c380 x1872862933180928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109406.055416:0:190330:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000004:00080000:2.0:1786109406.057105:0:190317:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:01000000:0.0:1786109406.057442:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109406.057448:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.057450:0:190330:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1786109406.057454:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786109406.057458:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.057460:0:190330:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786109406.057463:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786109406.057465:0:190330:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1786109406.057467:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109406.057469:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.057470:0:190330:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1786109406.057472:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786109406.057475:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.057476:0:190330:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1786109406.057479:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1786109406.057522:0:190330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190330:1872862933181056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109406.057609:0:190330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109406.057658:0:190330:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098be893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109406.057678:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933181056 00000100:00100000:0.0:1786109406.057685:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933181056 00000100:00100000:0.0:1786109406.057723:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786109406.057732:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:190330:x1872862933181056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109406.057857:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:190330:x1872862933181056:12345-0@lo:502:llog_process_th.0 Request processed in 125us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.057865:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786109406.057911:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933180928:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1786109406.057941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109406.057976:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933180928 00000100:00100000:0.0:1786109406.057980:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933180928 00000100:00100000:0.0:1786109406.058001:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23064 00000100:00100000:0.0:1786109406.058006:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:0+-99:3645:x1872862933180928:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1786109406.058030:0:179242:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8262 last 0 00000020:00000080:0.0:1786109406.058069:0:179242:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca363ac 00002000:00100000:0.0:1786109406.058083:0:179242:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff930985f20800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1786109406.058087:0:179242:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1786109406.058090:0:179242:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1786109406.058154:0:179242:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786109406.058177:0:179242:0:(import.c:65:import_set_state_nolock()) ffff930985f25000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109406.058217:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933180928:12345-0@lo:8:llog_process_th.0 Request processed in 209us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.058224:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23064 00000100:00100000:0.0:1786109406.058260:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786109406.058268:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1786109406.058274:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1786109406.058278:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1786109406.058280:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098e164800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1786109406.058290:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1786109406.058295:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933180928:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1786109406.058320:0:190330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190330:1872862933181056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786109406.058344:0:190330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109406.058348:0:190330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109406.058350:0:190330:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1786109406.058353:0:190330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000004:00080000:0.0:1786109406.058502:0:190338:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1786109406.058551:0:190338:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8262725119812ns, next at 0ns, rc = 0 00080000:00080000:0.0:1786109406.058557:0:190338:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:1.0:1786109406.058683:0:190316:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1786109406.058706:0:190316:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1786109406.058723:0:190316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.058734:0:190316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109406.058742:0:190316:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930ab28f1800 from 1 10000000:01000000:1.0:1786109406.058745:0:190316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786109406.058771:0:190316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.058779:0:190316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.058788:0:190316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109406.058802:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933181184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109406.058847:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109406.058879:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109406.058903:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933181184 00000100:00100000:1.0:1786109406.058908:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933181184 00000100:00100000:1.0:1786109406.058937:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786109406.058946:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:190316:x1872862933181184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109406.058955:0:190329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109406.058967:0:190329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0ace800/0xdb52b77d7ca363ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca363b3 expref: -99 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.058988:0:190329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0ace800/0xdb52b77d7ca363ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca363b3 expref: 9 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.058997:0:190329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0ace800/0xdb52b77d7ca363ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca363b3 expref: 9 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.059005:0:190329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0ace800, rc 0) 00000100:00100000:1.0:1786109406.059036:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:190316:x1872862933181184:12345-0@lo:101:mount.lustre.0 Request processed in 91us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109406.059042:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786109406.059087:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933181184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109406.059099:0:190316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca363ba expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.059107:0:190316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca363ba expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109406.059660:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933181312:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1786109406.059700:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109406.059726:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109406.059744:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933181312 00000100:00100000:1.0:1786109406.059749:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933181312 00000100:00100000:1.0:1786109406.059775:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786109406.059782:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:190316:x1872862933181312:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1786109406.059800:0:190323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1786109406.059911:0:190323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1786109406.059916:0:190323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1786109406.059920:0:190323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1786109406.059922:0:190323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 320 00000100:00100000:1.0:1786109406.060005:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:190316:x1872862933181312:12345-0@lo:256:mount.lustre.0 Request processed in 222us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109406.060012:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786109406.060106:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933181312:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1786109406.060733:0:190316:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786109406.060750:0:190316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca363ba expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.060760:0:190316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca363ba expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109406.060768:0:190316:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930ab28f1800 from 1 10000000:01000000:1.0:1786109406.060771:0:190316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786109406.060797:0:190316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.060805:0:190316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109406.061240:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109406.061255:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933181568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109406.061301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109406.061341:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933181568 00000100:00100000:0.0:1786109406.061347:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933181568 00000100:00100000:0.0:1786109406.061389:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5734 00000100:00100000:0.0:1786109406.061397:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933181568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109406.061420:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109406.061477:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933181568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.061484:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5734 00000100:00080000:0.0:1786109406.061503:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109406.061535:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933181568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786109406.062132:0:190316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109406.062156:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933181440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109406.062190:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109406.062232:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109406.062266:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933181440 00000100:00100000:1.0:1786109406.062270:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933181440 00000100:00100000:1.0:1786109406.062596:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786109406.062606:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:190316:x1872862933181440:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109406.062619:0:190322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109406.062635:0:190322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0ace600/0xdb52b77d7ca363c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca363c1 expref: -99 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.062660:0:190322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0ace600/0xdb52b77d7ca363c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca363c1 expref: 10 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.062671:0:190322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0ace600/0xdb52b77d7ca363c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca363c1 expref: 10 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.062679:0:190322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0ace600, rc 0) 00000100:00100000:1.0:1786109406.062729:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:190316:x1872862933181440:12345-0@lo:101:mount.lustre.0 Request processed in 124us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109406.062736:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786109406.062828:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933181440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109406.062843:0:190316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109406.062853:0:190316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109406.062917:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933181696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109406.062944:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.063174:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c531000 going to sleep for 11 seconds 00000100:00100000:0.0:1786109406.063207:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933181696 00000100:00100000:0.0:1786109406.063211:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933181696 00000100:00100000:0.0:1786109406.063235:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786109406.063242:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:190316:x1872862933181696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109406.063392:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:190316:x1872862933181696:12345-0@lo:501:mount.lustre.0 Request processed in 150us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.063398:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:0.0:1786109406.064027:0:190317:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1786109406.064191:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933181696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109406.064230:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933181824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109406.064285:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.064327:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c531000 going to sleep for 11 seconds 00000100:00100000:0.0:1786109406.064374:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933181824 00000100:00100000:0.0:1786109406.064378:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933181824 00000100:00100000:0.0:1786109406.064417:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786109406.064425:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:190316:x1872862933181824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109406.064536:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:190316:x1872862933181824:12345-0@lo:503:mount.lustre.0 Request processed in 111us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.064543:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786109406.064627:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933181824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109406.064951:0:190340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190340:1872862933181952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786109406.064985:0:190340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.065014:0:190340:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c5316c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109406.065058:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933181952 00000100:00100000:0.0:1786109406.065062:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933181952 00000100:00100000:0.0:1786109406.065097:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786109406.065104:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:190340:x1872862933181952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109406.065630:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:190340:x1872862933181952:12345-0@lo:502:llog_process_th.0 Request processed in 526us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.065638:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786109406.065708:0:190340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190340:1872862933181952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786109406.065732:0:190340:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109406.065742:0:190340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109406.065745:0:190340:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1786109406.065751:0:190340:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff930ab28f1800 00000020:00000080:2.0:1786109406.065753:0:190340:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786109406.065760:0:190340:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109406.065762:0:190340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109406.065764:0:190340:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1786109406.065766:0:190340:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109406.065768:0:190340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109406.065769:0:190340:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1786109406.065772:0:190340:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff930ab28f1800 00000020:00000080:2.0:1786109406.065775:0:190340:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786109406.065853:0:190340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190340:1872862933182080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786109406.065889:0:190340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.065918:0:190340:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c5316c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109406.067102:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933182080 00000100:00100000:1.0:1786109406.067111:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933182080 00000100:00100000:1.0:1786109406.067166:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786109406.067175:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:190340:x1872862933182080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109406.067302:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:190340:x1872862933182080:12345-0@lo:502:llog_process_th.0 Request processed in 127us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109406.067309:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786109406.067360:0:190340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190340:1872862933182080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786109406.067388:0:190340:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109406.067393:0:190340:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109406.067395:0:190340:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1786109406.067399:0:190340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1786109406.068876:0:190316:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1786109406.068907:0:190316:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786109406.069863:0:190316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109406.069877:0:190316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109406.069946:0:190316:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1786109406.069950:0:190316:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff930ab28f1800 10000000:01000000:0.0:1786109406.069953:0:190316:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff930ab28f1800 10000000:01000000:0.0:1786109406.069957:0:190316:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786109406.069962:0:190316:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930ab28f1800 from 1 10000000:01000000:0.0:1786109406.069964:0:190316:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786109406.069998:0:190316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109406.070005:0:190316:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109406.070017:0:190316:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109406.070041:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933182208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109406.070103:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109406.070159:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098be89480 going to sleep for 11 seconds 00000100:00100000:1.0:1786109406.070287:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933182208 00000100:00100000:1.0:1786109406.070294:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933182208 00000100:00100000:1.0:1786109406.070343:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786109406.070353:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:190316:x1872862933182208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109406.070367:0:190322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109406.070379:0:190322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0ace200/0xdb52b77d7ca363d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca363cf expref: -99 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.070403:0:190322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0ace200/0xdb52b77d7ca363d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca363cf expref: 11 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.070414:0:190322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0ace200/0xdb52b77d7ca363d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca363cf expref: 11 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.070422:0:190322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0ace200, rc 0) 00000100:00100000:1.0:1786109406.070485:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190316:x1872862933182208:12345-0@lo:101:mount.lustre.0 Request processed in 132us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109406.070491:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786109406.071158:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933182208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109406.071174:0:190316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109406.071183:0:190316:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109406.071242:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933182336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109406.071274:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109406.071307:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098be89480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109406.071323:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933182336 00000100:00100000:0.0:1786109406.071327:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933182336 00000100:00100000:0.0:1786109406.071371:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786109406.071378:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190316:x1872862933182336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109406.071508:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190316:x1872862933182336:12345-0@lo:501:mount.lustre.0 Request processed in 130us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.071516:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786109406.071547:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933182336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109406.071572:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933182464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109406.071613:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109406.071633:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098be89480 going to sleep for 11 seconds 00000100:00100000:3.0:1786109406.071691:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933182464 00000100:00100000:3.0:1786109406.071695:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933182464 00000100:00100000:3.0:1786109406.071726:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786109406.071734:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190316:x1872862933182464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109406.071826:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190316:x1872862933182464:12345-0@lo:503:mount.lustre.0 Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109406.071834:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786109406.072136:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933182464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109406.072661:0:190342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190342:1872862933182592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109406.072705:0:190342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109406.072746:0:190342:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109406.072786:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933182592 00000100:00100000:0.0:1786109406.072790:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933182592 00000100:00100000:0.0:1786109406.073943:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786109406.073957:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190342:x1872862933182592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109406.074104:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190342:x1872862933182592:12345-0@lo:502:llog_process_th.0 Request processed in 151us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.074112:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786109406.076170:0:190342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f55f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190342:1872862933182592:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1786109406.076245:0:190342:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1786109406.076259:0:190342:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff930a97cbb380) 00000020:00000080:0.0:1786109406.076283:0:190342:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1786109406.079956:0:190342:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930ab28f1800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1786109406.079966:0:190342:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930ab28f1800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1786109406.079970:0:190342:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab28f1800 4 00010000:00080000:0.0:1786109406.080011:0:190342:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930ab2828000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1786109406.084942:0:190342:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1786109406.085897:0:190342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1786109406.085979:0:190342:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786109406.085995:0:190342:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdb52b77d7ca363e4 00000100:00080000:0.0:1786109406.086006:0:190342:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786109406.086012:0:190342:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff930ab2828000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109406.086195:0:190342:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098ba4c380 x1872862933182720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109406.086230:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933182720:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786109406.086295:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109406.087875:0:190342:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1786109406.089188:0:190342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190342:1872862933182848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109406.089257:0:190342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109406.089295:0:190342:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098be89300 going to sleep for 11 seconds 00000100:00100000:0.0:1786109406.089312:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933182848 00000100:00100000:0.0:1786109406.089319:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933182848 00000100:00100000:0.0:1786109406.089355:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786109406.089362:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190342:x1872862933182848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109406.089565:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190342:x1872862933182848:12345-0@lo:502:llog_process_th.0 Request processed in 202us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.089573:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786109406.090222:0:190342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190342:1872862933182848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109406.090271:0:190342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190342:1872862933182976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109406.090308:0:190342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109406.090330:0:190342:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098be89300 going to sleep for 11 seconds 00000100:00100000:0.0:1786109406.090347:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933182976 00000100:00100000:0.0:1786109406.090351:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933182976 00000100:00100000:0.0:1786109406.090378:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1786109406.090385:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190342:x1872862933182976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109406.090877:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190342:x1872862933182976:12345-0@lo:502:llog_process_th.0 Request processed in 490us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.090885:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1786109406.090930:0:190342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190342:1872862933182976:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786109406.090956:0:190342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1786109406.091151:0:190316:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1786109406.091174:0:190316:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786109406.091190:0:190316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109406.091200:0:190316:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1786109406.091244:0:190316:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1786109406.091246:0:190316:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786109406.091247:0:190316:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109406.091248:0:190316:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109406.091249:0:190316:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109406.091251:0:190316:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109406.091252:0:190316:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786109406.091254:0:190316:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786109406.091255:0:190316:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109406.091256:0:190316:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786109406.091260:0:190316:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1786109406.091262:0:190316:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786109406.091263:0:190316:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786109406.091264:0:190316:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109406.091265:0:190316:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109406.091266:0:190316:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109406.091267:0:190316:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109406.091268:0:190316:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786109406.091269:0:190316:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786109406.091270:0:190316:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109406.091271:0:190316:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786109406.091283:0:190316:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1786109406.091292:0:190316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933183104:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1786109406.091322:0:190316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109406.091351:0:190316:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098be89000 going to sleep for 11 seconds 00000100:00100000:0.0:1786109406.091370:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933183104 00000100:00100000:0.0:1786109406.091373:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933183104 00000100:00100000:0.0:1786109406.091397:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786109406.091403:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab959d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190316:x1872862933183104:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786109406.091568:0:190322:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1786109406.091580:0:190322:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1786109406.092108:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933182720 00000100:00100000:3.0:1786109406.092113:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933182720 00000100:00100000:3.0:1786109406.092138:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:3.0:1786109406.092145:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933182720:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1786109406.092212:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933182720:12345-0@lo:38:llog_process_th.0 Request processed in 67us (5916us total) trans 0 rc -11/-11 00000100:00100000:3.0:1786109406.092219:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:0.0:1786109406.092483:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786109406.092490:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab2828000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109406.092494:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1786109406.092498:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933182720:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1786109406.095867:0:190322:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786109406.095889:0:190322:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1786109406.095991:0:190326:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786109406.095996:0:190326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786109406.096016:0:190326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.096034:0:190326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ac0ace800/0xdb52b77d7ca363ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca363b3 expref: 11 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.096053:0:190326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.096088:0:190326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ac0ace800/0xdb52b77d7ca363ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca363b3 expref: 11 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109406.096101:0:190326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ac0ace800/0xdb52b77d7ca363ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb52b77d7ca363b3 expref: 11 pid: 190329 timeout: 8362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109406.096115:0:190326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:190326:1872862933183232:0@lo:104: 00000100:00100000:1.0:1786109406.096171:0:190326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109406.096334:0:190326:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab91da6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109406.100217:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab959d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:190316:x1872862933183104:12345-0@lo:253:mount.lustre.0 Request processed in 8805us (8885us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.100231:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786109406.100324:0:190316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:190316:1872862933183104:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1786109406.100339:0:190316:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1786109406.100342:0:190316:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786109406.100344:0:190316:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786109406.100345:0:190316:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109406.100346:0:190316:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109406.100348:0:190316:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109406.100349:0:190316:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109406.100351:0:190316:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786109406.100352:0:190316:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786109406.100353:0:190316:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109406.100354:0:190316:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786109406.100379:0:190316:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1786109406.101255:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933183232 00000100:00100000:3.0:1786109406.101264:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933183232 00000100:00100000:3.0:1786109406.101302:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5259 00000100:00100000:3.0:1786109406.101311:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:190326:x1872862933183232:12345-0@lo:104: 00010000:00010000:3.0:1786109406.101327:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca363ba expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.101390:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786109406.101396:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:190326:x1872862933183232:12345-0@lo:104: Request processed in 87us (5224us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109406.101403:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5259 00000100:00100000:1.0:1786109406.101594:0:190326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:190326:1872862933183232:0@lo:104: 00010000:00010000:1.0:1786109406.101616:0:190326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.102578:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109406.102585:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca363ba expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.102595:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf600 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109406.102599:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb52b77d7ca363ba expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.102607:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca363ba expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109406.102614:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca363ba expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109406.102620:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109406.102923:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca363ba expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.102930:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109406.102962:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca363ba expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.102974:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0acf600/0xdb52b77d7ca363b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca363ba expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.102988:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109406.102989:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109406.102991:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109406.103690:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933183360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109406.103755:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109406.103910:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933183360 00000100:00100000:3.0:1786109406.103917:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933183360 00010000:00010000:3.0:1786109406.103941:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ac0ace800/0xdb52b77d7ca363ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca363b3 expref: 11 pid: 190329 timeout: 8362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109406.103979:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12633 00000100:00100000:3.0:1786109406.103987:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:3647:x1872862933183360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109406.104000:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109406.104004:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930ac0ace800/0xdb52b77d7ca363ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca363b3 expref: 11 pid: 190329 timeout: 8362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.104016:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ac0ace800/0xdb52b77d7ca363ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb52b77d7ca363b3 expref: 11 pid: 190329 timeout: 8362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.104029:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0ace800/0xdb52b77d7ca363ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca363b3 expref: 11 pid: 190329 timeout: 8362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.104056:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.104064:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1786109406.104083:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008087266s 00010000:00010000:3.0:1786109406.104087:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.104093:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.104101:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.104106:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.104111:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0ace400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109406.104115:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.104123:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.104144:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109406.104153:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109406.104185:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:3647:x1872862933183360:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109406.104191:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12633 00010000:00010000:2.0:1786109406.104476:0:190326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109406.104485:0:190326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109406.104491:0:190326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0ace400/0xdb52b77d7ca363eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 190326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109406.104877:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933183360:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1786109406.107701:0:190316:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 322122568692 00000040:01000000:0.0:1786109406.108726:0:190316:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1786109406.108957:0:190349:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1786109406.109085:0:190316:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:3.0:1786109406.109379:0:190348:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 322122568692 00000020:00080000:3.0:1786109406.109383:0:190348:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 322122568692 00000100:00100000:3.0:1786109406.109643:0:190350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933183488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1786109406.109712:0:190350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109406.109749:0:190350:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc600 going to sleep for 11 seconds 00000100:00100000:2.0:1786109406.109809:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933183488 00000100:00100000:2.0:1786109406.109826:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933183488 00000100:00100000:2.0:1786109406.109882:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12247 00000100:00100000:2.0:1786109406.109892:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933183488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.109970:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933183488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109406.109977:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12247 00000100:00100000:2.0:1786109406.110021:0:190350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933183488:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1786109406.110045:0:190350:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1786109406.110069:0:190350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933183616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.110101:0:190350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.110124:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933183616 00000100:00100000:2.0:1786109406.110128:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933183616 00000100:00100000:2.0:1786109406.110152:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12248 00000100:00100000:2.0:1786109406.110158:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933183616:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.110246:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933183616:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109406.110253:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12248 00000100:00100000:2.0:1786109406.110270:0:190350:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c531300 going to sleep for 11 seconds 00000100:00100000:2.0:1786109406.110283:0:190350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933183616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.110330:0:190350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933183744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.110353:0:190350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.110373:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933183744 00000100:00100000:2.0:1786109406.110376:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933183744 00000100:00100000:2.0:1786109406.110398:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12249 00000100:00100000:2.0:1786109406.110404:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933183744:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.110463:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933183744:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 58us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109406.110472:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12249 00000100:00100000:2.0:1786109406.110490:0:190350:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c531300 going to sleep for 11 seconds 00000100:00100000:2.0:1786109406.110503:0:190350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933183744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.110560:0:190350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933183872:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.110612:0:190350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.110632:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933183872 00000100:00100000:2.0:1786109406.110635:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933183872 00000100:00100000:2.0:1786109406.110656:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12250 00000100:00100000:2.0:1786109406.110663:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933183872:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.110804:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933183872:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 141us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109406.110811:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12250 00000100:00100000:2.0:1786109406.110845:0:190350:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c5319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109406.110857:0:190350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933183872:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1786109406.110893:0:190350:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400007ec:0x1:0x0] first idx 6, last_idx 8 00000100:00100000:2.0:1786109406.110979:0:190350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933184000:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.111017:0:190350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.111039:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933184000 00000100:00100000:2.0:1786109406.111042:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933184000 00000100:00100000:2.0:1786109406.111063:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12251 00000100:00100000:2.0:1786109406.111069:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933184000:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.111183:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933184000:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 112us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109406.111189:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12251 00000100:00100000:2.0:1786109406.111210:0:190350:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c5319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109406.111223:0:190350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933184000:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1786109406.111250:0:190350:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 8 synced_idx: 0 lgh_last_idx: 8 00000040:00080000:2.0:1786109406.111254:0:190350:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240002ef8:0x1:0x0] at index 7 of catalog [0x2400007ec:0x1:0x0] 00000100:00100000:2.0:1786109406.111287:0:190350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933184128:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.111314:0:190350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.111334:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933184128 00000100:00100000:2.0:1786109406.111338:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933184128 00000100:00100000:2.0:1786109406.111359:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12252 00000100:00100000:2.0:1786109406.111365:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933184128:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.111405:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933184128:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 41us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109406.111411:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12252 00000100:00100000:2.0:1786109406.111450:0:190350:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c531300 going to sleep for 11 seconds 00000100:00100000:2.0:1786109406.111464:0:190350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933184128:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.111511:0:190350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933184256:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.111564:0:190350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.111585:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933184256 00000100:00100000:2.0:1786109406.111588:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933184256 00000100:00100000:2.0:1786109406.111610:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12253 00000100:00100000:2.0:1786109406.111617:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933184256:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.111758:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933184256:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 141us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109406.111765:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12253 00000100:00100000:2.0:1786109406.111783:0:190350:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c5319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109406.111797:0:190350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933184256:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1786109406.112390:0:190316:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1786109406.112427:0:190316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1786109406.112865:0:190316:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1786109406.112873:0:190316:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1786109406.112904:0:190316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786109406.113953:0:190350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cee300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933184384:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.114012:0:190350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.114043:0:190350:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c5313c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109406.114131:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933184384 00000100:00100000:3.0:1786109406.114137:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933184384 00000100:00100000:3.0:1786109406.114180:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12254 00000100:00100000:3.0:1786109406.114189:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933184384:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1786109406.114261:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933184384:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 73us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109406.114269:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12254 00000100:00100000:2.0:1786109406.114349:0:190350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cee300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933184384:0@lo:1000:lod0000_rec0001.0 00000004:00080000:2.0:1786109406.114394:0:190350:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098c531900 with version 1 00000040:00080000:2.0:1786109406.114507:0:190350:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400007ec:0x1:0x0] first idx 7, last_idx 8 00000004:00080000:2.0:1786109406.114518:0:190350:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff93098c5319c0 with version 2 00000040:00080000:0.0:1786109406.114609:0:190316:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1786109406.115552:0:190316:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1786109406.115597:0:190316:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1786109406.115719:0:190316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1786109406.116394:0:190316:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x80:0x0] (8/32) registered 00000004:00080000:3.0:1786109406.117476:0:190334:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a82b69600 version 1 rpc_version 1 00000020:00100000:3.0:1786109406.117511:0:190334:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109406.117523:0:190334:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f57480 x1872862933184640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109406.117546:0:190334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f57480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190334:1872862933184640:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786109406.117609:0:190334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109406.117640:0:190334:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109406.117771:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933184640 00000100:00100000:1.0:1786109406.117779:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933184640 00000100:00100000:1.0:1786109406.117827:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12255 00000100:00100000:1.0:1786109406.117835:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190334:x1872862933184640:12345-0@lo:1000:osp_up1-0.0 00000040:00080000:2.0:1786109406.118314:0:190350:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x240002ef8:0x1:0x0] at index 7 of catalog [0x2400007ec:0x1:0x0] 00000040:00080000:1.0:1786109406.119607:0:190349:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x20001a210:0x1:0x0] first idx 3, last_idx 4 00000040:00080000:1.0:1786109406.119698:0:190349:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1786109406.119703:0:190349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x2000255c0:0x1:0x0] at index 4 of catalog [0x20001a210:0x1:0x0] 00000040:00080000:1.0:1786109406.119920:0:190349:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x2000255c0:0x1:0x0] at index 4 of catalog [0x20001a210:0x1:0x0] 00000040:00080000:1.0:1786109406.119940:0:190349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 4 count 1 00000004:00080000:1.0:1786109406.119990:0:190349:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00080000:2.0:1786109406.120421:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804564 is committed 00000001:00100000:2.0:1786109406.120520:0:187891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1786109406.121488:0:190316:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 326417514629 00010000:00080000:3.0:1786109406.122106:0:190351:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 190351 00010000:02000000:3.0:1786109406.122123:0:190351:0:(ldlm_lib.c:2336:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1786109406.122126:0:190351:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1786109406.122129:0:190351:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1786109406.122270:0:190316:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1786109406.122285:0:190316:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1786109406.122303:0:190316:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1786109406.122319:0:190316:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1786109406.123260:0:190316:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1786109406.123522:0:190316:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1786109406.132285:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:190334:x1872862933184640:12345-0@lo:1000:osp_up1-0.0 Request processed in 14441us (14666us total) trans 25769804564 rc 0/0 00000100:00100000:1.0:1786109406.132300:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12255 00000004:00080000:1.0:1786109406.132382:0:190334:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804564 committed transno 25769804564 00000100:00100000:1.0:1786109406.132387:0:190334:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804564 gen 2 00000100:00100000:1.0:1786109406.132406:0:190334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f57480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190334:1872862933184640:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1786109406.132454:0:190334:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a82b69600 version 2 rpc_version 2 00000020:00100000:1.0:1786109406.132480:0:190334:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109406.132487:0:190334:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9309859e9c00 x1872862933184896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109406.132506:0:190334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190334:1872862933184896:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109406.132544:0:190334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109406.132566:0:190334:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a597cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109406.158371:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933184896 00000100:00100000:2.0:1786109406.158386:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933184896 00000100:00100000:2.0:1786109406.158457:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12256 00000100:00100000:2.0:1786109406.158468:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:190334:x1872862933184896:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109406.158695:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190334:x1872862933184896:12345-0@lo:1000:osp_up1-0.0 Request processed in 229us (26150us total) trans 25769804565 rc 0/0 00000100:00100000:2.0:1786109406.158702:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12256 00000100:00100000:2.0:1786109406.165835:0:190334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190334:1872862933184896:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109406.170471:0:190350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cee300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933185024:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109406.170580:0:190350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.170618:0:190350:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c531840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109406.170923:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933185024 00000100:00100000:1.0:1786109406.170931:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933185024 00000100:00100000:1.0:1786109406.170989:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12257 00000100:00100000:1.0:1786109406.170999:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933185024:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109406.171191:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933185024:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 192us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109406.171199:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12257 00000100:00100000:0.0:1786109406.171917:0:190350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cee300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933185024:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1786109406.171974:0:190350:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:0.0:1786109406.171980:0:190350:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240002ef8:0x2:0x0] at index 8 of catalog [0x2400007ec:0x1:0x0] 00000100:00100000:0.0:1786109406.172056:0:190350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933185152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1786109406.172095:0:190350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109406.172125:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933185152 00000100:00100000:0.0:1786109406.172130:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933185152 00000100:00100000:0.0:1786109406.172167:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12258 00000100:00100000:0.0:1786109406.172175:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933185152:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1786109406.172233:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190350:x1872862933185152:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.172240:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12258 00000100:00100000:0.0:1786109406.172259:0:190350:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7e42cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109406.172272:0:190350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:190350:1872862933185152:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1786109406.172312:0:190350:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1786109406.172349:0:190350:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e42600 with version 3 00000004:00080000:0.0:1786109406.172385:0:190350:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff930ab7e42780 with version 4 00000040:00080000:0.0:1786109406.172389:0:190350:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x240002ef8:0x2:0x0] at index 8 of catalog [0x2400007ec:0x1:0x0] 00000040:00080000:0.0:1786109406.172401:0:190350:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 8 count 1 00000004:00080000:0.0:1786109406.172476:0:190350:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1786109406.172480:0:190350:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:2.0:1786109406.172729:0:190334:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a82b69600 version 3 rpc_version 3 00000020:00100000:2.0:1786109406.172747:0:190334:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109406.172755:0:190334:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac0cee680 x1872862933185408/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109406.172771:0:190334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cee680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190334:1872862933185408:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109406.172804:0:190334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.172839:0:190334:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c531c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109406.173002:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933185408 00000100:00100000:1.0:1786109406.173008:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933185408 00000100:00100000:1.0:1786109406.173100:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12259 00000100:00100000:1.0:1786109406.173111:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:190334:x1872862933185408:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109406.173303:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:190334:x1872862933185408:12345-0@lo:1000:osp_up1-0.0 Request processed in 194us (498us total) trans 25769804566 rc 0/0 00000100:00100000:1.0:1786109406.173311:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12259 00000100:00100000:2.0:1786109406.173383:0:190334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cee680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190334:1872862933185408:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786109406.173392:0:190334:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a82b69600 version 4 rpc_version 4 00000020:00100000:2.0:1786109406.173404:0:190334:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109406.173409:0:190334:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac0ceed80 x1872862933185664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109406.173422:0:190334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ceed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190334:1872862933185664:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786109406.173482:0:190334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109406.173503:0:190334:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c531c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109406.173670:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933185664 00000100:00100000:1.0:1786109406.173675:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933185664 00000100:00100000:1.0:1786109406.173707:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12260 00000100:00100000:1.0:1786109406.173714:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:190334:x1872862933185664:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786109406.173891:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:190334:x1872862933185664:12345-0@lo:1000:osp_up1-0.0 Request processed in 177us (407us total) trans 25769804567 rc 0/0 00000100:00100000:1.0:1786109406.173898:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12260 00010000:00080000:0.0:1786109406.174194:0:190351:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1786109406.177213:0:190334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ceed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:190334:1872862933185664:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1786109406.404673:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109406.987798:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933185792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109406.987919:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109406.988044:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933185792 00000100:00100000:1.0:1786109406.988052:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933185792 00000100:00100000:1.0:1786109406.988193:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5735 00000100:00100000:1.0:1786109406.988206:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933185792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109406.988230:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109406.988285:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933185792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109406.988294:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5735 00000100:00100000:1.0:1786109406.988388:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933185792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109406.989785:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109406.992325:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933185920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109406.992395:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109406.994784:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933185920 00000100:00100000:0.0:1786109406.994797:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933185920 00000100:00100000:0.0:1786109406.994862:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5736 00000100:00100000:0.0:1786109406.994872:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933185920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109406.994899:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109406.994978:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933185920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (2581us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109406.994985:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5736 00000100:00100000:2.0:1786109406.995101:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933185920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109407.261599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109407.261681:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109407.261768:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109407.261805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109407.261845:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109407.261876:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922074496 00000100:00100000:0.0:1786109407.261885:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922074496 00000100:00100000:0.0:1786109407.261957:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922074368 00000100:00100000:0.0:1786109407.261961:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922074368 00000100:00100000:0.0:1786109407.261982:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:0.0:1786109407.261994:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922074496:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109407.262066:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922074496:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109407.262074:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:0.0:1786109407.262091:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 899 00000100:00100000:0.0:1786109407.262096:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922074368:12345-192.168.203.38@tcp:38:kworker.0 00000100:00100000:2.0:1786109407.262180:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922074624 00000100:00100000:2.0:1786109407.262185:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922074624 00000100:00100000:2.0:1786109407.262219:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6849 00000100:00100000:2.0:1786109407.262228:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922074624:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109407.262259:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922074624:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109407.262265:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6849 00000100:00080000:2.0:1786109407.262312:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109407.262317:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1786109407.262504:0:187901:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '397d331e-10fc-4558-be87-308c3622e8eb' at ffff930ab31e9800, cookie 0xdb52b77d7ca3633c 00010000:00080000:0.0:1786109407.262512:0:187901:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp recovering/t322122566376 exp ffff930ab31e9800 cur 8263 last 1786109406 00010000:02000400:0.0:1786109407.262520:0:187901:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1786109407.262526:0:187901:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1786109407.262547:0:187901:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1786109407.262685:0:187901:0:(import.c:65:import_set_state_nolock()) ffff93098e512800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109407.262730:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862922074368:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 632us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109407.262738:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 899 00000100:00100000:3.0:1786109407.262942:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922074112 00000100:00100000:1.0:1786109407.262943:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922074240 00000100:00100000:3.0:1786109407.262949:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922074112 00000100:00100000:1.0:1786109407.262950:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922074240 00000100:00100000:1.0:1786109407.263362:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:2.0:1786109407.263371:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:1.0:1786109407.263376:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab959dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922074240:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109407.263385:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab959f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922074112:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109407.263396:0:190329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109407.263418:0:190329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd77a00/0xdb52b77d7ca363f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14d7 expref: -99 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109407.263427:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab959dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922074240:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 54us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109407.263458:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00010000:00010000:2.0:1786109407.263472:0:190329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd77a00/0xdb52b77d7ca363f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14d7 expref: 10 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109407.263485:0:190329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd77a00/0xdb52b77d7ca363f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14d7 expref: 10 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109407.263496:0:190329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77a00, rc 0) 00000100:00100000:2.0:1786109407.263520:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab959f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922074112:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 139us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109407.263527:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:2.0:1786109407.268360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109407.268467:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922074752 00000100:00100000:3.0:1786109407.268477:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922074752 00000100:00100000:3.0:1786109407.268536:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:3.0:1786109407.268555:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab959e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922074752:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1786109407.268582:0:190322:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1786109407.268606:0:190322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786109407.268610:0:190322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1786109407.268613:0:190322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1786109407.268616:0:190322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1786109407.268619:0:190322:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 321 00000100:00100000:3.0:1786109407.270109:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab959e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922074752:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 Request processed in 1488us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109407.270122:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:2.0:1786109407.272555:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109407.272661:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862920179840 00000100:00100000:3.0:1786109407.272671:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862920179840 00000100:00100000:3.0:1786109407.272757:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 900 00000100:00100000:3.0:1786109407.272770:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862920179840:12345-192.168.203.38@tcp:101:lfs.0 00010000:00080000:3.0:1786109407.272787:0:188678:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 326417514630, current: 322122566376, replaying 00000020:02000000:3.0:1786109407.272794:0:188678:0:(tgt_handler.c:403:tgt_handle_request0()) *** cfs_fail_loc=302, val=2147483648*** 00000100:00100000:3.0:1786109407.275265:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862920179840:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2488us (2709us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109407.275280:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 900 00010000:00010000:2.0:1786109407.428689:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786109407.942020:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786109407.942028:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930ab28f1800 from 321 10000000:01000000:3.0:1786109407.942033:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786109407.942077:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.942089:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.942101:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109407.942127:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109407.942190:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109407.942263:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109407.942859:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933186048 00000100:00100000:0.0:1786109407.942867:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933186048 00000100:00100000:0.0:1786109407.942933:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786109407.942943:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab959fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:6524:x1872862933186048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109407.942958:0:190329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109407.942983:0:190329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c3e00/0xdb52b77d7ca36400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca363f9 expref: -99 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.943005:0:190329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c3e00/0xdb52b77d7ca36400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca363f9 expref: 11 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.943016:0:190329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c3e00/0xdb52b77d7ca36400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca363f9 expref: 11 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.943024:0:190329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3e00, rc 0) 00000100:00100000:0.0:1786109407.943070:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab959fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933186048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109407.943078:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786109407.943172:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109407.943187:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.943195:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109407.943245:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786109407.943288:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109407.944904:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109407.946073:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933186176 00000100:00100000:0.0:1786109407.946083:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933186176 00000100:00100000:0.0:1786109407.946123:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786109407.946132:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab959c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933186176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786109407.946155:0:190323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786109407.946172:0:190323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786109407.946176:0:190323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 321 00000100:00100000:0.0:1786109407.946275:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab959c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933186176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (2986us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109407.946283:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786109407.946327:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1786109407.946415:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786109407.946424:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.946451:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109407.946461:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1786109407.946463:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930a92e3e800 from 52 10000000:01000000:0.0:1786109407.946466:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786109407.946505:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca36407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.946513:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca36407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.946521:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca36407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109407.946538:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109407.946577:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109407.946605:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985430a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109407.946617:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933186304 00000100:00100000:0.0:1786109407.946620:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933186304 00000100:00100000:0.0:1786109407.946642:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786109407.946648:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933186304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109407.946657:0:190329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109407.946669:0:190329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c2200/0xdb52b77d7ca3640e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36407 expref: -99 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.946687:0:190329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c2200/0xdb52b77d7ca3640e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36407 expref: 12 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.946697:0:190329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c2200/0xdb52b77d7ca3640e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36407 expref: 12 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.946706:0:190329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2200, rc 0) 00000100:00100000:0.0:1786109407.946733:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933186304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109407.946739:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786109407.946771:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109407.946782:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca36407 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3640e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.946791:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca36407 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3640e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109407.946918:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109407.946945:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109407.946996:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985430a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109407.947060:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933186432 00000100:00100000:2.0:1786109407.947064:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933186432 00000100:00100000:2.0:1786109407.947098:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1786109407.947105:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933186432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109407.947258:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933186432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109407.947265:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786109407.947348:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109407.947389:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109407.947458:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109407.947476:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985430a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109407.947546:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933186560 00000100:00100000:2.0:1786109407.947551:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933186560 00000100:00100000:2.0:1786109407.947572:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1786109407.947577:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933186560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109407.947654:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933186560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109407.947661:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786109407.947744:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786109407.950894:0:190446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1786109407.951044:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1786109407.951069:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786109407.951080:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca36407 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3640e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.951091:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca36407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3640e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109407.951100:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1786109407.951103:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930a92e3e800 from 318 10000000:01000000:0.0:1786109407.951105:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786109407.951138:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2600/0xdb52b77d7ca36415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.951145:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c2600/0xdb52b77d7ca36415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.951156:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c2600/0xdb52b77d7ca36415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109407.951178:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109407.951242:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109407.951299:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a89f5b900 going to sleep for 11 seconds 00000100:00100000:2.0:1786109407.951345:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933186688 00000100:00100000:2.0:1786109407.951352:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933186688 00000100:00100000:2.0:1786109407.951408:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786109407.951418:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933186688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109407.951458:0:190329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109407.951470:0:190329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd76a00/0xdb52b77d7ca3641c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36415 expref: -99 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109407.951493:0:190329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd76a00/0xdb52b77d7ca3641c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36415 expref: 13 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109407.951504:0:190329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd76a00/0xdb52b77d7ca3641c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36415 expref: 13 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109407.951512:0:190329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76a00, rc 0) 00000100:00100000:2.0:1786109407.951557:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933186688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109407.951563:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1786109407.951683:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109407.951697:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c2600/0xdb52b77d7ca36415 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3641c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.951705:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c2600/0xdb52b77d7ca36415 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3641c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109407.951760:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786109407.951793:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109407.951833:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc300 going to sleep for 11 seconds 00000100:00100000:0.0:1786109407.951876:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933186816 00000100:00100000:0.0:1786109407.951880:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933186816 00000100:00100000:0.0:1786109407.951918:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786109407.951925:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933186816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786109407.951938:0:190321:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786109407.951954:0:190321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786109407.951957:0:190321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1786109407.951961:0:190321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1786109407.951963:0:190321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1786109407.951966:0:190321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 321 00000100:00100000:0.0:1786109407.952126:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933186816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 201us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109407.952133:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786109407.952187:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1786109407.952255:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786109407.952260:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2600/0xdb52b77d7ca36415 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3641c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.952268:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c2600/0xdb52b77d7ca36415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3641c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109407.952275:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1786109407.952277:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1786109407.952279:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1786109407.952295:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295f400/0xdb52b77d7ca36423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.952303:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab295f400/0xdb52b77d7ca36423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.952310:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab295f400/0xdb52b77d7ca36423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109407.952323:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109407.952346:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109407.952368:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc300 going to sleep for 11 seconds 00000100:00100000:2.0:1786109407.952404:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933186944 00000100:00100000:2.0:1786109407.952408:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933186944 00000100:00100000:2.0:1786109407.952464:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786109407.952471:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933186944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109407.952482:0:190329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109407.952491:0:190329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd77600/0xdb52b77d7ca3642a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36423 expref: -99 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109407.952505:0:190329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd77600/0xdb52b77d7ca3642a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36423 expref: 14 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109407.952514:0:190329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd77600/0xdb52b77d7ca3642a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36423 expref: 14 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109407.952521:0:190329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77600, rc 0) 00000100:00100000:2.0:1786109407.952550:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933186944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109407.952556:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786109407.952665:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933186944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109407.952675:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab295f400/0xdb52b77d7ca36423 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3642a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.952685:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab295f400/0xdb52b77d7ca36423 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3642a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109407.952732:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109407.952752:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109407.952785:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc300 going to sleep for 11 seconds 00000100:00100000:2.0:1786109407.952829:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933187072 00000100:00100000:2.0:1786109407.952833:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933187072 00000100:00100000:2.0:1786109407.952863:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786109407.952868:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933187072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109407.953014:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933187072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109407.953021:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786109407.953046:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109407.953071:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ced500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109407.953107:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109407.953122:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c531900 going to sleep for 11 seconds 00000100:00100000:2.0:1786109407.953133:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933187200 00000100:00100000:2.0:1786109407.953136:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933187200 00000100:00100000:2.0:1786109407.953157:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786109407.953163:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8a733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933187200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109407.955656:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8a733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933187200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2484us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109407.955669:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1786109407.955741:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ced500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786109407.958295:0:190449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1786109407.963909:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1786109407.963961:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1786109407.963974:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295f400/0xdb52b77d7ca36423 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3642a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.963987:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab295f400/0xdb52b77d7ca36423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3642a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109407.963996:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1786109407.963999:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff930a92e3e800 from 1 10000000:01000000:3.0:1786109407.964002:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1786109407.964055:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295f000/0xdb52b77d7ca36431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.964064:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab295f000/0xdb52b77d7ca36431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.964076:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab295f000/0xdb52b77d7ca36431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109407.964103:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109407.964166:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109407.964912:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dca80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109407.967124:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933187328 00000100:00100000:0.0:1786109407.967137:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933187328 00000100:00100000:0.0:1786109407.967235:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1786109407.967246:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8a730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933187328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109407.967262:0:190322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109407.967279:0:190322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c3000/0xdb52b77d7ca36438 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36431 expref: -99 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.967305:0:190322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c3000/0xdb52b77d7ca36438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36431 expref: 15 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.967317:0:190322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c3000/0xdb52b77d7ca36438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36431 expref: 15 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.967330:0:190322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3000, rc 0) 00000100:00100000:0.0:1786109407.967414:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8a730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933187328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (3248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109407.967421:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786109407.967546:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109407.967563:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab295f000/0xdb52b77d7ca36431 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36438 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109407.967573:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab295f000/0xdb52b77d7ca36431 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36438 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109407.967591:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1786109407.967596:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295f000/0xdb52b77d7ca36431 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36438 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109407.967604:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab295f000/0xdb52b77d7ca36431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36438 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109407.967612:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786109407.967614:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930a92e3e800 from 7 10000000:01000000:1.0:1786109407.967616:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786109407.967639:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acec00/0xdb52b77d7ca3643f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109407.967647:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0acec00/0xdb52b77d7ca3643f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109407.967654:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0acec00/0xdb52b77d7ca3643f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109407.967671:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109407.967706:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109407.973793:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109407.976599:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933187456 00000100:00100000:3.0:1786109407.976613:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933187456 00000100:00100000:3.0:1786109407.976822:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786109407.976834:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8a731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933187456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109407.976852:0:190323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109407.976985:0:190323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab295e200/0xdb52b77d7ca36446 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3643f expref: -99 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.979123:0:190323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab295e200/0xdb52b77d7ca36446 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3643f expref: 16 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.979137:0:190323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab295e200/0xdb52b77d7ca36446 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3643f expref: 16 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109407.979148:0:190323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295e200, rc 0) 00000100:00100000:3.0:1786109407.980420:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8a731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933187456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3584us (12708us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109407.980445:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1786109407.980514:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109407.980547:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0acec00/0xdb52b77d7ca3643f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36446 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109407.980559:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0acec00/0xdb52b77d7ca3643f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36446 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109407.980644:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109407.980679:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109407.980721:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109407.980794:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933187584 00000100:00100000:0.0:1786109407.980812:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933187584 00000100:00100000:0.0:1786109407.980848:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786109407.980857:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a984b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933187584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109407.980976:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a984b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933187584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109407.980983:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786109407.981011:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109407.981051:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109407.981090:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109407.981105:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6a300 going to sleep for 11 seconds 00000100:00100000:1.0:1786109407.981193:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933187712 00000100:00100000:1.0:1786109407.981198:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933187712 00000100:00100000:1.0:1786109407.981235:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786109407.981242:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933187712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109407.981314:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933187712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109407.981321:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786109407.981397:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786109407.982502:0:190450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1786109407.982652:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1786109407.982682:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786109407.982692:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acec00/0xdb52b77d7ca3643f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36446 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109407.982702:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0acec00/0xdb52b77d7ca3643f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36446 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109407.982711:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786109407.982714:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930ab7c47000 from 52 10000000:01000000:1.0:1786109407.982717:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786109407.982746:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acf200/0xdb52b77d7ca3644d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109407.982753:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0acf200/0xdb52b77d7ca3644d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109407.982762:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0acf200/0xdb52b77d7ca3644d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109407.982776:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109407.982842:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109407.982881:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2000 going to sleep for 11 seconds 00000100:00100000:0.0:1786109407.982933:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933187840 00000100:00100000:0.0:1786109407.982941:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933187840 00000100:00100000:0.0:1786109407.983021:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786109407.983040:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933187840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109407.983052:0:190329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109407.983065:0:190329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca36454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3644d expref: -99 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.983094:0:190329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca36454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3644d expref: 17 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.983112:0:190329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca36454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3644d expref: 17 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109407.983120:0:190329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3600, rc 0) 00000100:00100000:0.0:1786109407.983159:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933187840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109407.983166:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1786109407.985542:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109407.985570:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0acf200/0xdb52b77d7ca3644d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36454 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109407.985582:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0acf200/0xdb52b77d7ca3644d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36454 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109407.985677:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109407.985733:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109407.985779:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2000 going to sleep for 11 seconds 00000100:00100000:3.0:1786109407.985878:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933187968 00000100:00100000:3.0:1786109407.985884:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933187968 00000100:00100000:3.0:1786109407.985925:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786109407.985934:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933187968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109407.987091:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933187968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1089us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109407.987103:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786109407.987186:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933187968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109407.987230:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109407.987274:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109407.987314:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6a780 going to sleep for 11 seconds 00000100:00100000:3.0:1786109407.987361:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933188096 00000100:00100000:3.0:1786109407.987366:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933188096 00000100:00100000:3.0:1786109407.987512:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786109407.987521:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933188096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109407.987661:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933188096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109407.987668:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786109407.993169:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786109407.996703:0:190451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1786109407.998582:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1786109407.998619:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786109407.998631:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acf200/0xdb52b77d7ca3644d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36454 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109407.998644:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0acf200/0xdb52b77d7ca3644d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36454 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109407.998654:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1786109407.998657:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1786109407.998659:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1786109407.998699:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acf800/0xdb52b77d7ca3645b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109407.998708:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0acf800/0xdb52b77d7ca3645b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109407.998718:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0acf800/0xdb52b77d7ca3645b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109407.998744:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109407.998822:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109407.998877:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109408.000530:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933188224 00000100:00100000:0.0:1786109408.000542:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933188224 00000100:00100000:0.0:1786109408.000614:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786109408.000625:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933188224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109408.000641:0:190321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109408.000657:0:190321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c3200/0xdb52b77d7ca36462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3645b expref: -99 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.000684:0:190321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c3200/0xdb52b77d7ca36462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3645b expref: 18 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.000696:0:190321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c3200/0xdb52b77d7ca36462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3645b expref: 18 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.000706:0:190321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3200, rc 0) 00000100:00100000:0.0:1786109408.000772:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933188224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109408.000779:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786109408.000848:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109408.000866:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0acf800/0xdb52b77d7ca3645b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36462 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.000875:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0acf800/0xdb52b77d7ca3645b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36462 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109408.000947:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109408.000993:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109408.001116:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933188352 00000100:00100000:1.0:1786109408.001120:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933188352 00000100:00100000:1.0:1786109408.003567:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786109408.003585:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933188352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109408.003768:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933188352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (2774us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109408.003775:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786109408.004483:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6a900 going to sleep for 11 seconds 00000100:00100000:1.0:1786109408.004513:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109408.004566:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109408.004615:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109408.006875:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9332240 going to sleep for 11 seconds 00000100:00100000:0.0:1786109408.011303:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933188480 00000100:00100000:0.0:1786109408.011318:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933188480 00000100:00100000:0.0:1786109408.011382:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786109408.011392:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933188480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109408.012777:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933188480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1382us (8157us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109408.012790:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786109408.012884:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786109408.015097:0:190455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1786109408.015244:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1786109408.015266:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1786109408.015412:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acf800/0xdb52b77d7ca3645b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36462 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.015426:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0acf800/0xdb52b77d7ca3645b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36462 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109408.015459:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786109408.015462:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930ab7c47000 from 7 10000000:01000000:0.0:1786109408.015465:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786109408.015498:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca36469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.015506:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca36469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.015516:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca36469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109408.015710:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109408.015771:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109408.015930:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109408.016229:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933188608 00000100:00100000:3.0:1786109408.016237:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933188608 00000100:00100000:3.0:1786109408.016388:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786109408.016399:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933188608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109408.016413:0:190323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109408.016427:0:190323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab295e600/0xdb52b77d7ca36470 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36469 expref: -99 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.016469:0:190323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab295e600/0xdb52b77d7ca36470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36469 expref: 19 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.016482:0:190323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab295e600/0xdb52b77d7ca36470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36469 expref: 19 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.016490:0:190323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295e600, rc 0) 00000100:00100000:3.0:1786109408.016612:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933188608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109408.016679:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786109408.016759:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109408.016774:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca36469 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36470 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.016794:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca36469 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36470 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109408.016865:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109408.016890:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109408.016916:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109408.016930:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933188736 00000100:00100000:0.0:1786109408.017749:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933188736 00000100:00100000:0.0:1786109408.018207:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786109408.018216:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933188736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109408.018723:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933188736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 508us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109408.018731:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786109408.018941:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109408.019112:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109408.019225:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109408.019375:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109408.019413:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933188864 00000100:00100000:1.0:1786109408.019418:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933188864 00000100:00100000:1.0:1786109408.019897:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1786109408.019906:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933188864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109408.020384:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933188864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 478us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109408.020393:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786109408.020502:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786109408.021714:0:190458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1786109408.022859:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1786109408.022890:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786109408.022902:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca36469 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36470 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109408.022914:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca36469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36470 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109408.022928:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786109408.022931:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930aa6612000 from 52 10000000:01000000:1.0:1786109408.022934:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786109408.022969:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0ace000/0xdb52b77d7ca36477 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109408.022976:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0ace000/0xdb52b77d7ca36477 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109408.022987:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0ace000/0xdb52b77d7ca36477 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109408.023009:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109408.023068:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109408.023116:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab93323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109408.025031:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933188992 00000100:00100000:3.0:1786109408.025043:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933188992 00000100:00100000:3.0:1786109408.025141:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786109408.025153:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933188992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109408.025169:0:190321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109408.025185:0:190321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab295fa00/0xdb52b77d7ca3647e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36477 expref: -99 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.025210:0:190321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab295fa00/0xdb52b77d7ca3647e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36477 expref: 20 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.025222:0:190321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab295fa00/0xdb52b77d7ca3647e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36477 expref: 20 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.025230:0:190321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab295fa00, rc 0) 00000100:00100000:3.0:1786109408.025298:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933188992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (2229us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109408.025304:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786109408.025929:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933188992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109408.025948:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0ace000/0xdb52b77d7ca36477 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3647e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.025958:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0ace000/0xdb52b77d7ca36477 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3647e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109408.026032:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.026070:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109408.026116:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc780 going to sleep for 11 seconds 00000100:00100000:1.0:1786109408.026174:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933189120 00000100:00100000:1.0:1786109408.026179:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933189120 00000100:00100000:1.0:1786109408.026248:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786109408.026256:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933189120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109408.026385:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933189120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109408.026392:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786109408.026459:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.026503:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.026568:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109408.028014:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc780 going to sleep for 11 seconds 00000100:00100000:2.0:1786109408.028124:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933189248 00000100:00100000:2.0:1786109408.028132:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933189248 00000100:00100000:2.0:1786109408.028172:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786109408.028181:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982458450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933189248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109408.028295:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982458450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933189248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109408.028303:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786109408.028869:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786109408.029582:0:190460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1786109408.029654:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1786109408.029685:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786109408.029694:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0ace000/0xdb52b77d7ca36477 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3647e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.029705:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0ace000/0xdb52b77d7ca36477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3647e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109408.029714:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1786109408.029716:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1786109408.029719:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1786109408.029748:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295ea00/0xdb52b77d7ca36485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.029755:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab295ea00/0xdb52b77d7ca36485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.029765:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab295ea00/0xdb52b77d7ca36485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109408.029783:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.029846:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109408.029889:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dce40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109408.030031:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933189376 00000100:00100000:2.0:1786109408.030037:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933189376 00000100:00100000:2.0:1786109408.030073:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1786109408.030081:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098245ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933189376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109408.030094:0:190323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109408.030108:0:190323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd76200/0xdb52b77d7ca3648c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36485 expref: -99 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109408.030130:0:190323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd76200/0xdb52b77d7ca3648c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36485 expref: 21 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109408.030141:0:190323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd76200/0xdb52b77d7ca3648c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36485 expref: 21 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109408.030149:0:190323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76200, rc 0) 00000100:00100000:2.0:1786109408.030190:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098245ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933189376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109408.030197:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1786109408.030237:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109408.030249:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab295ea00/0xdb52b77d7ca36485 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3648c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109408.030258:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab295ea00/0xdb52b77d7ca36485 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3648c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109408.030310:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109408.030334:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109408.030357:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c531900 going to sleep for 11 seconds 00000100:00100000:2.0:1786109408.030369:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933189504 00000100:00100000:2.0:1786109408.030372:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933189504 00000100:00100000:2.0:1786109408.030395:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786109408.030401:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933189504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109408.030550:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933189504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109408.030557:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786109408.030586:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109408.030612:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109408.030655:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109408.030676:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0f14180 going to sleep for 11 seconds 00000100:00100000:2.0:1786109408.030687:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933189632 00000100:00100000:2.0:1786109408.030690:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933189632 00000100:00100000:2.0:1786109408.030712:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786109408.030718:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098245a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933189632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.037682:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098245a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933189632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6953us (7016us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109408.037697:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1786109408.037832:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109408.039239:0:190461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1786109408.039426:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1786109408.039486:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786109408.039498:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295ea00/0xdb52b77d7ca36485 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3648c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.039509:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab295ea00/0xdb52b77d7ca36485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3648c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109408.039519:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786109408.039522:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930aa6612000 from 7 10000000:01000000:3.0:1786109408.039525:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786109408.039560:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295f200/0xdb52b77d7ca36493 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.039568:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab295f200/0xdb52b77d7ca36493 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.039578:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab295f200/0xdb52b77d7ca36493 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109408.039601:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.039662:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109408.039714:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109408.039776:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933189760 00000100:00100000:1.0:1786109408.039783:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933189760 00000100:00100000:1.0:1786109408.039843:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1786109408.039853:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933189760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109408.039868:0:190321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109408.039881:0:190321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0acea00/0xdb52b77d7ca3649a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36493 expref: -99 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109408.039904:0:190321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0acea00/0xdb52b77d7ca3649a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36493 expref: 22 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109408.039915:0:190321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0acea00/0xdb52b77d7ca3649a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36493 expref: 22 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109408.039925:0:190321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0acea00, rc 0) 00000100:00100000:1.0:1786109408.039964:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933189760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109408.039971:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786109408.040563:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109408.040577:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab295f200/0xdb52b77d7ca36493 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3649a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.040586:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab295f200/0xdb52b77d7ca36493 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3649a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109408.040660:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.040691:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109408.040732:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109408.040775:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933189888 00000100:00100000:1.0:1786109408.040780:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933189888 00000100:00100000:1.0:1786109408.040825:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786109408.040833:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933189888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109408.040942:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933189888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109408.040949:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1786109408.041010:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933189888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.041036:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933190016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.041076:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109408.041099:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109408.041113:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933190016 00000100:00100000:3.0:1786109408.041117:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933190016 00000100:00100000:3.0:1786109408.041141:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1786109408.041147:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933190016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.041240:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933190016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109408.041248:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1786109408.041290:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933190016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786109408.044028:0:190462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1786109408.044221:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1786109408.044276:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786109408.044288:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295f200/0xdb52b77d7ca36493 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3649a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.044299:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab295f200/0xdb52b77d7ca36493 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3649a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109408.044307:0:6524:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1786109408.044310:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff930a8a73cd40 from 1 10000000:01000000:3.0:1786109408.044313:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1786109408.044350:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295e400/0xdb52b77d7ca364a1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.044363:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab295e400/0xdb52b77d7ca364a1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.044374:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab295e400/0xdb52b77d7ca364a1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109408.044395:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933190144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.044483:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109408.044530:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109408.044591:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933190144 00000100:00100000:0.0:1786109408.044598:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933190144 00000100:00100000:0.0:1786109408.044647:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786109408.044656:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933190144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109408.044669:0:190329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109408.044683:0:190329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c2800/0xdb52b77d7ca364a8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca364a1 expref: -99 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.044705:0:190329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c2800/0xdb52b77d7ca364a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca364a1 expref: 23 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.044715:0:190329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c2800/0xdb52b77d7ca364a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca364a1 expref: 23 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.044724:0:190329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2800, rc 0) 00000100:00100000:0.0:1786109408.044760:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933190144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109408.044765:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1786109408.044853:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933190144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109408.044866:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab295e400/0xdb52b77d7ca364a1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca364a8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.044875:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab295e400/0xdb52b77d7ca364a1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca364a8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109408.044891:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1786109408.044894:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295e400/0xdb52b77d7ca364a1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca364a8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.044901:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab295e400/0xdb52b77d7ca364a1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca364a8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109408.044907:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1786109408.044909:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff930a8a73cd40 from 1 10000000:01000000:3.0:1786109408.044911:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1786109408.044924:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295ee00/0xdb52b77d7ca364af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.044934:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab295ee00/0xdb52b77d7ca364af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.044940:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab295ee00/0xdb52b77d7ca364af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109408.044952:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933190272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.044976:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109408.045002:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109408.045045:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933190272 00000100:00100000:0.0:1786109408.045050:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933190272 00000100:00100000:0.0:1786109408.045085:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786109408.045092:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933190272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109408.045100:0:190322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109408.045108:0:190322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca364b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca364af expref: -99 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.045122:0:190322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca364b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca364af expref: 24 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.045130:0:190322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca364b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca364af expref: 24 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109408.045136:0:190322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2c00, rc 0) 00000100:00100000:0.0:1786109408.045162:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933190272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109408.045169:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786109408.045232:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933190272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109408.045243:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab295ee00/0xdb52b77d7ca364af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca364b6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109408.045251:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab295ee00/0xdb52b77d7ca364af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca364b6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109408.045296:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933190400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109408.045319:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109408.045344:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109408.045383:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933190400 00000100:00100000:0.0:1786109408.045387:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933190400 00000100:00100000:0.0:1786109408.045466:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786109408.045474:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933190400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109408.045540:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933190400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (219us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786109408.045547:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1786109408.047764:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933190400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1786109408.048251:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1786109408.048263:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295ee00/0xdb52b77d7ca364af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca364b6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109408.048528:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab295ee00/0xdb52b77d7ca364af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca364b6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109408.453700:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109409.478300:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786109410.113900:0:190601:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1786109410.507226:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109411.096665:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933190528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109411.096734:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109411.097355:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933190528 00000100:00100000:2.0:1786109411.097364:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933190528 00000100:00100000:2.0:1786109411.097422:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12261 00000100:00100000:2.0:1786109411.097448:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:3646:x1872862933190528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109411.097488:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1786109411.099343:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:3646:x1872862933190528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1904us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109411.099356:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12261 00000100:00100000:1.0:1786109411.100144:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933190528:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1786109411.449638:0:190653:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1786109411.449897:0:190653:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1786109411.527222:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109411.589468:0:179248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109411.589475:0:179248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109411.589478:0:179248:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109411.589485:0:179248:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8262 00000100:00080000:0.0:1786109411.589490:0:179248:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109411.589496:0:179248:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109411.590772:0:179248:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098ba4d180 x1872862933190784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109411.590833:0:179248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109411.590837:0:179248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109411.590839:0:179248:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109411.590843:0:179248:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8262 00000100:00080000:0.0:1786109411.590847:0:179248:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109411.590853:0:179248:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109411.590869:0:179248:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098ba4fb80 x1872862933191040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109411.590888:0:179248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109411.590892:0:179248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109411.590893:0:179248:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109411.590896:0:179248:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8262 00000100:00080000:0.0:1786109411.590899:0:179248:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109411.590903:0:179248:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109411.590915:0:179248:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098ba4d880 x1872862933191296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109411.590940:0:179248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109411.590943:0:179248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109411.590945:0:179248:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109411.590948:0:179248:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8262 00000100:00080000:0.0:1786109411.590951:0:179248:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109411.590954:0:179248:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109411.590963:0:179248:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a893c2300 x1872862933191680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109411.590985:0:179248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1786109411.590988:0:179248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109411.591344:0:179248:0:(import.c:65:import_set_state_nolock()) ffff930ab2828000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109411.591353:0:179248:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff930ab2828000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109411.591370:0:179248:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a893c0700 x1872862933192192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109411.591412:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933190656:0@lo:400:kworker.0 00000100:00100000:0.0:1786109411.591492:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109411.591768:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933191552:0@lo:400:kworker.0 00000100:00100000:0.0:1786109411.591809:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109411.591837:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786109411.591843:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933191424:0@lo:400:kworker.0 00000100:00100000:0.0:1786109411.591867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109411.591884:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933192064:0@lo:400:kworker.0 00000100:00100000:0.0:1786109411.591906:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109411.591934:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933190784:0@lo:38:kworker.0 00000100:00100000:0.0:1786109411.591960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109411.591976:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933191040:0@lo:38:kworker.0 00000100:00100000:2.0:1786109411.592657:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933190912:0@lo:400:kworker.0 00000100:00100000:2.0:1786109411.592691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109411.592716:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933191808:0@lo:400:kworker.0 00000100:00100000:2.0:1786109411.592741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109411.592764:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1786109411.592769:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933191168:0@lo:400:kworker.0 00000100:00100000:2.0:1786109411.592802:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109411.592822:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933191936:0@lo:400:kworker.0 00000100:00100000:2.0:1786109411.592848:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109411.592924:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933190784 00000100:00100000:2.0:1786109411.592931:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933190784 00000100:00100000:2.0:1786109411.592959:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933190912 00000100:00100000:2.0:1786109411.592962:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933190912 00000100:00100000:0.0:1786109411.593577:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109411.594587:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933191296:0@lo:38:kworker.0 00000100:00100000:0.0:1786109411.594642:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109411.594662:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933191680:0@lo:38:kworker.0 00000100:00100000:0.0:1786109411.594700:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109411.594890:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933191808 00000100:00100000:1.0:1786109411.594897:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933191808 00000100:00100000:1.0:1786109411.594936:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933191296 00000100:00100000:1.0:1786109411.594939:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933191296 00000100:00100000:1.0:1786109411.594960:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12262 00000100:00100000:1.0:1786109411.594970:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:3648:x1872862933191808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109411.595470:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+8:3648:x1872862933191808:12345-0@lo:400:kworker.0 Request processed in 500us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109411.595479:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12262 00000100:00100000:1.0:1786109411.595499:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12263 00000100:00100000:1.0:1786109411.595504:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933191296:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1786109411.596081:0:177399:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff930ab31ef000, cookie 0xdb52b77d7ca36343 00010000:00080000:1.0:1786109411.596090:0:177399:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff930ab31ef000 cur 8268 last 1786109406 00000004:00100000:1.0:1786109411.596109:0:177399:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786109411.596239:0:177399:0:(import.c:65:import_set_state_nolock()) ffff930ab1982000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786109411.596297:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933191296:12345-0@lo:38:kworker.0 Request processed in 791us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109411.596306:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12263 00000100:00100000:1.0:1786109411.596366:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933191808:0@lo:400:kworker.0 00000100:00100000:1.0:1786109411.598147:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933191552 00000100:00100000:1.0:1786109411.598159:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933191552 00000100:00100000:1.0:1786109411.598214:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933191424 00000100:00100000:1.0:1786109411.598218:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933191424 00000100:00100000:1.0:1786109411.598244:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933192064 00000100:00100000:1.0:1786109411.598247:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933192064 00000100:00100000:1.0:1786109411.598266:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933191936 00000100:00100000:1.0:1786109411.598269:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933191936 00000100:00100000:1.0:1786109411.598292:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6850 00000100:00100000:1.0:1786109411.598302:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933191552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109411.598375:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933191552:12345-0@lo:400:kworker.0 Request processed in 74us (6564us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109411.598382:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6850 00000100:00100000:1.0:1786109411.598399:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6851 00000100:00100000:1.0:1786109411.598406:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933191424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109411.598452:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933191424:12345-0@lo:400:kworker.0 Request processed in 46us (6584us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109411.598458:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6851 00000100:00100000:1.0:1786109411.598469:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6852 00000100:00100000:1.0:1786109411.598475:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933192064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109411.598505:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933192064:12345-0@lo:400:kworker.0 Request processed in 30us (6597us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109411.598511:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6852 00000100:00100000:1.0:1786109411.598523:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6853 00000100:00100000:1.0:1786109411.598529:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933191936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109411.598565:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933191936:12345-0@lo:400:kworker.0 Request processed in 36us (5716us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109411.598570:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6853 00000100:00100000:1.0:1786109411.598593:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933190656 00000100:00100000:1.0:1786109411.598597:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933190656 00000100:00100000:1.0:1786109411.598622:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1786109411.598629:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab92ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933190656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109411.598661:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab92ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933190656:12345-0@lo:400:kworker.0 Request processed in 33us (7169us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109411.598667:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1786109411.598722:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933191936:0@lo:400:kworker.0 00000100:00100000:2.0:1786109411.598893:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933191168 00000100:00100000:2.0:1786109411.598898:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933191168 00000100:00100000:2.0:1786109411.598927:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933191040 00000100:00100000:2.0:1786109411.598931:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933191040 00000100:00100000:2.0:1786109411.598942:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1786109411.598949:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933190912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109411.599183:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933190912:12345-0@lo:400:kworker.0 Request processed in 233us (6490us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109411.599191:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1786109411.599205:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1786109411.599212:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933191168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109411.599243:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933191168:12345-0@lo:400:kworker.0 Request processed in 32us (6441us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109411.599250:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1786109411.599262:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1786109411.599266:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933190784:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1786109411.599290:0:187900:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8268 last 0 00000020:00000080:2.0:1786109411.599322:0:187900:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdb52b77d7ca364bd 00000004:00100000:2.0:1786109411.599337:0:187900:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786109411.599364:0:187900:0:(import.c:65:import_set_state_nolock()) ffff930ab7cee000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109411.599400:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872862933190784:12345-0@lo:38:kworker.0 Request processed in 132us (7439us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109411.599407:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1786109411.599420:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1786109411.599424:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933191040:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1786109411.599458:0:187900:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8268 last 0 00000020:00000080:2.0:1786109411.599480:0:187900:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdb52b77d7ca364c4 00000004:00100000:2.0:1786109411.599486:0:187900:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786109411.599503:0:187900:0:(import.c:65:import_set_state_nolock()) ffff930ab7ced800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109411.599532:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872862933191040:12345-0@lo:38:kworker.0 Request processed in 106us (5956us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109411.599539:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00080000:2.0:1786109411.599571:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109411.599575:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109411.599577:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109411.600758:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933191168:0@lo:400:kworker.0 00000100:00100000:1.0:1786109411.600787:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933190912:0@lo:400:kworker.0 00010000:00080000:1.0:1786109411.605516:0:190351:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1786109411.605525:0:190351:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 326417514630 00000020:00080000:1.0:1786109411.605531:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109411.605534:0:190351:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 326417514630 00000020:00080000:1.0:1786109411.605538:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109411.605540:0:190351:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 326417514630 00000100:00100000:0.0:1786109411.605683:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933191424:0@lo:400:kworker.0 00000100:00100000:0.0:1786109411.605698:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933192064:0@lo:400:kworker.0 00000100:00100000:0.0:1786109411.605708:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933190656:0@lo:400:kworker.0 00000100:00100000:0.0:1786109411.605718:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933191552:0@lo:400:kworker.0 00000100:00100000:0.0:1786109411.605752:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933192192:0@lo:38:kworker.0 00000100:00100000:0.0:1786109411.605820:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109411.605844:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933191680 00000100:00100000:0.0:1786109411.605849:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933191680 00000100:00100000:0.0:1786109411.605875:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933192192 00000100:00100000:0.0:1786109411.605877:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933192192 00000100:00100000:0.0:1786109411.605890:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1786109411.605896:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933191680:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109411.605923:0:189813:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8268 last 0 00000020:00000080:0.0:1786109411.605955:0:189813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdb52b77d7ca364cb 00000004:00100000:0.0:1786109411.605968:0:189813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109411.606656:0:189813:0:(import.c:65:import_set_state_nolock()) ffff930ab9963000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109411.606709:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872862933191680:12345-0@lo:38:kworker.0 Request processed in 811us (12007us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109411.606717:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1786109411.606736:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1786109411.606740:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933192192:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109411.606754:0:189813:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8268 last 0 00000020:00000080:0.0:1786109411.606775:0:189813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdb52b77d7ca364d2 00000004:00100000:0.0:1786109411.606956:0:189813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109411.606974:0:189813:0:(import.c:65:import_set_state_nolock()) ffff930ab9960000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109411.607576:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872862933192192:12345-0@lo:38:kworker.0 Request processed in 832us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109411.607583:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00010000:00080000:0.0:1786109411.607642:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a893c0700 x1872862933192192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109411.607658:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 77 00000100:00080000:0.0:1786109411.607666:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1786109411.607670:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786109411.607672:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab2828000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786109411.607678:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933192192:0@lo:38:kworker.0 00010000:00080000:0.0:1786109411.607707:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93098ba4d180 x1872862933190784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109411.607717:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 77 00000100:00080000:0.0:1786109411.616345:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff93098ba4d180 x1872862933190784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109431 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109411.616359:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109411.616367:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109411.616371:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109411.616377:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933190784:0@lo:38:kworker.0 00010000:00080000:0.0:1786109411.616416:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93098ba4fb80 x1872862933191040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109411.616794:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 77 00000100:00080000:0.0:1786109411.622708:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff93098ba4fb80 x1872862933191040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109431 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109411.622724:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109411.622729:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109411.622733:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109411.622739:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933191040:0@lo:38:kworker.0 00000100:00080000:0.0:1786109411.622789:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 77 00000100:00080000:0.0:1786109411.622800:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1786109411.622804:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1786109411.622807:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 326417514497 gen 2 00000100:00080000:0.0:1786109411.622811:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a89101800 from lustre-MDT0000_UUID committed 326417514497 last 0 00000100:00080000:0.0:1786109411.622813:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1786109411.623962:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933191296:0@lo:38:kworker.0 00010000:00080000:1.0:1786109411.624320:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a893c2300 x1872862933191680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109411.624338:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 77 00000100:00080000:1.0:1786109411.625276:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff930a893c2300 x1872862933191680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109431 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109411.625288:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1786109411.625292:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1786109411.625296:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1786109411.625301:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933191680:0@lo:38:kworker.0 00010000:00080000:0.0:1786109411.626942:0:190658:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1786109411.626948:0:190658:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1786109411.626955:0:190658:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1786109411.628905:0:190658:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1786109411.629581:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97faa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933192320:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1786109411.629665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109411.629717:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933192320 00000100:00100000:2.0:1786109411.629725:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933192320 00000100:00100000:2.0:1786109411.629774:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12264 00000100:00100000:2.0:1786109411.629795:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933192320:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1786109411.629820:0:177399:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ac0cedf80 x1872862933192320/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:637/0 lens 224/0 e 0 to 0 dl 1786109422 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109411.629838:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933192320:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 46us (174us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109411.629844:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12264 00000020:00080000:2.0:1786109411.629865:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109411.629870:0:190351:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 326417514630 00000100:00100000:1.0:1786109412.102687:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933192448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109412.102765:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109412.102848:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933192448 00000100:00100000:1.0:1786109412.102857:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933192448 00000100:00100000:1.0:1786109412.102908:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5737 00000100:00100000:1.0:1786109412.102918:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933192448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109412.102951:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109412.103458:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933192448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 539us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109412.103466:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5737 00000100:00100000:1.0:1786109412.103557:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933192448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109412.103587:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933192576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109412.103624:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109412.103663:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933192576 00000100:00100000:1.0:1786109412.103668:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933192576 00000100:00100000:1.0:1786109412.103695:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5738 00000100:00100000:1.0:1786109412.103703:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933192576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109412.103721:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109412.103758:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933192576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109412.103766:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5738 00000100:00100000:0.0:1786109412.106689:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933192576:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1786109412.112233:0:184688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1786109412.120764:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1786109412.121663:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804567 is committed 00000100:00100000:1.0:1786109412.369842:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109412.369889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109412.369925:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922075008 00000100:00100000:1.0:1786109412.369933:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922075008 00000100:00100000:3.0:1786109412.370080:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922074880 00000100:00100000:3.0:1786109412.370084:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922074880 00000100:00100000:3.0:1786109412.370115:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:3.0:1786109412.370123:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab92ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922074880:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109412.370191:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab92ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922074880:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 68us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109412.370199:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:1.0:1786109412.379585:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:1.0:1786109412.379624:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922075008:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109412.379717:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922075008:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 115us (9826us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109412.379725:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00080000:1.0:1786109412.379764:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109412.451120:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109412.451194:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922075136 00000100:00100000:3.0:1786109412.451203:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922075136 00000100:00100000:3.0:1786109412.451265:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6854 00000100:00100000:3.0:1786109412.451275:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922075136:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109412.451342:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922075136:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 69us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109412.451349:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6854 00000100:00080000:1.0:1786109412.451545:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786109412.550560:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1786109412.605324:0:190704:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1786109412.605712:0:190704:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1786109413.574684:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109414.597956:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109415.621102:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109416.197474:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933192704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109416.197545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109416.198010:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933192704 00000100:00100000:0.0:1786109416.198019:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933192704 00000100:00100000:0.0:1786109416.198153:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12265 00000100:00100000:0.0:1786109416.198163:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933192704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1786109416.198200:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:0.0:1786109416.198332:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933192704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109416.198339:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12265 00000100:00100000:2.0:1786109416.198855:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804567 gen 2 00000004:00080000:2.0:1786109416.198938:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804565 committed transno 25769804567 00000004:00080000:2.0:1786109416.199034:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804566 committed transno 25769804567 00000004:00080000:2.0:1786109416.199045:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769804567 committed transno 25769804567 00000100:00100000:2.0:1786109416.199064:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933192704:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786109416.648863:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109416.708668:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933192832:0@lo:400:kworker.0 00000100:00100000:2.0:1786109416.708920:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933192960:0@lo:400:kworker.0 00000100:00080000:0.0:1786109416.709001:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109416.709006:0:171804:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1786109416.709116:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109416.709183:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933193344:0@lo:400:kworker.0 00000100:00100000:1.0:1786109416.709212:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109416.709231:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933193856:0@lo:400:kworker.0 00000100:00100000:2.0:1786109416.709331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109416.709355:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933193472:0@lo:400:kworker.0 00000100:00100000:2.0:1786109416.709373:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109416.709388:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933193984:0@lo:400:kworker.0 00000100:00100000:2.0:1786109416.709401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109416.709455:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933193344 00000100:00100000:2.0:1786109416.709464:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933193344 00000100:00100000:2.0:1786109416.709512:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933192960 00000100:00100000:2.0:1786109416.709514:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933192960 00000100:00100000:2.0:1786109416.709533:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1786109416.709543:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933193344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109416.709588:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933193344:12345-0@lo:400:kworker.0 Request processed in 47us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109416.709594:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1786109416.709610:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1786109416.709616:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933192960:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1786109416.709627:0:187900:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930ac0cec380 x1872862933192960/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:642/0 lens 224/0 e 0 to 0 dl 1786109427 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109416.709663:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933192960:12345-0@lo:400:kworker.0 Request processed in 47us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109416.709669:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1786109416.709705:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a97fa8380 x1872862933192960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109416.709732:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933192960:0@lo:400:kworker.0 00000100:00100000:2.0:1786109416.709768:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933193216:0@lo:400:kworker.0 00000100:00100000:0.0:1786109416.709809:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933192832 00000100:00100000:0.0:1786109416.709813:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933192832 00000100:00100000:0.0:1786109416.709843:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1786109416.709849:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933192832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109416.709880:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933192832:12345-0@lo:400:kworker.0 Request processed in 31us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109416.709885:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1786109416.709924:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933193472 00000100:00100000:0.0:1786109416.709927:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933193472 00000100:00100000:0.0:1786109416.709945:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933193984 00000100:00100000:0.0:1786109416.709947:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933193984 00000100:00100000:0.0:1786109416.709960:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6855 00000100:00100000:0.0:1786109416.709965:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933193472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109416.709994:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933193472:12345-0@lo:400:kworker.0 Request processed in 29us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109416.709999:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6855 00000100:00100000:0.0:1786109416.710007:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6856 00000100:00100000:0.0:1786109416.710012:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933193984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109416.710030:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933193984:12345-0@lo:400:kworker.0 Request processed in 18us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109416.710035:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6856 00000100:00100000:0.0:1786109416.710053:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933193472:0@lo:400:kworker.0 00000100:00100000:0.0:1786109416.710061:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933193984:0@lo:400:kworker.0 00000100:00080000:0.0:1786109416.710080:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109416.710083:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109416.710144:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109416.710180:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933192832:0@lo:400:kworker.0 00000100:00100000:1.0:1786109416.710199:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933193344:0@lo:400:kworker.0 00000100:00100000:3.0:1786109416.710354:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933193088:0@lo:400:kworker.0 00000100:00100000:3.0:1786109416.710381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109416.710395:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933193600:0@lo:400:kworker.0 00000100:00100000:3.0:1786109416.710411:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109416.710424:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933194112:0@lo:400:kworker.0 00000100:00100000:3.0:1786109416.710462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109416.710495:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933193600 00000100:00100000:3.0:1786109416.710499:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933193600 00000100:00100000:3.0:1786109416.710531:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933194112 00000100:00100000:3.0:1786109416.710535:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933194112 00000100:00100000:3.0:1786109416.710556:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6857 00000100:00100000:3.0:1786109416.710563:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933193600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109416.710607:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933193600:12345-0@lo:400:kworker.0 Request processed in 44us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109416.710612:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6857 00000100:00100000:3.0:1786109416.710625:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6858 00000100:00100000:3.0:1786109416.710632:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933194112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109416.710657:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933194112:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109416.710662:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6858 00000100:00080000:3.0:1786109416.710685:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109416.710701:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933193600:0@lo:400:kworker.0 00000100:00100000:3.0:1786109416.710710:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933194112:0@lo:400:kworker.0 00000100:00100000:1.0:1786109416.710780:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933193088 00000100:00100000:1.0:1786109416.710784:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933193088 00000100:00100000:1.0:1786109416.710825:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1786109416.710832:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933193088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109416.710871:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933193088:12345-0@lo:400:kworker.0 Request processed in 40us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109416.710876:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1786109416.710905:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933193088:0@lo:400:kworker.0 00000100:00100000:0.0:1786109416.710970:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933193856 00000100:00100000:0.0:1786109416.710974:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933193856 00000100:00100000:0.0:1786109416.711008:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12266 00000100:00100000:0.0:1786109416.711015:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933193856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109416.711053:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933193856:12345-0@lo:400:kworker.0 Request processed in 39us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109416.711059:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12266 00000100:00100000:1.0:1786109416.711128:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933193856:0@lo:400:kworker.0 00000100:00100000:2.0:1786109416.711205:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109416.711236:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933193728:0@lo:400:kworker.0 00000100:00100000:2.0:1786109416.711274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109416.711298:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933194240:0@lo:400:kworker.0 00000100:00100000:2.0:1786109416.711320:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109416.711350:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933193216 00000100:00100000:2.0:1786109416.711354:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933193216 00000100:00100000:2.0:1786109416.711376:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933193728 00000100:00100000:2.0:1786109416.711379:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933193728 00000100:00100000:2.0:1786109416.711390:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933194240 00000100:00100000:2.0:1786109416.711393:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933194240 00000100:00100000:2.0:1786109416.711405:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1786109416.711411:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933193216:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1786109416.711422:0:188678:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930ac0ced500 x1872862933193216/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:642/0 lens 224/0 e 0 to 0 dl 1786109427 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109416.711480:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933193216:12345-0@lo:400:kworker.0 Request processed in 69us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109416.711486:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1786109416.711499:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786109416.711504:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933193728:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1786109416.711511:0:188678:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930ac0cee300 x1872862933193728/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:642/0 lens 224/0 e 0 to 0 dl 1786109427 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109416.711536:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933193728:12345-0@lo:400:kworker.0 Request processed in 33us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109416.711541:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786109416.711550:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786109416.711555:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933194240:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1786109416.711561:0:188678:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930a97fab480 x1872862933194240/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:642/0 lens 224/0 e 0 to 0 dl 1786109427 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109416.711583:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933194240:12345-0@lo:400:kworker.0 Request processed in 28us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109416.711588:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1786109416.711611:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a97fa9500 x1872862933193216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109416.711620:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933193216:0@lo:400:kworker.0 00010000:00080000:2.0:1786109416.711628:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930aa66ea300 x1872862933193728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109416.711635:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933193728:0@lo:400:kworker.0 00010000:00080000:2.0:1786109416.711643:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930aa66ead80 x1872862933194240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109416.711650:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933194240:0@lo:400:kworker.0 00000100:00080000:3.0:1786109416.711950:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109417.220643:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109417.220668:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933194368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109417.220752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109417.220891:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933194368 00000100:00100000:3.0:1786109417.220900:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933194368 00000100:00100000:3.0:1786109417.220950:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5739 00000100:00100000:3.0:1786109417.220961:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933194368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109417.220990:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109417.221048:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933194368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109417.221056:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5739 00000100:00100000:0.0:1786109417.221076:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933194368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109417.235124:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933194496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109417.235195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109417.235502:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933194496 00000100:00100000:2.0:1786109417.235510:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933194496 00000100:00100000:2.0:1786109417.235560:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5740 00000100:00100000:2.0:1786109417.235570:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933194496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109417.235600:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109417.235652:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933194496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109417.235659:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5740 00000100:00100000:0.0:1786109417.236205:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933194496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109417.501001:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109417.501098:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109417.501144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109417.501226:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922075520 00000100:00100000:0.0:1786109417.501236:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922075520 00000100:00100000:0.0:1786109417.501344:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:0.0:1786109417.501355:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922075520:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109417.501460:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922075520:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 106us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109417.501468:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:1.0:1786109417.501653:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922075648 00000100:00100000:1.0:1786109417.501657:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922075648 00000100:00100000:2.0:1786109417.501709:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922075392 00000100:00100000:2.0:1786109417.501714:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922075392 00000100:00100000:2.0:1786109417.501759:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:2.0:1786109417.501767:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2403:x1872862922075392:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109417.501802:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2403:x1872862922075392:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109417.501809:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00080000:3.0:1786109417.502027:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109417.502032:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109417.502205:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6859 00000100:00100000:2.0:1786109417.502214:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922075648:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109417.502259:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922075648:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 47us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109417.502266:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6859 00010000:00010000:3.0:1786109417.668660:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109418.693712:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109419.719071:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109420.741658:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109421.316788:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933194624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109421.316873:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109421.316983:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933194624 00000100:00100000:0.0:1786109421.317021:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933194624 00000100:00100000:0.0:1786109421.317069:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12267 00000100:00100000:0.0:1786109421.317079:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933194624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1786109421.317116:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:0.0:1786109421.317805:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933194624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 725us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109421.317813:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12267 00000100:00100000:1.0:1786109421.317973:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933194624:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786109421.824359:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109421.858244:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109421.858250:0:171804:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1786109421.858464:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933194752:0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.858535:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109421.858586:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933195264:0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.858654:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109421.858703:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933195136:0@lo:400:kworker.0 00000100:00100000:1.0:1786109421.858747:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933194752 00000100:00100000:1.0:1786109421.858755:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933194752 00000100:00100000:1.0:1786109421.858803:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786109421.858812:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933194752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109421.858862:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933194752:12345-0@lo:400:kworker.0 Request processed in 51us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109421.858869:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786109421.858914:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933195008:0@lo:400:kworker.0 00000100:00100000:0.0:1786109421.859003:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933194880:0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.859117:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933195776:0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.859144:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109421.859182:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933194752:0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.859209:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933195776 00000100:00100000:3.0:1786109421.859213:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933195776 00000100:00100000:3.0:1786109421.859241:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12268 00000100:00100000:3.0:1786109421.859248:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933195776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.859287:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933195776:12345-0@lo:400:kworker.0 Request processed in 40us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109421.859294:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12268 00000100:00100000:3.0:1786109421.859315:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109421.859730:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109421.859758:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933195264 00000100:00100000:2.0:1786109421.859763:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933195264 00000100:00100000:2.0:1786109421.859800:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933195008 00000100:00100000:2.0:1786109421.859803:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933195008 00000100:00100000:2.0:1786109421.859825:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1786109421.859832:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933195264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109421.859870:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933195264:12345-0@lo:400:kworker.0 Request processed in 39us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109421.859877:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1786109421.859890:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1786109421.859896:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933195008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109421.859923:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933195008:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109421.859930:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1786109421.859967:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933195264:0@lo:400:kworker.0 00000100:00100000:2.0:1786109421.859977:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933195776:0@lo:400:kworker.0 00000100:00080000:2.0:1786109421.860003:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109421.860093:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933195008:0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.860101:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933195520:0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.860127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109421.860157:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933196032:0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.860178:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109421.860257:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933195520 00000100:00100000:2.0:1786109421.860262:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933195520 00000100:00100000:2.0:1786109421.860297:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933196032 00000100:00100000:2.0:1786109421.860300:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933196032 00000100:00100000:2.0:1786109421.860321:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6860 00000100:00100000:2.0:1786109421.860328:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933195520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109421.860364:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933195520:12345-0@lo:400:kworker.0 Request processed in 36us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109421.860370:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6860 00000100:00100000:2.0:1786109421.860382:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6861 00000100:00100000:2.0:1786109421.860388:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933196032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109421.860416:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933196032:12345-0@lo:400:kworker.0 Request processed in 28us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109421.860422:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6861 00000100:00080000:3.0:1786109421.860525:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109421.860543:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933195520:0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.860553:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933196032:0@lo:400:kworker.0 00000100:00100000:2.0:1786109421.860728:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933194880 00000100:00100000:2.0:1786109421.860732:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933194880 00000100:00100000:2.0:1786109421.860765:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1786109421.860773:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933194880:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1786109421.860786:0:187901:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930aa66e9c00 x1872862933194880/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:647/0 lens 224/0 e 0 to 0 dl 1786109432 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109421.860915:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109421.860984:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933195648:0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.861011:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109421.861079:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933195392:0@lo:400:kworker.0 00000100:00100000:0.0:1786109421.861105:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109421.861123:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933195904:0@lo:400:kworker.0 00000100:00100000:0.0:1786109421.861145:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109421.861174:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933195392 00000100:00100000:0.0:1786109421.861178:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933195392 00000100:00100000:0.0:1786109421.861205:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933195904 00000100:00100000:0.0:1786109421.861208:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933195904 00000100:00100000:0.0:1786109421.861228:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6862 00000100:00100000:0.0:1786109421.861235:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933195392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109421.861270:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933195392:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109421.861275:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6862 00000100:00100000:0.0:1786109421.861287:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6863 00000100:00100000:0.0:1786109421.861292:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933195904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109421.861318:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933195904:12345-0@lo:400:kworker.0 Request processed in 26us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109421.861323:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6863 00000100:00080000:0.0:1786109421.861340:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109421.861355:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933195392:0@lo:400:kworker.0 00000100:00100000:0.0:1786109421.861363:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933195904:0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.861484:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933196160:0@lo:400:kworker.0 00000100:00100000:3.0:1786109421.861513:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109421.861646:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933195136 00000100:00100000:1.0:1786109421.861652:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933195136 00000100:00100000:1.0:1786109421.861677:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933195648 00000100:00100000:1.0:1786109421.861680:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933195648 00000100:00100000:1.0:1786109421.861695:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1786109421.861701:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933195136:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1786109421.861724:0:188678:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930a97fa9500 x1872862933195136/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:647/0 lens 224/0 e 0 to 0 dl 1786109432 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109421.861762:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933195136:12345-0@lo:400:kworker.0 Request processed in 60us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109421.861768:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1786109421.861781:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1786109421.861787:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933195648:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1786109421.861795:0:188678:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930ab7c57800 x1872862933195648/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:647/0 lens 224/0 e 0 to 0 dl 1786109432 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109421.861824:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933195648:12345-0@lo:400:kworker.0 Request processed in 37us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109421.861829:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1786109421.861865:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933194880:12345-0@lo:400:kworker.0 Request processed in 1093us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109421.861870:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1786109421.861896:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a97fab100 x1872862933194880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109421.861906:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933194880:0@lo:400:kworker.0 00010000:00080000:2.0:1786109421.862168:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac0fdc380 x1872862933195136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109421.862177:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933195136:0@lo:400:kworker.0 00010000:00080000:2.0:1786109421.862187:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930984cfd180 x1872862933195648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109421.862194:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933195648:0@lo:400:kworker.0 00000100:00100000:1.0:1786109421.862252:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933196160 00000100:00100000:1.0:1786109421.862257:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933196160 00000100:00100000:1.0:1786109421.862323:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1786109421.862330:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933196160:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1786109421.862339:0:188678:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930ab7c54000 x1872862933196160/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:647/0 lens 224/0 e 0 to 0 dl 1786109432 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109421.862391:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933196160:12345-0@lo:400:kworker.0 Request processed in 62us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109421.862398:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:3.0:1786109421.862465:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930984cfdf80 x1872862933196160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109421.862474:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933196160:0@lo:400:kworker.0 00000100:00100000:0.0:1786109422.413335:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933196288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109422.413422:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109422.413531:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933196288 00000100:00100000:0.0:1786109422.413539:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933196288 00000100:00100000:0.0:1786109422.413584:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5741 00000100:00100000:0.0:1786109422.413592:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933196288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109422.413651:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109422.413696:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933196288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109422.413703:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5741 00000100:00100000:0.0:1786109422.413768:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933196288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109422.413806:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933196416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109422.413835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109422.413912:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933196416 00000100:00100000:1.0:1786109422.413917:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933196416 00000100:00100000:2.0:1786109422.413968:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5742 00000100:00100000:2.0:1786109422.413976:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933196416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109422.413992:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109422.414040:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933196416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109422.414046:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5742 00000100:00100000:1.0:1786109422.414403:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933196416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109422.609133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109422.609248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109422.609345:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109422.609479:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922076032 00000100:00100000:3.0:1786109422.609491:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922076032 00000100:00100000:3.0:1786109422.609572:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6864 00000100:00100000:3.0:1786109422.609585:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922076032:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109422.609684:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922076032:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 101us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109422.609693:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6864 00000100:00080000:0.0:1786109422.610137:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109422.610208:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922075904 00000100:00100000:1.0:1786109422.610214:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922075904 00000100:00080000:0.0:1786109422.610319:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109422.610364:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:1.0:1786109422.610374:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922075904:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109422.610456:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922075904:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 60us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109422.610465:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:2.0:1786109422.610756:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922075776 00000100:00100000:2.0:1786109422.610763:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922075776 00000100:00100000:2.0:1786109422.611664:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:2.0:1786109422.611682:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922075776:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109422.612062:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922075776:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 385us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109422.612070:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:3.0:1786109422.636895:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109422.637006:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922076160 00000100:00100000:2.0:1786109422.637016:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922076160 00000100:00100000:2.0:1786109422.637126:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:2.0:1786109422.637139:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862922076160:12345-192.168.203.38@tcp:38:ptlrpcd_rcv.0 00010000:02000400:2.0:1786109422.637214:0:187899:0:(ldlm_lib.c:976:target_handle_reconnect()) lustre-MDT0000: Client 397d331e-10fc-4558-be87-308c3622e8eb (at 192.168.203.38@tcp) reconnected, waiting for 2 clients in recovery for 0:54 00010000:00080000:2.0:1786109422.646641:0:187899:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp recovering/t322122566376 exp ffff930ab31e9800 cur 8279 last 1786109422 00000004:00100000:2.0:1786109422.646680:0:187899:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.203.38@tcp supports cksum type f7, return f7 00000100:00080000:2.0:1786109422.646720:0:187899:0:(import.c:65:import_set_state_nolock()) ffff93098e512800 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1786109422.646729:0:187899:0:(import.c:65:import_set_state_nolock()) ffff93098e512800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109422.647036:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862922076160:12345-192.168.203.38@tcp:38:ptlrpcd_rcv.0 Request processed in 9898us (10147us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109422.647047:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:1.0:1786109422.650621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109422.650741:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862920179840 00000100:00100000:0.0:1786109422.650770:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862920179840 00000100:00100000:0.0:1786109422.650866:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 905 00000100:00100000:0.0:1786109422.650877:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862920179840:12345-192.168.203.38@tcp:101:lfs.0 00010000:00080000:0.0:1786109422.650894:0:187900:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 326417514630, current: 322122566376, replaying 00010000:00010000:0.0:1786109422.650904:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109422.650931:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca364d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc494ce7 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109422.654757:0:187900:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3775us 00000004:00080000:2.0:1786109422.660800:0:187900:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff93098ba4d180 x1872862920179840/t0(322122566376) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:648/0 lens 520/3488 e 0 to 0 dl 1786109433 ref 1 fl Interpret:/606/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00000400:2.0:1786109422.660818:0:187900:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff93098ba4d180 x1872862920179840/t322122566376(322122566376) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:648/0 lens 520/3488 e 0 to 0 dl 1786109433 ref 1 fl Interpret:/606/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00200000:3.0:1786109422.685639:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00080000:3.0:1786109422.685676:0:187900:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20001a9e3:0x191b:0x0], cookie = 0xdb52b77d7c9f9555 00000004:00080000:3.0:1786109422.685679:0:187900:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xdb52b77d7c9f9555 in new mfd 00010000:00010000:3.0:1786109422.686090:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca364d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.686112:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a829eeb00) 00010000:00010000:3.0:1786109422.686116:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786109422.686122:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca364d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.686149:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3c00, rc 0) 00000100:00100000:3.0:1786109422.686769:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862920179840:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 35888us (36151us total) trans 322122566376 rc 301/301 00000100:00100000:3.0:1786109422.686784:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 905 00000100:00100000:0.0:1786109422.690201:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109422.690271:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922065408 00000100:00100000:1.0:1786109422.690280:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922065408 00000100:00100000:1.0:1786109422.690346:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 906 00000100:00100000:1.0:1786109422.690358:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862922065408:12345-192.168.203.38@tcp:101:multiop.0 00010000:00080000:1.0:1786109422.690381:0:187901:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 326417514630, current: 326417514628, replaying 00010000:00010000:1.0:1786109422.690392:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109422.690418:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca364e7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1491 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109422.691109:0:187901:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20001a9e3:0x1de0:0x0], cookie = 0xdb52b77d7ca36208 00000004:00080000:1.0:1786109422.691114:0:187901:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xdb52b77d7ca36208 in new mfd 00010000:00010000:1.0:1786109422.691227:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca364e7 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1491 expref: 8 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.691243:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa65d7800) 00010000:00010000:1.0:1786109422.691246:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109422.691251:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca364e7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1491 expref: 8 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.691268:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0acfe00, rc 0) 00000100:00100000:1.0:1786109422.691322:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:2401:x1872862922065408:12345-192.168.203.38@tcp:101:multiop.0 Request processed in 967us (1130us total) trans 326417514628 rc 301/301 00000100:00100000:1.0:1786109422.691330:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 906 00000100:00100000:2.0:1786109422.694729:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109422.696900:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922067328 00000100:00100000:1.0:1786109422.696916:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922067328 00000100:00100000:1.0:1786109422.696992:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 907 00000100:00100000:1.0:1786109422.697003:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+7:2401:x1872862922067328:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00080000:1.0:1786109422.697025:0:187899:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 326417514630, current: 326417514630, replaying 00000100:00100000:1.0:1786109422.697035:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+7:2401:x1872862922067328:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 35us (2336us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109422.697042:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 907 00000020:00080000:2.0:1786109422.697126:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109422.697130:0:190351:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 326417514630, next_transno: 326417514630 00010000:00080000:2.0:1786109422.697134:0:190351:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (326417514630) 00000020:00080000:2.0:1786109422.697136:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109422.697145:0:190351:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922067328 t326417514630 from 192.168.203.38@tcp req@ffff930984cfd180 x1872862922067328/t0(326417514630) o36->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:648/0 lens 528/0 e 0 to 0 dl 1786109433 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1786109422.697311:0:190351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca364f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697326:0:190351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca364f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697341:0:190351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca364f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697354:0:190351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca364fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697361:0:190351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca364fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697367:0:190351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca364fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697779:0:190351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca364f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697787:0:190351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca364f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697793:0:190351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca364f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697799:0:190351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109422.697803:0:190351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca364f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697810:0:190351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca364f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697821:0:190351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0ddde00) 00010000:00010000:2.0:1786109422.697824:0:190351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109422.697828:0:190351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca364f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697834:0:190351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca364f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109422.697852:0:190351:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac70b28f reply state 000000006045ecea transno 326417514630 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca364fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697862:0:190351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca364fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.697867:0:190351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930aa0dddb00) 00010000:00010000:2.0:1786109422.697870:0:190351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109422.697872:0:190351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1786109422.697971:0:190351:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1786109422.697987:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109422.697990:0:190351:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 326417514631 00000020:00080000:2.0:1786109422.697994:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109422.697995:0:190351:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 326417514631 00000100:00100000:2.0:1786109422.701037:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109422.701136:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922067840 00000100:00100000:3.0:1786109422.701150:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922067840 00000100:00100000:3.0:1786109422.701318:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 908 00000100:00100000:3.0:1786109422.701331:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+9:2401:x1872862922067840:12345-192.168.203.38@tcp:36:rm.0 00010000:00080000:3.0:1786109422.701357:0:187900:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 326417514631, current: 326417514631, replaying 00000100:00100000:3.0:1786109422.701388:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+9:2401:x1872862922067840:12345-192.168.203.38@tcp:36:rm.0 Request processed in 60us (365us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109422.701396:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 908 00000020:00080000:1.0:1786109422.701586:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109422.701593:0:190351:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 326417514631, next_transno: 326417514631 00010000:00080000:1.0:1786109422.701597:0:190351:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (326417514631) 00000020:00080000:1.0:1786109422.701602:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109422.701614:0:190351:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922067840 t326417514631 from 192.168.203.38@tcp req@ffff930984cfc380 x1872862922067840/t0(326417514631) o36->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:648/0 lens 512/0 e 0 to 0 dl 1786109433 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1786109422.701749:0:190351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36503 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.701769:0:190351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36503 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.701787:0:190351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36503 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.701801:0:190351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca3650a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.701810:0:190351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca3650a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.701817:0:190351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca3650a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.701961:0:190351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36511 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.701975:0:190351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36511 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.701983:0:190351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36511 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702290:0:190351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36511 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702300:0:190351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36511 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702307:0:190351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36511 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702315:0:190351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0ace800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109422.702320:0:190351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36511 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702329:0:190351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36511 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702344:0:190351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de1:0x0].0x0 (ffff930aa65d7900) 00010000:00010000:1.0:1786109422.702347:0:190351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109422.702352:0:190351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36511 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702359:0:190351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace800/0xdb52b77d7ca36511 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1de1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702384:0:190351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36503 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702391:0:190351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36503 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702397:0:190351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36503 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702404:0:190351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acfe00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109422.702407:0:190351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36503 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702413:0:190351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36503 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702543:0:190351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa65d7800) 00010000:00010000:1.0:1786109422.702546:0:190351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109422.702550:0:190351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36503 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702556:0:190351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acfe00/0xdb52b77d7ca36503 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109422.702570:0:190351:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e8d1402 reply state 00000000f12f22fb transno 326417514631 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca3650a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702581:0:190351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca3650a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.702588:0:190351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930aa0dddb00) 00010000:00010000:1.0:1786109422.702590:0:190351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109422.702593:0:190351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1786109422.702908:0:190351:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1786109422.702935:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109422.702939:0:190351:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 326417514632 00000020:00080000:1.0:1786109422.702942:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109422.702945:0:190351:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 326417514632 00000100:00100000:0.0:1786109422.708093:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109422.708162:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922076288 00000100:00100000:1.0:1786109422.708186:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922076288 00000100:00100000:1.0:1786109422.708277:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 909 00000100:00100000:1.0:1786109422.708291:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+11:2401:x1872862922076288:12345-192.168.203.38@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1786109422.708320:0:187901:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff930aa66e8000 x1872862922076288/t0(0) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:648/0 lens 328/0 e 0 to 0 dl 1786109433 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109422.708354:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+11:2401:x1872862922076288:12345-192.168.203.38@tcp:101:ldlm_lock_repla.0 Request processed in 67us (276us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109422.708362:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 909 00000020:00080000:3.0:1786109422.708683:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109422.708688:0:190351:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 326417514632 00010000:00080000:3.0:1786109422.708693:0:190351:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1786109422.708696:0:190351:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109422.708715:0:190351:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1786109422.708718:0:190351:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1786109422.708726:0:190351:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.203.38@tcp: req@ffff930aa66e8000 x1872862922076288/t0(0) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:648/0 lens 328/0 e 0 to 0 dl 1786109433 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1786109422.708952:0:190351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109422.709000:0:190351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca36518 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc494ce7 expref: -99 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.710277:0:190351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca36518 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 12 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.710305:0:190351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca36518 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 12 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.710322:0:190351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6c600, rc 0) 00010000:00080000:3.0:1786109422.710689:0:190351:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1786109422.710716:0:190351:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1786109422.710882:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109422.711244:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922076416 00000100:00100000:3.0:1786109422.711254:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922076416 00000100:00100000:3.0:1786109422.711344:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 910 00000100:00100000:3.0:1786109422.711355:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+12:2401:x1872862922076416:12345-192.168.203.38@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1786109422.711379:0:189813:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff930aa66eb800 x1872862922076416/t0(0) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:648/0 lens 328/0 e 0 to 0 dl 1786109433 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109422.711409:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+12:2401:x1872862922076416:12345-192.168.203.38@tcp:101:ldlm_lock_repla.0 Request processed in 57us (529us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109422.711417:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 910 00010000:00080000:1.0:1786109422.711603:0:190351:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1786109422.711612:0:190351:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.203.38@tcp: req@ffff930aa66eb800 x1872862922076416/t0(0) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:648/0 lens 328/0 e 0 to 0 dl 1786109433 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1786109422.711633:0:190351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109422.711661:0:190351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca3651f lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc494c69 expref: -99 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.711683:0:190351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca3651f lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494c69 expref: 13 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.711697:0:190351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca3651f lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494c69 expref: 13 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.711717:0:190351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0ace400, rc 0) 00010000:00080000:1.0:1786109422.711770:0:190351:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1786109422.711780:0:190351:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1786109422.717877:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109422.719384:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922076544 00000100:00100000:3.0:1786109422.719422:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922076544 00000100:00100000:1.0:1786109422.720817:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:1.0:1786109422.720835:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+13:2401:x1872862922076544:12345-192.168.203.38@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1786109422.720868:0:187901:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930aa66eb100 x1872862922076544/t0(0) o400->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:648/0 lens 224/0 e 0 to 0 dl 1786109433 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109422.720903:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+13:2401:x1872862922076544:12345-192.168.203.38@tcp:400:ptlrpcd_rcv.0 Request processed in 72us (3041us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109422.720911:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 99 00010000:00080000:3.0:1786109422.721292:0:190351:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1786109422.721716:0:190351:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 77, last_transno is 330712481792 00000001:00100000:2.0:1786109422.724238:0:190317:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 397d331e-10fc-4558-be87-308c3622e8eb 00000001:00100000:2.0:1786109422.724250:0:190317:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1786109422.724336:0:190317:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 326417514631 is committed 00000001:00080000:3.0:1786109422.724455:0:190351:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1786109422.724498:0:190351:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1786109422.724545:0:190351:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff930ac0cedf80 x1872862933192320/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:649/0 lens 224/0 e 1 to 0 dl 1786109434 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1786109422.724721:0:190351:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.203.38@tcp: req@ffff930aa66eb100 x1872862922076544/t0(0) o400->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:648/0 lens 224/0 e 0 to 0 dl 1786109433 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1786109422.724789:0:190351:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:16, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:1.0:1786109422.726536:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca364fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726551:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca364fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726559:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca364fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726565:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109422.726570:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca364fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726578:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca364fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726595:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930aa0dddb00) 00010000:00010000:1.0:1786109422.726598:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109422.726603:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca364fc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726609:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca364fc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726628:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca3650a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726635:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca3650a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726640:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca3650a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726645:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109422.726647:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca3650a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726653:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca3650a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726660:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930aa0dddb00) 00010000:00010000:1.0:1786109422.726662:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109422.726665:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca3650a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.726670:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0acf600/0xdb52b77d7ca3650a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786109422.726784:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1786109422.726794:0:3645:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff930a97faa680 x1872862933192320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1786109439 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109422.726805:0:3645:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff930a97faa680 x1872862933192320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1786109439 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109422.726811:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1786109422.726865:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1786109422.726871:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e4f1cd99): req@ffff93098d89b480 x1872862933168128/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109390 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109422.726899:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97faa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933192320:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1786109422.728900:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109422.729019:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933168128 00000100:00100000:2.0:1786109422.729028:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933168128 00000100:00100000:2.0:1786109422.729103:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12269 00000100:00100000:2.0:1786109422.729128:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933168128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109422.729168:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:2.0:1786109422.729217:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933168128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109422.729223:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12269 00000100:00100000:0.0:1786109422.729379:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933168128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109422.731681:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109422.731696:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933196544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109422.731767:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109422.731826:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933196544 00000100:00100000:1.0:1786109422.731832:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933196544 00000100:00100000:1.0:1786109422.731869:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12270 00000100:00100000:1.0:1786109422.731877:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933196544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109422.731900:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:1.0:1786109422.731950:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933196544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109422.731956:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12270 00000100:00100000:1.0:1786109422.731993:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933196544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109422.732783:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109422.735536:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922075264 00000100:00100000:2.0:1786109422.735552:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922075264 00000100:00100000:2.0:1786109422.735666:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 911 00000100:00100000:2.0:1786109422.735678:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+8:158940:x1872862922075264:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109422.735699:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109422.735735:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca36526 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14de expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.735803:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca3652d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.735816:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca3652d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.735828:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca3652d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109422.735875:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:2.0:1786109422.735879:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109422.735902:0:187899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca3652d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.735939:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca36526 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14de expref: 10 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.735959:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca3652d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14de expref: 9 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.735967:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0f7ec00) 00010000:00010000:2.0:1786109422.735971:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109422.735974:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77c00, rc 0) 00000100:00100000:2.0:1786109422.736047:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+9:158940:x1872862922075264:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 371us (3265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109422.736054:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 911 00000004:00000080:0.0:1786109422.744672:0:190351:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa66f07fb3e10 00100000:10000000:0.0:1786109422.744688:0:190351:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1786109422.745162:0:190719:0:(mdd_orphans.c:363:mdd_orphan_key_test_and_delete()) Found orphan [0x20001a9e3:0x1de0:0x0] count 1, skip it 00000004:00080000:2.0:1786109422.745698:0:190339:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x1862:0x0] 00000100:00100000:2.0:1786109422.745754:0:190339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190339:1872862933196672:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1786109422.745824:0:190339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109422.745865:0:190339:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109422.745915:0:179241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933196672 00000100:00100000:0.0:1786109422.745922:0:179241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933196672 00000100:00100000:0.0:1786109422.746032:0:179241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23065 00000100:00100000:0.0:1786109422.746042:0:179241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:190339:x1872862933196672:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1786109422.746070:0:179241:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6273 -> diff = -31 00002000:02000040:0.0:1786109422.746075:0:179241:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6243 to 0x2c0000401:6273) 00000004:00080000:3.0:1786109422.747597:0:190337:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x1874:0x0] 00000100:00100000:3.0:1786109422.747634:0:190337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c57100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190337:1872862933196800:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1786109422.747684:0:190337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109422.747727:0:190337:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc780 going to sleep for 11 seconds 00000100:00100000:2.0:1786109422.748511:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933196800 00000100:00100000:2.0:1786109422.748519:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933196800 00000100:00100000:2.0:1786109422.748568:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23066 00000100:00100000:2.0:1786109422.748578:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:190337:x1872862933196800:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1786109422.748631:0:8442:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6337 -> diff = -77 00002000:02000040:2.0:1786109422.748636:0:8442:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6261 to 0x280000400:6337) 00002000:00010000:0.0:1786109422.753404:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1881:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109422.753419:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36534 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.753668:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1881:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:0.0:1786109422.753672:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1881:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109422.753679:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.753695:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.753717:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.753725:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.753754:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1786109422.753865:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1880:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109422.753871:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca3653b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.753884:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1880:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:0.0:1786109422.753888:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1880:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109422.753892:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca3653b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.753900:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca3653b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.753908:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca3653b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.753915:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca3653b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.754004:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1786109422.755941:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x187f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.755952:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ef6558/0xdb52b77d7ca36542 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.755967:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187f:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.755971:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.755976:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ef6558/0xdb52b77d7ca36542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.755988:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1ef6558/0xdb52b77d7ca36542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.755997:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ef6558/0xdb52b77d7ca36542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.756004:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ef6558/0xdb52b77d7ca36542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756067:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109422.756075:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756083:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.756088:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756098:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36534 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756115:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36534 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756122:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36534 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1881:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756143:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109422.756147:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca3653b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756154:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.756157:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca3653b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756165:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca3653b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756174:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca3653b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756181:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca3653b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1880:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756192:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109422.756195:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1ef6558/0xdb52b77d7ca36542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756201:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.756204:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ef6558/0xdb52b77d7ca36542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756212:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ef6558/0xdb52b77d7ca36542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756221:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1ef6558/0xdb52b77d7ca36542 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.756229:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.756231:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.756233:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.757883:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109422.759061:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786109422.759075:0:179241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1ef6558/0xdb52b77d7ca36542 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786109422.759222:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x187e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.759230:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042cd9cb6/0xdb52b77d7ca36549 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.759242:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187e:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.759247:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.759253:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042cd9cb6/0xdb52b77d7ca36549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.759267:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042cd9cb6/0xdb52b77d7ca36549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.759276:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042cd9cb6/0xdb52b77d7ca36549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.759284:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042cd9cb6/0xdb52b77d7ca36549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.760534:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109422.760546:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042cd9cb6/0xdb52b77d7ca36549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.760558:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acfe00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.760562:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042cd9cb6/0xdb52b77d7ca36549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.760572:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042cd9cb6/0xdb52b77d7ca36549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.760591:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042cd9cb6/0xdb52b77d7ca36549 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.760603:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.760604:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.760606:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109422.761129:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.761137:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca36550 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761148:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c1:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.761152:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.761156:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca36550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761169:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca36550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761178:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca36550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761186:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca36550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761215:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109422.761308:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.761313:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca36557 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761321:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c0:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.761325:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.761328:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca36557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761338:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca36557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761346:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca36557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761354:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca36557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761425:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786109422.761501:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.761507:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca3655e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761515:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18bf:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.761518:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.761522:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca3655e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761531:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca3655e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761539:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca3655e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761551:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca3655e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761567:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1786109422.761605:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.761610:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36565 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761618:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18be:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.761621:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.761625:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761634:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761641:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761649:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.761660:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1786109422.761696:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.761701:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca3656c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761812:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786109422.761818:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca36550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761826:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.761830:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca36550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761839:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca36550 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761858:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca36550 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761866:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca36550 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761889:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109422.761892:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca36557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761899:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.761902:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca36557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761910:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca36557 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761920:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca36557 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761939:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca36557 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761952:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109422.761955:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca3655e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761962:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.761965:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca3655e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761972:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca3655e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761982:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca3655e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.761989:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca3655e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762001:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109422.762004:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762011:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.762014:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762021:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762031:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36565 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762039:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36565 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762050:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.762052:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.762054:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.762061:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109422.762143:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18bd:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.762146:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.762151:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca3656c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762160:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca3656c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762168:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca3656c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762175:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca3656c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762200:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109422.762241:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.762245:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36573 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762252:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18bc:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.762255:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.762259:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762267:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762274:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762281:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762290:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786109422.762321:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.762325:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000da3ec2a/0xdb52b77d7ca3657a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762332:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18bb:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.762334:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.762338:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000da3ec2a/0xdb52b77d7ca3657a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762346:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000da3ec2a/0xdb52b77d7ca3657a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762353:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000da3ec2a/0xdb52b77d7ca3657a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762360:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000da3ec2a/0xdb52b77d7ca3657a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762374:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1786109422.762410:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.762415:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da7a4217/0xdb52b77d7ca36581 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762423:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ba:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.762426:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.762455:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da7a4217/0xdb52b77d7ca36581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762465:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da7a4217/0xdb52b77d7ca36581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762472:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da7a4217/0xdb52b77d7ca36581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762479:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da7a4217/0xdb52b77d7ca36581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762489:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1786109422.762524:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.762529:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037b04352/0xdb52b77d7ca36588 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762536:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b9:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.762540:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.762544:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037b04352/0xdb52b77d7ca36588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762552:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037b04352/0xdb52b77d7ca36588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762560:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037b04352/0xdb52b77d7ca36588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762567:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037b04352/0xdb52b77d7ca36588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762576:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1786109422.762615:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.762620:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5d59684/0xdb52b77d7ca3658f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762627:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b8:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.762630:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.762634:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d59684/0xdb52b77d7ca3658f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762643:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5d59684/0xdb52b77d7ca3658f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762651:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5d59684/0xdb52b77d7ca3658f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762658:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d59684/0xdb52b77d7ca3658f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.762666:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1786109422.762700:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109422.762754:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786109422.762759:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca3656c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762767:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.762770:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca3656c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762778:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca3656c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762790:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca3656c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762797:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca3656c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762813:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786109422.762817:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762823:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.762826:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762834:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36573 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762843:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36573 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762850:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36573 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762862:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786109422.762866:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000da3ec2a/0xdb52b77d7ca3657a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762873:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.762876:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000da3ec2a/0xdb52b77d7ca3657a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762883:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000da3ec2a/0xdb52b77d7ca3657a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762898:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000da3ec2a/0xdb52b77d7ca3657a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762905:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000da3ec2a/0xdb52b77d7ca3657a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.762918:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109422.762922:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da7a4217/0xdb52b77d7ca36581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763003:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036762813/0xdb52b77d7ca36596 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763012:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b7:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.763015:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.763019:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036762813/0xdb52b77d7ca36596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763029:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036762813/0xdb52b77d7ca36596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763037:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036762813/0xdb52b77d7ca36596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763044:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036762813/0xdb52b77d7ca36596 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763054:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1786109422.763090:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.763095:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca3659d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763103:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b6:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.763105:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.763109:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca3659d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763117:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca3659d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763125:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca3659d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763132:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca3659d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763140:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1786109422.763170:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.763174:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca365a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763181:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b5:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.763184:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.763189:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca365a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763197:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca365a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763205:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca365a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763213:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca365a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763221:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1786109422.763256:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.763261:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca365ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763269:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b4:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.763272:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.763276:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca365ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763285:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca365ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763293:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca365ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763300:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca365ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763314:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1786109422.763348:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.763354:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca365b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763362:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b3:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.763365:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.763369:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca365b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763378:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca365b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763385:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca365b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763392:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca365b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763401:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1786109422.763456:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.763462:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca365b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763470:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b2:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.763473:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.763477:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca365b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763485:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca365b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763493:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca365b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763500:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca365b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763508:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1786109422.763543:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.763548:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca365c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763555:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b1:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.763558:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.763562:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca365c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763571:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca365c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763578:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca365c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763585:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca365c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763594:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1786109422.763629:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.763634:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca365c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763642:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b0:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.763645:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.763650:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca365c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763658:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca365c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763665:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca365c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763672:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca365c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.763680:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:3.0:1786109422.763751:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.763755:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da7a4217/0xdb52b77d7ca36581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763763:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da7a4217/0xdb52b77d7ca36581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763776:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da7a4217/0xdb52b77d7ca36581 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763783:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da7a4217/0xdb52b77d7ca36581 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763801:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1786109422.763805:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037b04352/0xdb52b77d7ca36588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763812:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80031000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.763815:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037b04352/0xdb52b77d7ca36588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763823:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037b04352/0xdb52b77d7ca36588 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763832:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037b04352/0xdb52b77d7ca36588 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763839:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037b04352/0xdb52b77d7ca36588 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763853:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1786109422.763857:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5d59684/0xdb52b77d7ca3658f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763864:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.763867:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5d59684/0xdb52b77d7ca3658f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763874:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5d59684/0xdb52b77d7ca3658f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763883:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5d59684/0xdb52b77d7ca3658f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763891:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5d59684/0xdb52b77d7ca3658f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763904:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1786109422.763908:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036762813/0xdb52b77d7ca36596 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763915:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a80030e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.763918:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036762813/0xdb52b77d7ca36596 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.763997:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036762813/0xdb52b77d7ca36596 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764011:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036762813/0xdb52b77d7ca36596 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764019:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036762813/0xdb52b77d7ca36596 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764033:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1786109422.764037:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca3659d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764043:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.764047:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca3659d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764054:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca3659d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764064:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca3659d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764070:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca3659d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764081:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786109422.764084:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca365a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764090:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ae00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.764093:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca365a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764099:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca365a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764109:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca365a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764115:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca365a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764125:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786109422.764128:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca365ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764135:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.764138:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca365ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764145:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca365ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764154:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca365ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764161:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca365ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764172:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786109422.764175:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca365b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764181:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628aa00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.764184:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca365b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764196:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca365b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764206:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca365b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764212:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca365b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764224:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109422.764227:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca365b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764233:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.764236:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca365b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764244:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca365b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764253:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca365b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764261:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca365b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764276:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109422.764280:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca365c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764286:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.764289:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca365c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764296:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca365c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764305:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca365c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764313:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca365c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764324:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109422.764327:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca365c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764334:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628be00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.764337:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca365c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764349:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca365c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764359:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca365c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764366:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca365c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.764377:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.764379:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.764381:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.764393:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.764477:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.764485:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109422.764597:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786109422.764606:0:179241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042cd9cb6/0xdb52b77d7ca36549 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786109422.764723:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x187d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.764729:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b72d49c9/0xdb52b77d7ca365ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.764742:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187d:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.764745:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.764750:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b72d49c9/0xdb52b77d7ca365ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.764760:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b72d49c9/0xdb52b77d7ca365ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.764768:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b72d49c9/0xdb52b77d7ca365ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.764775:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b72d49c9/0xdb52b77d7ca365ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.764801:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109422.764840:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x187c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.764845:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000216f0118/0xdb52b77d7ca365d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.764853:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187c:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.764856:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.764861:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000216f0118/0xdb52b77d7ca365d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.764870:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000216f0118/0xdb52b77d7ca365d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.764878:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000216f0118/0xdb52b77d7ca365d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.764885:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000216f0118/0xdb52b77d7ca365d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.764895:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1786109422.765004:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109422.765009:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b72d49c9/0xdb52b77d7ca365ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.765016:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0ace800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.765020:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b72d49c9/0xdb52b77d7ca365ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.765028:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b72d49c9/0xdb52b77d7ca365ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.765039:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b72d49c9/0xdb52b77d7ca365ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.765047:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b72d49c9/0xdb52b77d7ca365ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.765060:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109422.765062:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000216f0118/0xdb52b77d7ca365d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.765068:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acee00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.765070:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000216f0118/0xdb52b77d7ca365d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.765078:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000216f0118/0xdb52b77d7ca365d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.765087:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000216f0118/0xdb52b77d7ca365d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.765094:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000216f0118/0xdb52b77d7ca365d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.765104:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.765105:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.765107:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.765141:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.765145:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109422.765167:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x187b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.765173:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e29835d6/0xdb52b77d7ca365dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765181:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187b:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.765184:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.765188:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e29835d6/0xdb52b77d7ca365dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765197:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e29835d6/0xdb52b77d7ca365dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765205:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e29835d6/0xdb52b77d7ca365dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765212:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e29835d6/0xdb52b77d7ca365dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765264:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109422.765305:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x187a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.765309:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcc613d0/0xdb52b77d7ca365e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765317:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187a:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.765319:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x187a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.765323:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc613d0/0xdb52b77d7ca365e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765330:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcc613d0/0xdb52b77d7ca365e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765337:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcc613d0/0xdb52b77d7ca365e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765344:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc613d0/0xdb52b77d7ca365e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786109422.765399:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.765405:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca365ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.765414:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18af:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.765417:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.765421:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca365ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.765456:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca365ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.765466:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca365ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.765473:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca365ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765545:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786109422.765551:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e29835d6/0xdb52b77d7ca365dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765558:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acfa00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.765562:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e29835d6/0xdb52b77d7ca365dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765569:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e29835d6/0xdb52b77d7ca365dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765581:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e29835d6/0xdb52b77d7ca365dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765588:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e29835d6/0xdb52b77d7ca365dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765602:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109422.765605:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcc613d0/0xdb52b77d7ca365e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765611:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.765614:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc613d0/0xdb52b77d7ca365e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765622:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc613d0/0xdb52b77d7ca365e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765630:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcc613d0/0xdb52b77d7ca365e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765637:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109422.765641:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca365ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765647:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.765650:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca365ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765657:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca365ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765666:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca365ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.765673:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.765675:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.765676:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109422.765814:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786109422.765820:0:179241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcc613d0/0xdb52b77d7ca365e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786109422.765897:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1879:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.765903:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007374af43/0xdb52b77d7ca365f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765910:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1879:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.765913:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1879:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.765917:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007374af43/0xdb52b77d7ca365f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765940:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007374af43/0xdb52b77d7ca365f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765949:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007374af43/0xdb52b77d7ca365f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765957:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007374af43/0xdb52b77d7ca365f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.765980:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109422.766019:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1878:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.766024:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000361d1241/0xdb52b77d7ca365f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766032:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1878:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.766034:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1878:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.766039:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000361d1241/0xdb52b77d7ca365f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766048:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000361d1241/0xdb52b77d7ca365f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766056:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000361d1241/0xdb52b77d7ca365f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766064:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000361d1241/0xdb52b77d7ca365f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766075:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1786109422.766111:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1877:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.766116:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b07753b/0xdb52b77d7ca365ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766123:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1877:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.766126:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1877:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.766130:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b07753b/0xdb52b77d7ca365ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766139:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b07753b/0xdb52b77d7ca365ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766147:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b07753b/0xdb52b77d7ca365ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766153:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b07753b/0xdb52b77d7ca365ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766169:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1786109422.766204:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1876:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.766209:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca36606 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766217:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1876:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.766219:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1876:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.766223:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca36606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766232:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca36606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766239:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca36606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766247:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca36606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766255:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1786109422.766290:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1875:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.766294:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec766999/0xdb52b77d7ca3660d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766302:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1875:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.766306:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1875:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.766310:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec766999/0xdb52b77d7ca3660d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766319:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec766999/0xdb52b77d7ca3660d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766326:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec766999/0xdb52b77d7ca3660d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766333:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec766999/0xdb52b77d7ca3660d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766341:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1786109422.766375:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1874:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.766380:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef32df23/0xdb52b77d7ca36614 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766387:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1874:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.766390:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1874:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.766394:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef32df23/0xdb52b77d7ca36614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766403:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef32df23/0xdb52b77d7ca36614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766411:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef32df23/0xdb52b77d7ca36614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766419:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef32df23/0xdb52b77d7ca36614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766426:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1786109422.766509:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1873:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.766514:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4f2a028/0xdb52b77d7ca3661b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766522:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1873:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.766524:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1873:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.766528:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4f2a028/0xdb52b77d7ca3661b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766537:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4f2a028/0xdb52b77d7ca3661b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766544:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4f2a028/0xdb52b77d7ca3661b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766551:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4f2a028/0xdb52b77d7ca3661b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766559:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1786109422.766589:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1872:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.766593:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a431d5e0/0xdb52b77d7ca36622 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766600:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1872:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.766603:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1872:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.766607:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a431d5e0/0xdb52b77d7ca36622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766615:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a431d5e0/0xdb52b77d7ca36622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766622:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a431d5e0/0xdb52b77d7ca36622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766629:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a431d5e0/0xdb52b77d7ca36622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766637:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1786109422.766667:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1871:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.766671:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca36629 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766678:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1871:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.766680:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1871:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.766684:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca36629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766692:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca36629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.766700:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca36629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766841:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1786109422.766847:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007374af43/0xdb52b77d7ca365f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766855:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.766858:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007374af43/0xdb52b77d7ca365f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766866:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007374af43/0xdb52b77d7ca365f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766879:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007374af43/0xdb52b77d7ca365f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766887:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007374af43/0xdb52b77d7ca365f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1879:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766902:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1786109422.766905:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000361d1241/0xdb52b77d7ca365f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766911:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.766914:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000361d1241/0xdb52b77d7ca365f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766921:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000361d1241/0xdb52b77d7ca365f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766943:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000361d1241/0xdb52b77d7ca365f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766950:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000361d1241/0xdb52b77d7ca365f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1878:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766961:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1786109422.766965:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b07753b/0xdb52b77d7ca365ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766970:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.766973:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b07753b/0xdb52b77d7ca365ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766980:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b07753b/0xdb52b77d7ca365ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766989:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b07753b/0xdb52b77d7ca365ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.766996:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b07753b/0xdb52b77d7ca365ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1877:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767006:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1786109422.767009:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca36606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767015:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.767018:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca36606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767024:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca36606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767032:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca36606 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767038:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca36606 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1876:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767047:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1786109422.767051:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec766999/0xdb52b77d7ca3660d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767056:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.767059:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec766999/0xdb52b77d7ca3660d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767065:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec766999/0xdb52b77d7ca3660d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767073:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec766999/0xdb52b77d7ca3660d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767078:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec766999/0xdb52b77d7ca3660d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1875:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767088:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786109422.767091:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef32df23/0xdb52b77d7ca36614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767097:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.767100:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef32df23/0xdb52b77d7ca36614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767111:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef32df23/0xdb52b77d7ca36614 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767119:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef32df23/0xdb52b77d7ca36614 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767125:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef32df23/0xdb52b77d7ca36614 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1874:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767135:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109422.767138:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4f2a028/0xdb52b77d7ca3661b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767143:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.767146:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4f2a028/0xdb52b77d7ca3661b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767152:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4f2a028/0xdb52b77d7ca3661b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767160:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4f2a028/0xdb52b77d7ca3661b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767167:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4f2a028/0xdb52b77d7ca3661b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1873:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767182:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109422.767185:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a431d5e0/0xdb52b77d7ca36622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767190:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.767193:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a431d5e0/0xdb52b77d7ca36622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767200:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a431d5e0/0xdb52b77d7ca36622 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767210:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a431d5e0/0xdb52b77d7ca36622 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767217:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a431d5e0/0xdb52b77d7ca36622 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1872:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767228:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.767230:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.767232:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.767238:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.767242:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109422.767319:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca36629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767344:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109422.767393:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1870:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.767398:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca36630 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767406:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1870:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.767409:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1870:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.767413:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca36630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767422:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca36630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767453:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca36630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767461:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca36630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767480:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1786109422.767517:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x186f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.767522:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7797cbb/0xdb52b77d7ca36637 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767530:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186f:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.767533:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.767538:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7797cbb/0xdb52b77d7ca36637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767547:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7797cbb/0xdb52b77d7ca36637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767556:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7797cbb/0xdb52b77d7ca36637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767564:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7797cbb/0xdb52b77d7ca36637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767575:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1786109422.767608:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x186e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.767613:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000137ea14/0xdb52b77d7ca3663e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767621:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186e:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.767624:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.767629:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000137ea14/0xdb52b77d7ca3663e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767638:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000137ea14/0xdb52b77d7ca3663e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767645:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000137ea14/0xdb52b77d7ca3663e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767652:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000137ea14/0xdb52b77d7ca3663e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.767659:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1786109422.767692:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x186d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.767697:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea339343/0xdb52b77d7ca36645 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767749:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1786109422.767754:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca36629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767767:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.767770:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca36629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767778:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca36629 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767790:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca36629 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767797:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca36629 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1871:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767812:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786109422.767815:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca36630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767822:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.767825:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca36630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767832:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca36630 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767841:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca36630 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767849:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca36630 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1870:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767859:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109422.767862:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7797cbb/0xdb52b77d7ca36637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767869:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.767872:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7797cbb/0xdb52b77d7ca36637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767879:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7797cbb/0xdb52b77d7ca36637 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767888:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7797cbb/0xdb52b77d7ca36637 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767895:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7797cbb/0xdb52b77d7ca36637 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767906:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109422.767909:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000137ea14/0xdb52b77d7ca3663e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767916:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.767919:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000137ea14/0xdb52b77d7ca3663e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767941:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000137ea14/0xdb52b77d7ca3663e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767951:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000137ea14/0xdb52b77d7ca3663e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767959:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000137ea14/0xdb52b77d7ca3663e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.767970:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.767972:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.767973:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.767980:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.767983:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109422.768062:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186d:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.768065:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.768070:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea339343/0xdb52b77d7ca36645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.768080:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea339343/0xdb52b77d7ca36645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.768088:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea339343/0xdb52b77d7ca36645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.768096:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea339343/0xdb52b77d7ca36645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.768186:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109422.768232:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x186c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.768237:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3664c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.768245:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186c:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.768248:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.768252:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3664c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.768260:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3664c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.768267:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3664c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.768273:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3664c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768349:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1786109422.768357:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca365ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786109422.768427:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.768445:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36653 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768453:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ae:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.768456:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.768460:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36653 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768470:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36653 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768478:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36653 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768485:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36653 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768498:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1786109422.768528:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.768532:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca3665a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768539:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ad:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.768542:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.768546:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca3665a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768554:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca3665a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768561:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca3665a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768573:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca3665a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768581:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1786109422.768609:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.768613:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36661 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768621:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ac:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.768623:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.768628:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768636:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768643:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768650:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36661 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768657:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1786109422.768689:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.768694:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36668 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768717:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ab:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.768721:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.768725:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36668 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768733:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36668 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768741:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36668 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768748:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36668 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768757:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1786109422.768793:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.768798:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca3666f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768805:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18aa:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.768808:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.768812:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca3666f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768820:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca3666f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768828:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca3666f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768835:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca3666f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768843:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1786109422.768877:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.768882:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36676 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768889:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a9:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.768892:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.768895:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768904:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768913:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36676 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768921:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.768950:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1786109422.768987:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.768992:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca3667d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.769000:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a8:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.769003:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.769007:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca3667d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.769017:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca3667d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.769025:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca3667d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.769031:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca3667d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.769039:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1786109422.769076:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.769082:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36684 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.769091:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a7:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.769094:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.769099:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.769108:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.769115:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.769123:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.769131:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1786109422.770789:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.770824:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3668b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.770837:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a6:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.770841:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.770846:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3668b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.770857:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3668b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.770865:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3668b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.770873:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3668b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.770883:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1786109422.770993:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.770998:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000223bbbb9/0xdb52b77d7ca36692 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771005:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a5:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.771008:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.771012:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000223bbbb9/0xdb52b77d7ca36692 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771020:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000223bbbb9/0xdb52b77d7ca36692 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771027:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000223bbbb9/0xdb52b77d7ca36692 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771034:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000223bbbb9/0xdb52b77d7ca36692 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771042:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1786109422.771082:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.771088:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca36699 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771097:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a4:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.771100:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.771105:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca36699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771114:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca36699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771122:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca36699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771131:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca36699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771140:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1786109422.771174:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.771179:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca366a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771186:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a3:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.771189:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.771193:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca366a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771201:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca366a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771208:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca366a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771215:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca366a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771224:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1786109422.771258:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109422.771263:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca366a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771271:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a2:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:2.0:1786109422.771274:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109422.771278:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca366a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771287:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca366a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771295:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca366a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771303:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca366a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109422.771318:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00080000:2.0:1786109422.771667:0:8442:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:6260 00010000:00010000:1.0:1786109422.771752:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:1.0:1786109422.771818:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x186b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.771823:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94311a3/0xdb52b77d7ca366ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.771833:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186b:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.771836:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.771840:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e94311a3/0xdb52b77d7ca366ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.771850:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e94311a3/0xdb52b77d7ca366ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.771857:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94311a3/0xdb52b77d7ca366ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.771865:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e94311a3/0xdb52b77d7ca366ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.771874:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:1.0:1786109422.771909:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x186a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.771914:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c129c006/0xdb52b77d7ca366b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.771922:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186a:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.771937:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x186a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.771942:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c129c006/0xdb52b77d7ca366b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.771951:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c129c006/0xdb52b77d7ca366b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.771958:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c129c006/0xdb52b77d7ca366b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.771965:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c129c006/0xdb52b77d7ca366b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.771973:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:1.0:1786109422.772040:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1869:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.772046:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca366bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772053:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1869:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.772056:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1869:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.772061:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca366bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772070:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca366bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772078:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca366bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772084:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca366bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772097:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:1.0:1786109422.772134:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1868:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.772139:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca366c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772147:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1868:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.772149:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1868:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.772153:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca366c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772162:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca366c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772168:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca366c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772175:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca366c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772183:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:1.0:1786109422.772216:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1867:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.772221:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000faa6f11/0xdb52b77d7ca366ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772229:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1867:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.772232:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1867:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.772236:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000faa6f11/0xdb52b77d7ca366ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772245:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000faa6f11/0xdb52b77d7ca366ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772252:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000faa6f11/0xdb52b77d7ca366ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772260:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000faa6f11/0xdb52b77d7ca366ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772268:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:1.0:1786109422.772305:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1866:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.772310:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc88583f/0xdb52b77d7ca366d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772318:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1866:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.772321:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1866:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.772324:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc88583f/0xdb52b77d7ca366d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772332:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc88583f/0xdb52b77d7ca366d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772340:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc88583f/0xdb52b77d7ca366d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772348:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc88583f/0xdb52b77d7ca366d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772356:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:1.0:1786109422.772389:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1865:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.772394:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096748c38/0xdb52b77d7ca366d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772400:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1865:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.772403:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1865:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.772407:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096748c38/0xdb52b77d7ca366d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772415:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096748c38/0xdb52b77d7ca366d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772422:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096748c38/0xdb52b77d7ca366d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772447:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096748c38/0xdb52b77d7ca366d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772457:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:1.0:1786109422.772491:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1864:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.772496:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000625308e2/0xdb52b77d7ca366df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772504:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1864:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.772507:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1864:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.772511:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000625308e2/0xdb52b77d7ca366df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772519:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000625308e2/0xdb52b77d7ca366df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772526:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000625308e2/0xdb52b77d7ca366df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772532:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000625308e2/0xdb52b77d7ca366df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772540:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:1.0:1786109422.772574:0:179241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1863:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109422.772579:0:179241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c355375/0xdb52b77d7ca366e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772586:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1863:0x0].0x0 since=8279s v=(0 0) 00010000:00010000:1.0:1786109422.772589:0:179241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1863:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109422.772593:0:179241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c355375/0xdb52b77d7ca366e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772602:0:179241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c355375/0xdb52b77d7ca366e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772610:0:179241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c355375/0xdb52b77d7ca366e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772618:0:179241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c355375/0xdb52b77d7ca366e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109422.772626:0:179241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00080000:1.0:1786109422.772647:0:179241:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6242 00010000:00010000:3.0:1786109422.772836:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:3.0:1786109422.772844:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea339343/0xdb52b77d7ca36645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.772853:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.772858:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea339343/0xdb52b77d7ca36645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.772868:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea339343/0xdb52b77d7ca36645 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.772884:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea339343/0xdb52b77d7ca36645 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.772892:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea339343/0xdb52b77d7ca36645 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.772917:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:3.0:1786109422.773005:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3664c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773014:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773017:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3664c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773025:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3664c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773036:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3664c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773044:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3664c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773057:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:3.0:1786109422.773062:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36653 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773068:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773071:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36653 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773078:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36653 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773088:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36653 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773095:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36653 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773112:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:3.0:1786109422.773115:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca3665a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773122:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773126:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca3665a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773132:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca3665a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773141:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca3665a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773148:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca3665a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773160:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:3.0:1786109422.773163:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36661 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773170:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ba00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773173:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36661 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773181:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36661 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773190:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36661 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773197:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36661 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773210:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:3.0:1786109422.773213:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36668 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773219:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773222:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36668 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773229:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36668 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773238:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36668 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773245:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36668 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773257:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:3.0:1786109422.773260:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca3666f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773265:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628bc00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773268:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca3666f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773279:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca3666f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773287:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca3666f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773293:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca3666f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773302:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:3.0:1786109422.773305:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773310:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773313:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773319:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773327:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36676 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773333:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36676 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773347:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:3.0:1786109422.773351:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca3667d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773358:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ac00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773361:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca3667d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773368:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca3667d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773376:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca3667d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773382:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca3667d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773392:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1786109422.773396:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773402:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773405:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773416:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36684 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773425:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36684 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773450:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36684 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773463:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1786109422.773467:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3668b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773473:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773476:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3668b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773483:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3668b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773493:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3668b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773500:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3668b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773518:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1786109422.773521:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000223bbbb9/0xdb52b77d7ca36692 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773527:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773530:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000223bbbb9/0xdb52b77d7ca36692 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773537:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000223bbbb9/0xdb52b77d7ca36692 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773547:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000223bbbb9/0xdb52b77d7ca36692 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773554:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000223bbbb9/0xdb52b77d7ca36692 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773565:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1786109422.773569:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca36699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773575:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773578:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca36699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773590:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca36699 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773599:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca36699 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773606:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca36699 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773617:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1786109422.773621:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca366a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773627:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773630:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca366a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773636:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca366a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773645:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca366a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773651:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca366a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773666:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1786109422.773669:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca366a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773676:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.773679:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca366a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773686:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca366a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773696:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca366a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109422.773772:0:179241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:190339:x1872862933196672:12345-0@lo:5:osp-pre-1-0.0 Request processed in 27727us (27944us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109422.773782:0:179241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23065 00010000:00010000:0.0:1786109422.773865:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1786109422.773872:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e94311a3/0xdb52b77d7ca366ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.773880:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109422.773883:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94311a3/0xdb52b77d7ca366ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.773891:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94311a3/0xdb52b77d7ca366ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.773908:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e94311a3/0xdb52b77d7ca366ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109422.773916:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e94311a3/0xdb52b77d7ca366ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.773996:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca366a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774012:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1786109422.774015:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c129c006/0xdb52b77d7ca366b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774021:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.774025:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c129c006/0xdb52b77d7ca366b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774038:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c129c006/0xdb52b77d7ca366b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774049:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c129c006/0xdb52b77d7ca366b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774056:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c129c006/0xdb52b77d7ca366b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774068:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1786109422.774072:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca366bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774078:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.774081:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca366bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774089:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca366bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774099:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca366bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774106:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca366bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1869:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774122:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786109422.774125:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca366c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774131:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.774134:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca366c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774141:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca366c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774150:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca366c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774158:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca366c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1868:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774170:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786109422.774173:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000faa6f11/0xdb52b77d7ca366ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774179:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.774183:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000faa6f11/0xdb52b77d7ca366ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774195:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000faa6f11/0xdb52b77d7ca366ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774205:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000faa6f11/0xdb52b77d7ca366ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774211:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000faa6f11/0xdb52b77d7ca366ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1867:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774222:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786109422.774225:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc88583f/0xdb52b77d7ca366d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774232:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.774235:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc88583f/0xdb52b77d7ca366d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774242:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc88583f/0xdb52b77d7ca366d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774251:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc88583f/0xdb52b77d7ca366d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774258:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc88583f/0xdb52b77d7ca366d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1866:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774273:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109422.774276:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096748c38/0xdb52b77d7ca366d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774282:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.774285:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096748c38/0xdb52b77d7ca366d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774293:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096748c38/0xdb52b77d7ca366d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774301:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096748c38/0xdb52b77d7ca366d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774308:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096748c38/0xdb52b77d7ca366d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1865:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774319:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109422.774322:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000625308e2/0xdb52b77d7ca366df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774329:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.774331:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000625308e2/0xdb52b77d7ca366df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774344:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000625308e2/0xdb52b77d7ca366df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774353:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000625308e2/0xdb52b77d7ca366df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774360:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000625308e2/0xdb52b77d7ca366df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1864:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774371:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109422.774374:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c355375/0xdb52b77d7ca366e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774380:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109422.774383:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c355375/0xdb52b77d7ca366e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774390:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c355375/0xdb52b77d7ca366e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774399:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c355375/0xdb52b77d7ca366e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774406:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c355375/0xdb52b77d7ca366e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1863:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109422.774422:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.774424:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109422.774425:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.774477:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.774479:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.774481:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.774489:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109422.774494:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109422.774622:0:190339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190339:1872862933196672:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1786109422.774637:0:190339:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x1881:0x0] from OST, last_created [0x2c0000401:0x1881:0x0]last_used is [0x2c0000401:0x1862:0x0] 00000100:00100000:0.0:1786109422.774728:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933196928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109422.774777:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109422.774847:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933196928 00000100:00100000:1.0:1786109422.774853:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933196928 00000100:00100000:1.0:1786109422.774896:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5743 00000100:00100000:1.0:1786109422.774903:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933196928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109422.774924:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579008 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109422.775005:0:190339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190339:1872862933197056:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1786109422.775030:0:190339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109422.775047:0:190339:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109422.775202:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:190337:x1872862933196800:12345-0@lo:5:osp-pre-0-0.0 Request processed in 26625us (27517us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109422.775211:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23066 00000100:00100000:2.0:1786109422.775226:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933197056 00000100:00100000:2.0:1786109422.775229:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933197056 00000100:00100000:2.0:1786109422.775250:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23067 00000100:00100000:2.0:1786109422.775256:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:190339:x1872862933197056:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1786109422.775283:0:8442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6274 00000100:00100000:2.0:1786109422.776900:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:190339:x1872862933197056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1639us (1864us total) trans 4294975819 rc 0/0 00000100:00100000:2.0:1786109422.776909:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23067 00000100:00100000:2.0:1786109422.777029:0:190339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:190339:1872862933197056:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1786109422.777042:0:190339:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1881:0x0]-[0x2c0000401:0x18a1:0x0] 00000100:00100000:3.0:1786109422.777154:0:190337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c57100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190337:1872862933196800:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1786109422.777164:0:190337:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x18c1:0x0] from OST, last_created [0x280000400:0x18c1:0x0]last_used is [0x280000400:0x1874:0x0] 00000100:00100000:3.0:1786109422.777209:0:190337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190337:1872862933197312:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1786109422.777237:0:190337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109422.777269:0:190337:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc780 going to sleep for 11 seconds 00000100:00100000:2.0:1786109422.777320:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933197312 00000100:00100000:2.0:1786109422.777326:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933197312 00000100:00100000:2.0:1786109422.777369:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23068 00000100:00100000:2.0:1786109422.777378:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:190337:x1872862933197312:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1786109422.777406:0:43912:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 6338 00000100:00100000:1.0:1786109422.779060:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933196928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4152us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109422.779071:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5743 00000100:00100000:2.0:1786109422.779278:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:190337:x1872862933197312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1900us (2038us total) trans 34359738458 rc 0/0 00000100:00100000:2.0:1786109422.779285:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23068 00000100:00100000:0.0:1786109422.779379:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933196928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109422.779399:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109422.779407:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933197184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109422.779466:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109422.779507:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933197184 00000100:00100000:0.0:1786109422.779512:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933197184 00000100:00100000:0.0:1786109422.779548:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5744 00000100:00100000:0.0:1786109422.779558:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933197184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109422.779577:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109422.779609:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933197184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109422.779615:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5744 00000100:00100000:0.0:1786109422.779655:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933197184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109422.779875:0:190337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:190337:1872862933197312:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1786109422.779886:0:190337:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x18c1:0x0]-[0x280000400:0x18e1:0x0] 00000100:00100000:0.0:1786109422.782925:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109422.783063:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922076672 00000100:00100000:3.0:1786109422.783073:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922076672 00000100:00100000:3.0:1786109422.783171:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 912 00000100:00100000:3.0:1786109422.783182:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+9:158940:x1872862922076672:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:3.0:1786109422.783214:0:189813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:3.0:1786109422.783285:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+9:158940:x1872862922076672:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 105us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109422.783293:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 912 00000100:00100000:0.0:1786109422.785237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109422.785324:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922076800 00000100:00100000:1.0:1786109422.785333:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922076800 00000100:00100000:1.0:1786109422.785482:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 913 00000100:00100000:1.0:1786109422.785492:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:158940:x1872862922076800:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:1.0:1786109422.785528:0:187901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:1.0:1786109422.785589:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:158940:x1872862922076800:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 98us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109422.785597:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 913 00000100:00100000:1.0:1786109422.789216:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109422.789323:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922076928 00000100:00100000:3.0:1786109422.789331:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922076928 00000100:00100000:3.0:1786109422.789415:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23069 00000100:00100000:3.0:1786109422.789424:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1872862922076928:12345-192.168.203.38@tcp:8:lfs.0 00010000:00080000:3.0:1786109422.789492:0:8443:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp t30064776137 exp 0000000000000000 cur 8279 last 0 00000020:00000080:3.0:1786109422.789523:0:8443:0:(genops.c:1406:class_connect()) connect: client 397d331e-10fc-4558-be87-308c3622e8eb, cookie 0xdb52b77d7ca366ed 00002000:00100000:3.0:1786109422.789533:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 397d331e-10fc-4558-be87-308c3622e8eb/ffff930a89250000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786109422.789544:0:8443:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786109422.789625:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1786109422.789653:0:8443:0:(import.c:65:import_set_state_nolock()) ffff930a89256800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786109422.789736:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862922076928:12345-192.168.203.38@tcp:8:lfs.0 Request processed in 311us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109422.789743:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23069 00000100:00100000:0.0:1786109422.793253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109422.793564:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922077056 00000100:00100000:1.0:1786109422.793587:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922077056 00000100:00080000:0.0:1786109422.793744:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109422.793788:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5745 00000100:00100000:1.0:1786109422.793801:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:158940:x1872862922077056:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109422.793825:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109422.793900:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:158940:x1872862922077056:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 101us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109422.793907:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5745 00000100:00100000:2.0:1786109422.799044:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109422.799173:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922077184 00000100:00100000:0.0:1786109422.799184:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922077184 00000100:00100000:0.0:1786109422.799274:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5746 00000100:00100000:0.0:1786109422.799286:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:158940:x1872862922077184:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:0.0:1786109422.799315:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109422.799394:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:158940:x1872862922077184:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 109us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109422.799402:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5746 00010000:00010000:3.0:1786109422.852614:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109423.878044:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109424.903398:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109425.927758:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109426.438314:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109426.438339:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933197440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109426.438402:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109426.438484:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933197440 00000100:00100000:3.0:1786109426.438490:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933197440 00000100:00100000:3.0:1786109426.438529:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12271 00000100:00100000:3.0:1786109426.438537:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933197440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786109426.438566:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:3.0:1786109426.438605:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933197440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109426.438612:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12271 00000100:00100000:3.0:1786109426.438650:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933197440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109426.977578:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933197568:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.977649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109426.977715:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933198080:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.977743:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109426.977765:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933198592:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.977786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109426.977811:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786109426.977817:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933197952:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.977838:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109426.977855:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933198464:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.977877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109426.978331:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933198976:0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.978361:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109426.978397:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933197696:0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.978420:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109426.978452:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933198208:0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.978475:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109426.978490:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933198720:0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.978509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109426.978525:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1786109426.978531:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933197824:0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.978555:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109426.978567:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933198336:0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.978587:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109426.978604:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933198848:0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.978623:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109426.978685:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933198080 00000100:00100000:0.0:1786109426.978693:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933198080 00000100:00100000:0.0:1786109426.978734:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933198592 00000100:00100000:0.0:1786109426.978737:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933198592 00000100:00100000:0.0:1786109426.978748:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933197952 00000100:00100000:0.0:1786109426.978750:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933197952 00000100:00100000:0.0:1786109426.978760:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933198976 00000100:00100000:0.0:1786109426.978762:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933198976 00000100:00100000:0.0:1786109426.978772:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933197696 00000100:00100000:0.0:1786109426.978774:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933197696 00000100:00100000:0.0:1786109426.978787:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933197824 00000100:00100000:0.0:1786109426.978789:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933197824 00000100:00100000:0.0:1786109426.978803:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1786109426.978811:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933198080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.978858:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933198080:12345-0@lo:400:kworker.0 Request processed in 47us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109426.978865:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1786109426.978881:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1786109426.978888:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933198592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109426.978988:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1786109426.978998:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933197952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109426.979033:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933197952:12345-0@lo:400:kworker.0 Request processed in 39us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109426.979039:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1786109426.979052:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1786109426.979058:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933198976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109426.979089:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933198976:12345-0@lo:400:kworker.0 Request processed in 32us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109426.979095:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1786109426.979107:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786109426.979113:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933197696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109426.979144:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933197696:12345-0@lo:400:kworker.0 Request processed in 31us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109426.979149:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786109426.979175:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1786109426.979181:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933197824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109426.979207:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933197824:12345-0@lo:400:kworker.0 Request processed in 27us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109426.979216:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1786109426.979265:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933198976:0@lo:400:kworker.0 00000100:00100000:2.0:1786109426.979294:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933197824:0@lo:400:kworker.0 00000100:00100000:2.0:1786109426.979304:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933197696:0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.983809:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933198592:12345-0@lo:400:kworker.0 Request processed in 4912us (6012us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109426.983823:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1786109426.983862:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109426.983868:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109426.983897:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933198208 00000100:00100000:0.0:1786109426.983905:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933198208 00000100:00100000:0.0:1786109426.983944:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12272 00000100:00100000:0.0:1786109426.983953:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933198208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.984013:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933198208:12345-0@lo:400:kworker.0 Request processed in 61us (5536us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109426.984019:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12272 00000100:00100000:0.0:1786109426.984078:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933198464 00000100:00100000:0.0:1786109426.984082:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933198464 00000100:00100000:0.0:1786109426.984111:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933198720 00000100:00100000:0.0:1786109426.984115:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933198720 00000100:00100000:0.0:1786109426.984129:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933198336 00000100:00100000:0.0:1786109426.984131:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933198336 00000100:00100000:0.0:1786109426.984145:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933198848 00000100:00100000:0.0:1786109426.984147:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933198848 00000100:00100000:0.0:1786109426.984166:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6865 00000100:00100000:0.0:1786109426.984171:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933198464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.984204:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933198464:12345-0@lo:400:kworker.0 Request processed in 32us (6326us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109426.984210:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6865 00000100:00100000:0.0:1786109426.984223:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6866 00000100:00100000:0.0:1786109426.984229:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933198720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.984254:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933198720:12345-0@lo:400:kworker.0 Request processed in 26us (5744us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109426.984260:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6866 00000100:00100000:0.0:1786109426.984270:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6867 00000100:00100000:0.0:1786109426.984275:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933198336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.984302:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933198336:12345-0@lo:400:kworker.0 Request processed in 27us (5714us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109426.984307:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6867 00000100:00100000:0.0:1786109426.984320:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6868 00000100:00100000:0.0:1786109426.984326:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933198848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.984350:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933198848:12345-0@lo:400:kworker.0 Request processed in 25us (5727us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109426.984356:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6868 00000100:00100000:0.0:1786109426.984389:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933197568 00000100:00100000:0.0:1786109426.984393:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933197568 00000100:00100000:0.0:1786109426.984416:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1786109426.984422:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933197568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109426.984473:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933197568:12345-0@lo:400:kworker.0 Request processed in 50us (6823us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109426.984479:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:0.0:1786109426.984508:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109426.984513:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109426.984515:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109426.985259:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933197952:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.985273:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933198464:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.985282:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933197568:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.985293:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933198080:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.985303:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933198592:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.985657:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933198336:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.985670:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933198848:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.985691:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933198208:0@lo:400:kworker.0 00000100:00100000:3.0:1786109426.985702:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933198720:0@lo:400:kworker.0 00000100:00100000:2.0:1786109427.461338:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109427.461362:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933199104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109427.461450:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109427.461633:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786109427.461643:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933199232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109427.461682:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109427.461712:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933199104 00000100:00100000:0.0:1786109427.461719:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933199104 00000100:00100000:0.0:1786109427.461759:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933199232 00000100:00100000:0.0:1786109427.461762:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933199232 00000100:00100000:0.0:1786109427.461783:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5747 00000100:00100000:0.0:1786109427.461791:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933199104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109427.461821:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109427.461864:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933199104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109427.461870:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5747 00000100:00100000:0.0:1786109427.461909:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5748 00000100:00100000:0.0:1786109427.461916:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933199232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109427.461931:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109427.461962:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933199232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109427.461967:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5748 00000100:00100000:0.0:1786109427.462009:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933199232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109427.462040:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933199104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109427.730230:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109427.730305:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109427.730333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109427.730360:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109427.730384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109427.730408:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922077568 00000100:00100000:0.0:1786109427.730417:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922077568 00000100:00100000:0.0:1786109427.730501:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922077440 00000100:00100000:0.0:1786109427.730504:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922077440 00000100:00100000:0.0:1786109427.730531:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 106 00000100:00100000:0.0:1786109427.730541:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922077568:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109427.730607:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922077568:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 68us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109427.730618:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 106 00000100:00100000:0.0:1786109427.730646:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:0.0:1786109427.730652:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+9:2404:x1872862922077440:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109427.730688:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+9:2404:x1872862922077440:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109427.730694:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00080000:0.0:1786109427.730710:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109427.730714:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109427.732251:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922077824 00000100:00100000:2.0:1786109427.732263:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922077824 00000100:00100000:2.0:1786109427.732329:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922077696 00000100:00100000:2.0:1786109427.732332:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922077696 00000100:00100000:2.0:1786109427.732356:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6869 00000100:00100000:2.0:1786109427.732365:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922077824:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109427.732464:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922077824:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 99us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109427.732472:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6869 00000100:00100000:2.0:1786109427.732488:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6870 00000100:00100000:2.0:1786109427.732495:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922077696:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109427.732520:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922077696:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (2136us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109427.732526:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6870 00000100:00100000:3.0:1786109427.733291:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922077312 00000100:00100000:3.0:1786109427.733299:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922077312 00000100:00100000:3.0:1786109427.733343:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:3.0:1786109427.733351:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922077312:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109427.733392:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922077312:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 42us (3170us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109427.733398:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00080000:0.0:1786109427.733957:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109427.733965:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109427.972656:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109427.972688:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933199360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109427.972753:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109427.972810:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933199616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109427.972843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109427.972990:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97faa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933199488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109427.973025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109427.973056:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933199360 00000100:00100000:0.0:1786109427.973062:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933199360 00000100:00100000:0.0:1786109427.973098:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933199488 00000100:00100000:0.0:1786109427.973100:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933199488 00000100:00100000:0.0:1786109427.973120:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5749 00000100:00100000:0.0:1786109427.973128:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933199360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109427.973148:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109427.973191:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933199360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109427.973198:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5749 00000100:00100000:0.0:1786109427.973227:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5750 00000100:00100000:0.0:1786109427.973235:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933199488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109427.973244:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109427.973275:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933199488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109427.973281:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5750 00000100:00100000:0.0:1786109427.973325:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933199360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109427.973351:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97faa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933199488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109427.974008:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933199616 00000100:00100000:2.0:1786109427.974013:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933199616 00000100:00100000:2.0:1786109427.974048:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12273 00000100:00100000:2.0:1786109427.974055:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933199616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109427.974076:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:2.0:1786109427.974125:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933199616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109427.974131:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12273 00000100:00100000:1.0:1786109427.974282:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933199616:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1786109428.037334:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786109428.494117:0:184688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 397d331e-10fc-4558-be87-308c3622e8eb 00000001:00080000:0.0:1786109428.494134:0:184688:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738458 is committed 00000001:00080000:2.0:1786109428.495002:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975819 is committed 00010000:00010000:2.0:1786109429.061580:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786109430.078589:0:190922:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:0.0:1786109430.096970:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109431.109730:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109431.560233:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933199744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109431.560487:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109431.576843:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933199744 00000100:00100000:0.0:1786109431.576864:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933199744 00000100:00100000:1.0:1786109431.576971:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12274 00000100:00100000:1.0:1786109431.577003:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933199744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109431.583708:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:1.0:1786109431.584020:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933199744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7030us (23527us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109431.584035:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12274 00000100:00100000:2.0:1786109431.584200:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933199744:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1786109431.834662:0:190970:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1786109432.068925:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933199872:0@lo:400:kworker.0 00000100:00100000:2.0:1786109432.069011:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109432.069246:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933200256:0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.069280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109432.069319:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933200128:0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.069343:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109432.069362:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109432.069368:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933200000:0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.069393:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109432.069422:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933200256 00000100:00100000:1.0:1786109432.069461:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933200256 00000100:00100000:1.0:1786109432.069512:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933200128 00000100:00100000:1.0:1786109432.069515:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933200128 00000100:00100000:1.0:1786109432.069541:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933200000 00000100:00100000:1.0:1786109432.069544:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933200000 00000100:00100000:1.0:1786109432.069570:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786109432.069578:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933200256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.069630:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933200256:12345-0@lo:400:kworker.0 Request processed in 52us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109432.069637:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786109432.069664:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1786109432.069671:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933200128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.069703:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933200128:12345-0@lo:400:kworker.0 Request processed in 33us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109432.069709:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1786109432.069718:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1786109432.069724:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933200000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.069749:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933200000:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109432.069755:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1786109432.069778:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109432.069781:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109432.069825:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933200256:0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.069860:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933200000:0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.069869:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933200128:0@lo:400:kworker.0 00000100:00100000:0.0:1786109432.069940:0:190322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933199872 00000100:00100000:0.0:1786109432.069945:0:190322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933199872 00000100:00100000:0.0:1786109432.069988:0:190322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1786109432.069996:0:190322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933199872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.070237:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933200512:0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.070272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109432.070295:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933201024:0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.070317:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109432.070336:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786109432.070341:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933200640:0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.070361:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109432.070379:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933201152:0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.070398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109432.070424:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933200512 00000100:00100000:3.0:1786109432.070427:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933200512 00000100:00100000:3.0:1786109432.070472:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12275 00000100:00100000:3.0:1786109432.070479:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933200512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.070517:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933200512:12345-0@lo:400:kworker.0 Request processed in 39us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109432.070523:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12275 00000100:00100000:3.0:1786109432.070542:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933201024 00000100:00100000:3.0:1786109432.070546:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933201024 00000100:00100000:3.0:1786109432.070574:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933200640 00000100:00100000:3.0:1786109432.070577:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933200640 00000100:00100000:3.0:1786109432.070591:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933201152 00000100:00100000:3.0:1786109432.070593:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933201152 00000100:00100000:3.0:1786109432.070612:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6871 00000100:00100000:3.0:1786109432.070618:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933201024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.070663:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933201024:12345-0@lo:400:kworker.0 Request processed in 46us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109432.070672:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6871 00000100:00100000:3.0:1786109432.070684:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6872 00000100:00100000:3.0:1786109432.070689:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933200640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.070715:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933200640:12345-0@lo:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109432.070721:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6872 00000100:00100000:3.0:1786109432.070731:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6873 00000100:00100000:3.0:1786109432.070737:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933201152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.070761:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933201152:12345-0@lo:400:kworker.0 Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109432.070767:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6873 00000100:00100000:3.0:1786109432.070808:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933200640:0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.070817:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975819 gen 2 00000100:00100000:3.0:1786109432.070828:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933201152:0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.070837:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933200512:0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.070844:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738458 gen 2 00000100:00100000:3.0:1786109432.070853:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933201024:0@lo:400:kworker.0 00000100:00080000:1.0:1786109432.070934:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109432.070938:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109432.070949:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933200768:0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.070979:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109432.071010:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933201280:0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.071037:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109432.071056:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786109432.071061:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933200384:0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.071081:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109432.071098:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933200896:0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.071115:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109432.071138:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933201280 00000100:00100000:1.0:1786109432.071142:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933201280 00000100:00100000:1.0:1786109432.071165:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933200384 00000100:00100000:1.0:1786109432.071168:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933200384 00000100:00100000:1.0:1786109432.071186:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933200896 00000100:00100000:1.0:1786109432.071189:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933200896 00000100:00100000:1.0:1786109432.071201:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1786109432.071206:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933201280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.071241:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933201280:12345-0@lo:400:kworker.0 Request processed in 34us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109432.071247:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1786109432.071261:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1786109432.071268:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933200384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.071295:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933200384:12345-0@lo:400:kworker.0 Request processed in 27us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109432.071300:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1786109432.071311:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1786109432.071317:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933200896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.071343:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933200896:12345-0@lo:400:kworker.0 Request processed in 27us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109432.071349:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1786109432.071369:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109432.071390:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933200384:0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.071398:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933200896:0@lo:400:kworker.0 00000100:00100000:1.0:1786109432.071406:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933201280:0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.071508:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933200768 00000100:00100000:3.0:1786109432.071512:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933200768 00000100:00100000:3.0:1786109432.071553:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6874 00000100:00100000:3.0:1786109432.071559:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933200768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109432.071593:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933200768:12345-0@lo:400:kworker.0 Request processed in 35us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109432.071602:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6874 00000100:00080000:1.0:1786109432.071818:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109432.071838:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933200768:0@lo:400:kworker.0 00000100:00100000:0.0:1786109432.071953:0:190322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933199872:12345-0@lo:400:kworker.0 Request processed in 1954us (2939us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109432.071961:0:190322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1786109432.072075:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933199872:0@lo:400:kworker.0 00010000:00010000:0.0:1786109432.132916:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109432.580953:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933201408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109432.581021:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109432.582080:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933201408 00000100:00100000:0.0:1786109432.582092:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933201408 00000100:00100000:0.0:1786109432.582335:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5751 00000100:00100000:0.0:1786109432.582347:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933201408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109432.582378:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109432.582473:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933201408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109432.582483:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5751 00000100:00100000:3.0:1786109432.582803:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933201408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109432.583026:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109432.583041:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933201536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109432.583083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109432.584356:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933201536 00000100:00100000:1.0:1786109432.584366:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933201536 00000100:00100000:1.0:1786109432.584443:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5752 00000100:00100000:1.0:1786109432.584456:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933201536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109432.584487:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109432.584555:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933201536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109432.584562:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5752 00000100:00100000:1.0:1786109432.584623:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933201536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109432.847248:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109432.847401:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109432.847470:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109432.847558:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922078080 00000100:00100000:1.0:1786109432.847569:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922078080 00000100:00100000:1.0:1786109432.847663:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:1.0:1786109432.847675:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+9:2403:x1872862922078080:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109432.847824:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+9:2403:x1872862922078080:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 150us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109432.847832:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00080000:0.0:1786109432.848002:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109432.848065:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922078336 00000100:00100000:2.0:1786109432.848070:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922078336 00000100:00100000:2.0:1786109432.848125:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6875 00000100:00100000:2.0:1786109432.848134:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922078336:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109432.848170:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922078336:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 38us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109432.848176:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6875 00000100:00080000:0.0:1786109432.848298:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109432.852250:0:190329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922077952 00000100:00100000:3.0:1786109432.852263:0:190329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922077952 00000100:00100000:3.0:1786109432.852327:0:190329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:3.0:1786109432.852337:0:190329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922077952:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109432.852852:0:190329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922077952:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 514us (5611us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109432.852861:0:190329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:1.0:1786109432.852987:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109432.853100:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109432.853173:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922078464 00000100:00100000:0.0:1786109432.853178:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922078464 00000100:00100000:0.0:1786109432.853234:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6876 00000100:00100000:0.0:1786109432.853243:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922078464:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109432.853282:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922078464:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 40us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109432.853288:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6876 00000100:00080000:1.0:1786109432.853427:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109432.853575:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922078208 00000100:00100000:3.0:1786109432.853579:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922078208 00000100:00100000:3.0:1786109432.853684:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:3.0:1786109432.853692:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922078208:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109432.853784:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922078208:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 92us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109432.853790:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00080000:1.0:1786109432.853869:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109433.092753:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109433.092775:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933201664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109433.092840:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109433.093040:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933201664 00000100:00100000:0.0:1786109433.093047:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933201664 00000100:00100000:0.0:1786109433.093100:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12276 00000100:00100000:0.0:1786109433.093109:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933201664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786109433.093141:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:0.0:1786109433.093191:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933201664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109433.093197:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12276 00000100:00100000:3.0:1786109433.093423:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933201792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109433.093565:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109433.093602:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109433.093609:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933201920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109433.093632:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109433.093701:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933201664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109433.093769:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933201792 00000100:00100000:0.0:1786109433.093773:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933201792 00000100:00100000:0.0:1786109433.093810:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933201920 00000100:00100000:0.0:1786109433.093813:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933201920 00000100:00100000:0.0:1786109433.093829:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5753 00000100:00100000:0.0:1786109433.093837:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933201792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109433.093854:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109433.093889:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933201792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109433.093896:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5753 00000100:00100000:0.0:1786109433.093915:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5754 00000100:00100000:0.0:1786109433.093921:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933201920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109433.093932:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109433.093960:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933201920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109433.093965:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5754 00000100:00100000:3.0:1786109433.094045:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933201920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109433.094057:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933201792:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786109433.156690:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109433.915316:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109433.915469:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922078592 00000100:00100000:2.0:1786109433.915480:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922078592 00000100:00100000:2.0:1786109433.915572:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 914 00000100:00100000:2.0:1786109433.915583:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+9:159412:x1872862922078592:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1786109433.915621:0:187899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:2.0:1786109433.915720:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+9:159412:x1872862922078592:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 139us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109433.915727:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 914 00000100:00100000:2.0:1786109433.919599:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109433.919836:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922078720 00000100:00100000:1.0:1786109433.919846:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922078720 00000100:00100000:1.0:1786109433.919948:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 915 00000100:00100000:1.0:1786109433.919959:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:159412:x1872862922078720:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:1.0:1786109433.920000:0:187900:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:1.0:1786109433.920083:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:159412:x1872862922078720:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 126us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109433.920090:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 915 00000100:00100000:3.0:1786109433.923972:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109433.924115:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922078848 00000100:00100000:0.0:1786109433.924125:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922078848 00000100:00100000:0.0:1786109433.924207:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5755 00000100:00100000:0.0:1786109433.924218:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+5:159412:x1872862922078848:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:0.0:1786109433.924246:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109433.924324:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+5:159412:x1872862922078848:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 108us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109433.924332:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5755 00000100:00100000:0.0:1786109433.929640:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109433.929736:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922078976 00000100:00100000:3.0:1786109433.929746:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922078976 00000100:00100000:3.0:1786109433.929864:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5756 00000100:00100000:3.0:1786109433.929876:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:159412:x1872862922078976:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:3.0:1786109433.929905:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109433.929984:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:159412:x1872862922078976:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 110us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109433.929992:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5756 00000100:00100000:2.0:1786109433.970672:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109433.970808:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922079232 00000100:00100000:0.0:1786109433.970818:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922079232 00000100:00100000:0.0:1786109433.970948:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 916 00000100:00100000:0.0:1786109433.970963:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+9:158506:x1872862922079232:12345-192.168.203.38@tcp:36:multiop.0 00010000:00010000:0.0:1786109433.971050:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca366f4 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109433.971071:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca366f4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109433.971085:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca366f4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109433.971296:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008051b0e8 reply state 00000000bb41e89b transno 330712481793 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca366f4 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109433.971309:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca366f4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109433.971315:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de0:0x0].0x0 (ffff930a9a33e700) 00010000:00010000:0.0:1786109433.971318:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1786109433.971321:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109433.971464:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+11:158506:x1872862922079232:12345-192.168.203.38@tcp:36:multiop.0 Request processed in 504us (801us total) trans 330712481793 rc 0/0 00000100:00100000:0.0:1786109433.971471:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 916 00000100:00100000:0.0:1786109433.973954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109433.974091:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922079360 00000100:00100000:2.0:1786109433.974101:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922079360 00000100:00100000:2.0:1786109433.974195:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 917 00000100:00100000:2.0:1786109433.974209:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+11:158506:x1872862922079360:12345-192.168.203.38@tcp:101:multiop.0 00010000:00010000:2.0:1786109433.974248:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109433.974271:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca366fb lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14e5 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109433.974333:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca366fb lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14e5 expref: 12 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109433.974354:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca366fb lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14e5 expref: 12 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109433.974375:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de0:0x0].0x0 (ffff930a9a33e700) 00010000:00010000:2.0:1786109433.974379:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786109433.974382:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360800, rc 0) 00000100:00100000:2.0:1786109433.974487:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+12:158506:x1872862922079360:12345-192.168.203.38@tcp:101:multiop.0 Request processed in 281us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109433.974494:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 917 00000100:00100000:2.0:1786109433.977691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109433.977822:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922079488 00000100:00100000:0.0:1786109433.977831:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922079488 00000100:00100000:0.0:1786109433.977925:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23070 00000100:00100000:0.0:1786109433.977936:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922079488:12345-192.168.203.38@tcp:2:multiop.0 00002000:00010000:0.0:1786109433.978134:0:179253:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1862:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786109433.978138:0:179253:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1862:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1786109433.978140:0:179253:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1862:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786109433.978142:0:179253:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1862:0x0] updating lvb ctime from disk: 0 -> 1786109433 00002000:00010000:0.0:1786109433.978144:0:179253:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1862:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1786109433.978220:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:397d331e-10fc-4558-be87-308c3622e8eb+7:2403:x1872862922079488:12345-192.168.203.38@tcp:2:multiop.0 Request processed in 286us (549us total) trans 4294975820 rc 0/0 00000100:00100000:0.0:1786109433.978227:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23070 00000100:00100000:1.0:1786109433.982079:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109433.982201:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922079616 00000100:00100000:2.0:1786109433.982213:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922079616 00000100:00100000:2.0:1786109433.982308:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 918 00000100:00100000:2.0:1786109433.982318:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+12:158506:x1872862922079616:12345-192.168.203.38@tcp:101:multiop.0 00010000:00010000:2.0:1786109433.982338:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109433.982358:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36702 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14ec expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109433.982477:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca36709 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109433.982490:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca36709 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109433.982502:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca36709 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109433.982555:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109433.982576:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca36709 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109433.982603:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36702 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14ec expref: 14 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109433.982624:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca36709 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14ec expref: 13 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109433.982689:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de0:0x0].0x0 (ffff930a9a33e700) 00010000:00010000:2.0:1786109433.982692:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786109433.982696:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9361000, rc 0) 00000100:00100000:2.0:1786109433.982751:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+13:158506:x1872862922079616:12345-192.168.203.38@tcp:101:multiop.0 Request processed in 435us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109433.982760:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 918 00000100:00100000:1.0:1786109434.018929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109434.019054:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922079872 00000100:00100000:2.0:1786109434.019065:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922079872 00000100:00100000:2.0:1786109434.019162:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1786109434.019173:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:397d331e-10fc-4558-be87-308c3622e8eb+13:158506:x1872862922079872:12345-192.168.203.38@tcp:35:multiop.0 00000004:00080000:2.0:1786109434.019486:0:187902:0:(mdd_object.c:4016:mdd_close()) Object [0x20001a9e3:0x1de0:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1786109434.019551:0:187902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x136:0x0].2, 64 off8320 00000004:00080000:2.0:1786109434.019563:0:187902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8290686131757ns, next at 8291686128281ns, rc = 0 00010000:00010000:2.0:1786109434.019619:0:187902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36710 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109434.019650:0:187902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36710 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010080000000 pid: 187902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109434.019663:0:187902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36710 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 187902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109434.019672:0:187902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36710 lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 187902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109434.019679:0:187902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36710 lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 187902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109434.019686:0:187902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36710 lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 187902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109434.019701:0:187902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786109434.019796:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:397d331e-10fc-4558-be87-308c3622e8eb+14:158506:x1872862922079872:12345-192.168.203.38@tcp:35:multiop.0 Request processed in 624us (875us total) trans 330712481794 rc 0/0 00000100:00100000:2.0:1786109434.019805:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00010000:00010000:0.0:1786109434.020039:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109434.020047:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36710 lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 187902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109434.020055:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109434.020060:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36710 lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 187902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109434.020067:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36710 lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 187902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109434.020081:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de0:0x0].0x0 (ffff930a9a33e700) 00010000:00010000:0.0:1786109434.020084:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109434.020089:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36710 lrc: 1/0,0 mode: --/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 187902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109434.020095:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca36710 lrc: 0/0,0 mode: --/PW res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 187902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109434.020110:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109434.020112:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109434.020114:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786109434.020168:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109434.029790:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109434.029904:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922080000 00000100:00100000:1.0:1786109434.029914:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922080000 00000100:00100000:1.0:1786109434.030014:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 919 00000100:00100000:1.0:1786109434.030026:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+14:158370:x1872862922080000:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1786109434.030051:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109434.030071:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca36717 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14f3 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030183:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca3671e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030197:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca3671e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030208:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca3671e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030222:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36725 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030229:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030250:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030315:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca3671e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030322:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca3671e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030328:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca3671e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030334:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109434.030338:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca3671e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030345:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca3671e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030356:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0f7ec00) 00010000:00010000:1.0:1786109434.030359:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109434.030363:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca3671e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030369:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca3671e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030380:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030386:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36725 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030391:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36725 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030396:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109434.030399:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36725 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030404:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36725 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030410:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19b90c90 (ffff930ab7ed2b00) 00010000:00010000:1.0:1786109434.030413:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109434.030416:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36725 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030422:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36725 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x19b90c90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030535:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca36717 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14f3 expref: 15 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030547:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0f7ec00) 00010000:00010000:1.0:1786109434.030549:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109434.030553:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca36717 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14f3 expref: 15 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109434.030561:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412000, rc 0) 00000100:00100000:1.0:1786109434.030640:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+14:158370:x1872862922080000:12345-192.168.203.38@tcp:101:bash.0 Request processed in 606us (849us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109434.030647:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 919 00010000:00010000:0.0:1786109434.220736:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109435.279156:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109436.292680:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109436.700034:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933202048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109436.700107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109436.700596:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933202048 00000100:00100000:2.0:1786109436.700604:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933202048 00000100:00100000:2.0:1786109436.700679:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12277 00000100:00100000:2.0:1786109436.700690:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933202048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109436.700724:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1786109436.700786:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933202048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109436.700794:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12277 00000100:00100000:0.0:1786109436.700948:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933202048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109437.188842:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933202176:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.188921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109437.188933:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933202304:0@lo:400:kworker.0 00000100:00100000:3.0:1786109437.188969:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109437.188985:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933202688:0@lo:400:kworker.0 00000100:00100000:3.0:1786109437.188994:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933202816:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.189023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109437.189028:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109437.189057:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933203200:0@lo:400:kworker.0 00000100:00100000:3.0:1786109437.189062:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786109437.189070:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933202432:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.189088:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109437.189118:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786109437.189126:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933202560:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.189158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109437.189163:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933202816 00000100:00100000:3.0:1786109437.189172:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933202816 00000100:00100000:1.0:1786109437.189180:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933203072:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.189208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109437.189218:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12278 00000100:00100000:3.0:1786109437.189229:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933202816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.189243:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933202176 00000100:00100000:1.0:1786109437.189248:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933202176 00000100:00100000:1.0:1786109437.189286:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1786109437.189287:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933202816:12345-0@lo:400:kworker.0 Request processed in 59us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109437.189299:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12278 00000100:00100000:1.0:1786109437.189301:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933202176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.189362:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933202176:12345-0@lo:400:kworker.0 Request processed in 67us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109437.189372:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1786109437.189387:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933203456:0@lo:400:kworker.0 00000100:00100000:2.0:1786109437.189416:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109437.189458:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109437.189463:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933203328:0@lo:400:kworker.0 00000100:00100000:2.0:1786109437.189481:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109437.189503:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933202304 00000100:00100000:2.0:1786109437.189506:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933202304 00000100:00100000:2.0:1786109437.189536:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933202688 00000100:00100000:2.0:1786109437.189538:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933202688 00000100:00100000:2.0:1786109437.189548:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933203200 00000100:00100000:0.0:1786109437.189717:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933203584:0@lo:400:kworker.0 00000100:00100000:0.0:1786109437.189750:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109437.189765:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933202560 00000100:00100000:1.0:1786109437.189771:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933202560 00000100:00100000:1.0:1786109437.189794:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933203584 00000100:00100000:1.0:1786109437.189797:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933203584 00000100:00100000:0.0:1786109437.189804:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1786109437.189826:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1786109437.189835:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933202304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.189851:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933202688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109437.189874:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933202304:12345-0@lo:400:kworker.0 Request processed in 61us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109437.189881:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1786109437.189902:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1786109437.189903:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933202688:12345-0@lo:400:kworker.0 Request processed in 66us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109437.189910:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933202560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.189916:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1786109437.189940:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1786109437.189944:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933202560:12345-0@lo:400:kworker.0 Request processed in 34us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109437.189954:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1786109437.189955:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933203584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109437.189974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109437.189995:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933202944:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.190008:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933203584:12345-0@lo:400:kworker.0 Request processed in 58us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109437.190017:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1786109437.190022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109437.190036:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933202432 00000100:00100000:1.0:1786109437.190041:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933202432 00000100:00100000:0.0:1786109437.190056:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933202304:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.190063:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1786109437.190069:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933202816:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.190074:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933202432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109437.190100:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933203072 00000100:00100000:0.0:1786109437.190104:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933203072 00000100:00100000:1.0:1786109437.190127:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933202432:12345-0@lo:400:kworker.0 Request processed in 55us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109437.190132:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933203456 00000100:00100000:1.0:1786109437.190136:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1786109437.190137:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933203456 00000100:00100000:1.0:1786109437.190165:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933203328 00000100:00100000:1.0:1786109437.190170:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933203328 00000100:00100000:0.0:1786109437.190171:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933202944 00000100:00100000:0.0:1786109437.190176:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933202944 00000100:00100000:1.0:1786109437.190206:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6877 00000100:00100000:1.0:1786109437.190215:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933203072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109437.190249:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933202560:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.190256:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933203072:12345-0@lo:400:kworker.0 Request processed in 41us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109437.190263:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6877 00000100:00100000:3.0:1786109437.190267:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933203072:0@lo:400:kworker.0 00000100:00100000:3.0:1786109437.190283:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933202176:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.190283:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6878 00000100:00100000:1.0:1786109437.190297:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933203456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109437.190299:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933202688:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.190343:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933203456:12345-0@lo:400:kworker.0 Request processed in 48us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109437.190351:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6878 00000100:00100000:3.0:1786109437.190359:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933203456:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.190369:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6879 00000100:00100000:1.0:1786109437.190379:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933203328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109437.190399:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933203200 00000100:00100000:2.0:1786109437.190448:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1786109437.190455:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933203200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109437.190490:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933203200:12345-0@lo:400:kworker.0 Request processed in 36us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109437.190496:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1786109437.190914:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6880 00000100:00100000:0.0:1786109437.190923:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933202944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109437.190955:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933202944:12345-0@lo:400:kworker.0 Request processed in 34us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109437.190964:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6880 00000100:00100000:0.0:1786109437.191020:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933203584:0@lo:400:kworker.0 00000100:00100000:0.0:1786109437.191044:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933202432:0@lo:400:kworker.0 00000100:00100000:0.0:1786109437.191053:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933202944:0@lo:400:kworker.0 00000100:00080000:0.0:1786109437.191082:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109437.191086:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109437.191089:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109437.191091:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109437.191118:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933203200:0@lo:400:kworker.0 00000100:00100000:1.0:1786109437.191344:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933203328:12345-0@lo:400:kworker.0 Request processed in 965us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109437.191351:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6879 00000100:00100000:0.0:1786109437.191559:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933203328:0@lo:400:kworker.0 00010000:00010000:0.0:1786109437.318955:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109437.702705:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109437.702727:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933203712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109437.702791:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109437.703115:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933203712 00000100:00100000:1.0:1786109437.703122:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933203712 00000100:00100000:1.0:1786109437.703174:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5757 00000100:00100000:1.0:1786109437.703184:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933203712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109437.703213:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109437.703260:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933203712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109437.703267:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5757 00000100:00100000:1.0:1786109437.703312:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933203712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109437.707684:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933203840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109437.707756:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109437.707860:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933203840 00000100:00100000:1.0:1786109437.707868:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933203840 00000100:00100000:1.0:1786109437.708156:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5758 00000100:00100000:1.0:1786109437.708167:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933203840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109437.708196:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109437.708259:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933203840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109437.708267:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5758 00000100:00100000:0.0:1786109437.708508:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933203840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109437.974266:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109437.976081:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922080128 00000100:00100000:2.0:1786109437.976096:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922080128 00000100:00100000:2.0:1786109437.976168:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:2.0:1786109437.976178:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922080128:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109437.976873:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922080128:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 693us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109437.976883:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:0.0:1786109437.984802:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109437.985216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109437.985241:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109437.985393:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922080640 00000100:00100000:3.0:1786109437.985403:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922080640 00000100:00100000:2.0:1786109437.985501:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922080384 00000100:00100000:2.0:1786109437.985506:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922080384 00000100:00100000:3.0:1786109437.985523:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6881 00000100:00100000:3.0:1786109437.985532:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:397d331e-10fc-4558-be87-308c3622e8eb+7:2402:x1872862922080640:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109437.985535:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922080256 00000100:00100000:2.0:1786109437.985538:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922080256 00000100:00100000:2.0:1786109437.985558:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:2.0:1786109437.985564:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922080384:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109437.986055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109437.986086:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922080384:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109437.986096:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:2.0:1786109437.986118:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:2.0:1786109437.986126:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+14:2402:x1872862922080256:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109437.994111:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+14:2402:x1872862922080256:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 7972us (8854us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109437.994128:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:2.0:1786109437.994182:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922080512 00000100:00100000:2.0:1786109437.994191:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922080512 00000100:00100000:2.0:1786109437.994251:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6882 00000100:00100000:2.0:1786109437.994260:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922080512:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109437.994331:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922080512:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 72us (8276us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109437.994339:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6882 00000100:00100000:3.0:1786109437.994401:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:397d331e-10fc-4558-be87-308c3622e8eb+7:2402:x1872862922080640:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 8868us (9184us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109437.994410:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6881 00000100:00080000:1.0:1786109438.000481:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109438.000490:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786109438.000493:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109438.000496:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109438.212812:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109438.212846:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933203968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109438.212917:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109438.212986:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933203968 00000100:00100000:3.0:1786109438.212993:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933203968 00000100:00100000:3.0:1786109438.213043:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5759 00000100:00100000:3.0:1786109438.213052:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933203968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786109438.213075:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109438.213122:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933203968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109438.213128:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5759 00000100:00100000:3.0:1786109438.213176:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933203968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109438.213298:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109438.213308:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933204096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109438.213339:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109438.213390:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933204096 00000100:00100000:1.0:1786109438.213394:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933204096 00000100:00100000:1.0:1786109438.213422:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12279 00000100:00100000:1.0:1786109438.213460:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933204096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109438.213489:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:1.0:1786109438.213528:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933204096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109438.213534:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12279 00000100:00100000:1.0:1786109438.213564:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933204096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109438.213881:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933204224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109438.213915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786109438.213997:0:190339:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8294880565062ns, next at 8295880562657ns, rc = 0 00000100:00100000:0.0:1786109438.214121:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933204224 00000100:00100000:0.0:1786109438.214126:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933204224 00000100:00100000:0.0:1786109438.214194:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5760 00000100:00100000:0.0:1786109438.214202:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933204224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109438.214215:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109438.214263:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933204224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109438.214269:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5760 00000100:00100000:1.0:1786109438.214325:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933204224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786109438.340648:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786109439.255081:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975820 is committed 00000004:00080000:3.0:1786109439.256573:0:190317:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1786109439.256617:0:190317:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 330712481794 is committed 00000004:00080000:3.0:1786109439.256623:0:190317:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1786109439.256667:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca366f4 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109439.256679:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca366f4 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109439.256687:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca366f4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109439.256693:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109439.256698:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca366f4 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109439.256705:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca366f4 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109439.256720:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de0:0x0].0x0 (ffff930a9a33e700) 00010000:00010000:3.0:1786109439.256723:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786109439.256728:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca366f4 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109439.256734:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca366f4 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109439.257542:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933204352:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786109439.257618:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109439.258035:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933204352 00000100:00100000:1.0:1786109439.258043:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933204352 00000100:00100000:1.0:1786109439.258104:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23071 00000100:00100000:1.0:1786109439.258113:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933204352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786109439.258231:0:179237:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:6242 count 1 00010000:00010000:1.0:1786109439.258254:0:179237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109439.258275:0:179237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce653669/0xdb52b77d7ca3621d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a149f expref: 5 pid: 179241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109439.258285:0:179237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1862:0x0].0x0 since=78s v=(0 0) 00010000:00010000:1.0:1786109439.258290:0:179237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1862:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109439.258295:0:179237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109439.258322:0:179237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce653669/0xdb52b77d7ca3621d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a149f expref: 5 pid: 179241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786109439.258405:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786109439.258758:0:179237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce653669/0xdb52b77d7ca3621d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a149f expref: 5 pid: 179241 timeout: 8395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109439.258773:0:179237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:179237:1872862933204480:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109439.258847:0:179237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309850c4600 going to sleep for 11 seconds 00000100:00100000:1.0:1786109439.266771:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109439.266810:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922080768 00000100:00100000:1.0:1786109439.266818:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922080768 00010000:00010000:1.0:1786109439.266864:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce653669/0xdb52b77d7ca3621d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a149f expref: 6 pid: 179241 timeout: 8395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109439.266897:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12634 00000100:00100000:1.0:1786109439.266906:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922080768:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109439.266922:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109439.266928:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce653669/0xdb52b77d7ca3621d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a149f expref: 6 pid: 179241 timeout: 8395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109439.266940:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce653669/0xdb52b77d7ca3621d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a149f expref: 6 pid: 179241 timeout: 8395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109439.268780:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1862:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109439.268786:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1862:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109439.268793:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109439.268805:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109439.268837:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109439.269531:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922080768:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 2619us (2763us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109439.269543:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12634 00010000:00010000:3.0:1786109439.270373:0:179237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce653669/0xdb52b77d7ca3621d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1862:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a149f expref: 5 pid: 179241 timeout: 8395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109439.270392:0:179237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:179237:1872862933204480:192.168.203.38@tcp:104: 00000100:00080000:1.0:1786109439.270549:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786109439.270727:0:179237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109439.270741:0:179237:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109439.270748:0:179237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109439.270758:0:179237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109439.270765:0:179237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109439.270796:0:179237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109439.271077:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109439.271085:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109439.271094:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109439.271098:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109439.271106:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109439.271122:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109439.271129:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ff3673e/0xdb52b77d7ca3672c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1862:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109439.271147:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109439.271148:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109439.271150:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109439.272043:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933204352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13925us (14419us total) trans 4294975821 rc 0/0 00000100:00100000:3.0:1786109439.272055:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23071 00000004:00080000:2.0:1786109439.272150:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab94c5c00/2, rc 0, transno 4294975821 00000100:00100000:2.0:1786109439.272158:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933204352:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1786109439.366228:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109440.410088:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109441.419596:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786109441.620289:0:191165:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 73b: open(O_CREAT), unlink, replay, reconnect at open_replay reply, close ========================================================== 09:30:39 (1786109439) 00000100:00100000:2.0:1786109441.805821:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109441.805843:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933204608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109441.805907:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109441.805959:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933204608 00000100:00100000:2.0:1786109441.805966:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933204608 00000100:00100000:2.0:1786109441.806011:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12280 00000100:00100000:2.0:1786109441.806019:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933204608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109441.806055:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1786109441.806099:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933204608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109441.806106:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12280 00000100:00100000:2.0:1786109441.806147:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933204608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109441.936993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109441.937103:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922081024 00000100:00100000:0.0:1786109441.937113:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922081024 00000100:00080000:1.0:1786109441.937213:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109441.937284:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 920 00000100:00100000:0.0:1786109441.937296:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+11:160008:x1872862922081024:12345-192.168.203.38@tcp:101:multiop.0 00010000:00010000:0.0:1786109441.937316:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109441.937319:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786109441.937344:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77c00/0xdb52b77d7ca3652d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14de expref: 11 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.937364:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0f7ec00) 00010000:00010000:0.0:1786109441.937376:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109441.937391:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36733 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14fa expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938200:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3673a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938216:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3673a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938226:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3673a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938239:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca36741 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938247:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca36741 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938254:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca36741 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109441.938615:0:187901:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x1863:0x0], count =31 00000004:00080000:0.0:1786109441.938623:0:187901:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x1863:0x0]+31 in llog 00000004:00080000:0.0:1786109441.938638:0:187901:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1882:0x0], index 1: 0 00010000:00010000:0.0:1786109441.938794:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca36748 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938804:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca36748 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938812:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca36748 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938843:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3673a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938850:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3673a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938871:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3673a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938878:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109441.938883:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3673a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938895:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3673a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938907:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a9a33ea00) 00010000:00010000:0.0:1786109441.938910:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109441.938915:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3673a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938921:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3673a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109441.938934:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025c89313 reply state 00000000c68af1e6 transno 330712481795 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca36741 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938945:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca36741 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.938952:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff930a9a33e800) 00010000:00010000:0.0:1786109441.938954:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109441.938956:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109441.938988:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36733 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14fa expref: 13 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.939006:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca36748 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14fa expref: 12 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109441.939014:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de2:0x0].0x0 (ffff930a9a33eb00) 00010000:00010000:0.0:1786109441.939016:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109441.939018:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3a00, rc 0) 00000100:00100000:0.0:1786109441.939278:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+13:160008:x1872862922081024:12345-192.168.203.38@tcp:101:multiop.0 Request processed in 1983us (2293us total) trans 330712481795 rc 0/0 00000100:00100000:0.0:1786109441.939287:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 920 00000100:00100000:2.0:1786109441.979384:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109441.979536:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922081152 00000100:00100000:3.0:1786109441.979546:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922081152 00000100:00100000:3.0:1786109441.979714:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 921 00000100:00100000:3.0:1786109441.979785:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+13:160018:x1872862922081152:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1786109441.979870:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109441.979897:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca36756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1501 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109441.979969:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca3675d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109441.979983:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca3675d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109441.979995:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca3675d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109441.980045:0:189813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:3.0:1786109441.980049:0:189813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109441.980071:0:189813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca3675d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109441.980094:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca36756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1501 expref: 15 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109441.980112:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca3675d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1501 expref: 14 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109441.980127:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930984516500) 00010000:00010000:3.0:1786109441.980130:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109441.980134:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6c200, rc 0) 00000100:00100000:3.0:1786109441.980242:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+14:160018:x1872862922081152:12345-192.168.203.38@tcp:101:rm.0 Request processed in 518us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109441.980250:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 921 00000100:00100000:1.0:1786109441.985829:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109441.985978:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922081280 00000100:00100000:3.0:1786109441.985988:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922081280 00000100:00100000:3.0:1786109441.986098:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23072 00000100:00100000:3.0:1786109441.986110:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922081280:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1786109441.986127:0:9990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109441.986147:0:9990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca36764 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1508 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109441.986173:0:9990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1882:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109441.986192:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1882:0x0].0x0 since=8298s v=(0 0) 00010000:00010000:3.0:1786109441.986196:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1882:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109441.986207:0:9990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca36764 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1508 expref: 6 pid: 9990 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109441.986226:0:9990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca36764 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1508 expref: 6 pid: 9990 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109441.986240:0:9990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6cc00, rc 0) 00000100:00100000:3.0:1786109441.986304:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922081280:12345-192.168.203.38@tcp:101:rm.0 Request processed in 196us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109441.986312:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23072 00000100:00080000:1.0:1786109441.986785:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109441.991572:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109441.991697:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922081536 00000100:00100000:1.0:1786109441.991707:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922081536 00000100:00100000:1.0:1786109441.991798:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 922 00000100:00100000:1.0:1786109441.991817:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+14:160018:x1872862922081536:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109441.991871:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1786109441.991898:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca36748 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14fa expref: 14 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.991918:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de2:0x0].0x0 (ffff930a9a33eb00) 00010000:00010000:1.0:1786109441.991934:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca3675d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1501 expref: 13 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.991943:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930984516500) 00010000:00010000:1.0:1786109441.991950:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109441.991973:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3676b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.991985:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3676b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.991994:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3676b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992005:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca36772 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992013:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca36772 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992019:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca36772 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992108:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36779 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992117:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36779 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992125:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36779 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109441.992307:0:187900:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x20001a9e3:0x1de2:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1786109441.992377:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36779 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992386:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36779 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992394:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36779 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992400:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109441.992405:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36779 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992413:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36779 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992422:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de2:0x0].0x0 (ffff930ab7ed2800) 00010000:00010000:1.0:1786109441.992424:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109441.992428:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36779 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992495:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca36779 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992510:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3676b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992517:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3676b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992523:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3676b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992529:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109441.992532:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3676b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992539:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3676b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992551:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab7ed2100) 00010000:00010000:1.0:1786109441.992554:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109441.992557:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3676b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992563:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3676b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109441.992573:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000509f1383 reply state 000000007f309bf3 transno 330712481796 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca36772 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992594:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca36772 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109441.992600:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff930a9a33e800) 00010000:00010000:1.0:1786109441.992603:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109441.992605:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109441.992688:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+14:160018:x1872862922081536:12345-192.168.203.38@tcp:36:rm.0 Request processed in 872us (1124us total) trans 330712481796 rc 0/0 00000100:00100000:1.0:1786109441.992696:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 922 00000100:00100000:1.0:1786109442.312075:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933204864:0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.312144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109442.312201:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933205376:0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.312226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109442.312252:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933205888:0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.312272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109442.312295:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1786109442.312300:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933204736:0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.312327:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109442.312349:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933205248:0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.312370:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109442.312385:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933205760:0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.312455:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933205120:0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.312482:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109442.312502:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933205632:0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.312521:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109442.312537:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933206144:0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.312557:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109442.312586:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1786109442.312592:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933204992:0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.312613:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109442.312629:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933205504:0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.312648:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109442.312664:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933206016:0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.312683:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109442.312712:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933204864 00000100:00100000:0.0:1786109442.312719:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933204864 00000100:00100000:0.0:1786109442.312764:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933205248 00000100:00100000:0.0:1786109442.312767:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933205248 00000100:00100000:0.0:1786109442.312778:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933205120 00000100:00100000:0.0:1786109442.312781:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933205120 00000100:00100000:0.0:1786109442.312794:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933206144 00000100:00100000:0.0:1786109442.312797:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933206144 00000100:00100000:0.0:1786109442.312806:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933204992 00000100:00100000:0.0:1786109442.312808:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933204992 00000100:00100000:0.0:1786109442.312822:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1786109442.312830:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933204864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.312874:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933204864:12345-0@lo:400:kworker.0 Request processed in 44us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109442.312881:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1786109442.312898:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1786109442.312904:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933205248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.312928:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933205248:12345-0@lo:400:kworker.0 Request processed in 25us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109442.312933:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1786109442.312943:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1786109442.312948:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933205120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.312973:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933205120:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109442.312978:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1786109442.312987:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1786109442.312992:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933206144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.313014:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933206144:12345-0@lo:400:kworker.0 Request processed in 22us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109442.313019:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1786109442.313028:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1786109442.313034:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933204992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.313056:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933204992:12345-0@lo:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109442.313061:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1786109442.313077:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933205888 00000100:00100000:0.0:1786109442.313080:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933205888 00000100:00100000:0.0:1786109442.313103:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933205632 00000100:00100000:0.0:1786109442.313106:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933205632 00000100:00100000:0.0:1786109442.313121:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933205504 00000100:00100000:0.0:1786109442.313123:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933205504 00000100:00100000:0.0:1786109442.313135:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933206016 00000100:00100000:0.0:1786109442.313137:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933206016 00000100:00100000:0.0:1786109442.313151:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6883 00000100:00100000:0.0:1786109442.313156:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933205888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.313183:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933205888:12345-0@lo:400:kworker.0 Request processed in 27us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109442.313188:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6883 00000100:00100000:0.0:1786109442.313197:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6884 00000100:00100000:0.0:1786109442.313203:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933205632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.313227:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933205632:12345-0@lo:400:kworker.0 Request processed in 24us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109442.313232:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6884 00000100:00100000:0.0:1786109442.313242:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6885 00000100:00100000:0.0:1786109442.313248:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933205504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.313272:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933205504:12345-0@lo:400:kworker.0 Request processed in 25us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109442.313277:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6885 00000100:00100000:0.0:1786109442.313287:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6886 00000100:00100000:0.0:1786109442.313293:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933206016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.313318:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933206016:12345-0@lo:400:kworker.0 Request processed in 26us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109442.313324:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6886 00000100:00100000:0.0:1786109442.313375:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933204992:0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.313387:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933205504:0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.313395:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933206016:0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.313403:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933205120:0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.313411:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933205632:0@lo:400:kworker.0 00000100:00100000:0.0:1786109442.313419:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933206144:0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.313544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109442.313588:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933204864:0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.313598:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933205888:0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.313614:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933205248:0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.313635:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933205376 00000100:00100000:1.0:1786109442.313638:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933205376 00000100:00100000:1.0:1786109442.313665:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12281 00000100:00100000:1.0:1786109442.313671:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933205376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.313703:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933205376:12345-0@lo:400:kworker.0 Request processed in 33us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109442.313709:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12281 00000100:00100000:1.0:1786109442.313728:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933204736 00000100:00100000:1.0:1786109442.313732:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933204736 00000100:00100000:1.0:1786109442.313751:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1786109442.313757:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933204736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.313785:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933204736:12345-0@lo:400:kworker.0 Request processed in 29us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109442.313791:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1786109442.313815:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933205760 00000100:00100000:1.0:1786109442.313818:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933205760 00000100:00100000:1.0:1786109442.313836:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1786109442.313842:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933205760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.313868:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933205760:12345-0@lo:400:kworker.0 Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109442.313874:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1786109442.313890:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109442.313894:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109442.313896:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109442.313898:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109442.313917:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933204736:0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.313926:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933205760:0@lo:400:kworker.0 00000100:00100000:1.0:1786109442.313935:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933205376:0@lo:400:kworker.0 00010000:00010000:2.0:1786109442.443688:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109442.822170:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933206272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109442.822270:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109442.823509:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933206400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109442.823594:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109442.823671:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933206272 00000100:00100000:0.0:1786109442.823681:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933206272 00000100:00100000:0.0:1786109442.823735:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933206400 00000100:00100000:0.0:1786109442.823738:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933206400 00000100:00100000:0.0:1786109442.823763:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5761 00000100:00100000:0.0:1786109442.823773:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933206272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109442.823832:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109442.824422:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5762 00000100:00100000:1.0:1786109442.824458:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933206400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109442.824483:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109442.824539:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933206400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109442.824546:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5762 00000100:00100000:1.0:1786109442.824620:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933206400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109442.826454:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933206272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2658us (4159us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109442.826469:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5761 00000100:00100000:3.0:1786109442.826946:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933206272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109443.108233:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109443.108336:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109443.108375:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109443.108399:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109443.108894:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922081664 00000100:00100000:1.0:1786109443.108908:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922081664 00000100:00100000:1.0:1786109443.108969:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:1.0:1786109443.108979:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2405:x1872862922081664:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109443.109063:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2405:x1872862922081664:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 85us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109443.109074:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:2.0:1786109443.109268:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922082048 00000100:00100000:2.0:1786109443.109274:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922082048 00000100:00100000:2.0:1786109443.109331:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6887 00000100:00100000:2.0:1786109443.109340:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:397d331e-10fc-4558-be87-308c3622e8eb+5:2405:x1872862922082048:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109443.109374:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:397d331e-10fc-4558-be87-308c3622e8eb+5:2405:x1872862922082048:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109443.109380:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6887 00000100:00080000:1.0:1786109443.113518:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109443.119945:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109443.134043:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922082176 00000100:00100000:0.0:1786109443.134066:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922082176 00000100:00100000:0.0:1786109443.134172:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6888 00000100:00100000:0.0:1786109443.134186:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922082176:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109443.134303:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922082176:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 120us (14372us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109443.134312:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6888 00000100:00080000:0.0:1786109443.134361:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109443.138186:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922081792 00000100:00100000:3.0:1786109443.138208:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922081792 00000100:00080000:0.0:1786109443.141317:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109443.141404:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922081920 00000100:00100000:0.0:1786109443.141417:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922081920 00000100:00080000:0.0:1786109443.141453:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109443.141491:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:0.0:1786109443.141503:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+14:2405:x1872862922081792:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109443.141628:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+14:2405:x1872862922081792:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 127us (33407us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109443.141636:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:0.0:1786109443.141659:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:0.0:1786109443.141666:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922081920:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109443.141697:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922081920:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 32us (33296us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109443.143698:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 131 00000001:00080000:1.0:1786109443.238748:0:190317:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 330712481796 is committed 00010000:00010000:0.0:1786109443.238822:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca36741 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238837:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca36741 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238845:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca36741 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238858:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109443.238864:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca36741 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238872:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca36741 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238893:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff930a9a33e800) 00010000:00010000:0.0:1786109443.238897:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109443.238903:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca36741 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238910:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca36741 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238934:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca36772 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238941:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca36772 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238947:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca36772 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238952:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109443.238955:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca36772 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238961:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca36772 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238973:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff930a9a33e800) 00010000:00010000:0.0:1786109443.238976:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109443.238979:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca36772 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.238986:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412400/0xdb52b77d7ca36772 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786109443.239094:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975821 is committed 00000100:00100000:1.0:1786109443.281366:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109443.282303:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922082304 00000100:00100000:3.0:1786109443.282319:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922082304 00000100:00100000:3.0:1786109443.283382:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 923 00000100:00100000:3.0:1786109443.283625:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+10:160027:x1872862922082304:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109443.283658:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109443.283694:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca36780 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a150f expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.283779:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36787 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.283922:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.283938:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109443.283997:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:3.0:1786109443.284002:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109443.284660:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.284704:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca36780 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a150f expref: 12 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.284724:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36787 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a150f expref: 11 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.284733:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930984516a00) 00010000:00010000:3.0:1786109443.284737:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109443.284741:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d800, rc 0) 00000100:00100000:3.0:1786109443.284978:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+11:160027:x1872862922082304:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1505us (3624us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109443.284988:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 923 00000100:00100000:2.0:1786109443.319157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109443.320931:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922082432 00000100:00100000:0.0:1786109443.321854:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922082432 00000100:00100000:0.0:1786109443.321958:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 924 00000100:00100000:0.0:1786109443.321970:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+11:160027:x1872862922082432:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:0.0:1786109443.322022:0:189813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:0.0:1786109443.322129:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+11:160027:x1872862922082432:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 161us (2984us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109443.322138:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 924 00000100:00100000:3.0:1786109443.334221:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109443.334251:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933206528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109443.334475:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109443.334670:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933206656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109443.335245:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109443.336908:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933206656 00000100:00100000:2.0:1786109443.336925:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933206656 00000100:00100000:2.0:1786109443.336997:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12282 00000100:00100000:2.0:1786109443.337010:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933206656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109443.337059:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:2.0:1786109443.337161:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933206656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109443.337175:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12282 00000100:00100000:3.0:1786109443.337546:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109443.337678:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933206528 00000100:00100000:3.0:1786109443.337684:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933206528 00000100:00100000:3.0:1786109443.337726:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5763 00000100:00100000:3.0:1786109443.337735:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933206528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786109443.337756:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109443.337800:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933206528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109443.337806:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5763 00000100:00100000:3.0:1786109443.337851:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933206784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109443.338174:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109443.338219:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933206784 00000100:00100000:3.0:1786109443.338223:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933206784 00000100:00100000:3.0:1786109443.338255:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5764 00000100:00100000:3.0:1786109443.338262:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933206784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109443.338275:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109443.338365:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933206784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109443.338529:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5764 00000100:00100000:3.0:1786109443.338607:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933206528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109443.338990:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109443.340239:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933206656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109443.342645:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922082560 00000100:00100000:0.0:1786109443.342666:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922082560 00000100:00100000:0.0:1786109443.343464:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 925 00000100:00100000:0.0:1786109443.343481:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:160027:x1872862922082560:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:0.0:1786109443.343536:0:188678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:0.0:1786109443.344426:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:160027:x1872862922082560:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 942us (5431us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109443.344460:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 925 00000100:00100000:2.0:1786109443.344514:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975821 gen 2 00000004:00080000:2.0:1786109443.344523:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab94c5c00, transno 4294975821 00000100:00100000:2.0:1786109443.355980:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933206784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109443.359630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109443.359782:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922082688 00000100:00100000:2.0:1786109443.359796:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922082688 00000100:00100000:2.0:1786109443.359937:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5765 00000100:00100000:2.0:1786109443.359949:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+5:160027:x1872862922082688:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1786109443.359983:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109443.360129:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+5:160027:x1872862922082688:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 181us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109443.360138:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5765 00000100:00100000:1.0:1786109443.364656:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109443.364861:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922082816 00000100:00100000:2.0:1786109443.364876:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922082816 00000100:00100000:2.0:1786109443.364951:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5766 00000100:00100000:2.0:1786109443.364964:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:160027:x1872862922082816:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1786109443.365020:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109443.365117:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:160027:x1872862922082816:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 156us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109443.365126:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5766 00000100:00100000:3.0:1786109443.451284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109443.459664:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922083072 00000100:00100000:0.0:1786109443.459681:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922083072 00000100:00100000:0.0:1786109443.459761:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 926 00000100:00100000:0.0:1786109443.459773:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+11:160034:x1872862922083072:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00010000:0.0:1786109443.459850:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109443.459888:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36787 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a150f expref: 11 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.459907:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930984516a00) 00010000:00010000:0.0:1786109443.459920:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109443.460016:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3678e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.460030:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3678e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.460040:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3678e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.460052:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36795 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.460058:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.460063:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.460515:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3678e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.460524:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3678e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.460531:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3678e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.460537:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109443.460542:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3678e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.460550:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3678e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.460559:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a83abd600) 00010000:00010000:0.0:1786109443.460562:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109443.462580:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3678e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.462601:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca3678e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109443.462630:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005419be0d reply state 00000000c48c1fb8 transno 330712481797 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.462650:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.462658:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a83abdc00) 00010000:00010000:0.0:1786109443.462661:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109443.462666:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109443.462817:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+12:160034:x1872862922083072:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 3040us (11543us total) trans 330712481797 rc 0/0 00000100:00100000:0.0:1786109443.462827:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 926 00010000:00010000:0.0:1786109443.463635:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109443.528606:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109443.528761:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922083200 00000100:00100000:2.0:1786109443.528774:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922083200 00000100:00100000:2.0:1786109443.528897:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 927 00000100:00100000:2.0:1786109443.528911:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+12:160037:x1872862922083200:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1786109443.528944:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109443.528976:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3679c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1516 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109443.529081:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca367a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109443.529098:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca367a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109443.529115:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca367a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109443.529175:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:2.0:1786109443.529181:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109443.529210:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca367a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109443.529239:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3679c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1516 expref: 14 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109443.529262:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca367a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1516 expref: 13 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109443.529272:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab8c04200) 00010000:00010000:2.0:1786109443.529276:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109443.529281:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360e00, rc 0) 00000100:00100000:2.0:1786109443.529368:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+13:160037:x1872862922083200:12345-192.168.203.38@tcp:101:rm.0 Request processed in 460us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109443.529377:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 927 00000100:00100000:2.0:1786109443.534319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109443.534420:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922083328 00000100:00100000:0.0:1786109443.534519:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922083328 00000100:00100000:0.0:1786109443.534642:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 928 00000100:00100000:0.0:1786109443.534654:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+13:160037:x1872862922083328:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1786109443.534679:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109443.534705:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca367aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a151d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.534790:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca367b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.534806:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca367b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.534820:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca367b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.534834:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca367b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.534841:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca367b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.534848:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca367b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.534961:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca367bf lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.534970:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca367bf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.534979:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca367bf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109443.535031:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x1de3:0x0]: returning size 0 00000004:00200000:0.0:1786109443.535035:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109443.535063:0:188678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca367bf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535077:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca367bf lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535086:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca367b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535093:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca367b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535101:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca367b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535108:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109443.535112:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca367b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535120:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca367b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535134:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab8c04200) 00010000:00010000:0.0:1786109443.535137:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109443.535143:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca367b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535154:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3c00/0xdb52b77d7ca367b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535169:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca367b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535182:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca367b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535187:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca367b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535191:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109443.535194:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca367b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535200:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca367b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535206:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a83abdc00) 00010000:00010000:0.0:1786109443.535209:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109443.535212:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca367b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535217:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3a00/0xdb52b77d7ca367b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535246:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2a00/0xdb52b77d7ca367aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a151d expref: 15 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535267:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca367bf lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a151d expref: 14 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.535276:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de3:0x0].0x0 (ffff930a83abd600) 00010000:00010000:0.0:1786109443.535284:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109443.535287:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d200, rc 0) 00000100:00100000:0.0:1786109443.535373:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+14:160037:x1872862922083328:12345-192.168.203.38@tcp:101:rm.0 Request processed in 721us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109443.535381:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 928 00000100:00100000:0.0:1786109443.539508:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109443.539976:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922083584 00000100:00100000:3.0:1786109443.539990:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922083584 00000100:00100000:3.0:1786109443.540109:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 929 00000100:00100000:3.0:1786109443.540122:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+14:160037:x1872862922083584:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:3.0:1786109443.540200:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786109443.540236:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca367bf lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a151d expref: 14 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540257:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de3:0x0].0x0 (ffff930a83abd600) 00010000:00010000:3.0:1786109443.540276:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca367a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1516 expref: 13 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540286:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab8c04200) 00010000:00010000:3.0:1786109443.540295:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109443.540325:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca367c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540346:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca367c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540357:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca367c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540369:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca367cd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540378:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca367cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540385:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca367cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540554:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca367d4 lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540573:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca367d4 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540582:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca367d4 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540841:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca367db lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540851:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca367db lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540860:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca367db lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540872:0:187901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca367db lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540879:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca367db lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540885:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca367db lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540907:0:187901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109443.540931:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca367d4 lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540938:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca367d4 lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540944:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca367d4 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540951:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109443.540956:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca367d4 lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540965:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca367d4 lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540974:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de3:0x0].0x0 (ffff930984516200) 00010000:00010000:3.0:1786109443.540977:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109443.540981:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca367d4 lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.540992:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca367d4 lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.541011:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca367c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.541017:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca367c6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.541024:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca367c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.541029:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109443.541032:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca367c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.541038:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca367c6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.541046:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930984516b00) 00010000:00010000:3.0:1786109443.541048:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109443.541050:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca367c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.541055:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca367c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109443.541069:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee1dfba6 reply state 0000000002f8a06a transno 330712481798 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca367cd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.541080:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca367cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109443.541088:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a83abdc00) 00010000:00010000:3.0:1786109443.541090:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109443.541093:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109443.541294:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109443.541303:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca367db lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.541310:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109443.541313:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca367db lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.541320:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca367db lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.541330:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de3:0x0].0x0 (ffff930984516200) 00010000:00010000:0.0:1786109443.541332:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109443.541335:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca367db lrc: 1/0,0 mode: --/PW res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.541340:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca367db lrc: 0/0,0 mode: --/PW res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109443.541359:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109443.541361:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109443.541363:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109443.541408:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+14:160037:x1872862922083584:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1285us (1911us total) trans 330712481798 rc 0/0 00000100:00100000:3.0:1786109443.541418:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 929 00010000:00010000:1.0:1786109444.489962:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109445.510723:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109446.532642:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109446.917846:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933206912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109446.918765:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109446.918932:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933206912 00000100:00100000:2.0:1786109446.919364:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933206912 00000100:00100000:2.0:1786109446.919465:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12283 00000100:00100000:2.0:1786109446.919477:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933206912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109446.919527:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1786109446.919628:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933206912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109446.919637:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12283 00000100:00100000:2.0:1786109446.919700:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933206912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109447.430337:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933207040:0@lo:400:kworker.0 00000100:00100000:1.0:1786109447.430464:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109447.430549:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933207168:0@lo:400:kworker.0 00000100:00100000:2.0:1786109447.430595:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109447.430626:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933207680:0@lo:400:kworker.0 00000100:00100000:2.0:1786109447.430654:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109447.430674:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933208192:0@lo:400:kworker.0 00000100:00100000:2.0:1786109447.430699:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109447.430741:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933207296:0@lo:400:kworker.0 00000100:00100000:2.0:1786109447.430770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109447.430790:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933207808:0@lo:400:kworker.0 00000100:00100000:2.0:1786109447.430813:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109447.430833:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933208320:0@lo:400:kworker.0 00000100:00100000:2.0:1786109447.430856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109447.430876:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1786109447.430883:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933207424:0@lo:400:kworker.0 00000100:00100000:2.0:1786109447.430907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109447.430925:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933207936:0@lo:400:kworker.0 00000100:00100000:2.0:1786109447.430949:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109447.430969:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933208448:0@lo:400:kworker.0 00000100:00100000:2.0:1786109447.430992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109447.431031:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933207168 00000100:00100000:2.0:1786109447.431041:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933207168 00000100:00100000:2.0:1786109447.431108:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933207296 00000100:00100000:2.0:1786109447.431112:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933207296 00000100:00100000:2.0:1786109447.431142:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933207424 00000100:00100000:2.0:1786109447.431146:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933207424 00000100:00100000:2.0:1786109447.431176:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1786109447.431189:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933207168:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109447.431221:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c7100 x1872862933207168/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:673/0 lens 224/224 e 0 to 0 dl 1786109458 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109447.431270:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933207168:12345-0@lo:400:kworker.0 Request processed in 85us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109447.431278:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1786109447.431300:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1786109447.431306:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933207296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109447.431344:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933207296:12345-0@lo:400:kworker.0 Request processed in 37us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109447.431350:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1786109447.431585:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933207552:0@lo:400:kworker.0 00000100:00100000:1.0:1786109447.431622:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109447.431640:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933208064:0@lo:400:kworker.0 00000100:00100000:1.0:1786109447.431662:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109447.431675:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933208576:0@lo:400:kworker.0 00000100:00100000:1.0:1786109447.431699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109447.431731:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933207040 00000100:00100000:1.0:1786109447.431736:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933207040 00000100:00100000:0.0:1786109447.431825:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933207808 00000100:00100000:0.0:1786109447.431831:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933207808 00000100:00100000:0.0:1786109447.431865:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933208320 00000100:00100000:0.0:1786109447.431869:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933208320 00000100:00100000:0.0:1786109447.431889:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933207936 00000100:00100000:0.0:1786109447.431892:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933207936 00000100:00100000:1.0:1786109447.431936:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1786109447.431944:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933207040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109447.433566:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933208448 00000100:00100000:0.0:1786109447.433581:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933208448 00000100:00100000:0.0:1786109447.434136:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6889 00000100:00100000:0.0:1786109447.434152:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933207808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109447.434270:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933207808:12345-0@lo:400:kworker.0 Request processed in 124us (3455us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109447.434288:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6889 00000100:00100000:0.0:1786109447.434308:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6890 00000100:00100000:0.0:1786109447.434315:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933208320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109447.434345:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933208320:12345-0@lo:400:kworker.0 Request processed in 31us (3488us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109447.434350:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6890 00000100:00100000:0.0:1786109447.434360:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6891 00000100:00100000:0.0:1786109447.434366:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933207936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109447.436925:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933207040:12345-0@lo:400:kworker.0 Request processed in 4968us (6448us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109447.436925:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933207936:12345-0@lo:400:kworker.0 Request processed in 2548us (5964us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109447.436942:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1786109447.437002:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6891 00000100:00100000:0.0:1786109447.437031:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6892 00000100:00100000:0.0:1786109447.437046:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933208448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109447.437117:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933208448:12345-0@lo:400:kworker.0 Request processed in 78us (6124us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109447.437124:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6892 00000100:00100000:1.0:1786109447.437271:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933207552 00000100:00100000:1.0:1786109447.437281:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933207552 00000100:00100000:1.0:1786109447.437322:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933208064 00000100:00100000:1.0:1786109447.437325:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933208064 00000100:00100000:1.0:1786109447.437338:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933208576 00000100:00100000:1.0:1786109447.437341:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933208576 00000100:00100000:1.0:1786109447.437354:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1786109447.437362:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933207424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109447.437363:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1786109447.437370:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933207552:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109447.437380:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c6300 x1872862933207424/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:673/0 lens 224/224 e 0 to 0 dl 1786109458 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109447.437418:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933207424:12345-0@lo:400:kworker.0 Request processed in 57us (6510us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109447.437424:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1786109447.437461:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1786109447.437468:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933208064:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109447.437479:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930982e53100 x1872862933208064/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:673/0 lens 224/224 e 0 to 0 dl 1786109458 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109447.437493:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933207552:12345-0@lo:400:kworker.0 Request processed in 123us (5871us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109447.437500:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1786109447.437504:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933208064:12345-0@lo:400:kworker.0 Request processed in 38us (5842us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109447.437510:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1786109447.437519:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1786109447.437526:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933208576:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109447.437537:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930982e52680 x1872862933208576/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:673/0 lens 224/224 e 0 to 0 dl 1786109458 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109447.437613:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109447.437619:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109447.437623:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109447.437625:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109447.438645:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933208576:12345-0@lo:400:kworker.0 Request processed in 1117us (6942us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109447.438653:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1786109447.438717:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933207040:0@lo:400:kworker.0 00000100:00100000:1.0:1786109447.438733:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933207552:0@lo:400:kworker.0 00000100:00100000:1.0:1786109447.438747:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933208064:0@lo:400:kworker.0 00000100:00100000:1.0:1786109447.438758:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933208576:0@lo:400:kworker.0 00000100:00100000:1.0:1786109447.439524:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933207680 00000100:00100000:1.0:1786109447.439536:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933207680 00000100:00100000:1.0:1786109447.439592:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933208192 00000100:00100000:1.0:1786109447.439596:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933208192 00000100:00100000:1.0:1786109447.439619:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12284 00000100:00100000:1.0:1786109447.439628:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933207680:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109447.439659:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c6a00 x1872862933207680/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:673/0 lens 224/224 e 0 to 0 dl 1786109458 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109447.439712:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933207680:12345-0@lo:400:kworker.0 Request processed in 85us (9057us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109447.439719:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12284 00000100:00100000:1.0:1786109447.439733:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12285 00000100:00100000:1.0:1786109447.439740:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933208192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109447.439773:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933208192:12345-0@lo:400:kworker.0 Request processed in 34us (9074us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109447.439780:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12285 00000100:00100000:3.0:1786109447.442663:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933207168:0@lo:400:kworker.0 00000100:00100000:3.0:1786109447.442686:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933207680:0@lo:400:kworker.0 00000100:00100000:3.0:1786109447.442701:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933208192:0@lo:400:kworker.0 00000100:00100000:3.0:1786109447.442760:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933207424:0@lo:400:kworker.0 00000100:00100000:3.0:1786109447.442775:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933207936:0@lo:400:kworker.0 00000100:00100000:3.0:1786109447.442790:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933208448:0@lo:400:kworker.0 00000100:00100000:3.0:1786109447.442803:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933207296:0@lo:400:kworker.0 00000100:00100000:3.0:1786109447.442817:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933207808:0@lo:400:kworker.0 00000100:00100000:3.0:1786109447.442830:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933208320:0@lo:400:kworker.0 00010000:00010000:0.0:1786109447.556645:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109447.941220:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109447.943126:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109447.943157:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933208832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109447.943323:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109447.943498:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933208832 00000100:00100000:1.0:1786109447.943508:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933208832 00000100:00100000:1.0:1786109447.943581:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5767 00000100:00100000:1.0:1786109447.943592:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933208832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109447.943631:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109447.943806:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933208704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109447.944702:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109447.944762:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933208704 00000100:00100000:0.0:1786109447.944769:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933208704 00000100:00100000:0.0:1786109447.944808:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5768 00000100:00100000:0.0:1786109447.944817:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933208704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109447.944848:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109447.944891:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933208704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109447.944899:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5768 00000100:00100000:0.0:1786109447.944973:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933208704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109447.946914:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933208832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3311us (3652us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109447.946931:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5767 00000100:00100000:1.0:1786109447.947010:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933208832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109448.210115:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109448.210166:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109448.210195:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109448.210237:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109448.210273:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922083968 00000100:00100000:0.0:1786109448.210290:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922083968 00000100:00100000:3.0:1786109448.210291:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109448.210331:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922083840 00000100:00100000:3.0:1786109448.210341:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922083840 00000100:00100000:0.0:1786109448.210402:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:0.0:1786109448.210416:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922083968:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109448.210423:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:3.0:1786109448.210473:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+14:2402:x1872862922083840:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109448.210586:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922083968:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 172us (416us total) trans 0 rc 0/0 00010000:00000080:3.0:1786109448.210590:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab928b800 x1872862922083840/t0(0) o400->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:674/0 lens 224/224 e 0 to 0 dl 1786109459 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109448.210609:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00080000:0.0:1786109448.210650:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109448.210657:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109448.210671:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+14:2402:x1872862922083840:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 199us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109448.210681:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:3.0:1786109448.210711:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922084224 00000100:00100000:3.0:1786109448.210715:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922084224 00000100:00100000:3.0:1786109448.210771:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922084096 00000100:00100000:3.0:1786109448.210776:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922084096 00000100:00100000:3.0:1786109448.210805:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6893 00000100:00100000:3.0:1786109448.210813:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922084224:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109448.210860:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6894 00000100:00100000:0.0:1786109448.210872:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922084096:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109448.211048:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922084096:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 177us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109448.211058:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922084224:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 243us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109448.211060:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6894 00000100:00100000:3.0:1786109448.211077:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6893 00000100:00080000:0.0:1786109448.211097:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109448.211103:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109448.212215:0:190323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922083712 00000100:00100000:2.0:1786109448.212228:0:190323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922083712 00000100:00100000:2.0:1786109448.212300:0:190323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:2.0:1786109448.212312:0:190323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922083712:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109448.212371:0:190323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922083712:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 62us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109448.212379:0:190323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:1.0:1786109448.455583:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933208960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109448.455648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109448.455720:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933208960 00000100:00100000:1.0:1786109448.455727:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933208960 00000100:00100000:1.0:1786109448.456361:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12286 00000100:00100000:1.0:1786109448.456372:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933208960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109448.456408:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00010000:00000080:1.0:1786109448.456423:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d886d80 x1872862933208960/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:674/0 lens 224/368 e 0 to 0 dl 1786109459 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109448.456499:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933208960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109448.456506:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12286 00000100:00100000:1.0:1786109448.456565:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933208960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109448.457148:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109448.457162:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933209088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109448.457204:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109448.457877:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109448.457890:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933209216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109448.457925:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109448.458400:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933209088 00000100:00100000:0.0:1786109448.458408:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933209088 00000100:00100000:0.0:1786109448.458468:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933209216 00000100:00100000:0.0:1786109448.458471:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933209216 00000100:00100000:0.0:1786109448.458491:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5769 00000100:00100000:0.0:1786109448.458499:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933209088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109448.458522:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109448.458580:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933209088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109448.458587:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5769 00000100:00100000:0.0:1786109448.458603:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5770 00000100:00100000:0.0:1786109448.458609:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933209216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109448.458620:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109448.458649:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933209216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109448.458654:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5770 00000100:00100000:0.0:1786109448.458697:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933209088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109448.460473:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933209216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786109448.581792:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786109449.512806:0:190317:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 330712481798 is committed 00010000:00010000:3.0:1786109449.512874:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513217:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36795 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513225:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513233:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109449.513237:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513246:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36795 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513264:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a83abdc00) 00010000:00010000:3.0:1786109449.513267:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109449.513271:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36795 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513278:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca36795 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513297:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca367cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513303:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca367cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513308:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca367cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513313:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6dc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109449.513316:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca367cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513323:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca367cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513331:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a83abdc00) 00010000:00010000:3.0:1786109449.513333:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109449.513336:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca367cd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109449.513343:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca367cd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109449.604694:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786109450.033068:0:191562:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:0.0:1786109450.629895:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109451.653132:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109452.037639:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109452.037862:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933209344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109452.037940:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109452.038085:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933209344 00000100:00100000:1.0:1786109452.038095:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933209344 00000100:00100000:1.0:1786109452.038186:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12287 00000100:00100000:1.0:1786109452.038195:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933209344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109452.038230:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:1.0:1786109452.038289:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933209344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109452.038296:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12287 00000100:00100000:3.0:1786109452.038372:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933209344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109452.551761:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933209472:0@lo:400:kworker.0 00000100:00100000:1.0:1786109452.551859:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109452.551994:0:190321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933209472 00000100:00100000:0.0:1786109452.552003:0:190321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933209472 00000100:00100000:0.0:1786109452.552064:0:190321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786109452.552075:0:190321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933209472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.552998:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933209856:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.553052:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109452.553104:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933209856 00000100:00100000:2.0:1786109452.553110:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933209856 00000100:00100000:2.0:1786109452.553167:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1786109452.553178:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933209856:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109452.553200:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c7b80 x1872862933209856/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:678/0 lens 224/224 e 0 to 0 dl 1786109463 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109452.553241:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933209856:12345-0@lo:400:kworker.0 Request processed in 66us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.553248:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1786109452.553272:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109452.553311:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933209856:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.553347:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933209600:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.553374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109452.553396:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109452.553402:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933209728:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.553422:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109452.553480:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933209600 00000100:00100000:2.0:1786109452.553484:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933209600 00000100:00100000:2.0:1786109452.553528:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933209728 00000100:00100000:2.0:1786109452.553531:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933209728 00000100:00100000:2.0:1786109452.553551:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1786109452.553557:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933209600:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109452.553571:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c5500 x1872862933209600/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:678/0 lens 224/224 e 0 to 0 dl 1786109463 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109452.553604:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933209600:12345-0@lo:400:kworker.0 Request processed in 46us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.553610:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1786109452.553623:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1786109452.553629:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933209728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.553658:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933209728:12345-0@lo:400:kworker.0 Request processed in 30us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.553664:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1786109452.553686:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109452.553689:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109452.553704:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933209728:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.553714:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933209600:0@lo:400:kworker.0 00000100:00100000:0.0:1786109452.553870:0:190321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933209472:12345-0@lo:400:kworker.0 Request processed in 1795us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109452.553880:0:190321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1786109452.554044:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933209472:0@lo:400:kworker.0 00000100:00100000:0.0:1786109452.555012:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933209984:0@lo:400:kworker.0 00000100:00100000:0.0:1786109452.555066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109452.555460:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933209984 00000100:00100000:2.0:1786109452.555467:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933209984 00000100:00100000:2.0:1786109452.555536:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1786109452.555546:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933209984:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1786109452.555634:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109452.559832:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933209984:12345-0@lo:400:kworker.0 Request processed in 4271us (4748us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.559853:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1786109452.559921:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933210112:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.559997:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109452.560043:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933210624:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.560069:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109452.560101:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1786109452.560108:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933210240:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.560136:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109452.560158:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933210752:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.560182:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109452.560217:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933210112 00000100:00100000:2.0:1786109452.560226:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933210112 00000100:00100000:2.0:1786109452.560272:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933210624 00000100:00100000:2.0:1786109452.560275:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933210624 00000100:00100000:2.0:1786109452.560298:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12288 00000100:00100000:2.0:1786109452.560308:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933210112:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109452.560343:0:8452:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c5180 x1872862933210112/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:678/0 lens 224/224 e 0 to 0 dl 1786109463 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109452.560388:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933210112:12345-0@lo:400:kworker.0 Request processed in 81us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.560395:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12288 00000100:00100000:2.0:1786109452.560409:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12289 00000100:00100000:2.0:1786109452.560415:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933210624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.560476:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933210624:12345-0@lo:400:kworker.0 Request processed in 60us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.560482:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12289 00000100:00100000:2.0:1786109452.560502:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933210240 00000100:00100000:2.0:1786109452.560518:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933210240 00000100:00100000:2.0:1786109452.560557:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933210752 00000100:00100000:2.0:1786109452.560560:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933210752 00000100:00100000:2.0:1786109452.560581:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6895 00000100:00100000:2.0:1786109452.560587:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933210240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.560620:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933210240:12345-0@lo:400:kworker.0 Request processed in 34us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.560626:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6895 00000100:00100000:2.0:1786109452.560638:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6896 00000100:00100000:2.0:1786109452.560644:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933210752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.560672:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933210752:12345-0@lo:400:kworker.0 Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.560681:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6896 00000100:00100000:2.0:1786109452.560725:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933210368:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.560753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109452.560775:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933210880:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.560801:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109452.560823:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786109452.560830:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933210496:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.560857:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109452.560877:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933211008:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.560900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109452.560929:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933210368 00000100:00100000:2.0:1786109452.560933:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933210368 00000100:00100000:2.0:1786109452.560959:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933210880 00000100:00100000:2.0:1786109452.560962:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933210880 00000100:00100000:2.0:1786109452.560984:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6897 00000100:00100000:2.0:1786109452.560991:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933210368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.561033:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933210368:12345-0@lo:400:kworker.0 Request processed in 42us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.561039:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6897 00000100:00100000:2.0:1786109452.561050:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6898 00000100:00100000:2.0:1786109452.561057:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933210880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.561085:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933210880:12345-0@lo:400:kworker.0 Request processed in 29us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.561091:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6898 00000100:00100000:2.0:1786109452.561122:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933210496 00000100:00100000:2.0:1786109452.561126:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933210496 00000100:00100000:2.0:1786109452.561152:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933211008 00000100:00100000:2.0:1786109452.561155:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933211008 00000100:00100000:2.0:1786109452.561172:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1786109452.561178:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933210496:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109452.561191:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac173d500 x1872862933210496/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:678/0 lens 224/224 e 0 to 0 dl 1786109463 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109452.561221:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933210496:12345-0@lo:400:kworker.0 Request processed in 43us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.561227:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1786109452.561240:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1786109452.561247:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933211008:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109452.561259:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac173dc00 x1872862933211008/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:678/0 lens 224/224 e 0 to 0 dl 1786109463 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109452.561288:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933211008:12345-0@lo:400:kworker.0 Request processed in 41us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.561294:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1786109452.561350:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933210496:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.561363:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933211008:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.561373:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933210368:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.561383:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933210880:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.561421:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933210240:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.561458:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933210752:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.561473:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933210112:0@lo:400:kworker.0 00000100:00100000:2.0:1786109452.561486:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933210624:0@lo:400:kworker.0 00000100:00080000:1.0:1786109452.561617:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109452.561623:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109452.561812:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933209984:0@lo:400:kworker.0 00010000:00010000:1.0:1786109452.681394:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1786109452.702590:0:191707:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1786109452.702666:0:191707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.702685:0:191707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.702693:0:191707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.702701:0:191707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.703375:0:191707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1786109452.703386:0:191707:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1786109452.703420:0:191707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786109452.703425:0:191707:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1786109452.703468:0:191707:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1786109452.703501:0:191707:0:(import.c:65:import_set_state_nolock()) ffff930ab2828000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1786109452.703592:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933211136:0@lo:39:umount.0 00000100:00100000:2.0:1786109452.703686:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786109452.705407:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109452.705425:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.705467:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2000 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:1.0:1786109452.705474:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.705487:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786109452.705496:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109452.705513:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1786109452.705517:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1786109452.705521:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1786109452.705569:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.705576:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109452.705610:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.705618:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac16c2000/0xdb52b77d7ca363cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca363d6 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.705632:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109452.705634:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109452.705635:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109452.705644:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109452.705660:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933211264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109452.705724:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109452.705791:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933211264 00000100:00100000:1.0:1786109452.705799:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933211264 00000100:00100000:1.0:1786109452.705858:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4502 00000100:00100000:1.0:1786109452.705869:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933211264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109452.705885:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109452.705904:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0ace200/0xdb52b77d7ca363d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca363cf expref: 24 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.705919:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109452.705958:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3649:x1872862933211264:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109452.705966:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4502 00000100:00100000:1.0:1786109452.706014:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933211264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109452.708847:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933211136 00000100:00100000:3.0:1786109452.708861:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933211136 00000100:00100000:3.0:1786109452.709000:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:3.0:1786109452.709012:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872862933211136:12345-0@lo:39:umount.0 00000020:00000080:3.0:1786109452.709063:0:187901:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca364d2 00000100:00080000:3.0:1786109452.709083:0:187901:0:(import.c:65:import_set_state_nolock()) ffff930ab9960000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1786109452.709859:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:3.0:1786109452.710021:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac173f480 x1872862933211136/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:678/0 lens 224/224 e 0 to 0 dl 1786109463 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109452.710264:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab2828000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1786109452.710280:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933211136:0@lo:39:umount.0 00000100:00100000:3.0:1786109452.710340:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1872862933211136:12345-0@lo:39:umount.0 Request processed in 1329us (6652us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109452.710349:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000020:00000080:3.0:1786109452.710362:0:187901:0:(genops.c:906:class_export_put()) final put ffff930ab9965000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1786109452.710425:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab9965000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1786109452.710518:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab9960000 for lustre-MDT0000 00000100:00080000:3.0:1786109452.710724:0:191707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786109452.710798:0:191707:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1786109452.710804:0:191707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1786109452.712342:0:191707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.712361:0:191707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.712369:0:191707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.712376:0:191707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.712529:0:191707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109452.712538:0:191707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.712550:0:191707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.712556:0:191707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.712562:0:191707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.712664:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786109452.712675:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.712683:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3800 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:1.0:1786109452.712687:0:29734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.712697:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786109452.712705:0:29734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109452.712713:0:29734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1786109452.712716:0:29734:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1786109452.712763:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.712770:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109452.712804:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.712812:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca362f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca362fd expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.712827:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109452.712831:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.712836:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab295f800 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:1.0:1786109452.712838:0:29734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.712844:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786109452.712850:0:29734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109452.712854:0:29734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1786109452.712856:0:29734:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1786109452.712868:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.712873:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109452.712890:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.712897:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109452.712898:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109452.712900:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109452.712908:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109452.712928:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933211520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109452.713013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109452.713094:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933211520 00000100:00100000:1.0:1786109452.713102:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933211520 00000100:00100000:2.0:1786109452.713238:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109452.713272:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933211392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109452.713307:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109452.714060:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933211392 00000100:00100000:1.0:1786109452.714067:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933211392 00000100:00100000:1.0:1786109452.714102:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4503 00000100:00100000:1.0:1786109452.714112:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933211520:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109452.714513:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4504 00000100:00100000:2.0:1786109452.714526:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933211392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109452.714536:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109452.714560:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0acfc00/0xdb52b77d7ca362fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca362f6 expref: 24 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109452.714576:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109452.714639:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3648:x1872862933211392:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.714647:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4504 00000100:00100000:2.0:1786109452.714697:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933211392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109452.715123:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109452.715208:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c3e00/0xdb52b77d7ca36400 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca363f9 expref: 22 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.715221:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109452.715269:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3647:x1872862933211520:12345-0@lo:103:ldlm_bl.0 Request processed in 1158us (2255us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109452.715276:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4503 00000100:00100000:0.0:1786109452.715350:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933211520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109452.715766:0:191707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109452.715776:0:191707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab295f800/0xdb52b77d7ca363f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36400 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109452.715789:0:191707:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1786109452.715801:0:191707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.715809:0:191707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.715817:0:191707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.715823:0:191707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.715876:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109452.715883:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.715896:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0acf000 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:1.0:1786109452.715900:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.715908:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786109452.715914:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109452.715920:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1786109452.715923:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1786109452.715953:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.715960:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1786109452.716009:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1786109452.716096:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.716106:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109452.716108:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109452.716110:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109452.716209:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933211648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109452.716264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786109452.716415:0:191707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109452.716420:0:191707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0acf000/0xdb52b77d7ca363c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca363c8 expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109452.716462:0:191707:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1786109452.716470:0:191707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.716478:0:191707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.716484:0:191707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.716490:0:191707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109452.716569:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109452.716576:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109452.716583:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76c00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:0.0:1786109452.716587:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109452.716595:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786109452.716602:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109452.716608:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1786109452.716610:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1786109452.716626:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109452.716631:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1786109452.716671:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933211776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109452.716701:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786109452.716737:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109452.716747:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109452.716748:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109452.716750:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109452.716883:0:191707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109452.716888:0:191707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca362e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca362ef expref: -99 pid: 190316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109452.716897:0:191707:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1786109452.716901:0:191707:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1786109452.716905:0:191707:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1786109452.716954:0:191707:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1786109452.716959:0:191707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1786109452.716964:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1786109452.716970:0:191707:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1786109452.717970:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109452.718538:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933211648 00000100:00100000:1.0:1786109452.718551:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933211648 00000100:00100000:1.0:1786109452.718802:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933211776 00000100:00100000:1.0:1786109452.718807:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933211776 00000100:00100000:2.0:1786109452.718820:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4505 00000100:00100000:2.0:1786109452.718839:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3646:x1872862933211648:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109452.718848:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4506 00000100:00100000:1.0:1786109452.718854:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3648:x1872862933211776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109452.718862:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109452.718862:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109452.718882:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab295e000/0xdb52b77d7ca362ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca362e1 expref: 22 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109452.718883:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0ace600/0xdb52b77d7ca363c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca363c1 expref: 22 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109452.718898:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109452.718898:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00000080:3.0:1786109452.719576:0:191707:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:3.0:1786109452.719878:0:191707:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1786109452.719887:0:191707:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930ab9962800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786109452.719893:0:191707:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930ab7ce8000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786109452.719898:0:191707:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930ab7cef800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786109452.719904:0:191707:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930ab31ef000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 326417514497 stale:0 00000020:00080000:3.0:1786109452.719915:0:191707:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930ab31e9800 397d331e-10fc-4558-be87-308c3622e8eb 192.168.203.38@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 330712481798 stale:0 00000020:00080000:3.0:1786109452.719920:0:191707:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff930ab99d4d40) has exports, disconnecting them 00000020:00080000:3.0:1786109452.719926:0:191707:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930ab9962800), last request at 1786109411 00000020:00000080:3.0:1786109452.719932:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca364cb 00000100:00080000:3.0:1786109452.719944:0:191707:0:(import.c:65:import_set_state_nolock()) ffff930ab9963000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1786109452.719970:0:191707:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab9962800): rc 0 00010000:00010000:0.0:1786109452.720008:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786109452.720029:0:191707:0:(genops.c:906:class_export_put()) final put ffff930ab9962800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1786109452.720047:0:191707:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930ab7ce8000), last request at 1786109452 00000020:00000080:3.0:1786109452.720050:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca364c4 00000100:00080000:3.0:1786109452.720055:0:191707:0:(import.c:65:import_set_state_nolock()) ffff930ab7ced800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1786109452.720067:0:191707:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab7ce8000): rc 0 00000020:00000080:3.0:1786109452.720070:0:191707:0:(genops.c:906:class_export_put()) final put ffff930ab7ce8000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1786109452.720073:0:191707:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930ab7cef800), last request at 1786109452 00000020:00000080:3.0:1786109452.720075:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca364bd 00000100:00080000:3.0:1786109452.720080:0:191707:0:(import.c:65:import_set_state_nolock()) ffff930ab7cee000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1786109452.720087:0:191707:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab7cef800): rc 0 00000020:00000080:3.0:1786109452.720089:0:191707:0:(genops.c:906:class_export_put()) final put ffff930ab7cef800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1786109452.720092:0:191707:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930ab31ef000), last request at 1786109406 00000020:00000080:3.0:1786109452.720098:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36343 00000100:00080000:3.0:1786109452.720107:0:191707:0:(import.c:65:import_set_state_nolock()) ffff930ab1982000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1786109452.720216:0:191707:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab31ef000): rc 0 00000020:00000080:3.0:1786109452.720219:0:191707:0:(genops.c:906:class_export_put()) final put ffff930ab31ef000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1786109452.720223:0:191707:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.38@tcp (ffff930ab31e9800), last request at 1786109448 00000020:00000080:3.0:1786109452.720227:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3633c 00000020:00010000:3.0:1786109452.720234:0:191707:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930ab31e9800: total 4 00000100:00080000:3.0:1786109452.720238:0:191707:0:(import.c:65:import_set_state_nolock()) ffff93098e512800 : changing import state from FULL to CLOSED 00000004:00080000:3.0:1786109452.720324:0:191707:0:(mdd_object.c:3897:mdd_close()) Object [0x20001a9e3:0x1de2:0x0] is retained in orphan list 00000020:00080000:3.0:1786109452.720333:0:191707:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.38@tcp (ffff930ab31e9800): rc 0 00000004:00000080:3.0:1786109452.720339:0:191707:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa66f085afae0 00000100:00080000:3.0:1786109452.720359:0:191707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1786109452.720364:0:191707:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804567 gen 3 00000100:00100000:1.0:1786109452.720400:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:3648:x1872862933211776:12345-0@lo:103:ldlm_bl.0 Request processed in 1543us (3695us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109452.720410:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4506 00000020:00010000:1.0:1786109452.720459:0:6514:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930ab31e9800: total 4 00010000:00010000:1.0:1786109452.720558:0:6514:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930ab31e9800, canceled 0 locks, left on hash table 4. 00000100:00100000:2.0:1786109452.720754:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3646:x1872862933211648:12345-0@lo:103:ldlm_bl.0 Request processed in 1922us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109452.720762:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4505 00000020:00000080:0.0:1786109452.720824:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab9962800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:2.0:1786109452.720850:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933211648:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1786109452.720877:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab7ce8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109452.720902:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab7cef800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109452.720918:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab31ef000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00010000:00010000:1.0:1786109452.720930:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0ace400/0xdb52b77d7ca3651f lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494c69 expref: 5 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109452.720949:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca36518 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 4 pid: 190351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1786109452.720950:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab9963000 for lustre-MDT0000 00000020:00000080:0.0:1786109452.720956:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab7ced800 for lustre-MDT0000 00000020:00000080:0.0:1786109452.720960:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab7cee000 for lustre-MDT0000 00000020:00000080:0.0:1786109452.720965:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab1982000 for lustre-MDT0000 00010000:00010000:1.0:1786109452.720970:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca36709 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14ec expref: 3 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109452.720977:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109452.720983:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca366fb lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1de0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14e5 expref: 2 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109452.720983:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109452.720987:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109452.720997:0:6514:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930ab31e9800, canceled 4 locks, left on hash table 0. 00000100:00100000:0.0:1786109452.722227:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933211776:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1786109452.722943:0:191707:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1786109452.722983:0:191707:0:(import.c:65:import_set_state_nolock()) ffff93098e162800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1786109452.723066:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933211904:0@lo:39:umount.0 00000100:00100000:2.0:1786109452.723314:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109452.723418:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933211904 00000100:00100000:3.0:1786109452.723460:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933211904 00000100:00100000:3.0:1786109452.723532:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12290 00000100:00100000:3.0:1786109452.723541:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933211904:12345-0@lo:39:umount.0 00000020:00000080:3.0:1786109452.723575:0:8452:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36382 00000100:00080000:3.0:1786109452.723584:0:8452:0:(import.c:65:import_set_state_nolock()) ffff930ac125d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786109452.723612:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769804567 00010000:00010000:0.0:1786109452.725822:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109452.725956:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3645:x1872862933211904:12345-0@lo:39:umount.0 Request processed in 2406us (2634us total) trans 25769804568 rc 0/0 00000100:00100000:3.0:1786109452.725972:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12290 00000100:00080000:0.0:1786109452.726032:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098e162800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1786109452.726045:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933211904:0@lo:39:umount.0 00000100:00080000:2.0:1786109452.726125:0:191707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1786109452.726213:0:191707:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738458 gen 3 00000004:00080000:2.0:1786109452.726238:0:191707:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1786109452.726325:0:191707:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1786109452.726633:0:191707:0:(import.c:65:import_set_state_nolock()) ffff930981dbd000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1786109452.726691:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933212032:0@lo:9:umount.0 00000100:00100000:0.0:1786109452.726841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109452.726897:0:191707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1786109452.726900:0:191707:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975821 gen 3 00000004:00080000:2.0:1786109452.726911:0:191707:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1786109452.727023:0:191707:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1786109452.727034:0:191707:0:(import.c:65:import_set_state_nolock()) ffff93098e164800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1786109452.727095:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933212032 00000100:00100000:3.0:1786109452.727103:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933212032 00000100:00100000:3.0:1786109452.727253:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23073 00000100:00100000:3.0:1786109452.727265:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933212032:12345-0@lo:9:umount.0 00000020:00000080:3.0:1786109452.727300:0:43911:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3639e 00000100:00080000:3.0:1786109452.727310:0:43911:0:(import.c:65:import_set_state_nolock()) ffff930ac0c8d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786109452.727373:0:43911:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738458 00000100:00100000:0.0:1786109452.727675:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933212160:0@lo:9:umount.0 00000100:00100000:0.0:1786109452.727706:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1786109452.727861:0:191707:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff930ab99d4d40) has no exports 00000100:00100000:3.0:1786109452.727921:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3645:x1872862933212032:12345-0@lo:9:umount.0 Request processed in 658us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109452.727929:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23073 00000100:00100000:3.0:1786109452.727944:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933212160 00000100:00100000:3.0:1786109452.727949:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933212160 00000100:00100000:3.0:1786109452.727981:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23074 00000100:00100000:3.0:1786109452.727988:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933212160:12345-0@lo:9:umount.0 00000020:00000080:3.0:1786109452.728003:0:43911:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca363ac 00000100:00080000:3.0:1786109452.728008:0:43911:0:(import.c:65:import_set_state_nolock()) ffff930985f25000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786109452.728036:0:43911:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975821 00000100:00100000:3.0:1786109452.728114:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3645:x1872862933212160:12345-0@lo:9:umount.0 Request processed in 127us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109452.728121:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23074 00010000:00010000:3.0:1786109452.728664:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1786109452.728749:0:191707:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff930ab99d4d40) has no exports 00000100:00080000:0.0:1786109452.732852:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981dbd000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1786109452.733891:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1786109452.737262:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109452.737286:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933212032:0@lo:9:umount.0 00000100:00080000:0.0:1786109452.737376:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098e164800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1786109452.737394:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1786109452.737396:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109452.737399:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933212160:0@lo:9:umount.0 00010000:00010000:0.0:1786109452.737425:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786109452.751491:0:6514:0:(genops.c:906:class_export_put()) final put ffff930ab31e9800/397d331e-10fc-4558-be87-308c3622e8eb 00010000:00010000:1.0:1786109452.751564:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109452.751567:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109452.751571:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786109452.751817:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab31e9800/397d331e-10fc-4558-be87-308c3622e8eb for lustre-MDT0000 00000020:00000080:0.0:1786109452.752012:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098e512800 for lustre-MDT0000 00000020:00000080:2.0:1786109452.781961:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36358 00000020:00000080:2.0:1786109452.781983:0:191707:0:(genops.c:906:class_export_put()) final put ffff93098617f000/lustre-QMT0000_UUID 00000020:01000000:2.0:1786109452.782005:0:191707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1786109452.782018:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786109452.782033:0:191707:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1786109452.782041:0:191707:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff930984ea8000) has no exports 00000020:00000080:0.0:1786109452.782241:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff93098617f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1786109452.782791:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36351 00000020:00000080:2.0:1786109452.782798:0:191707:0:(genops.c:906:class_export_put()) final put ffff930ac096c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786109452.782858:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac096c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1786109452.782933:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786109452.782943:0:191707:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1786109452.782947:0:191707:0:(genops.c:906:class_export_put()) final put ffff93098e2ba800/lustre-QMT0000_UUID 00000020:00000080:2.0:1786109452.782950:0:191707:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e2ba800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1786109452.782959:0:191707:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1786109452.783123:0:191707:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ac0f1f480 - data ffff930aa412b948/ffff930ac12dac00 00000020:01000000:2.0:1786109452.783359:0:191707:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930982519540 - data ffff930aa43600d8/ffff930983f63400 00000100:00080000:3.0:1786109452.840706:0:191707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1786109452.840718:0:191707:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804567 gen 4 00000100:00100000:3.0:1786109452.841544:0:191707:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff930ac1706680 x1872862933211904/t25769804568(25769804568) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109462 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109452.841667:0:191707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1786109452.844603:0:191707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1786109452.844613:0:191707:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738458 gen 4 00000004:00080000:0.0:1786109452.844628:0:191707:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109452.844631:0:191707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1786109452.845081:0:190336:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1786109452.845087:0:190336:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x134:0x0] index 1 count 1 00000040:00080000:1.0:1786109452.845101:0:190336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 77 count 2 00000100:00080000:0.0:1786109452.846288:0:191707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1786109452.846295:0:191707:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975821 gen 4 00000004:00080000:0.0:1786109452.846321:0:191707:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109452.846323:0:191707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1786109452.847291:0:190338:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1786109452.847298:0:190338:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x136:0x0] index 2 count 1 00000040:00080000:1.0:1786109452.847312:0:190338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 77 count 2 00000020:00000080:1.0:1786109452.858092:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36312 00000020:00000080:1.0:1786109452.858105:0:191707:0:(genops.c:906:class_export_put()) final put ffff93098c88e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786109452.858937:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff93098c88e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1786109452.861548:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36327 00000020:00000080:1.0:1786109452.861568:0:191707:0:(genops.c:906:class_export_put()) final put ffff930a87ba5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1786109452.861658:0:191707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1786109452.861665:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109452.861678:0:191707:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786109452.861683:0:191707:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff930ab99d0000) has no exports 00000020:00000080:0.0:1786109452.861798:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87ba5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1786109452.862335:0:191707:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1786109452.862347:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca363a5 00000020:00000080:1.0:1786109452.862354:0:191707:0:(genops.c:906:class_export_put()) final put ffff930985f26000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1786109452.862361:0:191707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1786109452.862365:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109452.862374:0:191707:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1786109452.862378:0:191707:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff930a97cb8000) has no exports 00000020:00000080:1.0:1786109452.862386:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36397 00000020:00000080:0.0:1786109452.862388:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930985f26000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1786109452.862390:0:191707:0:(genops.c:906:class_export_put()) final put ffff930981db8800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786109452.862397:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930981db8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1786109452.864357:0:191707:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1786109452.864366:0:191707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1786109452.864371:0:191707:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975821 gen 5 00000004:00080000:1.0:1786109452.864380:0:191707:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786109452.864383:0:191707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786109452.865598:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109452.865621:0:191707:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786109452.865633:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36389 00000020:00000080:1.0:1786109452.865645:0:191707:0:(genops.c:906:class_export_put()) final put ffff93098e515000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786109452.866029:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098e164800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1786109452.866038:0:171804:0:(genops.c:906:class_export_put()) final put ffff93098e514000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786109452.866041:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e514000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1786109452.866055:0:171804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1786109452.866832:0:191707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1786109452.866840:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109452.866850:0:191707:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1786109452.866855:0:191707:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff93098272cd40) has no exports 00000020:00000080:1.0:1786109452.866864:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3637b 00000020:00000080:1.0:1786109452.866870:0:191707:0:(genops.c:906:class_export_put()) final put ffff930981db9800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1786109452.867073:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e515000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1786109452.868660:0:191707:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1786109452.868670:0:191707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1786109452.868675:0:191707:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738458 gen 5 00000004:00080000:1.0:1786109452.868685:0:191707:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786109452.868688:0:191707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786109452.868924:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930981db9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1786109452.869242:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109452.869258:0:191707:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1786109452.869281:0:191707:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1786109452.869294:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3636d 00000020:00000080:3.0:1786109452.869531:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930981dbd000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1786109452.869541:0:171804:0:(genops.c:906:class_export_put()) final put ffff93098e167000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786109452.869544:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e167000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1786109452.869552:0:171804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786109452.870080:0:191707:0:(genops.c:906:class_export_put()) final put ffff930a83bb9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1786109452.870091:0:191707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1786109452.870095:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109452.870104:0:191707:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1786109452.870108:0:191707:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff930982728000) has no exports 00000020:00000080:1.0:1786109452.870116:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36366 00000020:00000080:1.0:1786109452.870120:0:191707:0:(genops.c:906:class_export_put()) final put ffff93098e166000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1786109452.870644:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930a83bb9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1786109452.870653:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e166000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1786109452.890958:0:191707:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1786109452.890971:0:191707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1786109452.890976:0:191707:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 25769804567 gen 5 00000100:00100000:1.0:1786109452.890987:0:191707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786109452.891052:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109452.891070:0:191707:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109452.891074:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098e162800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1786109452.891085:0:171804:0:(genops.c:906:class_export_put()) final put ffff93098e160800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786109452.891089:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e160800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1786109452.891102:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109452.891105:0:191707:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1786109452.891106:0:171804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786109452.891109:0:191707:0:(genops.c:906:class_export_put()) final put ffff930ab282d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786109452.891111:0:191707:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab282d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1786109452.891118:0:191707:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786109452.891238:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3632e 00000020:00000080:1.0:1786109452.891245:0:191707:0:(genops.c:906:class_export_put()) final put ffff930a87ba4800/lustre-MDD0000_UUID 00000020:01000000:1.0:1786109452.891266:0:191707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1786109452.891271:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109452.891277:0:191707:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786109452.891282:0:191707:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff930ab99d19c0) has no exports 00000020:00000080:1.0:1786109452.891307:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109452.891311:0:191707:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1786109452.891316:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36335 00000020:00000080:1.0:1786109452.891322:0:191707:0:(genops.c:906:class_export_put()) final put ffff93098c88f800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1786109452.891339:0:191707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930ab28f1800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1786109452.891343:0:191707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab28f1800 3 00000020:01000004:1.0:1786109452.891347:0:191707:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff930ab28f1800 from lustre-MDT0000 00000020:00000080:3.0:1786109452.891352:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87ba4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1786109452.891356:0:171804:0:(genops.c:906:class_export_put()) final put ffff93098c88d800/lustre-MDD0000_UUID 00000020:00000080:3.0:1786109452.891358:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff93098c88d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1786109452.891362:0:171804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1786109452.891368:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109452.891387:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff93098c88f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1786109452.891391:0:191707:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1786109452.891394:0:191707:0:(genops.c:906:class_export_put()) final put ffff93098c889800/lustre-MDT0000_UUID 00000020:00000080:1.0:1786109452.891396:0:191707:0:(genops.c:865:class_export_destroy()) destroying export ffff93098c889800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1786109452.891403:0:191707:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1786109452.891569:0:191707:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1786109452.894540:0:191707:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1786109452.894557:0:191707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1786109452.895144:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109452.895232:0:191707:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1786109452.895243:0:191707:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff930ab2abd800 aeab97cc-8463-4daa-a678-1bb2ad93cc69 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786109452.895255:0:191707:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff930ab282e800 fea1ac35-e793-43ec-a86d-d40dc5658dad 192.168.203.38@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786109452.895261:0:191707:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff93098272b380) has exports, disconnecting them 00000020:00080000:0.0:1786109452.895266:0:191707:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff930ab2abd800), last request at 1786109405 00000020:00000080:0.0:1786109452.895296:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca362da 00000020:00010000:0.0:1786109452.895304:0:191707:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930ab2abd800: total 0 00000100:00080000:0.0:1786109452.895309:0:191707:0:(import.c:65:import_set_state_nolock()) ffff930ab2abb000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786109452.895335:0:191707:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab2abd800): rc 0 00000020:00080000:0.0:1786109452.895339:0:191707:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.38@tcp (ffff930ab282e800), last request at 1786109402 00000020:00000080:0.0:1786109452.895390:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca362b7 00000020:00010000:0.0:1786109452.895394:0:191707:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930ab282e800: total 0 00000100:00080000:0.0:1786109452.895397:0:191707:0:(import.c:65:import_set_state_nolock()) ffff930ab282a800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786109452.895404:0:191707:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.38@tcp (ffff930ab282e800): rc 0 00000020:00080000:0.0:1786109452.895412:0:191707:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff93098272b380) has no exports 00000100:00100000:1.0:1786109452.895563:0:190321:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff930982478000:190321] 0 exiting: rc = 1 00000100:00100000:0.0:1786109452.895754:0:190329:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff930ab9957400:190329] 3 exiting: rc = 0 00000100:00100000:0.0:1786109452.895831:0:190322:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff930982478e00:190322] 1 exiting: rc = 0 00000020:00010000:3.0:1786109452.895926:0:10402:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930ab2abd800: total 0 00010000:00010000:3.0:1786109452.895988:0:10402:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930ab2abd800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1786109452.896025:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c3200/0xdb52b77d7ca36462 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3645b expref: 14 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896045:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab295e600/0xdb52b77d7ca36470 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36469 expref: 13 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896060:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab295fa00/0xdb52b77d7ca3647e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36477 expref: 12 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896072:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c2200/0xdb52b77d7ca3640e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36407 expref: 11 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896083:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd76200/0xdb52b77d7ca3648c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36485 expref: 10 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896095:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd76a00/0xdb52b77d7ca3641c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36415 expref: 9 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896106:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0acea00/0xdb52b77d7ca3649a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36493 expref: 8 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896118:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd77600/0xdb52b77d7ca3642a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36423 expref: 7 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896129:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c2800/0xdb52b77d7ca364a8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca364a1 expref: 6 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896143:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c3000/0xdb52b77d7ca36438 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36431 expref: 5 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896274:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca364b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca364af expref: 4 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896285:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca36454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3644d expref: 3 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896295:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab295e200/0xdb52b77d7ca36446 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3643f expref: 2 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896305:0:10402:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930ab2abd800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1786109452.896327:0:10402:0:(genops.c:906:class_export_put()) final put ffff930ab2abd800/aeab97cc-8463-4daa-a678-1bb2ad93cc69 00000020:00010000:3.0:1786109452.896347:0:10402:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930ab282e800: total 1 00010000:00010000:3.0:1786109452.896366:0:10402:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930ab282e800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1786109452.896384:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca362c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14c2 expref: 5 pid: 190323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896397:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab295f600/0xdb52b77d7ca362d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14d0 expref: 4 pid: 190322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896413:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd76e00/0xdb52b77d7ca362cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14c9 expref: 3 pid: 190321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896452:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd77a00/0xdb52b77d7ca363f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14d7 expref: 2 pid: 190329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109452.896464:0:10402:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930ab282e800, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1786109452.896476:0:10402:0:(genops.c:906:class_export_put()) final put ffff930ab282e800/fea1ac35-e793-43ec-a86d-d40dc5658dad 00010000:00010000:3.0:1786109452.896482:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109452.896484:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109452.896486:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109452.896494:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786109452.896619:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2abd800/aeab97cc-8463-4daa-a678-1bb2ad93cc69 for MGS 00000020:00000080:0.0:1786109452.896790:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab282e800/fea1ac35-e793-43ec-a86d-d40dc5658dad for MGS 00000020:00000080:0.0:1786109452.896808:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab2abb000 for MGS 00000020:00000080:0.0:1786109452.896812:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab282a800 for MGS 00000100:00100000:2.0:1786109452.897017:0:190323:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff930982479a00:190323] 2 exiting: rc = 0 00000100:00100000:1.0:1786109452.897897:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897907:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897914:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897921:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897928:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897935:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897942:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897948:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897955:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897962:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897969:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897976:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897983:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897989:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.897996:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898002:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898007:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898014:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898020:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898027:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898034:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898041:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898047:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898054:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898061:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898067:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898073:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898079:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898085:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898092:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898098:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898104:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898111:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898118:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898124:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898130:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898136:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898142:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898147:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898347:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898355:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898361:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898367:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898373:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898380:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898388:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898394:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898400:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898406:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898412:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898417:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898423:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898482:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898490:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898498:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898577:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898584:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898591:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898597:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898604:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898610:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898617:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898622:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786109452.898855:0:191707:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1786109452.903276:0:191707:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9309827721e0 - data ffff93098a388bd0/ffff930985cc3400 00000020:01000000:0.0:1786109452.903462:0:191707:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ac0ab5e40 - data ffff930abfaa5bd0/ffff9309849c9800 00000020:00000080:0.0:1786109452.904317:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca362b0 00000020:00000080:0.0:1786109452.904331:0:191707:0:(genops.c:906:class_export_put()) final put ffff930ab19f9000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1786109452.904349:0:191707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930ab28f1800 from MGS, refs=2 00000020:01000004:0.0:1786109452.904353:0:191707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab28f1800 2 00000020:01000004:0.0:1786109452.904357:0:191707:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff930ab28f1800 from MGS 00000020:00000080:0.0:1786109452.904382:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109452.904391:0:191707:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1786109452.904394:0:191707:0:(genops.c:906:class_export_put()) final put ffff930ab99c4000/MGS 00000020:00000080:0.0:1786109452.904397:0:191707:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab99c4000/MGS for MGS 00000020:01000000:0.0:1786109452.904409:0:191707:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1786109452.904612:0:191707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1786109452.904617:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109452.904758:0:191707:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1786109452.904768:0:191707:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff930985f22000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786109452.904776:0:191707:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff930a97cbb380) has exports, disconnecting them 00000020:00080000:0.0:1786109452.904782:0:191707:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff930985f22000), last request at 1786109406 00000020:00000080:0.0:1786109452.904787:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca363e4 00000020:00080000:0.0:1786109452.904800:0:191707:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930985f22000): rc 0 00000020:00000080:0.0:1786109452.904806:0:191707:0:(genops.c:906:class_export_put()) final put ffff930985f22000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1786109452.905607:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab19f9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1786109452.905621:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930985f22000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1786109452.938788:0:191707:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1786109452.938800:0:191707:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109452.938806:0:191707:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1786109452.938817:0:191707:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786109452.939038:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109452.939057:0:191707:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1786109452.939068:0:191707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab28f1800 1 00000020:00000080:0.0:1786109452.939077:0:191707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca362a2 00000020:00000080:0.0:1786109452.939088:0:191707:0:(genops.c:906:class_export_put()) final put ffff930ab99c1000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1786109452.939117:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab2828000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1786109452.939124:0:171804:0:(genops.c:906:class_export_put()) final put ffff930985f22800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1786109452.939128:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930985f22800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1786109452.939135:0:171804:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1786109452.939965:0:191707:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1786109452.939974:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109452.939981:0:191707:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786109452.939987:0:191707:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9309827299c0) has no exports 00000020:00000080:3.0:1786109452.940289:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab99c1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1786109452.974562:0:191707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109452.974580:0:191707:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1786109452.974587:0:191707:0:(genops.c:906:class_export_put()) final put ffff930ab19fe000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1786109452.974593:0:191707:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab19fe000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1786109452.974608:0:191707:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1786109452.974912:0:191707:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff930ab19fb000 00000020:02000400:1.0:1786109452.974990:0:191707:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1786109453.061181:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933212288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109453.061273:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109453.061342:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933212416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109453.061372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109453.061422:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933212288 00000100:00100000:1.0:1786109453.061449:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933212288 00000100:00100000:1.0:1786109453.061518:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933212416 00000100:00100000:1.0:1786109453.061522:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933212416 00000100:00100000:1.0:1786109453.061546:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5771 00000100:00100000:1.0:1786109453.061556:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933212288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109453.061594:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109453.061648:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933212288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109453.061655:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5771 00000100:00100000:1.0:1786109453.061673:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5772 00000100:00100000:1.0:1786109453.061680:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933212416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109453.061699:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109453.061734:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933212416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109453.061740:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5772 00000100:00100000:1.0:1786109453.061798:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933212416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109453.061832:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933212288:0@lo:13:osp-pre-0-1.0 00000400:00000100:3.0:1786109453.327322:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922084352 offset 0 length 224: 4 00000100:00100000:3.0:1786109453.327377:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109453.328137:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109453.328966:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922084608 00000100:00100000:0.0:1786109453.328969:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922084864 00000100:00100000:2.0:1786109453.328980:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922084608 00000100:00100000:0.0:1786109453.328980:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922084864 00000100:00100000:0.0:1786109453.329065:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6899 00000100:00100000:0.0:1786109453.329078:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922084864:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109453.329177:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922084864:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 102us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109453.329186:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6899 00000100:00100000:2.0:1786109453.329927:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:2.0:1786109453.329939:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922084608:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109453.329986:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922084608:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 51us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109453.329993:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 146 00000100:00080000:1.0:1786109453.330389:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109453.330397:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109453.332529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109453.332643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109453.332722:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922084736 00000100:00100000:0.0:1786109453.332734:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922084736 00000100:00100000:0.0:1786109453.332818:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6900 00000100:00100000:0.0:1786109453.332831:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922084736:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109453.332915:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922084736:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 86us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109453.332923:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6900 00000100:00080000:1.0:1786109453.333038:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109453.333122:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922084480 00000100:00100000:3.0:1786109453.333127:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922084480 00000100:00100000:3.0:1786109453.333204:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 931 00000100:00100000:3.0:1786109453.333288:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1872862922084480:12345-192.168.203.38@tcp:400:kworker.0 00000020:00080000:3.0:1786109453.333295:0:188678:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.38@tcp 00000100:00100000:3.0:1786109453.333326:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2402:x1872862922084480:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 40us (906us total) trans 0 rc -107/-107 00000100:00100000:3.0:1786109453.333337:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 931 00000100:00100000:2.0:1786109453.336339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109453.336554:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922084992 00000100:00100000:3.0:1786109453.336566:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922084992 00000100:00100000:2.0:1786109453.336748:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 932 00000100:00100000:2.0:1786109453.336758:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922084992:12345-192.168.203.38@tcp:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1786109453.336788:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109453.336877:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922084992:12345-192.168.203.38@tcp:38:ptlrpcd_00_00.0 Request processed in 119us (558us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109453.336885:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 932 00000100:00100000:3.0:1786109453.572870:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109453.572905:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933212544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109453.572997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109453.573125:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933212544 00000100:00100000:1.0:1786109453.573135:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933212544 00000100:00100000:1.0:1786109453.573196:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12291 00000100:00100000:1.0:1786109453.573207:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1872862933212544:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1786109453.573216:0:179257:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109453.573272:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1872862933212544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (275us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109453.573279:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12291 00000100:02020000:1.0:1786109453.573323:0:3646:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1786109453.573330:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786109453.573335:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1786109453.573340:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1786109453.573347:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109453.573352:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8268 00000100:00080000:1.0:1786109453.573360:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109453.573386:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7c52680 x1872862933212672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109453.573420:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933212672:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1786109453.573471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109453.573515:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933212672 00000100:00100000:1.0:1786109453.573520:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933212672 00000100:00100000:1.0:1786109453.573543:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12292 00000100:00100000:1.0:1786109453.573548:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933212672:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1786109453.573571:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109453.573605:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933212672:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 56us (133us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109453.573612:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12292 00000100:00080000:1.0:1786109453.573642:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109453.573647:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109453.573651:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933212672:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1786109453.702415:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109454.725178:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109455.748601:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109456.781806:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109457.668701:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933212800:0@lo:400:kworker.0 00000100:00080000:3.0:1786109457.668724:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109457.668731:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000400:00000100:1.0:1786109457.668779:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933212800 offset 0 length 224: 4 00000100:00100000:1.0:1786109457.668874:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933213312:0@lo:400:kworker.0 00000100:00100000:1.0:1786109457.668913:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786109457.669032:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109457.669042:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8310 00000100:00080000:3.0:1786109457.669048:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1786109457.669057:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109457.669077:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933212928:0@lo:400:kworker.0 00000100:00100000:3.0:1786109457.669090:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c20380 x1872862933213440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109457.669132:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933213184:0@lo:400:kworker.0 00000100:00100000:3.0:1786109457.669198:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933213440:0@lo:38:kworker.0 00000100:00100000:3.0:1786109457.669265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109457.669327:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933213056:0@lo:400:kworker.0 00000100:00100000:0.0:1786109457.669369:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933213440 00000100:00100000:0.0:1786109457.669380:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933213440 00000100:00100000:3.0:1786109457.669958:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12293 00000100:00100000:3.0:1786109457.669968:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933213440:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109457.669995:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109457.670064:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933213440:12345-0@lo:38:kworker.0 Request processed in 95us (799us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109457.670076:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12293 00000100:00080000:3.0:1786109457.670125:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109457.670130:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109457.670134:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933213440:0@lo:38:kworker.0 00000100:00100000:1.0:1786109457.670636:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109457.670650:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933213568:0@lo:400:kworker.0 00000100:00100000:0.0:1786109457.670661:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109457.670691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109457.670727:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933213568 00000100:00100000:1.0:1786109457.670734:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933213568 00000100:00100000:1.0:1786109457.670792:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6901 00000100:00100000:1.0:1786109457.670804:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933213568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109457.670857:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933213568:12345-0@lo:400:kworker.0 Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109457.670864:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6901 00000100:00100000:1.0:1786109457.670902:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933213568:0@lo:400:kworker.0 00000100:00080000:3.0:1786109457.670961:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109457.672352:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933213312 00000100:00100000:2.0:1786109457.672366:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933213312 00000100:00100000:3.0:1786109457.672369:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933212928 00000100:00100000:3.0:1786109457.672377:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933212928 00000100:00100000:2.0:1786109457.672456:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1786109457.672481:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933213312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109457.672508:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:3.0:1786109457.672515:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1872862933212928:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1786109457.672523:0:187899:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109457.672967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109457.673083:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933213312:12345-0@lo:400:kworker.0 Request processed in 615us (4167us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109457.673092:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1786109457.673221:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1872862933212928:12345-0@lo:400:kworker.0 Request processed in 704us (2560us total) trans 0 rc -107/-107 00000100:00080000:0.0:1786109457.673290:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1786109457.673299:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1786109457.673303:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1786109457.673310:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109457.673314:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8268 00000100:00080000:0.0:1786109457.673322:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109457.673358:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab94c5c00 x1872862933213952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109457.673386:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933212928:0@lo:400:kworker.0 00000100:00100000:2.0:1786109457.674206:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933213184 00000100:00100000:2.0:1786109457.674214:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933213184 00000100:00100000:0.0:1786109457.674334:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933213952:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1786109457.674340:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933213824:0@lo:400:kworker.0 00000100:00100000:3.0:1786109457.674496:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:3.0:1786109457.674523:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:3.0:1786109457.674532:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1872862933213184:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1786109457.674541:0:187899:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1786109457.675074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109457.675120:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933213952 00000100:00100000:0.0:1786109457.675126:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933213952 00000100:00100000:0.0:1786109457.675153:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:0.0:1786109457.675159:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933213952:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1786109457.675183:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109457.675301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109457.675343:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933213824 00000100:00100000:1.0:1786109457.675347:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933213824 00000100:00100000:1.0:1786109457.675367:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:1.0:1786109457.675372:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1872862933213824:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1786109457.675378:0:187901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109457.675413:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1872862933213824:12345-0@lo:400:kworker.0 Request processed in 40us (112us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109457.675420:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00080000:1.0:1786109457.675458:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109457.675500:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786109457.675505:0:3647:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1786109457.675509:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1786109457.675514:0:3647:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109457.675520:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8268 00000100:00080000:1.0:1786109457.675526:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109457.675554:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7c52d80 x1872862933214080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109457.675579:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933213824:0@lo:400:kworker.0 00000100:00100000:1.0:1786109457.676056:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933214080:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1786109457.676113:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933213952:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 950us (1037us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109457.676122:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:0.0:1786109457.676201:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933213312:0@lo:400:kworker.0 00000100:00100000:1.0:1786109457.676248:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786109457.676422:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109457.676453:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109457.676458:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933213952:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1786109457.676556:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1872862933213184:12345-0@lo:400:kworker.0 Request processed in 2007us (3574us total) trans 0 rc -107/-107 00000100:00100000:3.0:1786109457.676565:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:3.0:1786109457.676587:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933214080 00000100:00100000:3.0:1786109457.676592:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933214080 00000100:00100000:2.0:1786109457.677053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109457.677246:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933213696:0@lo:400:kworker.0 00000100:00100000:2.0:1786109457.677288:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109457.677414:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933213056 00000100:00100000:0.0:1786109457.677420:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933213056 00000100:00100000:0.0:1786109457.677495:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1786109457.677505:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933213056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109457.677569:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933213056:12345-0@lo:400:kworker.0 Request processed in 66us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109457.677577:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1786109457.677591:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:0.0:1786109457.677596:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933214080:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1786109457.677618:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109457.677654:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933214080:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 57us (1407us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109457.677660:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:0.0:1786109457.677684:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933213696 00000100:00100000:0.0:1786109457.677687:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933213696 00000100:00100000:0.0:1786109457.677716:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6902 00000100:00100000:0.0:1786109457.677722:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933213696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109457.677755:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933213696:12345-0@lo:400:kworker.0 Request processed in 33us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109457.677761:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6902 00000100:00080000:0.0:1786109457.677783:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109457.677788:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109457.678796:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933213056:0@lo:400:kworker.0 00000100:00100000:1.0:1786109457.678820:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933213696:0@lo:400:kworker.0 00000100:00080000:3.0:1786109457.678911:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1786109457.678918:0:3647:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1786109457.678923:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1786109457.678930:0:3647:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109457.678935:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8268 00000100:00080000:3.0:1786109457.678944:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109457.678982:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c20380 x1872862933214208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109457.679002:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933213184:0@lo:400:kworker.0 00000100:00100000:0.0:1786109457.679260:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933214208:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1786109457.679316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109457.679355:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109457.679360:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109457.679364:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933214080:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1786109457.679741:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933214208 00000100:00100000:1.0:1786109457.679749:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933214208 00000100:00100000:1.0:1786109457.680095:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:1.0:1786109457.680214:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933214208:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1786109457.680239:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109457.680303:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933214208:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 198us (987us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109457.680310:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00080000:0.0:1786109457.680649:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109457.680656:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109457.680661:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933214208:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1786109457.796867:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109458.181792:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933214464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109458.181890:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109458.181960:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109458.181967:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933214336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109458.181993:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109458.183003:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933214464 00000100:00100000:1.0:1786109458.183018:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933214464 00000100:00100000:1.0:1786109458.183079:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933214336 00000100:00100000:1.0:1786109458.183083:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933214336 00000100:00100000:0.0:1786109458.184015:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5773 00000100:00100000:0.0:1786109458.186591:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933214464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109458.186644:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109458.188750:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5774 00000100:00100000:1.0:1786109458.188780:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933214336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109458.188822:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109458.189830:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933214464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3256us (7933us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109458.189842:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5773 00000100:00100000:3.0:1786109458.190814:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933214336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109458.190835:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933214464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109458.191004:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933214336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 171us (6941us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109458.191017:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5774 00000001:00100000:2.0:1786109458.286711:0:187891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1786109458.286727:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804568 is committed 00000020:00000080:2.0:1786109458.286732:0:187891:0:(genops.c:906:class_export_put()) final put ffff930ac1259000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786109458.287606:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac1259000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1786109458.287893:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac125d800 for lustre-MDT0001 00000001:00100000:0.0:1786109458.288530:0:184688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786109458.288538:0:184688:0:(genops.c:906:class_export_put()) final put ffff930ac0c88800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786109458.299074:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0c88800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:2.0:1786109458.299519:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786109458.299527:0:9518:0:(genops.c:906:class_export_put()) final put ffff930985f20800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786109458.299762:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930985f20800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1786109458.299789:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac0c8d000 for lustre-OST0000 00000020:00000080:1.0:1786109458.299795:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930985f25000 for lustre-OST0001 00000100:00100000:0.0:1786109458.447304:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109458.447344:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000400:00000100:0.0:1786109458.447376:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922085120 offset 0 length 224: 4 00000100:00100000:0.0:1786109458.447397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109458.447513:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922085248 00000100:00100000:3.0:1786109458.447526:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922085248 00000100:00100000:3.0:1786109458.447569:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922085376 00000100:00100000:3.0:1786109458.447572:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922085376 00000100:00100000:3.0:1786109458.447621:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:3.0:1786109458.447635:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922085376:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109458.447727:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922085376:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 95us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109458.447735:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:3.0:1786109458.447753:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 939 00000100:00100000:3.0:1786109458.447758:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1872862922085248:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:3.0:1786109458.447781:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109458.447808:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1872862922085248:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 49us (521us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109458.447814:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 939 00000100:00080000:3.0:1786109458.447935:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109458.448065:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109458.448346:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922085632 00000100:00100000:2.0:1786109458.448354:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922085632 00000100:00100000:2.0:1786109458.448415:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922085504 00000100:00100000:2.0:1786109458.448419:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922085504 00000100:00100000:2.0:1786109458.448485:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6903 00000100:00100000:2.0:1786109458.448495:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922085632:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109458.448543:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922085632:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 51us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109458.448550:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6903 00000100:00100000:2.0:1786109458.448566:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6904 00000100:00100000:2.0:1786109458.448573:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922085504:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109458.448598:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922085504:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109458.448605:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6904 00000100:00080000:0.0:1786109458.448677:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109458.448681:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786109458.821826:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109459.845164:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109460.882070:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109461.892933:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109462.789333:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1786109462.789462:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109462.789469:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109462.789474:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109462.789485:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8314 00000100:00080000:2.0:1786109462.789492:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109462.789500:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109462.789532:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098d885180 x1872862933214720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109462.789711:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933214720:0@lo:38:kworker.0 00000100:00100000:0.0:1786109462.789813:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109462.790187:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933214848:0@lo:400:kworker.0 00000100:00100000:3.0:1786109462.790226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109462.790476:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933214592:0@lo:400:kworker.0 00000400:00000100:3.0:1786109462.790501:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933214592 offset 0 length 224: 4 00000100:00080000:2.0:1786109462.790651:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109462.790658:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109462.790660:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109462.790665:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8314 00000100:00080000:2.0:1786109462.790670:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109462.790676:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109462.790698:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098d884700 x1872862933214976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109462.790741:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109462.790744:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109462.790746:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109462.790750:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8314 00000100:00080000:2.0:1786109462.790753:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109462.790757:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109462.790769:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7e5f100 x1872862933215232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109462.790795:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109462.790798:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109462.790800:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109462.790804:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8314 00000100:00080000:2.0:1786109462.790807:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109462.790810:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109462.790821:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098490b480 x1872862933215616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109462.790850:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933215104:0@lo:400:kworker.0 00000100:00100000:2.0:1786109462.791496:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109462.792049:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933215360:0@lo:400:kworker.0 00000100:00100000:3.0:1786109462.792240:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109462.792310:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933215360 00000100:00100000:3.0:1786109462.792320:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933215360 00000100:00100000:3.0:1786109462.793295:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6905 00000100:00100000:3.0:1786109462.793316:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933215360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109462.793322:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933214720 00000100:00100000:0.0:1786109462.793331:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933214720 00000100:00100000:0.0:1786109462.793368:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933214848 00000100:00100000:0.0:1786109462.793372:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933214848 00000100:00100000:2.0:1786109462.793376:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933215104 00000100:00100000:2.0:1786109462.793385:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933215104 00000100:00100000:0.0:1786109462.793410:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1786109462.793420:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933214848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109462.793517:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933214848:12345-0@lo:400:kworker.0 Request processed in 98us (3290us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109462.793561:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933215360:12345-0@lo:400:kworker.0 Request processed in 254us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109462.793570:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6905 00000100:00080000:3.0:1786109462.793596:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109462.793602:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109462.793627:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933215488:0@lo:400:kworker.0 00000100:00100000:3.0:1786109462.793666:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109462.793674:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1786109462.793685:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933215104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109462.793711:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933215488 00000100:00100000:3.0:1786109462.793716:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933215488 00000100:00100000:2.0:1786109462.793740:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933215104:12345-0@lo:400:kworker.0 Request processed in 59us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109462.793752:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1786109462.793759:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6906 00000100:00100000:3.0:1786109462.793768:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933215488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109462.793776:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:2.0:1786109462.793783:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933214720:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109462.793807:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109462.793814:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933215488:12345-0@lo:400:kworker.0 Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109462.793822:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6906 00000100:00100000:2.0:1786109462.793848:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933214720:12345-0@lo:38:kworker.0 Request processed in 64us (4034us total) trans 0 rc -19/-19 00000100:00080000:3.0:1786109462.793857:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109462.793858:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:3.0:1786109462.793890:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933215488:0@lo:400:kworker.0 00000100:00100000:2.0:1786109462.793891:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933214976:0@lo:38:kworker.0 00000100:00100000:1.0:1786109462.793891:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933215360:0@lo:400:kworker.0 00000100:00100000:3.0:1786109462.793947:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933215104:0@lo:400:kworker.0 00000100:00100000:0.0:1786109462.793980:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1786109462.793983:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933214848:0@lo:400:kworker.0 00000100:00100000:2.0:1786109462.794008:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109462.794045:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933215232:0@lo:38:kworker.0 00000100:00100000:0.0:1786109462.794050:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933214976 00000100:00100000:2.0:1786109462.794075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109462.794107:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933215616:0@lo:38:kworker.0 00000100:00100000:2.0:1786109462.794129:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109462.794157:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109462.794164:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109462.794167:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933214720:0@lo:38:kworker.0 00000100:00100000:2.0:1786109462.794194:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933215616 00000100:00100000:0.0:1786109462.794227:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933214976 00000100:00100000:0.0:1786109462.794301:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1786109462.794306:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933214976:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109462.794319:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109462.794360:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933214976:12345-0@lo:38:kworker.0 Request processed in 52us (353us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109462.794362:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933215616 00000100:00100000:0.0:1786109462.794370:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1786109462.794385:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:0.0:1786109462.794389:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933215616:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109462.794399:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109462.794425:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933215616:12345-0@lo:38:kworker.0 Request processed in 34us (294us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109462.794461:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00100000:3.0:1786109462.794929:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933215232 00000100:00100000:3.0:1786109462.794935:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933215232 00000100:00080000:2.0:1786109462.794993:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109462.794999:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109462.795004:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933214976:0@lo:38:kworker.0 00000100:00080000:2.0:1786109462.795018:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109462.795022:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109462.795026:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933215616:0@lo:38:kworker.0 00000100:00100000:3.0:1786109462.795040:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12294 00000100:00100000:3.0:1786109462.795050:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933215232:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109462.795066:0:8451:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109462.795122:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933215232:12345-0@lo:38:kworker.0 Request processed in 72us (1046us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109462.795129:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12294 00000100:00080000:2.0:1786109462.795524:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109462.795529:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109462.795533:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933215232:0@lo:38:kworker.0 00010000:00010000:1.0:1786109462.979103:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109463.303218:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933215744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109463.303303:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109463.303382:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933215744 00000100:00100000:2.0:1786109463.303391:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933215744 00000100:00100000:1.0:1786109463.304024:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109463.304052:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933215872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109463.304131:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109463.304406:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933215872 00000100:00100000:2.0:1786109463.304415:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933215872 00000100:00100000:2.0:1786109463.304482:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5775 00000100:00100000:2.0:1786109463.304493:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933215744:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109463.304557:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5776 00000100:00100000:1.0:1786109463.304573:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933215872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109463.304617:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109463.304671:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933215872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109463.304679:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5776 00000100:00100000:1.0:1786109463.304743:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933215872:0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109463.306335:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109463.310074:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933215744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5574us (6762us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109463.310090:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5775 00000100:00100000:0.0:1786109463.310846:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933215744:0@lo:13:osp-pre-1-1.0 00000400:00000100:3.0:1786109463.568136:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922085760 offset 0 length 224: 4 00000100:00100000:3.0:1786109463.569148:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109463.570572:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922086272 00000100:00100000:2.0:1786109463.570592:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922086272 00000100:00100000:3.0:1786109463.570893:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109463.570920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109463.570955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00080000:0.0:1786109463.571020:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109463.571041:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922086016 00000100:00100000:0.0:1786109463.571045:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922086016 00000100:00100000:0.0:1786109463.571091:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922085888 00000100:00100000:0.0:1786109463.571095:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922085888 00000100:00100000:0.0:1786109463.571121:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 152 00000100:00100000:0.0:1786109463.571134:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922086016:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109463.571536:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6907 00000100:00100000:2.0:1786109463.571548:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922086272:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109463.571629:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922086272:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 84us (2486us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109463.571638:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6907 00000100:00100000:2.0:1786109463.572994:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922086144 00000100:00100000:2.0:1786109463.573008:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922086144 00000100:00100000:2.0:1786109463.573064:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23075 00000100:00100000:2.0:1786109463.573074:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397d331e-10fc-4558-be87-308c3622e8eb+5:2401:x1872862922086144:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:2.0:1786109463.573106:0:9990:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca366ed 00000100:00080000:2.0:1786109463.573116:0:9990:0:(import.c:65:import_set_state_nolock()) ffff930a89256800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786109463.574393:0:9990:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738458 00000100:00100000:2.0:1786109463.574793:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397d331e-10fc-4558-be87-308c3622e8eb+2:2401:x1872862922086144:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 1713us (3829us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109463.574806:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23075 00000100:00100000:2.0:1786109463.574862:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 943 00000100:00100000:2.0:1786109463.574871:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1872862922085888:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:2.0:1786109463.574899:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109463.574927:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1872862922085888:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 57us (4007us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109463.574933:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 943 00010000:00010000:2.0:1786109463.574981:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109463.575130:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109463.575137:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109463.576884:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922086016:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 5739us (5983us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109463.576902:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 152 00010000:00010000:3.0:1786109463.973622:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109465.032721:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109466.059931:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109467.076650:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786109467.921086:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109467.921095:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109467.921099:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109467.921110:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8319 00000100:00080000:3.0:1786109467.921195:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1786109467.921363:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109467.921392:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c23800 x1872862933216128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109467.921567:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109467.921572:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109467.921573:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109467.921577:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8319 00000100:00080000:3.0:1786109467.921581:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1786109467.921585:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109467.921608:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c20380 x1872862933216384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109467.922051:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109467.922056:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109467.922058:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109467.922063:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8319 00000100:00080000:3.0:1786109467.922067:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1786109467.922073:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109467.922091:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c21c00 x1872862933216640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109467.922291:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109467.922295:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109467.922297:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109467.922302:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8319 00000100:00080000:3.0:1786109467.922305:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1786109467.922309:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109467.922322:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098d885180 x1872862933217024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109467.922371:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933216256:0@lo:400:kworker.0 00000100:00100000:3.0:1786109467.922795:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109467.922904:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933216128:0@lo:38:kworker.0 00000100:00100000:0.0:1786109467.922979:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109467.923039:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933216384:0@lo:38:kworker.0 00000100:00100000:3.0:1786109467.923059:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109467.923071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109467.923076:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933216512:0@lo:400:kworker.0 00000100:00100000:0.0:1786109467.923101:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933216640:0@lo:38:kworker.0 00000100:00100000:0.0:1786109467.923145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109467.923175:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933217024:0@lo:38:kworker.0 00000100:00100000:0.0:1786109467.923209:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933216256 00000100:00100000:0.0:1786109467.923217:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933216256 00000100:00100000:3.0:1786109467.923245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109467.923296:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933216128 00000100:00100000:0.0:1786109467.923302:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933216128 00000100:00100000:0.0:1786109467.923318:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933216384 00000100:00100000:0.0:1786109467.923322:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933216384 00000100:00100000:0.0:1786109467.923335:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933216512 00000100:00100000:3.0:1786109467.923342:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109467.923344:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933216512 00000100:00100000:0.0:1786109467.923374:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933217024 00000100:00100000:0.0:1786109467.923378:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933217024 00000100:00100000:0.0:1786109467.923395:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1786109467.923416:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933216256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109467.923497:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933216256:12345-0@lo:400:kworker.0 Request processed in 94us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109467.923504:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1786109467.923524:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1786109467.923531:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933216512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109467.923564:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933216512:12345-0@lo:400:kworker.0 Request processed in 34us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109467.923571:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1786109467.923592:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1786109467.923597:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933216128:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109467.923619:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109467.923736:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933216000:0@lo:400:kworker.0 00000100:00100000:2.0:1786109467.923801:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933216768:0@lo:400:kworker.0 00000100:00100000:3.0:1786109467.923837:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933216512:0@lo:400:kworker.0 00000100:00100000:3.0:1786109467.923859:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933216256:0@lo:400:kworker.0 00000100:00100000:0.0:1786109467.923863:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933216128:12345-0@lo:38:kworker.0 Request processed in 261us (882us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109467.923874:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1786109467.923891:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:0.0:1786109467.923896:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933216384:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109467.923906:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109467.923934:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933216384:12345-0@lo:38:kworker.0 Request processed in 36us (864us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109467.923939:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:0.0:1786109467.923955:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1786109467.923963:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933217024:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109467.923973:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109467.923998:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933217024:12345-0@lo:38:kworker.0 Request processed in 36us (663us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109467.924003:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1786109467.924028:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933216640 00000100:00100000:0.0:1786109467.924031:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933216640 00000100:00080000:3.0:1786109467.924053:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1786109467.924054:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12295 00000100:00080000:3.0:1786109467.924067:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109467.924068:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933216640:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1786109467.924080:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933216128:0@lo:38:kworker.0 00010000:00020000:0.0:1786109467.924087:0:179257:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1786109467.924102:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109467.924109:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109467.924123:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933216640:12345-0@lo:38:kworker.0 Request processed in 58us (977us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109467.924125:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933216384:0@lo:38:kworker.0 00000100:00100000:0.0:1786109467.924141:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12295 00000100:00080000:3.0:1786109467.924163:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109467.924168:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109467.924172:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933216640:0@lo:38:kworker.0 00000100:00080000:3.0:1786109467.924182:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109467.924186:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109467.924189:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933217024:0@lo:38:kworker.0 00000400:00000100:1.0:1786109467.924214:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933216000 offset 0 length 224: 4 00000100:00100000:1.0:1786109467.924249:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933216896:0@lo:400:kworker.0 00000100:00100000:1.0:1786109467.924274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109467.924599:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786109467.924604:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109467.924827:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933216896 00000100:00100000:0.0:1786109467.924833:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933216896 00000100:00100000:0.0:1786109467.924889:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933216768 00000100:00100000:0.0:1786109467.924893:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933216768 00000100:00100000:0.0:1786109467.924917:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6908 00000100:00100000:0.0:1786109467.924923:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933216896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109467.924973:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6909 00000100:00100000:0.0:1786109467.924976:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933216896:12345-0@lo:400:kworker.0 Request processed in 50us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109467.924986:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6908 00000100:00100000:3.0:1786109467.925005:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933216768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109467.925029:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933216896:0@lo:400:kworker.0 00000100:00100000:3.0:1786109467.925095:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933216768:12345-0@lo:400:kworker.0 Request processed in 99us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109467.925105:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6909 00000100:00080000:2.0:1786109467.925110:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109467.925116:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109467.925186:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933216768:0@lo:400:kworker.0 00010000:00010000:3.0:1786109468.100763:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109468.422001:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933217152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109468.422096:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109468.422395:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933217152 00000100:00100000:2.0:1786109468.422417:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933217152 00000100:00100000:2.0:1786109468.422508:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5777 00000100:00100000:2.0:1786109468.422519:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933217152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109468.422559:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109468.422619:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933217152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109468.422627:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5777 00000100:00100000:2.0:1786109468.422682:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933217152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109468.423417:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109468.424742:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933217280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109468.424820:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109468.425039:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933217280 00000100:00100000:1.0:1786109468.425050:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933217280 00000100:00100000:1.0:1786109468.425106:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5778 00000100:00100000:1.0:1786109468.425116:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933217280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109468.425151:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109468.425209:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933217280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109468.425216:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5778 00000100:00100000:2.0:1786109468.425302:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933217280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109468.691467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109468.691509:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109468.691532:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000400:00000100:0.0:1786109468.691554:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922086912 offset 0 length 520: 4 00000100:00100000:0.0:1786109468.691592:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922086528 00000100:00100000:0.0:1786109468.691604:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922086528 00000100:00100000:0.0:1786109468.691648:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922086656 00000100:00100000:0.0:1786109468.691651:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922086656 00000100:00100000:0.0:1786109468.691704:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 155 00000100:00100000:0.0:1786109468.691717:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922086656:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109468.691814:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922086656:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 99us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109468.691823:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 155 00000100:00100000:0.0:1786109468.691845:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 947 00000100:00100000:0.0:1786109468.691850:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922086528:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:0.0:1786109468.692079:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109468.692111:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922086528:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 259us (657us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109468.692119:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 947 00000100:00100000:0.0:1786109468.692223:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922086784 00000100:00100000:0.0:1786109468.692228:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922086784 00000100:00100000:0.0:1786109468.692262:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6910 00000100:00100000:0.0:1786109468.692270:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922086784:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109468.692301:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922086784:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 32us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109468.692307:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6910 00000100:00080000:0.0:1786109468.692328:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109468.692333:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1786109469.151714:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786109469.463190:0:184688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 397d331e-10fc-4558-be87-308c3622e8eb 00000020:00000080:3.0:1786109469.463201:0:184688:0:(genops.c:906:class_export_put()) final put ffff930a89250000/397d331e-10fc-4558-be87-308c3622e8eb 00000020:00000080:2.0:1786109469.463270:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930a89250000/397d331e-10fc-4558-be87-308c3622e8eb for lustre-OST0000 00000020:00000080:2.0:1786109469.465661:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a89256800 for lustre-OST0000 00010000:00010000:3.0:1786109470.218538:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109471.249578:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109472.260562:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1786109473.029738:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109457/real 1786109457] req@ffff930ab9660380 x1872862933212800/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109473 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109473.029787:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff930ab9660380 x1872862933212800/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109473 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109473.029797:0:3648:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1786109473.029801:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1786109473.029805:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.138@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1786109473.029807:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1786109473.029812:0:3648:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930ab9660380 x1872862933212800/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109473 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109473.029821:0:3648:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930ac173fb80 x1872862933214592/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109478 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109473.029851:0:3648:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930ab1c20700 x1872862933216000/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109483 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1786109473.029867:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1786109473.029870:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1786109473.029872:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1786109473.029874:0:3648:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1786109473.029903:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933212800:0@lo:400:kworker.0 00000100:00080000:2.0:1786109473.029936:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109473.029941:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1786109473.029943:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109473.029948:0:171804:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8262 00000100:00080000:2.0:1786109473.029957:0:171804:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109473.029988:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309825ac000 x1872862933217408/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109473.030009:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109473.030013:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109473.030014:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109473.030018:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8324 00000100:00080000:2.0:1786109473.030022:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786109473.030025:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109473.030040:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309825ae680 x1872862933217536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109473.030063:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109473.030067:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109473.030068:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109473.030071:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8324 00000100:00080000:2.0:1786109473.030074:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786109473.030078:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109473.030089:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309825af480 x1872862933217792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109473.030106:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109473.030109:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109473.030110:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109473.030113:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8324 00000100:00080000:2.0:1786109473.030116:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1786109473.030119:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109473.030131:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309825ad880 x1872862933218048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109473.030157:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109473.030159:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109473.030161:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109473.030165:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8324 00000100:00080000:2.0:1786109473.030168:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786109473.030171:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109473.030181:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309825ac700 x1872862933218432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109473.030207:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933217408:0@lo:250:kworker.0 00000400:00000100:2.0:1786109473.030249:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933217408 offset 0 length 520: 4 00000100:00100000:2.0:1786109473.030303:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933217536:0@lo:38:kworker.0 00000100:00100000:2.0:1786109473.030337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109473.030357:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933217792:0@lo:38:kworker.0 00000100:00100000:1.0:1786109473.031467:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933217920:0@lo:400:kworker.0 00000100:00100000:1.0:1786109473.031512:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109473.031543:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933216000:0@lo:400:kworker.0 00000100:00100000:1.0:1786109473.031562:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109473.031566:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933217664:0@lo:400:kworker.0 00000100:00100000:1.0:1786109473.031584:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109473.031921:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933218176:0@lo:400:kworker.0 00000100:00100000:1.0:1786109473.031952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109473.031976:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109473.031982:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933218304:0@lo:400:kworker.0 00000100:00100000:1.0:1786109473.032004:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109473.032033:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933217536 00000100:00100000:1.0:1786109473.032040:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933217536 00000100:00100000:1.0:1786109473.032069:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933217920 00000100:00100000:1.0:1786109473.032073:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933217920 00000100:00100000:1.0:1786109473.032105:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933217664 00000100:00100000:1.0:1786109473.032108:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933217664 00000100:00100000:1.0:1786109473.032124:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1786109473.032133:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933217920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109473.032182:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933217920:12345-0@lo:400:kworker.0 Request processed in 49us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109473.032188:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1786109473.032203:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1786109473.032209:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933217664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109473.032234:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933217664:12345-0@lo:400:kworker.0 Request processed in 26us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109473.032239:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1786109473.032249:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:1.0:1786109473.032253:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933217536:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109473.032269:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109473.032294:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933217536:12345-0@lo:38:kworker.0 Request processed in 40us (1958us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109473.032300:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:1.0:1786109473.032319:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933218176 00000100:00100000:1.0:1786109473.032323:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933218176 00000100:00100000:1.0:1786109473.032345:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933218304 00000100:00100000:1.0:1786109473.032348:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933218304 00000100:00100000:1.0:1786109473.032380:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6911 00000100:00100000:1.0:1786109473.032387:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933218176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109473.032421:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933218176:12345-0@lo:400:kworker.0 Request processed in 35us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109473.032453:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6911 00000100:00100000:1.0:1786109473.032465:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6912 00000100:00100000:1.0:1786109473.032471:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933218304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109473.032496:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933218304:12345-0@lo:400:kworker.0 Request processed in 27us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109473.032502:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6912 00000100:00080000:1.0:1786109473.032521:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109473.032525:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109473.032527:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109473.032553:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933217664:0@lo:400:kworker.0 00000100:00100000:1.0:1786109473.032565:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933217920:0@lo:400:kworker.0 00000100:00100000:0.0:1786109473.035499:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933214592:0@lo:400:kworker.0 00000100:00100000:2.0:1786109473.035732:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109473.035786:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933218048:0@lo:38:kworker.0 00000100:00100000:2.0:1786109473.035821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109473.035842:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933218432:0@lo:38:kworker.0 00000100:00100000:2.0:1786109473.035866:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109473.035902:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109473.035908:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109473.035911:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933217536:0@lo:38:kworker.0 00000100:00100000:2.0:1786109473.035942:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933217792 00000100:00100000:2.0:1786109473.035947:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933217792 00000100:00100000:2.0:1786109473.035976:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933218432 00000100:00100000:2.0:1786109473.035980:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933218432 00000100:00100000:2.0:1786109473.036000:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:2.0:1786109473.036008:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933217792:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109473.036025:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109473.036064:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933217792:12345-0@lo:38:kworker.0 Request processed in 55us (332us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109473.036071:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:2.0:1786109473.036085:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:2.0:1786109473.036089:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933218432:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109473.036098:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109473.036119:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933218432:12345-0@lo:38:kworker.0 Request processed in 29us (253us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109473.036124:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:2.0:1786109473.036142:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933218048 00000100:00100000:2.0:1786109473.036146:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933218048 00000100:00100000:2.0:1786109473.036163:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12296 00000100:00100000:2.0:1786109473.036167:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933218048:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109473.036175:0:8451:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109473.036198:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933218048:12345-0@lo:38:kworker.0 Request processed in 30us (376us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109473.036204:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12296 00000100:00080000:2.0:1786109473.036237:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109473.036241:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109473.036244:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933217792:0@lo:38:kworker.0 00000100:00080000:2.0:1786109473.036251:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109473.036254:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109473.036257:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933218048:0@lo:38:kworker.0 00000100:00080000:2.0:1786109473.036263:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109473.036266:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109473.036269:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933218432:0@lo:38:kworker.0 00000100:00100000:1.0:1786109473.037850:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933218304:0@lo:400:kworker.0 00000100:00100000:1.0:1786109473.037884:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933218176:0@lo:400:kworker.0 00010000:00010000:1.0:1786109473.288408:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109473.540720:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109473.540743:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933218560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109473.540814:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109473.540863:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933218560 00000100:00100000:1.0:1786109473.540871:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933218560 00000100:00100000:1.0:1786109473.540920:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5779 00000100:00100000:1.0:1786109473.540929:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933218560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109473.540960:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109473.542226:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933218560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1292us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109473.542240:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5779 00000100:00100000:1.0:1786109473.542486:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933218560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109473.548312:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933218688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109473.548396:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109473.553527:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933218688 00000100:00100000:2.0:1786109473.553543:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933218688 00000100:00100000:2.0:1786109473.553653:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5780 00000100:00100000:2.0:1786109473.553665:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933218688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109473.553701:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109473.558526:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933218688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4855us (10120us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109473.558541:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5780 00000100:00100000:1.0:1786109473.560768:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933218688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109473.825288:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109473.825361:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109473.825475:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109473.825578:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922087296 00000100:00100000:3.0:1786109473.825599:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922087296 00000100:00100000:3.0:1786109473.825668:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6913 00000100:00100000:3.0:1786109473.825807:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922087296:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109473.825880:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922087296:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 203us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109473.825888:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6913 00000100:00080000:2.0:1786109473.827030:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109473.828417:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922087040 00000100:00100000:0.0:1786109473.828491:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922087040 00000100:00100000:0.0:1786109473.828855:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922087168 00000100:00100000:0.0:1786109473.828860:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922087168 00000100:00100000:0.0:1786109473.828959:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:0.0:1786109473.828970:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922087168:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109473.829053:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922087168:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 85us (3690us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109473.829062:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:0.0:1786109473.829080:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 951 00000100:00100000:0.0:1786109473.829084:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922087040:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:0.0:1786109473.829207:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109473.829236:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922087040:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 150us (3958us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109473.829243:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 951 00000100:00080000:3.0:1786109473.830784:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1786109474.312895:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109475.335184:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1786109476.192054:0:192324:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1786109476.192157:0:192324:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1786109476.192159:0:192324:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1786109476.192276:0:192324:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93098365d000 00000020:01000004:1.0:1786109476.192290:0:192324:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1786109476.192303:0:192324:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1786109476.192316:0:192324:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff930985213380) 00000020:00000080:1.0:1786109476.192333:0:192324:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1786109476.278055:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1786109476.278367:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.279821:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1786109476.280080:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1786109476.280474:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1786109476.280692:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1786109476.280884:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1786109476.281088:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1786109476.281307:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1786109476.281667:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1786109476.281924:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1786109476.282120:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1786109476.282334:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1786109476.282622:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1786109476.285271:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1786109476.286179:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.286397:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.286766:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.287008:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.287230:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.287464:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.287714:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.287921:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.288160:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.288374:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.288730:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.288997:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.289210:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.289452:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.289680:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.289885:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.290122:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.290317:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.290629:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.290836:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.291086:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.291289:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.291550:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.291778:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.292020:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.292219:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.292480:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.292710:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.292970:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.293209:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.293455:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1786109476.293692:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1786109476.295422:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1786109476.295817:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1786109476.296064:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1786109476.296463:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1786109476.296722:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1786109476.296925:0:192324:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1786109476.297401:0:192324:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1786109476.297698:0:192324:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1786109476.297707:0:192324:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786109476.297717:0:192324:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca367e9 00000020:01000004:3.0:1786109476.297723:0:192324:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1786109476.297734:0:192324:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1786109476.297739:0:192324:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93098365d000 from MGS 00000020:01000004:3.0:1786109476.297742:0:192324:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1786109476.297751:0:192324:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff930ab99d19c0) 00000020:00000080:3.0:1786109476.297761:0:192324:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1786109476.297815:0:192324:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93098365d000 from MGS, refs=2 00080000:01000000:3.0:1786109476.297819:0:192324:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1786109476.297823:0:192324:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca367f7 00010000:00010000:3.0:1786109476.297926:0:192324:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1786109476.301251:0:192324:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1786109476.302110:0:192328:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1786109476.302150:0:192324:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1786109476.302191:0:192324:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1786109476.302913:0:192324:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1786109476.303169:0:192324:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786109476.303310:0:192324:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1786109476.303317:0:192324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1786109476.303763:0:192324:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1786109476.303769:0:192324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1786109476.304084:0:192324:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1786109476.304091:0:192324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1786109476.304558:0:192324:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1786109476.304591:0:192324:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1786109476.304592:0:192324:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1786109476.304596:0:192324:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1786109476.304601:0:192324:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff930a8a640000 already not connected (conn 13794, was 0): CONNECTING 00000100:00100000:2.0:1786109476.304607:0:192324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:3.0:1786109476.358548:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109477.381190:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786109478.148864:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109478.148875:0:171804:0:(pinger.c:247:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1786109478.148878:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109478.148882:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109478.148887:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109478.148894:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8329 00000100:00080000:1.0:1786109478.148899:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109478.148906:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109478.148951:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309851f1880 x1872862933218816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109478.149013:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109478.149017:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109478.149019:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109478.149022:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8329 00000100:00080000:1.0:1786109478.149024:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109478.149028:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109478.149039:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309851f3480 x1872862933219072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109478.149055:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109478.149058:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109478.149059:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109478.149063:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8329 00000100:00080000:1.0:1786109478.149065:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109478.149069:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109478.149079:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309851f2300 x1872862933219328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109478.149112:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109478.149115:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109478.149117:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109478.149120:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8329 00000100:00080000:1.0:1786109478.149123:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109478.149126:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109478.149144:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309851f0700 x1872862933219712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109478.149173:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933219584:0@lo:400:kworker.0 00000100:00100000:1.0:1786109478.149248:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109478.149319:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109478.149326:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933219456:0@lo:400:kworker.0 00000100:00100000:1.0:1786109478.149362:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109478.149392:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933219584 00000100:00100000:1.0:1786109478.149398:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933219584 00000100:00100000:1.0:1786109478.149461:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933219456 00000100:00100000:1.0:1786109478.149464:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933219456 00000100:00100000:1.0:1786109478.149492:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6914 00000100:00100000:1.0:1786109478.149500:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933219584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109478.149549:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933219584:12345-0@lo:400:kworker.0 Request processed in 50us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109478.149571:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6914 00000100:00100000:1.0:1786109478.149588:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6915 00000100:00100000:1.0:1786109478.149594:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933219456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109478.149624:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933219456:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109478.149630:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6915 00000100:00100000:1.0:1786109478.149669:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933219456:0@lo:400:kworker.0 00000100:00100000:1.0:1786109478.149680:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933219584:0@lo:400:kworker.0 00000100:00100000:2.0:1786109478.149755:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933218816:0@lo:38:kworker.0 00000100:00100000:2.0:1786109478.149787:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109478.149825:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933219072:0@lo:38:kworker.0 00000100:00100000:2.0:1786109478.149847:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109478.149866:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933219328:0@lo:38:kworker.0 00000100:00100000:2.0:1786109478.149893:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109478.149917:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933219712:0@lo:38:kworker.0 00000100:00100000:2.0:1786109478.149937:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109478.149963:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109478.149968:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109478.149978:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933218816 00000100:00100000:2.0:1786109478.149982:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933218816 00000100:00100000:2.0:1786109478.149999:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933219072 00000100:00100000:2.0:1786109478.150002:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933219072 00000100:00100000:2.0:1786109478.150011:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933219712 00000100:00100000:2.0:1786109478.150013:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933219712 00000100:00100000:2.0:1786109478.150023:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1786109478.150028:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933218816:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109478.150045:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109478.150079:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933218816:12345-0@lo:38:kworker.0 Request processed in 50us (291us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109478.150086:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1786109478.150100:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:2.0:1786109478.150104:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933219072:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109478.150114:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109478.150138:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933219072:12345-0@lo:38:kworker.0 Request processed in 32us (289us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109478.150144:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:2.0:1786109478.150155:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1786109478.150159:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933219712:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109478.150167:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109478.150191:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933219712:12345-0@lo:38:kworker.0 Request processed in 30us (253us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109478.150197:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00080000:2.0:1786109478.150221:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109478.150226:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109478.150229:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933218816:0@lo:38:kworker.0 00000100:00080000:2.0:1786109478.150241:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109478.150244:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109478.150247:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933219072:0@lo:38:kworker.0 00000100:00080000:2.0:1786109478.150254:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109478.150256:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109478.150259:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933219712:0@lo:38:kworker.0 00000100:00100000:3.0:1786109478.150354:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933218944:0@lo:400:kworker.0 00000100:00100000:3.0:1786109478.150383:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109478.150411:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109478.150417:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933219200:0@lo:400:kworker.0 00000100:00100000:3.0:1786109478.150459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109478.150557:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933219328 00000100:00100000:0.0:1786109478.150562:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933219328 00000100:00100000:0.0:1786109478.150594:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12297 00000100:00100000:0.0:1786109478.150600:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab5395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933219328:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109478.150612:0:179257:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109478.150648:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab5395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933219328:12345-0@lo:38:kworker.0 Request processed in 47us (754us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109478.150654:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12297 00000100:00100000:0.0:1786109478.150946:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933218944 00000100:00100000:0.0:1786109478.150950:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933218944 00000100:00100000:0.0:1786109478.150975:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933219200 00000100:00100000:0.0:1786109478.150978:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933219200 00000100:00100000:0.0:1786109478.150990:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1786109478.150996:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933218944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109478.151033:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933218944:12345-0@lo:400:kworker.0 Request processed in 37us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109478.151040:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1786109478.151052:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1786109478.151059:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933219200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109478.151086:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933219200:12345-0@lo:400:kworker.0 Request processed in 28us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109478.151092:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1786109478.151125:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109478.151129:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109478.151133:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933219328:0@lo:38:kworker.0 00000100:00100000:3.0:1786109478.151290:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933219200:0@lo:400:kworker.0 00000100:00100000:3.0:1786109478.151302:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933218944:0@lo:400:kworker.0 00000100:00080000:2.0:1786109478.151373:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1786109478.405136:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109478.660840:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933219840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109478.660910:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109478.661016:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933219840 00000100:00100000:1.0:1786109478.661025:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933219840 00000100:00100000:1.0:1786109478.661192:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5781 00000100:00100000:1.0:1786109478.661275:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933219840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109478.661303:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109478.661364:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933219840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109478.661372:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5781 00000100:00100000:3.0:1786109478.661531:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933219840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109478.661732:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933219968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109478.661765:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109478.661936:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933219968 00000100:00100000:1.0:1786109478.661941:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933219968 00000100:00100000:1.0:1786109478.661972:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5782 00000100:00100000:1.0:1786109478.661980:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933219968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109478.661996:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109478.663446:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933219968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1443us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109478.663458:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5782 00000100:00100000:2.0:1786109478.663823:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933219968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109478.927407:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109478.927670:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109478.927729:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109478.928087:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922087808 00000100:00100000:2.0:1786109478.928098:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922087808 00000100:00100000:2.0:1786109478.928150:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1786109478.928158:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1872862922087808:12345-192.168.203.38@tcp:250:kworker.0 00010000:00080000:2.0:1786109478.928186:0:192330:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from fea1ac35-e793-43ec-a86d-d40dc5658dad@192.168.203.38@tcp t0 exp 0000000000000000 cur 8335 last 0 00000020:00000080:2.0:1786109478.928736:0:192330:0:(genops.c:1406:class_connect()) connect: client fea1ac35-e793-43ec-a86d-d40dc5658dad, cookie 0xdb52b77d7ca367fe 00000100:00080000:2.0:1786109478.929083:0:192330:0:(import.c:65:import_set_state_nolock()) ffff930ac0b7a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109478.929152:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+5:2401:x1872862922087808:12345-192.168.203.38@tcp:250:kworker.0 Request processed in 993us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109478.929162:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:3.0:1786109478.932009:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109478.932569:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922087424 00000100:00100000:0.0:1786109478.932578:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922087424 00000100:00100000:2.0:1786109478.932646:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922087680 00000100:00100000:2.0:1786109478.932650:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922087680 00000100:00100000:2.0:1786109478.932706:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6916 00000100:00100000:2.0:1786109478.932717:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922087680:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109478.933848:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922087680:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1127us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109478.933858:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6916 00000100:00080000:3.0:1786109478.934172:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109478.934238:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922087552 00000100:00100000:1.0:1786109478.934245:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922087552 00000100:00100000:1.0:1786109478.935647:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:1.0:1786109478.935661:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922087552:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109478.935734:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922087552:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 76us (8005us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109478.935741:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:1.0:1786109478.935758:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 955 00000100:00100000:1.0:1786109478.935763:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1872862922087424:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:1.0:1786109478.935800:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109478.935828:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1872862922087424:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 63us (8432us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109478.935834:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 955 00000100:00080000:3.0:1786109478.936170:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1786109479.429289:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109480.009006:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109480.009093:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922087936 00000100:00100000:3.0:1786109480.009165:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922087936 00000100:00100000:3.0:1786109480.009219:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:3.0:1786109480.009229:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+5:15195:x1872862922087936:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109480.009244:0:192332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109480.009262:0:192332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6c800/0xdb52b77d7ca36805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1524 expref: -99 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109480.009285:0:192332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6c800/0xdb52b77d7ca36805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1524 expref: 6 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109480.009296:0:192332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6c800/0xdb52b77d7ca36805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1524 expref: 6 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109480.009305:0:192332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6c800, rc 0) 00000100:00100000:3.0:1786109480.009374:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+6:15195:x1872862922087936:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 146us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109480.009380:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:3.0:1786109480.012404:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109480.012978:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922088064 00000100:00100000:1.0:1786109480.012988:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922088064 00000100:00100000:1.0:1786109480.013083:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:1.0:1786109480.013094:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1ac35-e793-43ec-a86d-d40dc5658dad+6:15195:x1872862922088064:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1786109480.013180:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1ac35-e793-43ec-a86d-d40dc5658dad+6:15195:x1872862922088064:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 Request processed in 87us (784us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786109480.013190:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:1.0:1786109480.016006:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109480.016092:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922088192 00000100:00100000:3.0:1786109480.016169:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922088192 00000100:00100000:3.0:1786109480.016222:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:3.0:1786109480.016232:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+6:15195:x1872862922088192:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109480.016248:0:192332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109480.016266:0:192332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6dc00/0xdb52b77d7ca3680c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a152b expref: -99 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109480.016294:0:192332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6dc00/0xdb52b77d7ca3680c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a152b expref: 7 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109480.016305:0:192332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6dc00/0xdb52b77d7ca3680c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a152b expref: 7 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109480.016318:0:192332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6dc00, rc 0) 00000100:00100000:3.0:1786109480.016621:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+7:15195:x1872862922088192:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 388us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109480.016629:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1786109480.097050:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109480.098348:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922088320 00000100:00100000:2.0:1786109480.098365:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922088320 00000100:00100000:3.0:1786109480.099470:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1786109480.099492:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+7:15195:x1872862922088320:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1786109480.101539:0:192334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1786109480.101743:0:192330:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 321 20000000:01000000:0.0:1786109480.107359:0:192335:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1786109480.107367:0:192335:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1786109480.107370:0:192335:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1786109480.107372:0:192335:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1786109480.107679:0:192335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1786109480.107940:0:192330:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1786109480.108069:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+8:15195:x1872862922088320:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 8581us (11029us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109480.108081:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:2.0:1786109480.109747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109480.109839:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922088448 00000100:00100000:3.0:1786109480.109857:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922088448 00000100:00100000:3.0:1786109480.109945:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:3.0:1786109480.109956:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+8:15195:x1872862922088448:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109480.110171:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+8:15195:x1872862922088448:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 215us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109480.110179:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1786109480.115788:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109480.116254:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922088576 00000100:00100000:3.0:1786109480.116271:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922088576 00000100:00100000:3.0:1786109480.116353:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1786109480.116364:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+8:15195:x1872862922088576:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109480.117871:0:192330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109480.117907:0:192330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6d000/0xdb52b77d7ca36813 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1532 expref: -99 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109480.117954:0:192330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6d000/0xdb52b77d7ca36813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1532 expref: 9 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109480.117967:0:192330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6d000/0xdb52b77d7ca36813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1532 expref: 9 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109480.117978:0:192330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d000, rc 0) 00000100:00100000:3.0:1786109480.120487:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922088576:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 4108us (4691us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109480.120504:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1786109480.270249:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109480.271226:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922088704 00000100:00100000:3.0:1786109480.271243:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922088704 00000100:00100000:3.0:1786109480.271318:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:3.0:1786109480.271341:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922088704:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109480.271592:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922088704:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 253us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109480.271601:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1786109480.280645:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109480.280946:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922088832 00000100:00100000:3.0:1786109480.280959:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922088832 00000100:00100000:3.0:1786109480.282234:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:3.0:1786109480.282258:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922088832:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109480.282509:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922088832:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 261us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109480.282518:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:3.0:1786109480.292214:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109480.293346:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922088960 00000100:00100000:2.0:1786109480.293361:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922088960 00000100:00100000:3.0:1786109480.295044:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1786109480.295073:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922088960:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109480.295101:0:192331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109480.295126:0:192331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6d400/0xdb52b77d7ca3681a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1539 expref: -99 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109480.295164:0:192331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6d400/0xdb52b77d7ca3681a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1539 expref: 10 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109480.295178:0:192331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6d400/0xdb52b77d7ca3681a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1539 expref: 10 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109480.295188:0:192331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d400, rc 0) 00000100:00100000:3.0:1786109480.295376:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922088960:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 317us (3173us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109480.295384:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1786109480.299106:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109480.344654:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922089088 00000100:00100000:0.0:1786109480.344672:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922089088 00000100:00100000:0.0:1786109480.344806:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:0.0:1786109480.344818:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922089088:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109480.344955:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922089088:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 139us (45864us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786109480.344963:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00010000:00010000:3.0:1786109480.452650:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109481.476701:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109482.500629:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109483.268633:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109483.268643:0:171804:0:(pinger.c:247:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1786109483.268646:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109483.268649:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109483.268654:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109483.268663:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8334 00000100:00080000:0.0:1786109483.268668:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109483.268676:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109483.268718:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9632d80 x1872862933220096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109483.268784:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933220096:0@lo:38:kworker.0 00000100:00100000:1.0:1786109483.268853:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109483.269012:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933220096 00000100:00100000:2.0:1786109483.269019:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933220096 00000100:00100000:2.0:1786109483.269067:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:2.0:1786109483.269075:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933220096:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109483.269097:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1786109483.269398:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109483.269403:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109483.269405:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109483.269409:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8334 00000100:00080000:0.0:1786109483.269412:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109483.269417:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109483.269463:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9631500 x1872862933220352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109483.269509:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933220224:0@lo:400:kworker.0 00000100:00100000:3.0:1786109483.269541:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109483.269577:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933220224 00000100:00100000:3.0:1786109483.269581:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933220224 00000100:00100000:3.0:1786109483.269624:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1786109483.269632:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933220224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109483.269677:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933220224:12345-0@lo:400:kworker.0 Request processed in 46us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109483.269684:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1786109483.269705:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109483.269734:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933220224:0@lo:400:kworker.0 00000100:00100000:1.0:1786109483.269834:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933220352:0@lo:38:kworker.0 00000100:00100000:1.0:1786109483.269861:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109483.269911:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933220352 00000100:00100000:3.0:1786109483.269915:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933220352 00000100:00100000:3.0:1786109483.269935:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:3.0:1786109483.269940:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933220352:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109483.269953:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109483.269980:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933220352:12345-0@lo:38:kworker.0 Request processed in 38us (118us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109483.269986:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:2.0:1786109483.270077:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933220096:12345-0@lo:38:kworker.0 Request processed in 1001us (1223us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109483.270083:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:3.0:1786109483.270291:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1786109483.270321:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109483.270325:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109483.270327:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109483.270331:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8334 00000100:00080000:0.0:1786109483.270334:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1786109483.270339:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109483.270354:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9632680 x1872862933220608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109483.270399:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109483.270403:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109483.270405:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109483.270409:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8334 00000100:00080000:0.0:1786109483.270412:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109483.270415:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109483.270427:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a9780ce00 x1872862933220992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109483.270519:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933220864:0@lo:400:kworker.0 00000100:00100000:2.0:1786109483.270554:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786109483.270585:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109483.270592:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109483.270595:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109483.270596:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933220096:0@lo:38:kworker.0 00000100:00100000:2.0:1786109483.270604:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933220736:0@lo:400:kworker.0 00000100:00100000:1.0:1786109483.270620:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933220608:0@lo:38:kworker.0 00000100:00100000:2.0:1786109483.270632:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109483.270656:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109483.270670:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933220864 00000100:00100000:2.0:1786109483.270675:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933220864 00000100:00100000:1.0:1786109483.270695:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933220992:0@lo:38:kworker.0 00000100:00100000:2.0:1786109483.270715:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933220736 00000100:00100000:2.0:1786109483.270720:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933220736 00000100:00100000:1.0:1786109483.270724:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109483.270753:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6917 00000100:00080000:1.0:1786109483.270754:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109483.270761:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109483.270766:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933220864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109483.270766:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933220352:0@lo:38:kworker.0 00000100:00100000:2.0:1786109483.270812:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933220864:12345-0@lo:400:kworker.0 Request processed in 50us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109483.270819:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6917 00000100:00100000:2.0:1786109483.270831:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6918 00000100:00100000:2.0:1786109483.270838:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933220736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109483.270867:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933220736:12345-0@lo:400:kworker.0 Request processed in 30us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109483.270873:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6918 00000100:00080000:2.0:1786109483.270893:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109483.270895:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109483.270924:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933220736:0@lo:400:kworker.0 00000100:00100000:2.0:1786109483.270938:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933220864:0@lo:400:kworker.0 00000100:00100000:1.0:1786109483.270962:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933220608 00000100:00100000:1.0:1786109483.270967:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933220608 00000100:00100000:1.0:1786109483.270988:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12298 00000100:00100000:1.0:1786109483.270994:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933220608:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109483.271008:0:8451:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109483.271049:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933220992 00000100:00100000:1.0:1786109483.271053:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933220608:12345-0@lo:38:kworker.0 Request processed in 57us (396us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109483.271055:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933220992 00000100:00100000:1.0:1786109483.271063:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12298 00000100:00100000:0.0:1786109483.271085:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1786109483.271091:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933220992:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109483.271102:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109483.271134:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933220992:12345-0@lo:38:kworker.0 Request processed in 42us (412us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109483.271140:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1786109483.271218:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933220480:0@lo:400:kworker.0 00000100:00100000:3.0:1786109483.271251:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109483.271334:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933220480 00000100:00100000:0.0:1786109483.271338:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933220480 00000100:00100000:0.0:1786109483.271382:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1786109483.271389:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933220480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109483.271423:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933220480:12345-0@lo:400:kworker.0 Request processed in 35us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109483.271448:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1786109483.271511:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109483.271515:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109483.271519:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933220608:0@lo:38:kworker.0 00000100:00080000:2.0:1786109483.271530:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109483.271533:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109483.271536:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933220992:0@lo:38:kworker.0 00000100:00080000:3.0:1786109483.271587:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109483.271606:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933220480:0@lo:400:kworker.0 00010000:00010000:1.0:1786109483.532724:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109483.780997:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933221120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109483.781073:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109483.781236:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933221120 00000100:00100000:1.0:1786109483.781244:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933221120 00000100:00100000:3.0:1786109483.781427:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109483.781457:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933221248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109483.781485:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109483.782595:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933221248 00000100:00100000:1.0:1786109483.782603:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933221248 00000100:00100000:1.0:1786109483.782646:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5783 00000100:00100000:1.0:1786109483.782656:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933221120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109483.782686:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109483.782743:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933221120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109483.782749:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5783 00000100:00100000:1.0:1786109483.782765:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5784 00000100:00100000:1.0:1786109483.782771:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933221248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109483.782786:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109483.782811:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933221248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109483.782819:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5784 00000100:00100000:2.0:1786109483.782933:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933221248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109483.782949:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933221120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109484.047653:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109484.047763:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109484.047801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109484.047832:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109484.047873:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922089600 00000100:00100000:0.0:1786109484.047875:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922089216 00000100:00100000:3.0:1786109484.047883:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922089600 00000100:00100000:0.0:1786109484.047895:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922089216 00000100:00100000:3.0:1786109484.047935:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6919 00000100:00100000:0.0:1786109484.047935:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:3.0:1786109484.047945:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922089600:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109484.047945:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2405:x1872862922089216:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109484.048012:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922089600:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 69us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.048012:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2405:x1872862922089216:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 65us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.048021:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:3.0:1786109484.048022:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6919 00000100:00080000:3.0:1786109484.048042:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109484.048282:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922089344 00000100:00100000:1.0:1786109484.048287:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922089344 00000100:00100000:1.0:1786109484.048361:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922089472 00000100:00100000:1.0:1786109484.048365:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922089472 00000100:00100000:0.0:1786109484.048414:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 164 00000100:00080000:3.0:1786109484.048417:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109484.048424:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922089472:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109484.048502:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922089472:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 80us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.048508:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 164 00000100:00100000:0.0:1786109484.048524:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 959 00000100:00100000:0.0:1786109484.048529:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922089344:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:0.0:1786109484.048549:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109484.048576:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922089344:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 46us (934us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109484.048583:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 959 00000100:00100000:2.0:1786109484.292544:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109473/real 1786109473] req@ffff9309825ac000 x1872862933217408/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786109483 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109484.292592:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9309825ac000 x1872862933217408/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786109483 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109484.292612:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109484.292696:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1786109484.292713:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933217408:0@lo:250:kworker.0 00000100:00080000:0.0:1786109484.292764:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 10000000:01000000:3.0:1786109484.292769:0:192324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:0.0:1786109484.292769:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1786109484.292772:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109484.292777:0:171804:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8329 00000100:00080000:0.0:1786109484.292782:0:171804:0:(import.c:589:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 5s 00010000:00010000:3.0:1786109484.292785:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab295e400/0xdb52b77d7ca364a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca364a8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786109484.292786:0:171804:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 10000000:00010000:3.0:1786109484.292796:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab295e400/0xdb52b77d7ca364a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca364a8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.292801:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:0.0:1786109484.292817:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a9780dc00 x1872862933221376/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1786109484.292825:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.292834:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab295e400/0xdb52b77d7ca364a1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca364a8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.292851:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca36407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3640e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.292858:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca36407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3640e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.292863:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00020000:2.0:1786109484.292863:0:3645:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff930a9780dc00 x1872862933221376/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1786109484.292867:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.292870:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca36407 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3640e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.292879:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab295f400/0xdb52b77d7ca36423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3642a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.292885:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab295f400/0xdb52b77d7ca36423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3642a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.292891:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109484.292894:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.292897:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab295f400/0xdb52b77d7ca36423 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3642a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.292904:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0acf200/0xdb52b77d7ca3644d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36454 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.292910:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0acf200/0xdb52b77d7ca3644d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36454 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.292914:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109484.292917:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.292920:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0acf200/0xdb52b77d7ca3644d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36454 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.292928:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0acf800/0xdb52b77d7ca3645b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36462 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.292934:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0acf800/0xdb52b77d7ca3645b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36462 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.292939:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109484.292942:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.292945:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0acf800/0xdb52b77d7ca3645b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36462 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.292953:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0ace000/0xdb52b77d7ca36477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3647e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.292963:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0ace000/0xdb52b77d7ca36477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3647e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.292967:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109484.292970:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.292973:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0ace000/0xdb52b77d7ca36477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3647e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.292980:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab295ea00/0xdb52b77d7ca36485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3648c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.292985:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab295ea00/0xdb52b77d7ca36485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3648c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.292989:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109484.292992:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.292994:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab295ea00/0xdb52b77d7ca36485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3648c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.293002:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab295ee00/0xdb52b77d7ca364af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca364b6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.293008:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab295ee00/0xdb52b77d7ca364af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca364b6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.293013:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109484.293016:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.293019:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab295ee00/0xdb52b77d7ca364af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca364b6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.293036:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac16c2600/0xdb52b77d7ca36415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3641c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.293043:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c2600/0xdb52b77d7ca36415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3641c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.293048:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109484.293051:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.293055:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac16c2600/0xdb52b77d7ca36415 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3641c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.293065:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab295f000/0xdb52b77d7ca36431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36438 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.293071:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab295f000/0xdb52b77d7ca36431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36438 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.293075:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109484.293078:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.293081:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab295f000/0xdb52b77d7ca36431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36438 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.293091:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0acec00/0xdb52b77d7ca3643f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36446 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.293097:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0acec00/0xdb52b77d7ca3643f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36446 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.293101:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786109484.293104:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.293107:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0acec00/0xdb52b77d7ca3643f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36446 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.293115:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca36469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36470 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.293197:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca36469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36470 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.293204:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786109484.293262:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.293267:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca36469 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36470 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.293278:0:192324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab295f200/0xdb52b77d7ca36493 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3649a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.293284:0:192324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab295f200/0xdb52b77d7ca36493 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3649a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.293289:0:192324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786109484.293389:0:192324:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109484.293394:0:192324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab295f200/0xdb52b77d7ca36493 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3649a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786109484.293620:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109484.293629:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109484.293631:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109484.293636:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8339 00000100:00080000:0.0:1786109484.293639:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1786109484.293643:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109484.293664:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a9780ce00 x1872862933221504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109484.293698:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109484.293701:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109484.293703:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109484.293707:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8339 00000100:00080000:0.0:1786109484.293710:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1786109484.293713:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109484.293725:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9660a80 x1872862933221760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109484.293744:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109484.293747:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109484.293749:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109484.293752:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8339 00000100:00080000:0.0:1786109484.293754:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109484.293758:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109484.293770:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0b55f80 x1872862933222016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109484.293779:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109484.293782:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109484.293784:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109484.293788:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8339 00000100:00080000:0.0:1786109484.293790:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1786109484.293793:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109484.293804:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0b55880 x1872862933222144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109484.293832:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933221632:0@lo:400:kworker.0 00000100:00100000:0.0:1786109484.293913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.293949:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109484.293955:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933221888:0@lo:400:kworker.0 00000100:00100000:0.0:1786109484.293978:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.294011:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933221632 00000100:00100000:0.0:1786109484.294017:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933221632 00000100:00100000:0.0:1786109484.294059:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933221888 00000100:00100000:0.0:1786109484.294062:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933221888 00000100:00100000:0.0:1786109484.294083:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1786109484.294092:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933221632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109484.294140:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933221632:12345-0@lo:400:kworker.0 Request processed in 48us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.294147:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1786109484.294164:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1786109484.294170:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933221888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109484.294197:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933221888:12345-0@lo:400:kworker.0 Request processed in 28us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.294203:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1786109484.294255:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933221888:0@lo:400:kworker.0 00000100:00100000:0.0:1786109484.294266:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933221632:0@lo:400:kworker.0 00000100:00080000:3.0:1786109484.307427:0:192324:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff930a8a640000 already not connected (conn 13795, was 0): CONNECTING 00000100:00080000:3.0:1786109484.307453:0:192324:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1786109484.307588:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109484.307615:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00080000:0.0:1786109484.307672:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109484.307677:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1786109484.307680:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1786109484.307688:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:0:1872862933221376:0@lo:250:kworker.0 00000100:00080000:0.0:1786109484.307693:0:171804:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8340 00000100:00080000:0.0:1786109484.307699:0:171804:0:(import.c:589:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109484.307705:0:171804:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109484.307944:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0b54000 x1872862933222272/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109484.307971:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933221504:0@lo:38:kworker.0 00000100:00100000:2.0:1786109484.308038:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.308083:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933221760:0@lo:38:kworker.0 00000100:00100000:2.0:1786109484.308106:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.308130:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933222016:0@lo:38:kworker.0 00000100:00100000:2.0:1786109484.308155:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.308169:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933221504 00000100:00100000:0.0:1786109484.308176:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933221504 00000100:00100000:2.0:1786109484.308191:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933222144:0@lo:38:kworker.0 00000100:00100000:0.0:1786109484.308207:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:2.0:1786109484.308213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.308214:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933221504:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1786109484.308231:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933222272:0@lo:250:kworker.0 00010000:00020000:0.0:1786109484.308233:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109484.308254:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.308269:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933221504:12345-0@lo:38:kworker.0 Request processed in 55us (231us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109484.308276:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00080000:2.0:1786109484.308287:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109484.308291:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109484.308291:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933221760 00000100:00100000:0.0:1786109484.308307:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933221760 00000100:00100000:2.0:1786109484.308308:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933221504:0@lo:38:kworker.0 00000100:00100000:0.0:1786109484.308322:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933222144 00000100:00100000:0.0:1786109484.308324:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933222144 00000100:00100000:0.0:1786109484.308334:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:0.0:1786109484.308339:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933221760:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1786109484.308347:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00010000:00020000:0.0:1786109484.308349:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109484.308351:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933222144:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109484.308360:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109484.308377:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933221760:12345-0@lo:38:kworker.0 Request processed in 37us (270us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109484.308382:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933222144:12345-0@lo:38:kworker.0 Request processed in 31us (169us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109484.308383:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:2.0:1786109484.308387:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:0.0:1786109484.308402:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933222272 00000100:00100000:2.0:1786109484.308403:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933222016 00000100:00100000:2.0:1786109484.308405:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933222016 00000100:00100000:0.0:1786109484.308405:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933222272 00000100:00100000:2.0:1786109484.308421:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12299 00000100:00100000:0.0:1786109484.308425:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786109484.308426:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933222016:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1786109484.308447:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3645:x1872862933222272:12345-0@lo:250:kworker.0 00010000:00020000:2.0:1786109484.308456:0:179257:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1786109484.308472:0:192332:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from aeab97cc-8463-4daa-a678-1bb2ad93cc69@0@lo t0 exp 0000000000000000 cur 8340 last 0 00000020:00000080:0.0:1786109484.308500:0:192332:0:(genops.c:1406:class_connect()) connect: client aeab97cc-8463-4daa-a678-1bb2ad93cc69, cookie 0xdb52b77d7ca36821 00000100:00080000:3.0:1786109484.308558:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109484.308563:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109484.308567:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933221760:0@lo:38:kworker.0 00000100:00080000:3.0:1786109484.308576:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109484.308579:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109484.308581:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933222144:0@lo:38:kworker.0 00000100:00080000:0.0:1786109484.308648:0:192332:0:(import.c:65:import_set_state_nolock()) ffff93098e510000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109484.308749:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+5:3645:x1872862933222272:12345-0@lo:250:kworker.0 Request processed in 316us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.308756:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786109484.308779:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933222016:12345-0@lo:38:kworker.0 Request processed in 351us (622us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109484.308786:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12299 00000100:00100000:3.0:1786109484.308816:0:3645:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.138@tcp: committing for last_committed 0 gen 78 00000100:00080000:3.0:1786109484.308823:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.138@tcp: connect to target with instance 0 00000100:00080000:3.0:1786109484.308831:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1786109484.308835:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1786109484.308839:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1786109484.308840:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1786109484.308910:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1786109484.308926:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933222272:0@lo:250:kworker.0 00000100:00080000:3.0:1786109484.308940:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109484.308943:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109484.308946:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933222016:0@lo:38:kworker.0 00000100:00080000:2.0:1786109484.308960:0:192324:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1786109484.308969:0:192324:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1786109484.309005:0:192324:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 00000020:01000000:0.0:1786109484.309008:0:171804:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.138@tcp 10000000:01000000:2.0:1786109484.309010:0:192324:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 10000000:01000000:0.0:1786109484.309022:0:171804:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1786109484.309024:0:171804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1786109484.309026:0:171804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786109484.309027:0:171804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109484.309028:0:171804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109484.309029:0:171804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109484.309030:0:171804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109484.309031:0:171804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786109484.309033:0:171804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109484.309034:0:171804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1786109484.309090:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933222400:0@lo:253:kworker.0 00000040:01000000:2.0:1786109484.309114:0:192324:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000100:00100000:3.0:1786109484.309123:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1786109484.309138:0:192324:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1786109484.309142:0:192324:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786109484.309143:0:192324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109484.309144:0:192324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109484.309146:0:192324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109484.309147:0:192324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109484.309148:0:192324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109484.309149:0:192324:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109484.309150:0:192324:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109484.309151:0:192324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109484.309152:0:192324:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786109484.309154:0:192324:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1786109484.309157:0:192324:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786109484.309158:0:192324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109484.309159:0:192324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109484.309160:0:192324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109484.309161:0:192324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109484.309162:0:192324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109484.309163:0:192324:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109484.309164:0:192324:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109484.309165:0:192324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109484.309166:0:192324:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000000:0.0:1786109484.309177:0:171804:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1786109484.309180:0:192324:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 10000000:01000000:0.0:1786109484.309183:0:171804:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1786109484.309185:0:171804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1786109484.309186:0:171804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786109484.309187:0:171804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:2.0:1786109484.309188:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933222528:0@lo:253:mount.lustre.0 00000020:01000004:0.0:1786109484.309189:0:171804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109484.309190:0:171804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109484.309191:0:171804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109484.309192:0:171804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786109484.309194:0:171804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109484.309195:0:171804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1786109484.309227:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109484.309234:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933222656:0@lo:253:kworker.0 00000100:00100000:1.0:1786109484.309259:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933222400 00000100:00100000:3.0:1786109484.309262:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.309264:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933222400 00000100:00100000:1.0:1786109484.309288:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933222656 00000100:00100000:1.0:1786109484.309291:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933222656 00000100:00100000:3.0:1786109484.309305:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786109484.309313:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+6:3648:x1872862933222400:12345-0@lo:253:kworker.0 00000100:00100000:1.0:1786109484.309317:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786109484.309322:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+6:3648:x1872862933222656:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1786109484.309335:0:192332:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1786109484.309335:0:192331:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1786109484.309345:0:192331:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000000:0.0:1786109484.309362:0:171804:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1786109484.309368:0:171804:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1786109484.309370:0:171804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1786109484.309371:0:171804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1786109484.309373:0:171804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109484.309374:0:171804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109484.309375:0:171804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109484.309376:0:171804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109484.309377:0:171804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786109484.309378:0:171804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109484.309379:0:171804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1786109484.309399:0:171804:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1786109484.309419:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109484.309428:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933222784:0@lo:253:kworker.0 00000100:00100000:0.0:1786109484.309474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.309495:0:192330:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1786109484.309502:0:192330:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1786109484.309723:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.309879:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933222784 00000100:00100000:1.0:1786109484.309884:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933222784 00000100:00100000:1.0:1786109484.309904:0:192330:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1786109484.309909:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933222528 00000100:00100000:1.0:1786109484.309912:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933222528 00000100:00100000:2.0:1786109484.309944:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109484.309992:0:192336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786109484.310000:0:192336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:3647:x1872862933222784:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1786109484.310016:0:192336:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1786109484.312054:0:192331:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786109484.312093:0:192332:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1786109484.312113:0:192331:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1786109484.312187:0:192334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1786109484.312192:0:192334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786109484.312215:0:192334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109484.312234:0:192334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ab8f6c800/0xdb52b77d7ca36805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1524 expref: 9 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109484.312242:0:192334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109484.312345:0:192334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ab8f6c800/0xdb52b77d7ca36805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1524 expref: 9 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109484.312363:0:192334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ab8f6c800/0xdb52b77d7ca36805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1524 expref: 9 pid: 192332 timeout: 8440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109484.312377:0:192334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c50380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:192334:1872862933222912:192.168.203.38@tcp:104: 00000100:00100000:2.0:1786109484.312487:0:192334:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109484.312852:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:3648:x1872862933222656:12345-0@lo:253:kworker.0 Request processed in 3526us (3585us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109484.312861:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:3.0:1786109484.312876:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1786109484.312879:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1786109484.312880:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109484.312881:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109484.312882:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109484.312884:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109484.312885:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786109484.312886:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109484.312887:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1786109484.312890:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933222656:0@lo:253:kworker.0 00000100:00100000:1.0:1786109484.312895:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786109484.312904:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:192324:x1872862933222528:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1786109484.312939:0:192331:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1786109484.312941:0:192331:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1786109484.312944:0:192331:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1786109484.312951:0:192331:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1786109484.317422:0:192332:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786109484.317446:0:192332:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1786109484.317507:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:192324:x1872862933222528:12345-0@lo:253:mount.lustre.0 Request processed in 4600us (7780us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109484.317518:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786109484.317586:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933222528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1786109484.317600:0:192324:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1786109484.317604:0:192324:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786109484.317605:0:192324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109484.317606:0:192324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109484.317607:0:192324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109484.317608:0:192324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109484.317610:0:192324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109484.317611:0:192324:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109484.317613:0:192324:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109484.317615:0:192324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109484.317616:0:192324:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786109484.317649:0:192324:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93098365d000 from lustre-MDT0000 10000000:01000000:2.0:1786109484.317676:0:192324:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1786109484.317679:0:192324:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1786109484.317688:0:192324:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93098365d000 00000100:00100000:3.0:1786109484.317692:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+6:3648:x1872862933222400:12345-0@lo:253:kworker.0 Request processed in 8379us (8567us total) trans 0 rc 0/0 10000000:01000000:2.0:1786109484.317692:0:192324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1786109484.317697:0:192324:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93098365d000 00000100:00100000:3.0:1786109484.317699:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 10000000:01000000:2.0:1786109484.317700:0:192324:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1786109484.317703:0:192324:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff93098365d000 from 1 10000000:01000000:2.0:1786109484.317705:0:192324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00000020:01000004:3.0:1786109484.317730:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1786109484.317732:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1786109484.317733:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109484.317734:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109484.317735:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109484.317736:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109484.317737:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786109484.317738:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109484.317739:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1786109484.317741:0:192324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109484.317742:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933222400:0@lo:253:kworker.0 00010000:00010000:2.0:1786109484.317751:0:192324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109484.317760:0:192324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109484.317778:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933223040:0@lo:101:mount.lustre.0 20000000:01000000:0.0:1786109484.317809:0:192336:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1786109484.317812:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.317906:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109484.317963:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933223040 00000100:00100000:3.0:1786109484.317969:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933223040 00000100:00100000:1.0:1786109484.318111:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109484.318124:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786109484.318133:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+6:192324:x1872862933223040:12345-0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109484.318134:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922089728 00000100:00100000:1.0:1786109484.318137:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922089728 00010000:00010000:2.0:1786109484.318146:0:192330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109484.318155:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ab8f6c800/0xdb52b77d7ca36805 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1524 expref: 10 pid: 192332 timeout: 8440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109484.318158:0:192330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9360400/0xdb52b77d7ca36836 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3682f expref: -99 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109484.318178:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12635 00010000:00010000:2.0:1786109484.318179:0:192330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9360400/0xdb52b77d7ca36836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3682f expref: 7 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109484.318185:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922089728:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786109484.318190:0:192330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9360400/0xdb52b77d7ca36836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3682f expref: 7 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.318193:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109484.318198:0:192330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360400, rc 0) 00010000:00010000:1.0:1786109484.318198:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930ab8f6c800/0xdb52b77d7ca36805 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1524 expref: 10 pid: 192332 timeout: 8440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.318208:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ab8f6c800/0xdb52b77d7ca36805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1524 expref: 10 pid: 192332 timeout: 8440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.318223:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109484.318226:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:192324:x1872862933223040:12345-0@lo:101:mount.lustre.0 Request processed in 95us (414us total) trans 0 rc 0/0 00010000:00010000:1.0:1786109484.318230:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109484.318232:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 20000000:01000000:1.0:1786109484.318242:0:6513:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006050715s 00010000:00010000:1.0:1786109484.318246:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.318253:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.318260:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.318276:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.318282:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109484.318286:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.318305:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.318314:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109484.318323:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933223040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109484.318323:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109484.318334:0:192324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109484.318342:0:192324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109484.318353:0:192324:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1786109484.318362:0:192324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109484.318366:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922089728:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 181us (257us total) trans 0 rc 0/0 00010000:00010000:2.0:1786109484.318370:0:192324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109484.318372:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12635 10000000:01000000:2.0:1786109484.318376:0:192324:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1786109484.318380:0:192324:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786109484.318384:0:192324:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93098365d000 10000000:01000000:2.0:1786109484.318387:0:192324:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1786109484.318389:0:192324:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1786109484.318391:0:192324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1786109484.318404:0:192324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109484.318412:0:192324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109484.318419:0:192324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.318652:0:192334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6c800/0xdb52b77d7ca36805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1524 expref: 9 pid: 192332 timeout: 8440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109484.318667:0:192334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c50380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:192334:1872862933222912:192.168.203.38@tcp:104: 00000100:00100000:2.0:1786109484.318677:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933223168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109484.318682:0:192334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.318690:0:192334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.318696:0:192334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.318701:0:192334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca36828 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109484.318702:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.318773:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c346c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109484.318812:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933223168 00000100:00100000:3.0:1786109484.318817:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933223168 00000100:00100000:3.0:1786109484.318883:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786109484.318892:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:192324:x1872862933223168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786109484.318900:0:192332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109484.318908:0:192332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6da00/0xdb52b77d7ca36844 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3683d expref: -99 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.318924:0:192332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6da00/0xdb52b77d7ca36844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3683d expref: 8 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.318932:0:192332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6da00/0xdb52b77d7ca36844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3683d expref: 8 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.318939:0:192332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6da00, rc 0) 00000100:00100000:3.0:1786109484.318980:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:192324:x1872862933223168:12345-0@lo:101:mount.lustre.0 Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109484.318986:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786109484.319043:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933223168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109484.319054:0:192324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.319063:0:192324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109484.319113:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933223296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109484.319161:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.319222:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab967c780 going to sleep for 11 seconds 00000100:00100000:2.0:1786109484.319250:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933223296 00000100:00100000:2.0:1786109484.319254:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933223296 00000100:00100000:2.0:1786109484.319320:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786109484.319326:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:192324:x1872862933223296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109484.319463:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:192324:x1872862933223296:12345-0@lo:501:mount.lustre.0 Request processed in 136us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109484.319470:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786109484.319540:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933223296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109484.319584:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933223424:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109484.319624:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.319659:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985db9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109484.319769:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933223424 00000100:00100000:0.0:1786109484.319774:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933223424 00000100:00100000:0.0:1786109484.319804:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786109484.319810:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:192324:x1872862933223424:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109484.320865:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:192324:x1872862933223424:12345-0@lo:503:mount.lustre.0 Request processed in 1051us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.320874:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786109484.320998:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933223424:0@lo:503:mount.lustre.0 20000000:01000000:3.0:1786109484.321205:0:192336:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786109484.321275:0:192336:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1786109484.321556:0:192336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:3647:x1872862933222784:12345-0@lo:253:kworker.0 Request processed in 11556us (12081us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109484.321564:0:192336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000004:0.0:1786109484.321627:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1786109484.321630:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1786109484.321631:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109484.321633:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109484.321634:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109484.321635:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109484.321636:0:3647:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786109484.321638:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109484.321640:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1786109484.321643:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933222784:0@lo:253:kworker.0 20000000:01000000:1.0:1786109484.321680:0:192334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786109484.321684:0:192334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786109484.321703:0:192334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ab9413a00/0xdb52b77d7ca3684b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.321722:0:192334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9413a00/0xdb52b77d7ca3684b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786109484.321730:0:192334:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006050715s 00010000:00010000:1.0:1786109484.321735:0:192334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9413a00/0xdb52b77d7ca3684b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.321740:0:192334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9413a00/0xdb52b77d7ca3684b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.321746:0:192334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ab9413a00/0xdb52b77d7ca3684b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.321753:0:192334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ab9413a00/0xdb52b77d7ca3684b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.321760:0:192334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109484.321763:0:192334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ab9413a00/0xdb52b77d7ca3684b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.321770:0:192334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ab9413a00/0xdb52b77d7ca3684b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.321781:0:192334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ab9413a00/0xdb52b77d7ca3684b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.321788:0:192334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ab9413a00/0xdb52b77d7ca3684b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.321794:0:192334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9413a00/0xdb52b77d7ca3684b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109484.321944:0:192337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c51c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192337:1872862933223552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786109484.321996:0:192337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.322042:0:192337:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109484.322115:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933223552 00000100:00100000:1.0:1786109484.322121:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933223552 00000100:00100000:1.0:1786109484.322160:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786109484.322168:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:192337:x1872862933223552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109484.322718:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:192337:x1872862933223552:12345-0@lo:502:llog_process_th.0 Request processed in 549us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109484.322726:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786109484.322755:0:192337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c51c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192337:1872862933223552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786109484.322780:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109484.322791:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109484.322793:0:192337:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1786109484.322798:0:192337:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1786109484.322801:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786109484.322813:0:192337:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff930984ea8000) 00000020:00000080:2.0:1786109484.322834:0:192337:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1786109484.322840:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1786109484.322935:0:192337:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1786109484.322942:0:192337:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36859 00000020:00000080:2.0:1786109484.323154:0:192337:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1786109484.323158:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109484.323162:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109484.323163:0:192337:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1786109484.323166:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109484.323169:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109484.323171:0:192337:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1786109484.323174:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786109484.323182:0:192337:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff930984ea99c0) 00000020:00000080:2.0:1786109484.323208:0:192337:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1786109484.323213:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1786109484.323214:0:192337:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1786109484.323217:0:192337:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1786109484.323223:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1786109484.323265:0:192337:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93098365d000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1786109484.323276:0:192337:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff930984eacd40) 00000020:00000080:2.0:1786109484.323288:0:192337:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1786109484.323356:0:192337:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1786109484.323361:0:192337:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca3686e 00000020:00000080:2.0:1786109484.323742:0:192337:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1786109484.323750:0:192337:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1786109484.323755:0:192337:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdb52b77d7ca36875 00080000:01000000:2.0:1786109484.323759:0:192337:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1786109484.323762:0:192337:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca3687c 00010000:00010000:2.0:1786109484.370041:0:192337:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1786109484.370176:0:192337:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 397d331e-10fc-4558-be87-308c3622e8eb idx: 0 lr: 326417514631 srv lr: 330712481792 lx: 0 gen 18 00000001:00080000:2.0:1786109484.370220:0:192337:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 326417514497 srv lr: 330712481792 lx: 0 gen 23 00000001:00000004:2.0:1786109484.370243:0:192337:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 78, last_transno is 330712481792 00000001:00080000:2.0:1786109484.370359:0:192337:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1786109484.370414:0:192337:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ab8e2fcc0: xid 1872862932692352, transno 326417514497, client gen 23, slot idx 0 00000001:00080000:2.0:1786109484.370426:0:192337:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ab8e2f3c0: xid 1872862922081536, transno 330712481796, client gen 18, slot idx 1 00000001:00080000:2.0:1786109484.370460:0:192337:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ab8e2f9c0: xid 1872862922081024, transno 330712481795, client gen 18, slot idx 2 00000001:00080000:2.0:1786109484.370467:0:192337:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ac085fcc0: xid 1872862922065408, transno 326417514628, client gen 18, slot idx 3 00000001:00080000:2.0:1786109484.370471:0:192337:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ac085fe40: xid 1872862932692096, transno 322122568361, client gen 23, slot idx 4 00000001:00080000:2.0:1786109484.370476:0:192337:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ac10cbc00: xid 1872862932691584, transno 322122568360, client gen 23, slot idx 5 00000001:00080000:2.0:1786109484.370481:0:192337:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ac10cb9c0: xid 1872862920179840, transno 322122566376, client gen 18, slot idx 7 00000020:00000080:2.0:1786109484.371012:0:192337:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff930ac11b0000) 00000020:00000080:2.0:1786109484.371033:0:192337:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1786109484.371106:0:192337:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1786109484.371113:0:192337:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36898 00000020:00000080:1.0:1786109484.377340:0:192337:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1786109484.380503:0:192337:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdb52b77d7ca3689f 00000020:00000080:2.0:1786109484.380956:0:192337:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1786109484.380979:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109484.380985:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109484.380988:0:192337:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1786109484.380991:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1786109484.380994:0:192337:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1786109484.380996:0:192337:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786109484.380998:0:192337:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786109484.380999:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1786109484.381002:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109484.381004:0:192337:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1786109484.381006:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109484.381011:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109484.381012:0:192337:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1786109484.381017:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1786109484.381057:0:192337:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1786109484.381072:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109484.381076:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109484.381077:0:192337:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1786109484.381080:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109484.381083:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109484.381085:0:192337:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1786109484.381087:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1786109484.381093:0:192337:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:2.0:1786109484.381114:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786109484.381129:0:192337:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9309824819c0) 00000020:00000080:2.0:1786109484.381146:0:192337:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1786109484.381151:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1786109484.381230:0:192337:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1786109484.381237:0:192337:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:2.0:1786109484.381243:0:192337:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca368ad 00010000:00080000:2.0:1786109484.381272:0:192337:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930a9788c000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1786109484.387073:0:192337:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1786109484.390005:0:192337:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109484.390019:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1786109484.390075:0:192337:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1786109484.390099:0:192337:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca368b4 00000100:00080000:3.0:1786109484.390110:0:192337:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786109484.390116:0:192337:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930a9788c000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109484.390166:0:192337:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c21f80 x1872862933223680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109484.390231:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933223680:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1786109484.390311:0:192337:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1786109484.390369:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1786109484.390566:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109484.390570:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109484.390638:0:192337:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1786109484.390643:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1786109484.390645:0:192337:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1786109484.390647:0:192337:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109484.390649:0:192337:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109484.390650:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1786109484.390654:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109484.390656:0:192337:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1786109484.390659:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786109484.390664:0:192337:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1786109484.390667:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109484.390669:0:192337:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1786109484.390672:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1786109484.390676:0:192337:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1786109484.390696:0:192337:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1786109484.390699:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109484.390711:0:192337:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff930ab99d4d40) 00000020:00000080:3.0:1786109484.390728:0:192337:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1786109484.390733:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1786109484.390798:0:192337:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1786109484.390804:0:192337:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:3.0:1786109484.390809:0:192337:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca368c2 00010000:00080000:3.0:1786109484.390838:0:192337:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93098650c000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1786109484.391049:0:192337:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1786109484.391711:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933223680 00000100:00100000:1.0:1786109484.391720:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933223680 00000100:00100000:1.0:1786109484.391766:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12300 00000100:00100000:1.0:1786109484.391776:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933223680:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1786109484.391801:0:177399:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8341 last 0 00000020:00000080:1.0:1786109484.391832:0:177399:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca368c9 00000004:00100000:1.0:1786109484.391846:0:177399:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786109484.391930:0:177399:0:(import.c:65:import_set_state_nolock()) ffff930a87b2c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786109484.392003:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933223680:12345-0@lo:38:llog_process_th.0 Request processed in 227us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109484.392010:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12300 00000100:00100000:3.0:1786109484.392273:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786109484.392282:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 6 00000100:00080000:3.0:1786109484.392288:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1786109484.392304:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1786109484.392307:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a9788c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1786109484.392329:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933223680:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786109484.392463:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109484.392473:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933223808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109484.392511:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109484.392636:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933223808 00000100:00100000:3.0:1786109484.392641:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933223808 00000100:00100000:3.0:1786109484.392681:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12301 00000100:00100000:3.0:1786109484.392689:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933223808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786109484.392713:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:3.0:1786109484.392753:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933223808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109484.392760:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12301 00000100:00100000:3.0:1786109484.392798:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933223808:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1786109484.392948:0:192337:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1786109484.392974:0:192337:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1786109484.393286:0:192337:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 76, last_idx 77 00000040:00080000:1.0:1786109484.393984:0:192337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786109484.394011:0:192337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].78, 64 off13184 00000040:00080000:1.0:1786109484.394203:0:192337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x138:0x0].1, 64 off8256 00000100:00100000:2.0:1786109484.394717:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1786109484.395045:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109484.395050:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109484.395053:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109484.395060:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8340 00000100:00080000:0.0:1786109484.395065:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109484.395072:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109484.395094:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0b57800 x1872862933224064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109484.395163:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933224064:0@lo:38:kworker.0 00000100:00100000:3.0:1786109484.395219:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1786109484.395924:0:192337:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109484.395935:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1786109484.395972:0:192337:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1786109484.395993:0:192337:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca368d0 00000100:00080000:3.0:1786109484.395999:0:192337:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786109484.396002:0:192337:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93098650c000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109484.396021:0:192337:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9660a80 x1872862933224320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109484.396088:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933224320:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1786109484.396126:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.396333:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933224192:0@lo:400:kworker.0 00000100:00100000:2.0:1786109484.396365:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.396389:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933223936:0@lo:400:kworker.0 00000100:00100000:2.0:1786109484.396416:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.396474:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933224320 00000100:00100000:2.0:1786109484.396480:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933224320 00000100:00100000:2.0:1786109484.396508:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23076 00000100:00100000:1.0:1786109484.396600:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933224064 00000100:00100000:1.0:1786109484.396605:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933224064 00000100:00100000:1.0:1786109484.396625:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933224192 00000100:00100000:1.0:1786109484.396627:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933224192 00000100:00100000:1.0:1786109484.396659:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1786109484.396667:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933224192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109484.396738:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933224192:12345-0@lo:400:kworker.0 Request processed in 71us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109484.396745:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1786109484.396761:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:1.0:1786109484.396766:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933224064:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1786109484.396807:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933224064:12345-0@lo:38:kworker.0 Request processed in 39us (1587us total) trans 0 rc -11/-11 00000100:00100000:1.0:1786109484.396813:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00080000:1.0:1786109484.396844:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109484.396848:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1786109484.396851:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933224064:0@lo:38:kworker.0 00000100:00100000:2.0:1786109484.396897:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3645:x1872862933224320:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1786109484.396916:0:43914:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8341 last 0 00000020:00000080:2.0:1786109484.396945:0:43914:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca368d7 00002000:00100000:2.0:1786109484.396957:0:43914:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff930ac1268800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1786109484.396961:0:43914:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1786109484.396964:0:43914:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1786109484.397046:0:43914:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786109484.397066:0:43914:0:(import.c:65:import_set_state_nolock()) ffff93098666d000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1786109484.397170:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109484.397174:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109484.397177:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109484.397181:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8340 00000100:00080000:0.0:1786109484.397184:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109484.397188:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109484.397205:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0b55180 x1872862933224448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109484.397242:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933224320:12345-0@lo:8:llog_process_th.0 Request processed in 346us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109484.397252:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23076 00000100:00100000:2.0:1786109484.397289:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933224192:0@lo:400:kworker.0 00000040:00080000:2.0:1786109484.397495:0:192343:0:(llog.c:805:llog_process_thread()) index: 77, lh_last_idx: 78 synced_idx: 0 lgh_last_idx: 78 00000040:00080000:2.0:1786109484.397500:0:192343:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x134:0x0] at index 77 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1786109484.397672:0:192343:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 77, last_idx 78 00000040:00080000:2.0:1786109484.397693:0:192343:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x134:0x0] at index 77 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1786109484.397826:0:192343:0:(llog.c:805:llog_process_thread()) index: 78, lh_last_idx: 78 synced_idx: 78 lgh_last_idx: 78 00000040:00080000:2.0:1786109484.397830:0:192343:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x138:0x0] at index 78 of catalog [0x1:0x2:0x0] 00000100:00080000:0.0:1786109484.398068:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109484.398073:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109484.398075:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109484.398079:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8340 00000100:00080000:0.0:1786109484.398083:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1786109484.398088:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109484.398103:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0b55c00 x1872862933224704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109484.398127:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109484.398130:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109484.398132:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109484.398135:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8340 00000100:00080000:0.0:1786109484.398138:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109484.398141:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109484.398152:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0b57100 x1872862933225088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109484.398186:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933224960:0@lo:400:kworker.0 00000100:00100000:0.0:1786109484.398226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.398267:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933224960 00000100:00100000:0.0:1786109484.398272:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933224960 00000100:00100000:3.0:1786109484.398339:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933224576:0@lo:400:kworker.0 00000100:00100000:3.0:1786109484.398374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109484.398396:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109484.398402:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933224832:0@lo:400:kworker.0 00000100:00100000:3.0:1786109484.398424:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109484.398472:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933224576 00000100:00100000:3.0:1786109484.398477:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933224576 00000100:00100000:3.0:1786109484.398506:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1786109484.398528:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933224576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109484.398571:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933224576:12345-0@lo:400:kworker.0 Request processed in 58us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109484.398578:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1786109484.398609:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933224576:0@lo:400:kworker.0 00000100:00080000:3.0:1786109484.398631:0:192337:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1786109484.398694:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109484.398699:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109484.398702:0:192337:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1786109484.398705:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1786109484.398707:0:192337:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1786109484.398709:0:192337:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109484.398710:0:192337:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109484.398712:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1786109484.398714:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109484.398715:0:192337:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1786109484.398717:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786109484.398723:0:192337:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1786109484.398726:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109484.398727:0:192337:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1786109484.398730:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1786109484.398733:0:192337:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1786109484.398752:0:192337:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1786109484.398754:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109484.398768:0:192337:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff930ab99d0000) 00000020:00000080:3.0:1786109484.398787:0:192337:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1786109484.398792:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1786109484.398887:0:192337:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1786109484.398892:0:192337:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:3.0:1786109484.398900:0:192337:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca368e5 00010000:00080000:3.0:1786109484.398926:0:192337:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930ac125d800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1786109484.399126:0:192337:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1786109484.399182:0:192337:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1786109484.399196:0:192337:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1786109484.399751:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933224832 00000100:00100000:0.0:1786109484.399757:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933224832 00000100:00100000:0.0:1786109484.399791:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6920 00000100:00100000:0.0:1786109484.399800:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933224960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109484.399858:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933224960:12345-0@lo:400:kworker.0 Request processed in 60us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.399864:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6920 00000100:00100000:0.0:1786109484.399877:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6921 00000100:00100000:0.0:1786109484.399883:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933224832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109484.399913:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933224832:12345-0@lo:400:kworker.0 Request processed in 31us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.399919:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6921 00000100:00100000:0.0:1786109484.399956:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933224960:0@lo:400:kworker.0 00000100:00100000:0.0:1786109484.399984:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933224832:0@lo:400:kworker.0 00000100:00100000:0.0:1786109484.400006:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933223936 00000100:00100000:0.0:1786109484.400010:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933223936 00000100:00100000:0.0:1786109484.400032:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786109484.400038:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:3649:x1872862933223936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109484.400088:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:3649:x1872862933223936:12345-0@lo:400:kworker.0 Request processed in 49us (3670us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.400095:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000040:00080000:0.0:1786109484.400578:0:192337:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 76, last_idx 77 00000100:00100000:2.0:1786109484.401081:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933223936:0@lo:400:kworker.0 00000040:00080000:0.0:1786109484.401731:0:192337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786109484.401765:0:192337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].78, 64 off13184 00000040:00080000:0.0:1786109484.401914:0:192337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13a:0x0].1, 64 off8256 00000100:00100000:1.0:1786109484.402203:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786109484.402216:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 8 00000100:00080000:1.0:1786109484.402226:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1786109484.402232:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1786109484.402236:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098650c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1786109484.402301:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1786109484.402308:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933224320:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1786109484.402332:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933224448:0@lo:38:kworker.0 00000100:00100000:1.0:1786109484.402392:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.402453:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933224448 00000100:00100000:1.0:1786109484.402460:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933224448 00000100:00100000:1.0:1786109484.402490:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1786109484.402498:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933224448:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1786109484.402678:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933224448:12345-0@lo:38:kworker.0 Request processed in 178us (284us total) trans 0 rc -11/-11 00000100:00100000:1.0:1786109484.402684:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00080000:1.0:1786109484.402727:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109484.402732:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1786109484.402735:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933224448:0@lo:38:kworker.0 00000100:00100000:1.0:1786109484.402742:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933224704:0@lo:38:kworker.0 00000100:00100000:1.0:1786109484.402767:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.402798:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933225088:0@lo:38:kworker.0 00000100:00100000:1.0:1786109484.402820:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786109484.402899:0:192343:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1786109484.402961:0:192343:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8341069529001ns, next at 0ns, rc = 0 00080000:00080000:3.0:1786109484.402967:0:192343:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1786109484.403007:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933225088 00000100:00100000:3.0:1786109484.403012:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933225088 00000100:00100000:3.0:1786109484.403034:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1786109484.403039:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933225088:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1786109484.403081:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933225088:12345-0@lo:38:kworker.0 Request processed in 41us (259us total) trans 0 rc -11/-11 00000100:00100000:3.0:1786109484.403087:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00080000:1.0:1786109484.404204:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109484.404213:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1786109484.404217:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933225088:0@lo:38:kworker.0 00000100:00100000:0.0:1786109484.404291:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933224704 00000100:00100000:0.0:1786109484.404307:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933224704 00000100:00100000:0.0:1786109484.404348:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12302 00000100:00100000:0.0:1786109484.404355:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933224704:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1786109484.404456:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933224704:12345-0@lo:38:kworker.0 Request processed in 75us (1663us total) trans 0 rc -11/-11 00000100:00100000:0.0:1786109484.404463:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12302 00000100:00080000:3.0:1786109484.404575:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109484.404580:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1786109484.404583:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933224704:0@lo:38:kworker.0 00000004:00080000:1.0:1786109484.405081:0:192325:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1786109484.405628:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109484.405645:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933225216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109484.405692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.405924:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933225216 00000100:00100000:2.0:1786109484.405931:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933225216 00000100:00100000:2.0:1786109484.405989:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5785 00000100:00100000:2.0:1786109484.405998:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933225216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109484.406020:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109484.406067:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933225216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109484.406074:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5785 00000040:00080000:3.0:1786109484.406142:0:192345:0:(llog.c:805:llog_process_thread()) index: 77, lh_last_idx: 78 synced_idx: 0 lgh_last_idx: 78 00000040:00080000:3.0:1786109484.406147:0:192345:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x136:0x0] at index 77 of catalog [0x1:0x5:0x0] 00000100:00080000:1.0:1786109484.406332:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109484.406373:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933225216:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1786109484.407220:0:192337:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786109484.407234:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1786109484.407276:0:192337:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1786109484.407375:0:192337:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca368ec 00000100:00080000:1.0:1786109484.407385:0:192337:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786109484.407390:0:192337:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff930ac125d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109484.407419:0:192337:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309851f3480 x1872862933225344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109484.407671:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933225344:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1786109484.407729:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786109484.407804:0:192337:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1786109484.407869:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109484.407874:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109484.407876:0:192337:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1786109484.407880:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109484.407884:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109484.407885:0:192337:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1786109484.407887:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786109484.407889:0:192337:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1786109484.407891:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109484.407893:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109484.407894:0:192337:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1786109484.407896:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109484.407897:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109484.407899:0:192337:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1786109484.407902:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1786109484.407930:0:192337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192337:1872862933225472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109484.407978:0:192337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.408009:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933225472 00000100:00100000:1.0:1786109484.408015:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933225472 00000100:00100000:1.0:1786109484.408046:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786109484.408056:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:192337:x1872862933225472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109484.408163:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:192337:x1872862933225472:12345-0@lo:502:llog_process_th.0 Request processed in 108us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109484.408171:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786109484.408209:0:192337:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098469f840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109484.408226:0:192337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192337:1872862933225472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786109484.408248:0:192337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109484.408252:0:192337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109484.408254:0:192337:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1786109484.408257:0:192337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:2.0:1786109484.408332:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933225344 00000100:00100000:2.0:1786109484.408336:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933225344 00000100:00100000:2.0:1786109484.408357:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23077 00000100:00100000:2.0:1786109484.408362:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1872862933225344:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1786109484.408386:0:8442:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8341 last 0 00000020:00000080:2.0:1786109484.408410:0:8442:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca368f3 00002000:00100000:2.0:1786109484.408422:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff930982c97000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1786109484.408426:0:8442:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1786109484.408452:0:8442:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1786109484.408539:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786109484.408562:0:8442:0:(import.c:65:import_set_state_nolock()) ffff930982c94800 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1786109484.408992:0:192324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1786109484.409050:0:192324:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786109484.409075:0:192324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.409087:0:192324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109484.409095:0:192324:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93098365d000 from 1 10000000:01000000:0.0:1786109484.409098:0:192324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786109484.409125:0:192324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.409133:0:192324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.409146:0:192324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109484.409162:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933225600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109484.409199:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.409231:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab967c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109484.409248:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933225600 00000100:00100000:0.0:1786109484.409252:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933225600 00000100:00100000:0.0:1786109484.409284:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786109484.409305:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:192324:x1872862933225600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109484.409314:0:192332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109484.409327:0:192332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0b2d000/0xdb52b77d7ca36901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca368fa expref: -99 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.409347:0:192332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2d000/0xdb52b77d7ca36901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca368fa expref: 9 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.409357:0:192332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0b2d000/0xdb52b77d7ca36901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca368fa expref: 9 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.409365:0:192332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d000, rc 0) 00000100:00100000:0.0:1786109484.409398:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:192324:x1872862933225600:12345-0@lo:101:mount.lustre.0 Request processed in 107us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.409404:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786109484.409464:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933225600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109484.409478:0:192324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36901 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.409487:0:192324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36901 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109484.410138:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933225728:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1786109484.410178:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.410302:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab967c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109484.410396:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933225344:12345-0@lo:8:llog_process_th.0 Request processed in 2031us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109484.410405:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23077 00000100:00100000:1.0:1786109484.410613:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933225728 00000100:00100000:1.0:1786109484.410620:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933225728 00000100:00100000:1.0:1786109484.410696:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786109484.410705:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:192324:x1872862933225728:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1786109484.410722:0:192331:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1786109484.410740:0:192331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1786109484.410744:0:192331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1786109484.410747:0:192331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1786109484.410749:0:192331:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 324 00000100:00100000:1.0:1786109484.410837:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:192324:x1872862933225728:12345-0@lo:256:mount.lustre.0 Request processed in 134us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109484.410844:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786109484.410919:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786109484.410928:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1786109484.410935:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1786109484.410940:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1786109484.410944:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ac125d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1786109484.410967:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1786109484.410973:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933225344:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1786109484.411027:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109484.411036:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933225856:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786109484.411065:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109484.411096:0:179241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933225856 00000100:00100000:3.0:1786109484.411100:0:179241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933225856 00000100:00100000:3.0:1786109484.411143:0:179241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23078 00000100:00100000:3.0:1786109484.411149:0:179241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933225856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786109484.411168:0:179241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:6242 count 1 00000100:00100000:3.0:1786109484.411244:0:179241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933225856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 95us (178us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786109484.411251:0:179241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23078 00000100:00080000:3.0:1786109484.411267:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1786109484.411287:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9309852b9180, transno 0 00000004:00080000:3.0:1786109484.411291:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9309852b9180/1, rc -2, transno 0 00000100:00100000:3.0:1786109484.411309:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933225856:0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1786109484.411467:0:192345:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 77, last_idx 78 00000040:00080000:3.0:1786109484.411493:0:192345:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x136:0x0] at index 77 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1786109484.411507:0:192345:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x136:0x0] index 2 count 1 00000040:00080000:3.0:1786109484.411687:0:192345:0:(llog.c:805:llog_process_thread()) index: 78, lh_last_idx: 78 synced_idx: 78 lgh_last_idx: 78 00000040:00080000:3.0:1786109484.411691:0:192345:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13a:0x0] at index 78 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1786109484.411711:0:192345:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1786109484.411736:0:192345:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8341078304887ns, next at 0ns, rc = 0 00080000:00080000:3.0:1786109484.411742:0:192345:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1786109484.412182:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933225984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109484.412219:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786109484.413159:0:192325:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1786109484.413304:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933225728:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1786109484.414062:0:192324:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786109484.414083:0:192324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36901 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.414095:0:192324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36901 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109484.414104:0:192324:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93098365d000 from 1 10000000:01000000:0.0:1786109484.414106:0:192324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786109484.414137:0:192324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.414145:0:192324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.414154:0:192324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109484.414172:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933226112:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109484.414221:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.414264:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab967c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109484.414352:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933226112 00000100:00100000:0.0:1786109484.414359:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933226112 00000100:00100000:0.0:1786109484.414456:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786109484.414466:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:192324:x1872862933226112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109484.414478:0:192332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109484.414491:0:192332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0b2d800/0xdb52b77d7ca3690f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36908 expref: -99 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.414526:0:192332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2d800/0xdb52b77d7ca3690f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36908 expref: 10 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.414538:0:192332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0b2d800/0xdb52b77d7ca3690f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36908 expref: 10 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.414545:0:192332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d800, rc 0) 00000100:00100000:0.0:1786109484.414581:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:192324:x1872862933226112:12345-0@lo:101:mount.lustre.0 Request processed in 117us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.414588:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786109484.414628:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933226112:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109484.414640:0:192324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109484.414649:0:192324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109484.414704:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933226240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109484.414729:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.414743:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab967c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109484.414759:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933226240 00000100:00100000:0.0:1786109484.414762:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933226240 00000100:00100000:0.0:1786109484.414784:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786109484.414791:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:192324:x1872862933226240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109484.414891:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:192324:x1872862933226240:12345-0@lo:501:mount.lustre.0 Request processed in 100us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.414898:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786109484.414929:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933226240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109484.414956:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933226368:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109484.415001:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.415015:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab967c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109484.415028:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933226368 00000100:00100000:0.0:1786109484.415032:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933226368 00000100:00100000:0.0:1786109484.415049:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786109484.415055:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:192324:x1872862933226368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109484.415132:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:192324:x1872862933226368:12345-0@lo:503:mount.lustre.0 Request processed in 76us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.415138:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786109484.415180:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933226368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109484.415461:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933225984 00000100:00100000:2.0:1786109484.415466:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933225984 00000100:00100000:2.0:1786109484.415505:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5786 00000100:00100000:2.0:1786109484.415713:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933225984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786109484.415732:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109484.415792:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933225984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 280us (3571us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109484.415799:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5786 00000100:00100000:1.0:1786109484.415875:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933225984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109484.418665:0:192347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192347:1872862933226496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786109484.418760:0:192347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.418808:0:192347:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac10cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109484.418870:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933226496 00000100:00100000:0.0:1786109484.418878:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933226496 00000100:00100000:0.0:1786109484.418932:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786109484.418943:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:192347:x1872862933226496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109484.419350:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:192347:x1872862933226496:12345-0@lo:502:llog_process_th.0 Request processed in 407us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.419358:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786109484.419492:0:192347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192347:1872862933226496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786109484.419590:0:192347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109484.419603:0:192347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109484.419606:0:192347:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1786109484.419614:0:192347:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93098365d000 00000020:00000080:2.0:1786109484.419617:0:192347:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786109484.419626:0:192347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109484.419628:0:192347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109484.419629:0:192347:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1786109484.419632:0:192347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109484.419634:0:192347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109484.419636:0:192347:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1786109484.419639:0:192347:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93098365d000 00000020:00000080:2.0:1786109484.419641:0:192347:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786109484.419705:0:192347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192347:1872862933226624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786109484.419742:0:192347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.419780:0:192347:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac10cbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109484.420359:0:192336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933226624 00000100:00100000:3.0:1786109484.420366:0:192336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933226624 00000100:00100000:3.0:1786109484.420415:0:192336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786109484.420425:0:192336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:192347:x1872862933226624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109484.420627:0:192336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:192347:x1872862933226624:12345-0@lo:502:llog_process_th.0 Request processed in 203us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109484.420634:0:192336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786109484.420682:0:192347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192347:1872862933226624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786109484.420706:0:192347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109484.420711:0:192347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109484.420713:0:192347:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1786109484.420717:0:192347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1786109484.421512:0:192324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1786109484.422679:0:192324:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786109484.422704:0:192324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.422717:0:192324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109484.422798:0:192324:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1786109484.422801:0:192324:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93098365d000 10000000:01000000:1.0:1786109484.422804:0:192324:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93098365d000 10000000:01000000:1.0:1786109484.422810:0:192324:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786109484.422816:0:192324:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93098365d000 from 1 10000000:01000000:1.0:1786109484.422819:0:192324:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786109484.422858:0:192324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.422867:0:192324:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.422878:0:192324:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109484.422900:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933226752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109484.422966:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.423015:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109484.423041:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933226752 00000100:00100000:1.0:1786109484.423048:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933226752 00000100:00100000:1.0:1786109484.423088:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786109484.423097:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2e89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:192324:x1872862933226752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109484.423111:0:192332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109484.423124:0:192332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9412600/0xdb52b77d7ca3691d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36916 expref: -99 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.423146:0:192332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9412600/0xdb52b77d7ca3691d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36916 expref: 11 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.423159:0:192332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9412600/0xdb52b77d7ca3691d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36916 expref: 11 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.423166:0:192332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412600, rc 0) 00000100:00100000:1.0:1786109484.423205:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2e89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192324:x1872862933226752:12345-0@lo:101:mount.lustre.0 Request processed in 108us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109484.423211:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786109484.423260:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933226752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109484.423274:0:192324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.423282:0:192324:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109484.423913:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933226880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109484.423947:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.423974:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109484.423991:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933226880 00000100:00100000:1.0:1786109484.423995:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933226880 00000100:00100000:1.0:1786109484.424024:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786109484.424031:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2e89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192324:x1872862933226880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109484.424150:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2e89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192324:x1872862933226880:12345-0@lo:501:mount.lustre.0 Request processed in 119us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109484.424157:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786109484.424196:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933226880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109484.424225:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933227008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109484.424262:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.424278:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a87f70a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109484.424305:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933227008 00000100:00100000:1.0:1786109484.424309:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933227008 00000100:00100000:1.0:1786109484.424331:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786109484.424337:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2e8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192324:x1872862933227008:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109484.424413:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2e8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192324:x1872862933227008:12345-0@lo:503:mount.lustre.0 Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109484.424420:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786109484.424482:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933227008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109484.425382:0:192349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192349:1872862933227136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109484.425599:0:192349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.425651:0:192349:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab967c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109484.425695:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933227136 00000100:00100000:1.0:1786109484.425702:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933227136 00000100:00100000:1.0:1786109484.425782:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786109484.425791:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2e8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192349:x1872862933227136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109484.425918:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2e8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192349:x1872862933227136:12345-0@lo:502:llog_process_th.0 Request processed in 127us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109484.425926:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1786109484.425996:0:192349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192349:1872862933227136:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1786109484.426055:0:192349:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1786109484.426069:0:192349:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff930a97cb99c0) 00000020:00000080:0.0:1786109484.426094:0:192349:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1786109484.430277:0:192349:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93098365d000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1786109484.430287:0:192349:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93098365d000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1786109484.430290:0:192349:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93098365d000 4 00010000:00080000:0.0:1786109484.432376:0:192349:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930ab1981000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1786109484.437269:0:192349:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1786109484.438451:0:192349:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1786109484.438502:0:192349:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786109484.438530:0:192349:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdb52b77d7ca3692b 00000100:00080000:0.0:1786109484.438542:0:192349:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786109484.438547:0:192349:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff930ab1981000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109484.438583:0:192349:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0b54e00 x1872862933227264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109484.438613:0:192349:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1786109484.438915:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933227264:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786109484.438983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.439334:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933227264 00000100:00100000:0.0:1786109484.439342:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933227264 00000100:00100000:0.0:1786109484.439384:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:0.0:1786109484.439392:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933227264:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786109484.439485:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933227264:12345-0@lo:38:llog_process_th.0 Request processed in 93us (502us total) trans 0 rc -11/-11 00000100:00100000:0.0:1786109484.439493:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:0.0:1786109484.440340:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786109484.440349:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab1981000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109484.440354:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1786109484.440357:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933227264:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786109484.440706:0:192349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192349:1872862933227392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109484.440766:0:192349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.440797:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933227392 00000100:00100000:0.0:1786109484.440802:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933227392 00000100:00100000:0.0:1786109484.440836:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786109484.440845:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192349:x1872862933227392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109484.440952:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2e8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192349:x1872862933227392:12345-0@lo:502:llog_process_th.0 Request processed in 107us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109484.440959:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786109484.441014:0:192349:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a88ff2780 going to sleep for 11 seconds 00000100:00100000:0.0:1786109484.441028:0:192349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192349:1872862933227392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109484.441063:0:192349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192349:1872862933227520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109484.441094:0:192349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109484.441637:0:192349:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a88ff2780 going to sleep for 11 seconds 00000100:00100000:2.0:1786109484.443367:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933227520 00000100:00100000:2.0:1786109484.443380:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933227520 00000100:00100000:2.0:1786109484.444403:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1786109484.444415:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2e8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192349:x1872862933227520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786109484.444596:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2e8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192349:x1872862933227520:12345-0@lo:502:llog_process_th.0 Request processed in 183us (3500us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109484.444603:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786109484.444760:0:192349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192349:1872862933227520:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1786109484.444797:0:192349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1786109484.446153:0:192324:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1786109484.446181:0:192324:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786109484.446238:0:192324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.446250:0:192324:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786109484.446343:0:192324:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786109484.446345:0:192324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786109484.446346:0:192324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109484.446348:0:192324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109484.446349:0:192324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109484.446350:0:192324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109484.446352:0:192324:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786109484.446353:0:192324:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786109484.446355:0:192324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109484.446357:0:192324:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786109484.446360:0:192324:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1786109484.446363:0:192324:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786109484.446364:0:192324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786109484.446365:0:192324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109484.446366:0:192324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109484.446368:0:192324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109484.446369:0:192324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109484.446370:0:192324:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786109484.446371:0:192324:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786109484.446372:0:192324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109484.446373:0:192324:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786109484.446394:0:192324:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1786109484.446411:0:192324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933227648:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1786109484.446497:0:192324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.446604:0:192324:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a87f70d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109484.448349:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933227648 00000100:00100000:2.0:1786109484.448362:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933227648 00000100:00100000:2.0:1786109484.448416:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1786109484.448426:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2e8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192324:x1872862933227648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1786109484.448475:0:192330:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1786109484.448492:0:192330:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1786109484.452243:0:192330:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1786109484.452262:0:192330:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1786109484.452581:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2e8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:192324:x1872862933227648:12345-0@lo:253:mount.lustre.0 Request processed in 4152us (6080us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109484.452593:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 20000000:01000000:1.0:1786109484.452716:0:192334:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786109484.452721:0:192334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786109484.452741:0:192334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.452757:0:192334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ac0b2d000/0xdb52b77d7ca36901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca368fa expref: 10 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.452765:0:192334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.452802:0:192334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ac0b2d000/0xdb52b77d7ca36901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca368fa expref: 10 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.452815:0:192334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ac0b2d000/0xdb52b77d7ca36901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb52b77d7ca368fa expref: 10 pid: 192332 timeout: 8441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109484.452829:0:192334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:192334:1872862933227776:0@lo:104: 00000100:00100000:1.0:1786109484.452866:0:192334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.452920:0:192334:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac20f96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109484.453021:0:192324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:192324:1872862933227648:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1786109484.453033:0:192324:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1786109484.453036:0:192324:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786109484.453038:0:192324:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786109484.453039:0:192324:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109484.453040:0:192324:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109484.453042:0:192324:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109484.453043:0:192324:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109484.453044:0:192324:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786109484.453046:0:192324:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786109484.453048:0:192324:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109484.453049:0:192324:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1786109484.453064:0:192324:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1786109484.453611:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933227776 00000100:00100000:2.0:1786109484.453618:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933227776 00000100:00100000:2.0:1786109484.453659:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5260 00000100:00100000:2.0:1786109484.453668:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:192334:x1872862933227776:12345-0@lo:104: 00010000:00010000:2.0:1786109484.453680:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca36901 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109484.453736:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786109484.453742:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:192334:x1872862933227776:12345-0@lo:104: Request processed in 75us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109484.453749:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5260 00000100:00100000:1.0:1786109484.453963:0:192334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:192334:1872862933227776:0@lo:104: 00010000:00010000:1.0:1786109484.453981:0:192334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.454030:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109484.454038:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca36901 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.454045:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2ca00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109484.454049:0:29734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb52b77d7ca36901 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.454058:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca36901 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109484.454065:0:29734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca36901 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109484.454071:0:29734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109484.454218:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36901 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.454226:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109484.454303:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36901 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.454312:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ca00/0xdb52b77d7ca368fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36901 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.454326:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109484.454328:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109484.454330:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109484.454343:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933227904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109484.454376:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109484.455364:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933227904 00000100:00100000:1.0:1786109484.455371:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933227904 00010000:00010000:1.0:1786109484.455396:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ac0b2d000/0xdb52b77d7ca36901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca368fa expref: 11 pid: 192332 timeout: 8441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109484.455659:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12636 00000100:00100000:1.0:1786109484.455672:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:3648:x1872862933227904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109484.455684:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109484.455691:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930ac0b2d000/0xdb52b77d7ca36901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca368fa expref: 11 pid: 192332 timeout: 8441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.455701:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ac0b2d000/0xdb52b77d7ca36901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb52b77d7ca368fa expref: 11 pid: 192332 timeout: 8441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.455714:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2d000/0xdb52b77d7ca36901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca368fa expref: 11 pid: 192332 timeout: 8441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.455727:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.455735:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786109484.455748:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006050715s 00010000:00010000:1.0:1786109484.455751:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.455757:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.455764:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.455770:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.455776:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109484.455780:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.455787:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.455813:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109484.455823:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109484.455876:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:3648:x1872862933227904:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (1499us total) trans 0 rc 0/0 00010000:00010000:3.0:1786109484.455914:0:192334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.455923:0:192334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109484.455928:0:192334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9412c00/0xdb52b77d7ca36932 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 192334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109484.456590:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933227904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109484.456682:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12636 00000020:00080000:3.0:1786109484.460120:0:192324:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 322122568692 00000040:01000000:3.0:1786109484.460456:0:192324:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1786109484.460798:0:192356:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1786109484.463486:0:192324:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1786109484.464544:0:192357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c50380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192357:1872862933228032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109484.464618:0:192357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.464657:0:192357:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac10cb540 going to sleep for 11 seconds 00000040:01000000:0.0:1786109484.465131:0:192324:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1786109484.465173:0:192324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1786109484.465884:0:192324:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1786109484.465894:0:192324:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1786109484.465938:0:192324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1786109484.466640:0:192355:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 322122568692 00000020:00080000:1.0:1786109484.466645:0:192355:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 322122568692 00000040:00080000:3.0:1786109484.467029:0:192356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1786109484.467109:0:192356:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1786109484.467157:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933228032 00000100:00100000:3.0:1786109484.467165:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933228032 00000100:00100000:3.0:1786109484.467212:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12303 00000100:00100000:3.0:1786109484.467222:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192357:x1872862933228032:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1786109484.468288:0:192324:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1786109484.468393:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192357:x1872862933228032:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1170us (3772us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109484.468404:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12303 00000100:00100000:2.0:1786109484.468704:0:192357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c50380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192357:1872862933228032:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1786109484.468741:0:192357:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1786109484.468784:0:192357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c50380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192357:1872862933228160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109484.468828:0:192357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.468869:0:192357:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac10cb540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109484.468925:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933228160 00000100:00100000:1.0:1786109484.468931:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933228160 00000100:00100000:1.0:1786109484.468975:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12304 00000100:00100000:1.0:1786109484.468983:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192357:x1872862933228160:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109484.469110:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192357:x1872862933228160:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 128us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109484.469117:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12304 00000100:00100000:3.0:1786109484.469179:0:192357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c50380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192357:1872862933228160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1786109484.469246:0:192357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852bbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192357:1872862933228288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1786109484.469272:0:192357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109484.469334:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933228288 00000100:00100000:2.0:1786109484.469339:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933228288 00000100:00100000:2.0:1786109484.469364:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12305 00000100:00100000:2.0:1786109484.469371:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192357:x1872862933228288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109484.469419:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192357:x1872862933228288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 48us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109484.469425:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12305 00000100:00100000:3.0:1786109484.469657:0:192357:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098261c300 going to sleep for 11 seconds 00000100:00100000:3.0:1786109484.469672:0:192357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852bbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192357:1872862933228288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1786109484.469739:0:192357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852bbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192357:1872862933228416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1786109484.469789:0:192357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109484.469802:0:192357:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098261ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109484.469851:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933228416 00000100:00100000:1.0:1786109484.469855:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933228416 00000100:00100000:1.0:1786109484.469892:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12306 00000100:00100000:1.0:1786109484.469899:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192357:x1872862933228416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109484.470060:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:192357:x1872862933228416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 161us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109484.470067:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12306 00000100:00100000:3.0:1786109484.470374:0:192357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852bbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:192357:1872862933228416:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1786109484.471083:0:192324:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1786109484.471123:0:192324:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1786109484.471227:0:192324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109484.473986:0:192357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1786109484.474068:0:192357:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1786109484.474073:0:192357:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:1.0:1786109484.474949:0:192324:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x81:0x0] (8/32) registered 00010000:00080000:3.0:1786109484.477094:0:192324:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 330712481796 00010000:00080000:2.0:1786109484.478030:0:192358:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 192358 00010000:02000000:2.0:1786109484.478081:0:192358:0:(ldlm_lib.c:2336:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1786109484.478086:0:192358:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1786109484.478090:0:192358:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1786109484.478166:0:192324:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1786109484.478183:0:192324:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1786109484.478227:0:192324:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1786109484.478251:0:192324:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1786109484.481249:0:192324:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1786109484.482491:0:192324:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1786109484.548703:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109485.552620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109485.552716:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922089856 00000100:00100000:1.0:1786109485.552726:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922089856 00000100:00100000:1.0:1786109485.552863:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:1.0:1786109485.552873:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2e8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:15195:x1872862922089856:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109485.552891:0:192331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109485.552910:0:192331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9412200/0xdb52b77d7ca36939 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1540 expref: -99 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109485.552942:0:192331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9412200/0xdb52b77d7ca36939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1540 expref: 10 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109485.552954:0:192331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9412200/0xdb52b77d7ca36939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1540 expref: 10 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109485.552963:0:192331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412200, rc 0) 00000100:00100000:1.0:1786109485.553025:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2e8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922089856:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 153us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109485.553031:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00010000:00010000:2.0:1786109485.573483:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109485.575988:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109485.578786:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922089984 00000100:00100000:2.0:1786109485.578800:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922089984 00000100:00100000:2.0:1786109485.578866:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:2.0:1786109485.578876:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922089984:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1786109485.578902:0:192332:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1786109485.578922:0:192332:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786109485.578925:0:192332:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1786109485.578928:0:192332:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1786109485.578930:0:192332:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1786109485.578932:0:192332:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 325 00000100:00100000:2.0:1786109485.676480:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:15195:x1872862922089984:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 Request processed in 97595us (100489us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109485.676494:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:2.0:1786109485.713585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109485.713709:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922090112 00000100:00100000:1.0:1786109485.713719:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922090112 00000100:00100000:1.0:1786109485.713767:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 967 00000100:00100000:1.0:1786109485.713775:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922090112:12345-192.168.203.38@tcp:38:ll_cfg_requeue.0 00010000:00080000:1.0:1786109485.713807:0:187900:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '397d331e-10fc-4558-be87-308c3622e8eb' at ffff930986508000, cookie 0xdb52b77d7ca36883 00010000:00080000:1.0:1786109485.713813:0:187900:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp recovering/t322122566376 exp ffff930986508000 cur 8342 last 1786109484 00010000:02000400:1.0:1786109485.713822:0:187900:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1786109485.713828:0:187900:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1786109485.713847:0:187900:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1786109485.714836:0:187900:0:(import.c:65:import_set_state_nolock()) ffff930981e11000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786109485.716424:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862922090112:12345-192.168.203.38@tcp:38:ll_cfg_requeue.0 Request processed in 2640us (2840us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109485.716450:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 967 00000100:00100000:2.0:1786109485.734060:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109485.734230:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862920179840 00000100:00100000:0.0:1786109485.734343:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862920179840 00000100:00100000:0.0:1786109485.734846:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 968 00000100:00100000:0.0:1786109485.734859:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862920179840:12345-192.168.203.38@tcp:101:lfs.0 00010000:00080000:0.0:1786109485.734877:0:187899:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 330712481797, current: 322122566376, replaying 00010000:00010000:0.0:1786109485.734886:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109485.734912:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca36940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc494ce7 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109485.738390:0:187899:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3425us 00000004:00200000:0.0:1786109485.796008:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00000004:00080000:0.0:1786109485.796037:0:187899:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20001a9e3:0x191b:0x0], cookie = 0xdb52b77d7c9f9555 00000004:00080000:0.0:1786109485.796039:0:187899:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xdb52b77d7c9f9555 in new mfd 00010000:00010000:0.0:1786109485.796159:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca36940 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109485.796174:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a83abd200) 00010000:00010000:0.0:1786109485.796177:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786109485.796182:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2d200/0xdb52b77d7ca36940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109485.796200:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d200, rc 0) 00010000:02000000:0.0:1786109485.796206:0:187899:0:(ldlm_lib.c:3345:target_send_reply_msg()) *** cfs_fail_loc=157, val=2147483648*** 00010000:00020000:0.0:1786109485.803995:0:187899:0:(ldlm_lib.c:3346:target_send_reply_msg()) @@@ dropping reply req@ffff930a9780ce00 x1872862920179840/t322122566376(322122566376) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:711/0 lens 520/664 e 0 to 0 dl 1786109496 ref 1 fl Interpret:/604/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1786109485.851425:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+7:2401:x1872862920179840:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 116555us (117358us total) trans 322122566376 rc 301/0 00000100:00100000:0.0:1786109485.863653:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 968 10000000:01000000:1.0:1786109486.212507:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786109486.212515:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93098365d000 from 325 10000000:01000000:1.0:1786109486.212523:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786109486.212576:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.212586:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.212597:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109486.212624:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9630380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933228544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.212730:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.212786:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109486.212871:0:192336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933228544 00000100:00100000:2.0:1786109486.212879:0:192336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933228544 00000100:00100000:2.0:1786109486.212939:0:192336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786109486.212948:0:192336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098dbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:6524:x1872862933228544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109486.212963:0:192336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109486.212977:0:192336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9361200/0xdb52b77d7ca36955 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3694e expref: -99 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.212999:0:192336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9361200/0xdb52b77d7ca36955 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3694e expref: 11 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.213015:0:192336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9361200/0xdb52b77d7ca36955 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3694e expref: 11 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.213023:0:192336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9361200, rc 0) 00000100:00100000:2.0:1786109486.213354:0:192336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098dbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933228544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 407us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109486.213361:0:192336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786109486.213474:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9630380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933228544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109486.213490:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.213499:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109486.213560:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933228672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786109486.213596:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109486.213616:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098e37a180 going to sleep for 11 seconds 00000100:00100000:2.0:1786109486.213691:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933228672 00000100:00100000:2.0:1786109486.213696:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933228672 00000100:00100000:2.0:1786109486.213729:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1786109486.213737:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098dbcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933228672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1786109486.213752:0:192330:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1786109486.213768:0:192330:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786109486.213771:0:192330:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 325 00000100:00100000:2.0:1786109486.213844:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098dbcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933228672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109486.213852:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1786109486.214385:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933228672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1786109486.214459:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786109486.214466:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.214474:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109486.214482:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786109486.214485:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930a92e3e800 from 52 10000000:01000000:1.0:1786109486.214487:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786109486.214508:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca3695c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.214514:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca3695c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.214526:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca3695c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109486.214540:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933228800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.214572:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.214606:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.214620:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933228800 00000100:00100000:1.0:1786109486.214624:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933228800 00000100:00100000:1.0:1786109486.214653:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786109486.214660:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098dbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933228800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109486.214668:0:192331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109486.214680:0:192331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca36963 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3695c expref: -99 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.214699:0:192331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca36963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3695c expref: 12 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.214709:0:192331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca36963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3695c expref: 12 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.214716:0:192331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413200, rc 0) 00000100:00100000:1.0:1786109486.214744:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098dbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933228800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.214750:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786109486.214781:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933228800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109486.214790:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca3695c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36963 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.214798:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca3695c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36963 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109486.214844:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933228928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.214870:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.214883:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.214893:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933228928 00000100:00100000:1.0:1786109486.214896:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933228928 00000100:00100000:1.0:1786109486.214914:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786109486.214920:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098dbc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933228928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.215027:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098dbc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933228928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.215033:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786109486.215059:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933228928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.215083:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.215122:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.215135:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.215144:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933229056 00000100:00100000:1.0:1786109486.215148:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933229056 00000100:00100000:1.0:1786109486.215167:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786109486.215172:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098dbc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933229056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.215247:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098dbc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933229056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.215253:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786109486.216671:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786109486.219909:0:192427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1786109486.222364:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1786109486.222406:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786109486.222418:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca3695c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36963 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.222493:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca3695c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36963 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109486.222504:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786109486.222508:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930a92e3e800 from 322 10000000:01000000:1.0:1786109486.222510:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786109486.222553:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412a00/0xdb52b77d7ca3696a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.222563:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9412a00/0xdb52b77d7ca3696a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.222575:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9412a00/0xdb52b77d7ca3696a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109486.222601:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.222668:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.222938:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109486.223859:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933229184 00000100:00100000:2.0:1786109486.223869:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933229184 00000100:00100000:2.0:1786109486.223961:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786109486.223971:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933229184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109486.223988:0:192330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109486.224006:0:192330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9361800/0xdb52b77d7ca36971 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3696a expref: -99 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.224030:0:192330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9361800/0xdb52b77d7ca36971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3696a expref: 13 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.224044:0:192330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9361800/0xdb52b77d7ca36971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3696a expref: 13 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.224051:0:192330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9361800, rc 0) 00000100:00100000:2.0:1786109486.224126:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933229184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109486.224132:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786109486.224204:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109486.224221:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9412a00/0xdb52b77d7ca3696a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36971 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.224230:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9412a00/0xdb52b77d7ca3696a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36971 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109486.224311:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786109486.224349:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109486.224496:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098e37a180 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.224696:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933229312 00000100:00100000:1.0:1786109486.224701:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933229312 00000100:00100000:1.0:1786109486.224732:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786109486.224740:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933229312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1786109486.224755:0:192331:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1786109486.224774:0:192331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1786109486.224778:0:192331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1786109486.224781:0:192331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1786109486.224784:0:192331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1786109486.224786:0:192331:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 325 00000100:00100000:1.0:1786109486.224870:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933229312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.224877:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786109486.224913:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1786109486.224993:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786109486.225000:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412a00/0xdb52b77d7ca3696a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36971 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.225026:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9412a00/0xdb52b77d7ca3696a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36971 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109486.225036:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1786109486.225038:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1786109486.225040:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1786109486.225059:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412000/0xdb52b77d7ca36978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.225066:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9412000/0xdb52b77d7ca36978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.225074:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9412000/0xdb52b77d7ca36978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109486.225086:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.225110:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.225125:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.225136:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933229440 00000100:00100000:1.0:1786109486.225140:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933229440 00000100:00100000:1.0:1786109486.225160:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786109486.225165:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2dd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933229440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109486.225172:0:192331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109486.225182:0:192331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca3697f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36978 expref: -99 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.225197:0:192331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca3697f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36978 expref: 14 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.225205:0:192331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca3697f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36978 expref: 14 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.225212:0:192331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413800, rc 0) 00000100:00100000:1.0:1786109486.225238:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2dd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933229440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.225243:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786109486.225269:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109486.225292:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9412000/0xdb52b77d7ca36978 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3697f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.225300:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9412000/0xdb52b77d7ca36978 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3697f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109486.225346:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.225367:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.225378:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.225387:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933229568 00000100:00100000:1.0:1786109486.225390:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933229568 00000100:00100000:1.0:1786109486.225408:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786109486.225414:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2dd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933229568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.225627:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2dd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933229568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.225634:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786109486.225659:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.225683:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.225721:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.225733:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.225744:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933229696 00000100:00100000:1.0:1786109486.225747:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933229696 00000100:00100000:1.0:1786109486.225765:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786109486.225770:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2dd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933229696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.245401:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2dd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933229696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 19613us (19663us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.245422:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786109486.246156:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786109486.249809:0:192428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1786109486.256384:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1786109486.256480:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1786109486.256497:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412000/0xdb52b77d7ca36978 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3697f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.256527:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9412000/0xdb52b77d7ca36978 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3697f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109486.256547:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1786109486.256551:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff930a92e3e800 from 1 10000000:01000000:1.0:1786109486.256554:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1786109486.256612:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413e00/0xdb52b77d7ca36986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.256621:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9413e00/0xdb52b77d7ca36986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.256636:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9413e00/0xdb52b77d7ca36986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109486.256671:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.258245:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109486.258341:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933229824 00000100:00100000:2.0:1786109486.258357:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933229824 00000100:00100000:2.0:1786109486.258458:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786109486.258469:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2dd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933229824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109486.258487:0:192330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109486.258505:0:192330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca3698d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36986 expref: -99 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.258533:0:192330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca3698d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36986 expref: 15 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.258546:0:192330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca3698d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36986 expref: 15 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.258556:0:192330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9361e00, rc 0) 00000100:00100000:2.0:1786109486.258690:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2dd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933229824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109486.258700:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1786109486.258705:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.258746:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109486.258788:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9413e00/0xdb52b77d7ca36986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3698d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.258802:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9413e00/0xdb52b77d7ca36986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3698d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109486.258826:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1786109486.258832:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413e00/0xdb52b77d7ca36986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3698d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.258840:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9413e00/0xdb52b77d7ca36986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3698d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109486.258856:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786109486.258859:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930a92e3e800 from 7 10000000:01000000:1.0:1786109486.258862:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786109486.258898:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412400/0xdb52b77d7ca36994 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.258906:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9412400/0xdb52b77d7ca36994 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.258915:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9412400/0xdb52b77d7ca36994 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109486.258939:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.258993:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.259032:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109486.259068:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933229952 00000100:00100000:0.0:1786109486.259076:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933229952 00000100:00100000:0.0:1786109486.259124:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786109486.259133:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2a75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933229952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109486.259142:0:192332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109486.259153:0:192332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0b2da00/0xdb52b77d7ca3699b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36994 expref: -99 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109486.259170:0:192332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2da00/0xdb52b77d7ca3699b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36994 expref: 16 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109486.259180:0:192332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0b2da00/0xdb52b77d7ca3699b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36994 expref: 16 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109486.259187:0:192332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2da00, rc 0) 00000100:00100000:0.0:1786109486.259244:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2a75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933229952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109486.259250:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786109486.259338:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933229952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109486.259356:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9412400/0xdb52b77d7ca36994 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3699b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.259366:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9412400/0xdb52b77d7ca36994 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3699b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109486.259474:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.259512:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109486.259620:0:192336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933230080 00000100:00100000:3.0:1786109486.259625:0:192336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933230080 00000100:00100000:3.0:1786109486.259660:0:192336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1786109486.259668:0:192336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933230080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109486.259771:0:192336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933230080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109486.259778:0:192336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786109486.259848:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81388600 going to sleep for 11 seconds 00000100:00100000:0.0:1786109486.259864:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109486.259893:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109486.259992:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109486.260013:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930986044f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109486.260064:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933230208 00000100:00100000:3.0:1786109486.260068:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933230208 00000100:00100000:3.0:1786109486.260134:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1786109486.260141:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2a77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933230208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109486.260228:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2a77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933230208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109486.260235:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786109486.260313:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786109486.261340:0:192429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1786109486.261684:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1786109486.261707:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786109486.261716:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412400/0xdb52b77d7ca36994 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3699b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.261726:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9412400/0xdb52b77d7ca36994 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3699b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109486.261736:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786109486.261738:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930ab7c47000 from 52 10000000:01000000:2.0:1786109486.261741:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786109486.261770:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.261778:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.261788:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109486.261806:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.261852:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109486.261928:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81388300 going to sleep for 11 seconds 00000100:00100000:3.0:1786109486.261961:0:192336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933230336 00000100:00100000:3.0:1786109486.261966:0:192336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933230336 00000100:00100000:3.0:1786109486.262034:0:192336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786109486.262043:0:192336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2a74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933230336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109486.262056:0:192336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109486.262068:0:192336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6ce00/0xdb52b77d7ca369a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca369a2 expref: -99 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.262089:0:192336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6ce00/0xdb52b77d7ca369a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca369a2 expref: 17 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.262099:0:192336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6ce00/0xdb52b77d7ca369a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca369a2 expref: 17 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.262112:0:192336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6ce00, rc 0) 00000100:00100000:3.0:1786109486.262186:0:192336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2a74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933230336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109486.262191:0:192336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786109486.262266:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109486.262278:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109486.262319:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109486.262368:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109486.262393:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109486.262574:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309860443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.262605:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933230464 00000100:00100000:1.0:1786109486.262610:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933230464 00000100:00100000:1.0:1786109486.262644:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786109486.262651:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2a77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933230464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.262750:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2a77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933230464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.262757:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786109486.262786:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.262813:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.262857:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.262872:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109486.262921:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933230592 00000100:00100000:0.0:1786109486.262926:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933230592 00000100:00100000:0.0:1786109486.262953:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786109486.262959:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2a75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933230592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109486.263043:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2a75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933230592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109486.263049:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786109486.263198:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109486.264213:0:192430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1786109486.264395:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1786109486.264417:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786109486.264426:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.264574:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109486.264583:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1786109486.264586:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1786109486.264589:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1786109486.264618:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.264626:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.264635:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109486.264657:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109486.264710:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109486.264789:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309827e49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109486.264832:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933230720 00000100:00100000:0.0:1786109486.264837:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933230720 00000100:00100000:0.0:1786109486.264912:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786109486.264921:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933230720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109486.264932:0:192332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109486.264944:0:192332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0b2ce00/0xdb52b77d7ca369b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca369b0 expref: -99 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109486.264964:0:192332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2ce00/0xdb52b77d7ca369b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca369b0 expref: 18 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109486.264974:0:192332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0b2ce00/0xdb52b77d7ca369b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca369b0 expref: 18 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109486.264980:0:192332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2ce00, rc 0) 00000100:00100000:0.0:1786109486.265027:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933230720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109486.265033:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786109486.265095:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109486.265108:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.265116:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109486.265163:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.265188:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.265301:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109486.265361:0:192336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933230848 00000100:00100000:3.0:1786109486.265365:0:192336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933230848 00000100:00100000:3.0:1786109486.265423:0:192336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1786109486.265453:0:192336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933230848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109486.265568:0:192336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933230848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109486.265575:0:192336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786109486.265683:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.265710:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.265754:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.265773:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933230976 00000100:00100000:1.0:1786109486.265776:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933230976 00000100:00100000:1.0:1786109486.265795:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786109486.265801:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933230976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.265945:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd16f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.269205:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933230976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3377us (3423us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.269227:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1786109486.269254:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933230976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109486.274075:0:192431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1786109486.275541:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1786109486.275593:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1786109486.275607:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.275619:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109486.275630:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786109486.275633:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930ab7c47000 from 7 10000000:01000000:2.0:1786109486.275636:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786109486.275680:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.275690:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.275702:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109486.275728:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.275794:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109486.275860:0:192336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933231104 00000100:00100000:2.0:1786109486.275861:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81388480 going to sleep for 11 seconds 00000100:00100000:3.0:1786109486.275877:0:192336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933231104 00000100:00100000:3.0:1786109486.275955:0:192336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786109486.275967:0:192336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933231104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109486.275989:0:192336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109486.276009:0:192336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6de00/0xdb52b77d7ca369c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca369be expref: -99 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.276272:0:192336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6de00/0xdb52b77d7ca369c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca369be expref: 19 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.276294:0:192336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6de00/0xdb52b77d7ca369c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca369be expref: 19 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.276305:0:192336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6de00, rc 0) 00000100:00100000:3.0:1786109486.277689:0:192336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933231104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1715us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109486.277702:0:192336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786109486.277719:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109486.277746:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.277762:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109486.277840:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.277887:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109486.277985:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81388480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109486.278022:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933231232 00000100:00100000:0.0:1786109486.278028:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933231232 00000100:00100000:0.0:1786109486.278071:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786109486.278080:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933231232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109486.278239:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933231232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109486.278246:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1786109486.278307:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.278334:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.278380:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109486.278476:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81388480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109486.278536:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933231360 00000100:00100000:0.0:1786109486.278540:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933231360 00000100:00100000:0.0:1786109486.278567:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786109486.278575:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933231360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109486.278710:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933231360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109486.278717:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786109486.278776:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109486.279790:0:192432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1786109486.290011:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1786109486.292261:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786109486.292292:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.292309:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109486.292322:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786109486.292326:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930aa6612000 from 52 10000000:01000000:2.0:1786109486.293162:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786109486.293222:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360600/0xdb52b77d7ca369cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.293234:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9360600/0xdb52b77d7ca369cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.293259:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9360600/0xdb52b77d7ca369cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109486.293302:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.295109:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109486.295188:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81388480 going to sleep for 11 seconds 00000100:00100000:3.0:1786109486.295854:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933231488 00000100:00100000:3.0:1786109486.295867:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933231488 00000100:00100000:3.0:1786109486.295931:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786109486.295941:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933231488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109486.295965:0:192330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109486.295987:0:192330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6d200/0xdb52b77d7ca369d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca369cc expref: -99 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.296019:0:192330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6d200/0xdb52b77d7ca369d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca369cc expref: 20 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.296031:0:192330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6d200/0xdb52b77d7ca369d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca369cc expref: 20 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.296041:0:192330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d200, rc 0) 00000100:00100000:3.0:1786109486.296102:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933231488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109486.296108:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786109486.299315:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109486.300366:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9360600/0xdb52b77d7ca369cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369d3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.300388:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9360600/0xdb52b77d7ca369cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca369d3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109486.300534:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.300624:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109486.300689:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933231616 00000100:00100000:2.0:1786109486.300697:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933231616 00000100:00100000:2.0:1786109486.300772:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786109486.300785:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933231616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.300948:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933231616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109486.300956:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786109486.301018:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81388480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109486.301044:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.304699:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.305421:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.306127:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933231744 00000100:00100000:1.0:1786109486.306142:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933231744 00000100:00100000:1.0:1786109486.306218:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1786109486.306229:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933231744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.306400:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933231744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.306407:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1786109486.306496:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81388480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109486.306536:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786109486.310239:0:192433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1786109486.312271:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1786109486.312327:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786109486.312353:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360600/0xdb52b77d7ca369cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369d3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.312367:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9360600/0xdb52b77d7ca369cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369d3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109486.312380:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1786109486.312383:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1786109486.312386:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1786109486.313266:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360800/0xdb52b77d7ca369da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.313291:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9360800/0xdb52b77d7ca369da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.313306:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9360800/0xdb52b77d7ca369da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109486.313356:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.313553:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109486.313670:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81388480 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.313849:0:192336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933231872 00000100:00100000:1.0:1786109486.313859:0:192336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933231872 00000100:00100000:1.0:1786109486.314017:0:192336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786109486.314030:0:192336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933231872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109486.314050:0:192336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109486.314069:0:192336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9413000/0xdb52b77d7ca369e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca369da expref: -99 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.314099:0:192336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9413000/0xdb52b77d7ca369e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca369da expref: 21 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.314111:0:192336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9413000/0xdb52b77d7ca369e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca369da expref: 21 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.314120:0:192336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413000, rc 0) 00000100:00100000:1.0:1786109486.314675:0:192336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933231872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 645us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.314683:0:192336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786109486.315210:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933231872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109486.315234:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9360800/0xdb52b77d7ca369da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369e1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.315247:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9360800/0xdb52b77d7ca369da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca369e1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109486.315508:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109486.315558:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109486.315603:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109486.316264:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933232000 00000100:00100000:2.0:1786109486.316274:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933232000 00000100:00100000:2.0:1786109486.316354:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786109486.316367:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933232000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.316607:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933232000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109486.316616:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786109486.317324:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109486.317401:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.318294:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109486.318539:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9687000 going to sleep for 11 seconds 00000100:00100000:3.0:1786109486.323585:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933232128 00000100:00100000:3.0:1786109486.323606:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933232128 00000100:00100000:3.0:1786109486.336014:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786109486.336048:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933232128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109486.345708:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933232128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 9663us (27414us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109486.345728:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1786109486.347041:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109486.354606:0:192434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1786109486.355673:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1786109486.355721:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786109486.355737:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360800/0xdb52b77d7ca369da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369e1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.356606:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9360800/0xdb52b77d7ca369da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369e1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109486.356628:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786109486.356632:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930aa6612000 from 7 10000000:01000000:3.0:1786109486.356635:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786109486.356688:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c800/0xdb52b77d7ca369e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.356697:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c800/0xdb52b77d7ca369e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.356709:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c800/0xdb52b77d7ca369e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109486.356740:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109486.357149:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.359080:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933232256 00000100:00100000:1.0:1786109486.359096:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933232256 00000100:00100000:3.0:1786109486.359317:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab96879c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.359381:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786109486.359395:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933232256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109486.359417:0:192330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109486.359466:0:192330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9413600/0xdb52b77d7ca369ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca369e8 expref: -99 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.359502:0:192330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9413600/0xdb52b77d7ca369ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca369e8 expref: 22 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.359516:0:192330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9413600/0xdb52b77d7ca369ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca369e8 expref: 22 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.359527:0:192330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413600, rc 0) 00000100:00100000:1.0:1786109486.359601:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933232256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (2454us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.359668:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1786109486.360570:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109486.360603:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c800/0xdb52b77d7ca369e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369ef expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.360615:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c800/0xdb52b77d7ca369e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca369ef expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109486.360732:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.360796:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109486.360861:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81388540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.360991:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933232384 00000100:00100000:1.0:1786109486.361000:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933232384 00000100:00100000:1.0:1786109486.361058:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786109486.361070:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933232384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.361357:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933232384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.361366:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786109486.361415:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.361480:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109486.361535:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109486.361563:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985430300 going to sleep for 11 seconds 00000100:00100000:2.0:1786109486.361636:0:192336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933232512 00000100:00100000:2.0:1786109486.361642:0:192336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933232512 00000100:00100000:2.0:1786109486.361673:0:192336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1786109486.361681:0:192336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933232512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.361779:0:192336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933232512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109486.361786:0:192336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786109486.362133:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786109486.364387:0:192435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1786109486.365005:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1786109486.365048:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786109486.365066:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c800/0xdb52b77d7ca369e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369ef expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.365080:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c800/0xdb52b77d7ca369e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369ef expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109486.365092:0:6524:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1786109486.365096:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff930a8a73cd40 from 1 10000000:01000000:2.0:1786109486.365099:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1786109486.365153:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361000/0xdb52b77d7ca369f6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.365254:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9361000/0xdb52b77d7ca369f6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.365271:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9361000/0xdb52b77d7ca369f6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109486.365314:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.365401:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109486.365572:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81388540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.365709:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933232640 00000100:00100000:1.0:1786109486.365718:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933232640 00000100:00100000:1.0:1786109486.365777:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1786109486.365789:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933232640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109486.365808:0:192331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109486.365826:0:192331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9413c00/0xdb52b77d7ca369fd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca369f6 expref: -99 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.365852:0:192331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9413c00/0xdb52b77d7ca369fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca369f6 expref: 23 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.365864:0:192331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9413c00/0xdb52b77d7ca369fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca369f6 expref: 23 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.365874:0:192331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413c00, rc 0) 00000100:00100000:1.0:1786109486.365928:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933232640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109486.365934:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786109486.366491:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109486.366521:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9361000/0xdb52b77d7ca369f6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369fd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.366545:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9361000/0xdb52b77d7ca369f6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca369fd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109486.366571:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1786109486.366577:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361000/0xdb52b77d7ca369f6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369fd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.366585:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9361000/0xdb52b77d7ca369f6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369fd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109486.367991:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1786109486.367996:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff930a8a73cd40 from 1 10000000:01000000:2.0:1786109486.368000:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786109486.368041:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360000/0xdb52b77d7ca36a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.368052:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9360000/0xdb52b77d7ca36a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109486.368063:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9360000/0xdb52b77d7ca36a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109486.368088:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109486.368150:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109486.368206:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81388480 going to sleep for 11 seconds 00000100:00100000:3.0:1786109486.370031:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933232768 00000100:00100000:3.0:1786109486.370044:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933232768 00000100:00100000:3.0:1786109486.370104:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786109486.370116:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac09d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933232768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109486.370132:0:192332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109486.370150:0:192332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6c600/0xdb52b77d7ca36a0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36a04 expref: -99 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.370179:0:192332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6c600/0xdb52b77d7ca36a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36a04 expref: 24 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.370191:0:192332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6c600/0xdb52b77d7ca36a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36a04 expref: 24 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.370206:0:192332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6c600, rc 0) 00000100:00100000:3.0:1786109486.370299:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac09d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933232768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109486.370307:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786109486.370899:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109486.370930:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9360000/0xdb52b77d7ca36a04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36a0b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109486.370944:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9360000/0xdb52b77d7ca36a04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36a0b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109486.371056:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109486.371120:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109486.371967:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930986044e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109486.374529:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933232896 00000100:00100000:1.0:1786109486.374546:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933232896 00000100:00100000:3.0:1786109486.375696:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786109486.375710:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933232896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109486.375841:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933232896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (4720us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786109486.375849:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786109486.376095:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933232896:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1786109486.376151:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1786109486.376162:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360000/0xdb52b77d7ca36a04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36a0b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109486.376174:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9360000/0xdb52b77d7ca36a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36a0b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109486.597129:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109487.620581:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109488.644643:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109488.900613:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933233024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109488.900683:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109488.900745:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933233024 00000100:00100000:0.0:1786109488.900753:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933233024 00000100:00100000:0.0:1786109488.900810:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5787 00000100:00100000:0.0:1786109488.900819:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933233024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109488.900850:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109488.900893:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933233024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109488.900899:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5787 00000100:00080000:0.0:1786109488.900919:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109488.900949:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933233024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109488.901059:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109488.901068:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933233152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109488.901094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109488.901121:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933233152 00000100:00100000:1.0:1786109488.901125:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933233152 00000100:00100000:1.0:1786109488.901154:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5788 00000100:00100000:1.0:1786109488.901160:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933233152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109488.901176:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109488.901207:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933233152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109488.901214:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5788 00000100:00080000:1.0:1786109488.901229:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109488.901246:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933233152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109489.168168:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109489.168218:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109489.168250:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109489.168294:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922090368 00000100:00100000:0.0:1786109489.168303:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922090368 00000100:00100000:0.0:1786109489.168368:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 169 00000100:00100000:0.0:1786109489.168380:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922090368:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109489.168477:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922090368:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 99us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109489.168485:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 169 00000100:00100000:0.0:1786109489.168509:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922090496 00000100:00100000:0.0:1786109489.168513:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922090496 00000100:00100000:0.0:1786109489.168539:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6922 00000100:00100000:0.0:1786109489.168545:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922090496:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109489.168571:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922090496:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109489.168577:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6922 00000100:00080000:0.0:1786109489.168592:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109489.168597:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109489.170424:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922090240 00000100:00100000:3.0:1786109489.170460:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922090240 00000100:00100000:3.0:1786109489.170509:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:3.0:1786109489.170519:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2403:x1872862922090240:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109489.170584:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2403:x1872862922090240:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 66us (2426us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109489.170595:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:1.0:1786109489.412717:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933233280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109489.412795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109489.412918:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933233280 00000100:00100000:2.0:1786109489.412928:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933233280 00000100:00100000:2.0:1786109489.413013:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12307 00000100:00100000:2.0:1786109489.413021:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933233280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109489.413048:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1786109489.413085:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933233280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109489.413089:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12307 00000100:00100000:1.0:1786109489.413166:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933233280:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1786109489.606240:0:192610:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1786109489.668784:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109489.926520:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109489.926527:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109489.926531:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109489.926542:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109489.926560:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0b57800 x1872862933233536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109489.926579:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109489.926582:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109489.926584:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109489.926588:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93098617d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109489.926596:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0b55c00 x1872862933233792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109489.926616:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109489.926619:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109489.926621:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109489.926625:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109489.926634:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0b55180 x1872862933234048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109489.926650:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109489.926653:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109489.926654:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109489.926658:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109489.926666:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7d24380 x1872862933234432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109489.926684:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1786109489.926687:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109489.926689:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab1981000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109489.926693:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff930ab1981000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109489.926701:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a9780b800 x1872862933234816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109489.926724:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933233408:0@lo:400:kworker.0 00000100:00100000:0.0:1786109489.926788:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109489.926841:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933234304:0@lo:400:kworker.0 00000100:00100000:0.0:1786109489.926868:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109489.926893:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786109489.926899:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933233664:0@lo:400:kworker.0 00000100:00100000:0.0:1786109489.926921:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109489.926948:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933234560:0@lo:400:kworker.0 00000100:00100000:0.0:1786109489.926971:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109489.926997:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933233536:0@lo:38:kworker.0 00000100:00100000:0.0:1786109489.927018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109489.927034:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933233792:0@lo:38:kworker.0 00000100:00100000:0.0:1786109489.927054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109489.927068:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933234048:0@lo:38:kworker.0 00000100:00100000:0.0:1786109489.927087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109489.927103:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933234432:0@lo:38:kworker.0 00000100:00100000:0.0:1786109489.927122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109489.927135:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933234816:0@lo:38:kworker.0 00000100:00100000:0.0:1786109489.927154:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109489.927182:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933233664 00000100:00100000:0.0:1786109489.927190:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933233664 00000100:00100000:0.0:1786109489.927232:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933233536 00000100:00100000:0.0:1786109489.927235:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933233536 00000100:00100000:0.0:1786109489.927244:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933233792 00000100:00100000:0.0:1786109489.927245:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933233792 00000100:00100000:0.0:1786109489.927251:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933234432 00000100:00100000:0.0:1786109489.927253:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933234432 00000100:00100000:0.0:1786109489.927277:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933234816 00000100:00100000:0.0:1786109489.927279:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933234816 00000100:00100000:0.0:1786109489.927292:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1786109489.927300:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933233664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109489.927353:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933233664:12345-0@lo:400:kworker.0 Request processed in 54us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109489.927360:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1786109489.927376:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1786109489.927380:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933233536:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109489.927401:0:187901:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8346 last 0 00000020:00000080:0.0:1786109489.927457:0:187901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdb52b77d7ca36a12 00000004:00100000:0.0:1786109489.927470:0:187901:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109489.927605:0:187901:0:(import.c:65:import_set_state_nolock()) ffff93098617c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109489.927639:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872862933233536:12345-0@lo:38:kworker.0 Request processed in 258us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109489.927646:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1786109489.927660:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:0.0:1786109489.927664:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933233792:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109489.927677:0:187901:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8346 last 0 00000020:00000080:0.0:1786109489.927698:0:187901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdb52b77d7ca36a19 00000004:00100000:0.0:1786109489.927705:0:187901:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109489.927721:0:187901:0:(import.c:65:import_set_state_nolock()) ffff93098617e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109489.927746:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872862933233792:12345-0@lo:38:kworker.0 Request processed in 81us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109489.927752:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:0.0:1786109489.927764:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1786109489.927768:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933234432:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109489.927782:0:187901:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8346 last 0 00000020:00000080:0.0:1786109489.927801:0:187901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdb52b77d7ca36a20 00000004:00100000:0.0:1786109489.927807:0:187901:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109489.927820:0:187901:0:(import.c:65:import_set_state_nolock()) ffff93098617f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109489.927843:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872862933234432:12345-0@lo:38:kworker.0 Request processed in 74us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109489.927849:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1786109489.927860:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:0.0:1786109489.927863:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933234816:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109489.927875:0:187901:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8346 last 0 00000020:00000080:0.0:1786109489.927893:0:187901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdb52b77d7ca36a27 00000004:00100000:0.0:1786109489.927899:0:187901:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109489.927912:0:187901:0:(import.c:65:import_set_state_nolock()) ffff93098e510800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109489.927938:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872862933234816:12345-0@lo:38:kworker.0 Request processed in 73us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109489.927944:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00080000:0.0:1786109489.927966:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109489.927993:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933233664:0@lo:400:kworker.0 00010000:00080000:0.0:1786109489.928024:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac0b57800 x1872862933233536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109489.928035:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 78 00000100:00080000:0.0:1786109489.928878:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff930ac0b57800 x1872862933233536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109509 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109489.928889:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109489.928894:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109489.928898:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109489.928903:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933233536:0@lo:38:kworker.0 00010000:00080000:0.0:1786109489.928926:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac0b55c00 x1872862933233792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109489.928936:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 78 00000100:00100000:3.0:1786109489.933222:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933233920:0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.933310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109489.933347:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933234688:0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.933371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109489.933398:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109489.933405:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933234176:0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.933428:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109489.933534:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933233408 00000100:00100000:3.0:1786109489.933541:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933233408 00000100:00100000:3.0:1786109489.933585:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1786109489.933593:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933233408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.933646:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933233408:12345-0@lo:400:kworker.0 Request processed in 53us (6858us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109489.933653:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1786109489.933686:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933234304 00000100:00100000:3.0:1786109489.933689:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933234304 00000100:00100000:3.0:1786109489.933713:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933234560 00000100:00100000:3.0:1786109489.933716:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933234560 00000100:00100000:3.0:1786109489.933742:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6923 00000100:00100000:3.0:1786109489.933748:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933234304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.933782:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933234304:12345-0@lo:400:kworker.0 Request processed in 34us (6912us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109489.933788:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6923 00000100:00100000:3.0:1786109489.933798:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933234688 00000100:00100000:3.0:1786109489.933801:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933234688 00000100:00100000:3.0:1786109489.933822:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933234176 00000100:00100000:3.0:1786109489.933825:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933234176 00000100:00100000:3.0:1786109489.933845:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6924 00000100:00100000:3.0:1786109489.933851:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933234560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.933881:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933234560:12345-0@lo:400:kworker.0 Request processed in 31us (6909us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109489.933887:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6924 00000100:00100000:3.0:1786109489.933898:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6925 00000100:00100000:3.0:1786109489.933905:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933234688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.933935:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933234688:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109489.933942:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6925 00000100:00100000:3.0:1786109489.933952:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6926 00000100:00100000:3.0:1786109489.933958:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933234176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.933984:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933234176:12345-0@lo:400:kworker.0 Request processed in 26us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109489.933989:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6926 00000100:00100000:3.0:1786109489.934005:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933233920 00000100:00100000:3.0:1786109489.934008:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933233920 00000100:00100000:3.0:1786109489.934036:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1786109489.934043:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933233920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.934072:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933233920:12345-0@lo:400:kworker.0 Request processed in 30us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109489.934077:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1786109489.934120:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933234560:0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.934131:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933233408:0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.934142:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933234304:0@lo:400:kworker.0 00000100:00080000:3.0:1786109489.934170:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109489.934175:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109489.934177:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109489.934197:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933234176:0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.934206:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933233920:0@lo:400:kworker.0 00000100:00100000:3.0:1786109489.934215:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933234688:0@lo:400:kworker.0 00000100:00080000:0.0:1786109489.935700:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff930ac0b55c00 x1872862933233792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109509 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109489.935714:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109489.935719:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109489.935724:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109489.935730:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933233792:0@lo:38:kworker.0 00010000:00080000:0.0:1786109489.935761:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ab7d24380 x1872862933234432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109489.935774:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 78 00000100:00100000:1.0:1786109489.937100:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933234048 00000100:00100000:1.0:1786109489.937112:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933234048 00000100:00100000:1.0:1786109489.937153:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12308 00000100:00100000:1.0:1786109489.937161:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933234048:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1786109489.937190:0:177399:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff93098650b800, cookie 0xdb52b77d7ca3688a 00010000:00080000:1.0:1786109489.937195:0:177399:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff93098650b800 cur 8346 last 1786109484 00000004:00100000:1.0:1786109489.937214:0:177399:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786109489.937243:0:177399:0:(import.c:65:import_set_state_nolock()) ffff930981e16800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786109489.937341:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933234048:12345-0@lo:38:kworker.0 Request processed in 179us (10251us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109489.937348:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12308 00000100:00080000:0.0:1786109489.939677:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff930ab7d24380 x1872862933234432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109509 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109489.939690:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109489.939696:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109489.939700:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109489.939706:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933234432:0@lo:38:kworker.0 00010000:00080000:0.0:1786109489.939744:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a9780b800 x1872862933234816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109489.939761:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 78 00000100:00080000:0.0:1786109489.939771:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1786109489.939776:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786109489.939778:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab1981000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786109489.939783:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933234816:0@lo:38:kworker.0 00000100:00080000:0.0:1786109489.939827:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 78 00000100:00080000:0.0:1786109489.939834:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1786109489.939838:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1786109489.939840:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 326417514497 gen 2 00000100:00080000:0.0:1786109489.939844:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a89101800 from lustre-MDT0000_UUID committed 326417514497 last 0 00000100:00080000:0.0:1786109489.939847:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00010000:00080000:2.0:1786109489.940908:0:192358:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1786109489.940914:0:192358:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 330712481797 00000020:00080000:2.0:1786109489.940919:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109489.940923:0:192358:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 330712481797 00000020:00080000:2.0:1786109489.940926:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109489.940928:0:192358:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 330712481797 00000100:00100000:1.0:1786109489.941286:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933234048:0@lo:38:kworker.0 00010000:00080000:1.0:1786109489.941317:0:192632:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1786109489.941321:0:192632:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1786109489.941326:0:192632:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1786109489.942089:0:192632:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1786109489.944383:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933234944:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1786109489.944475:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109489.944909:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933234944 00000100:00100000:2.0:1786109489.944917:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933234944 00000100:00100000:2.0:1786109489.944969:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12309 00000100:00100000:2.0:1786109489.944979:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933234944:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1786109489.945003:0:8452:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ab9632680 x1872862933234944/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:715/0 lens 224/0 e 0 to 0 dl 1786109500 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109489.945026:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933234944:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 49us (552us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109489.945033:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12309 00000020:00080000:2.0:1786109489.945049:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109489.945054:0:192358:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 330712481797 00000020:00000004:0.0:1786109490.436179:0:192663:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1786109490.438733:0:192663:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00100000:2.0:1786109490.443225:0:187891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1786109490.443703:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1786109490.445837:0:184688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1786109490.692690:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1786109491.175207:0:192713:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1786109491.175594:0:192713:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1786109491.216893:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109491.216941:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109491.216974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109491.217004:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922090880 00000100:00100000:0.0:1786109491.217013:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922090880 00000100:00100000:0.0:1786109491.217072:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6927 00000100:00100000:0.0:1786109491.217083:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922090880:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109491.217158:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922090880:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 76us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109491.217165:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6927 00000100:00100000:0.0:1786109491.217352:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922090752 00000100:00100000:0.0:1786109491.217356:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922090752 00000100:00100000:0.0:1786109491.217383:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:0.0:1786109491.217390:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922090752:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109491.217416:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922090752:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109491.217422:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 172 00000100:00080000:0.0:1786109491.217455:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109491.217458:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109491.217608:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922090624 00000100:00100000:3.0:1786109491.217612:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922090624 00000100:00100000:3.0:1786109491.217650:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:3.0:1786109491.217656:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922090624:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109491.217689:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922090624:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109491.217695:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00010000:00010000:3.0:1786109491.723198:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109492.740828:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109493.765104:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109494.020828:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933235072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109494.020954:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109494.021008:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109494.021018:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933235200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109494.021136:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109494.021265:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933235072 00000100:00100000:2.0:1786109494.021273:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933235072 00000100:00100000:2.0:1786109494.021362:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933235200 00000100:00100000:2.0:1786109494.021365:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933235200 00000100:00100000:2.0:1786109494.021390:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5789 00000100:00100000:2.0:1786109494.021400:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933235072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109494.021470:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109494.021519:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933235072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109494.021527:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5789 00000100:00100000:2.0:1786109494.021545:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5790 00000100:00100000:2.0:1786109494.021552:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933235200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109494.021567:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109494.021598:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933235200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109494.021604:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5790 00000100:00100000:2.0:1786109494.021641:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933235072:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1786109494.021709:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786109494.021728:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109494.021815:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933235200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109494.532700:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933235328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109494.533058:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109494.534240:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933235328 00000100:00100000:2.0:1786109494.534251:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933235328 00000100:00100000:2.0:1786109494.535363:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12310 00000100:00100000:2.0:1786109494.535381:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933235328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109494.535420:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1786109494.535895:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933235328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 520us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109494.535903:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12310 00000100:00100000:3.0:1786109494.536253:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933235328:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1786109494.796413:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109495.051856:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933235456:0@lo:400:kworker.0 00000100:00100000:3.0:1786109495.051925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109495.051977:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109495.051981:0:171804:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1786109495.052021:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933235712:0@lo:400:kworker.0 00000100:00100000:0.0:1786109495.052049:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109495.052102:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933236224:0@lo:400:kworker.0 00000100:00100000:0.0:1786109495.052122:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109495.052144:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933236736:0@lo:400:kworker.0 00000100:00100000:1.0:1786109495.052526:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933235584:0@lo:400:kworker.0 00000100:00100000:1.0:1786109495.052554:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109495.052591:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933236096:0@lo:400:kworker.0 00000100:00100000:1.0:1786109495.052609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109495.052623:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933236608:0@lo:400:kworker.0 00000100:00100000:1.0:1786109495.052639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109495.052655:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786109495.052659:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933235968:0@lo:400:kworker.0 00000100:00100000:1.0:1786109495.052675:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109495.052687:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933236480:0@lo:400:kworker.0 00000100:00100000:1.0:1786109495.052701:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109495.052774:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933235840:0@lo:400:kworker.0 00000100:00100000:2.0:1786109495.052812:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933235456 00000100:00100000:2.0:1786109495.052819:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933235456 00000100:00100000:2.0:1786109495.052860:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1786109495.052869:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933235456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109495.052917:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933235456:12345-0@lo:400:kworker.0 Request processed in 49us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109495.052923:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1786109495.052960:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933235456:0@lo:400:kworker.0 00000100:00100000:2.0:1786109495.052996:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933235712 00000100:00100000:2.0:1786109495.052999:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933235712 00000100:00100000:2.0:1786109495.053028:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933235584 00000100:00100000:2.0:1786109495.053030:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933235584 00000100:00100000:2.0:1786109495.053042:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933235968 00000100:00100000:2.0:1786109495.053044:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933235968 00000100:00100000:2.0:1786109495.053057:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1786109495.053062:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933235712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109495.053095:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933235712:12345-0@lo:400:kworker.0 Request processed in 33us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109495.053100:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1786109495.053125:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1786109495.053131:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933235584:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1786109495.053141:0:187899:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930ac1783800 x1872862933235584/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:721/0 lens 224/0 e 0 to 0 dl 1786109506 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109495.053186:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933235584:12345-0@lo:400:kworker.0 Request processed in 56us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109495.053192:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1786109495.053203:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1786109495.053209:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933235968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109495.053247:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933235968:12345-0@lo:400:kworker.0 Request processed in 39us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109495.053252:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1786109495.053332:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786109495.053376:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109495.053458:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933235712:0@lo:400:kworker.0 00010000:00080000:1.0:1786109495.053536:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a97fd4e00 x1872862933235584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109495.053547:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933235584:0@lo:400:kworker.0 00000100:00100000:1.0:1786109495.053563:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933235968:0@lo:400:kworker.0 00000100:00100000:2.0:1786109495.053627:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933236224 00000100:00100000:2.0:1786109495.053632:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933236224 00000100:00100000:2.0:1786109495.053658:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933236096 00000100:00100000:2.0:1786109495.053661:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933236096 00000100:00100000:2.0:1786109495.053674:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933236608 00000100:00100000:2.0:1786109495.053677:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933236608 00000100:00100000:2.0:1786109495.053695:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933236480 00000100:00100000:2.0:1786109495.053698:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933236480 00000100:00100000:2.0:1786109495.053718:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6928 00000100:00100000:2.0:1786109495.053725:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933236224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109495.053771:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933236224:12345-0@lo:400:kworker.0 Request processed in 46us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109495.053780:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6928 00000100:00100000:2.0:1786109495.053791:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6929 00000100:00100000:2.0:1786109495.053797:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933236096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109495.053835:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933236096:12345-0@lo:400:kworker.0 Request processed in 37us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109495.053841:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6929 00000100:00100000:2.0:1786109495.053852:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6930 00000100:00100000:2.0:1786109495.053858:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933236608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109495.053885:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933236608:12345-0@lo:400:kworker.0 Request processed in 28us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109495.053891:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6930 00000100:00100000:2.0:1786109495.053901:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6931 00000100:00100000:2.0:1786109495.053907:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933236480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109495.053933:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933236480:12345-0@lo:400:kworker.0 Request processed in 26us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109495.053939:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6931 00000100:00100000:3.0:1786109495.053985:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933236736 00000100:00100000:3.0:1786109495.053989:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933236736 00000100:00100000:3.0:1786109495.054009:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1786109495.054015:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933236736:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1786109495.054023:0:188678:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930a893c1f80 x1872862933236736/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:721/0 lens 224/0 e 0 to 0 dl 1786109506 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109495.054054:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933236736:12345-0@lo:400:kworker.0 Request processed in 39us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109495.054060:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1786109495.054081:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109495.054100:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933236352:0@lo:400:kworker.0 00000100:00100000:3.0:1786109495.054123:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109495.054143:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933235840 00000100:00100000:3.0:1786109495.054147:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933235840 00000100:00100000:0.0:1786109495.054173:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933236352 00000100:00100000:0.0:1786109495.054177:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933236352 00000100:00100000:0.0:1786109495.054196:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1786109495.054203:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933236352:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1786109495.054212:0:187900:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff9309852baa00 x1872862933236352/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:721/0 lens 224/0 e 0 to 0 dl 1786109506 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109495.054261:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933236352:12345-0@lo:400:kworker.0 Request processed in 58us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109495.054271:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1786109495.054313:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933236480:0@lo:400:kworker.0 00000100:00100000:0.0:1786109495.054323:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933236096:0@lo:400:kworker.0 00000100:00100000:0.0:1786109495.054336:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933236608:0@lo:400:kworker.0 00000100:00080000:0.0:1786109495.054374:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109495.054377:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109495.054402:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933236224:0@lo:400:kworker.0 00010000:00080000:0.0:1786109495.054413:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a97fd6d80 x1872862933236736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109495.054422:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933236736:0@lo:400:kworker.0 00000100:00100000:3.0:1786109495.054570:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1786109495.054576:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933235840:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1786109495.054584:0:188678:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff9309852bad80 x1872862933235840/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:721/0 lens 224/0 e 0 to 0 dl 1786109506 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109495.054614:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933235840:12345-0@lo:400:kworker.0 Request processed in 37us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109495.054619:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:3.0:1786109495.054642:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a97fd7800 x1872862933235840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109495.054651:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933235840:0@lo:400:kworker.0 00010000:00080000:3.0:1786109495.054660:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a97fd5180 x1872862933236352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109495.054668:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933236352:0@lo:400:kworker.0 00010000:00010000:3.0:1786109495.813636:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109496.337894:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109496.337951:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109496.338021:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922091264 00000100:00100000:2.0:1786109496.338030:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922091264 00000100:00100000:0.0:1786109496.338141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109496.338171:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922091392 00000100:00100000:0.0:1786109496.338175:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922091392 00000100:00100000:3.0:1786109496.338256:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922091136 00000100:00100000:3.0:1786109496.338261:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922091136 00000100:00100000:3.0:1786109496.338304:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:3.0:1786109496.338314:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2405:x1872862922091136:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109496.338382:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2405:x1872862922091136:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 69us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109496.338389:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:2.0:1786109496.338683:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 179 00000100:00100000:2.0:1786109496.338693:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922091264:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109496.338733:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922091264:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 43us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109496.338739:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 179 00000100:00080000:1.0:1786109496.338880:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109496.338885:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109496.339024:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6932 00000100:00100000:0.0:1786109496.339034:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922091392:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109496.339096:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922091392:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 64us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109496.339104:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6932 00010000:00010000:2.0:1786109496.836681:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109497.907032:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109498.949419:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109499.140650:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933236864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109499.140682:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933236992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109499.140726:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109499.140759:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933236864 00000100:00100000:1.0:1786109499.140767:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933236864 00000100:00100000:1.0:1786109499.140836:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5791 00000100:00080000:2.0:1786109499.140840:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109499.140848:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933236864:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109499.140953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109499.141005:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933236992 00000100:00100000:2.0:1786109499.141011:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933236992 00000100:00080000:0.0:1786109499.141044:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109499.141057:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5792 00000100:00100000:2.0:1786109499.141066:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933236992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109499.141085:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578112 pending 0 free 3923496960 avail 3691974656 00002000:00000024:1.0:1786109499.141085:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109499.141153:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933236864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 303us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109499.141161:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5791 00000100:00100000:2.0:1786109499.141214:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933236992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 148us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109499.141222:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5792 00000100:00100000:2.0:1786109499.141277:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933236864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109499.141341:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933236992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109499.652874:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109499.652897:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933237120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109499.652982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109499.653339:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933237120 00000100:00100000:2.0:1786109499.653348:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933237120 00000100:00100000:2.0:1786109499.653405:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12311 00000100:00100000:2.0:1786109499.653415:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933237120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109499.653466:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1786109499.653510:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933237120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109499.653517:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12311 00000100:00100000:1.0:1786109499.653618:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933237120:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786109499.972616:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109500.164685:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109500.164705:0:183576:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1786109500.164765:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933237632:0@lo:400:kworker.0 00000100:00100000:0.0:1786109500.164832:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109500.164895:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933238144:0@lo:400:kworker.0 00000100:00100000:0.0:1786109500.164918:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109500.164940:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1786109500.164946:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933237504:0@lo:400:kworker.0 00000100:00100000:0.0:1786109500.164966:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109500.164992:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933238016:0@lo:400:kworker.0 00000100:00100000:0.0:1786109500.165016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109500.165166:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933237376:0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.165208:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109500.165233:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933237888:0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.165255:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109500.165273:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933238400:0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.165293:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109500.165309:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1786109500.165314:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933237248:0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.165341:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109500.165364:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933237760:0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.165383:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109500.165398:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933238272:0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.165417:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109500.165466:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933237632 00000100:00100000:3.0:1786109500.165473:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933237632 00000100:00100000:3.0:1786109500.165512:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933238144 00000100:00100000:3.0:1786109500.165515:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933238144 00000100:00100000:3.0:1786109500.165528:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933237504 00000100:00100000:3.0:1786109500.165531:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933237504 00000100:00100000:3.0:1786109500.165549:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933237376 00000100:00100000:3.0:1786109500.165552:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933237376 00000100:00100000:3.0:1786109500.165562:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933237760 00000100:00100000:3.0:1786109500.165565:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933237760 00000100:00100000:3.0:1786109500.165578:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1786109500.165587:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933237632:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1786109500.165603:0:188678:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930ab1c52a00 x1872862933237632/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:726/0 lens 224/0 e 0 to 0 dl 1786109511 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109500.165646:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933237632:12345-0@lo:400:kworker.0 Request processed in 59us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109500.165653:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1786109500.165668:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1786109500.165673:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933238144:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1786109500.165681:0:188678:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930ab1c52300 x1872862933238144/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:726/0 lens 224/0 e 0 to 0 dl 1786109511 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109500.165707:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933238144:12345-0@lo:400:kworker.0 Request processed in 33us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109500.165713:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1786109500.165723:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1786109500.165729:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933237504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.165752:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933237504:12345-0@lo:400:kworker.0 Request processed in 23us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109500.165758:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1786109500.165768:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1786109500.165774:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933237376:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1786109500.165780:0:188678:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff9309852b8a80 x1872862933237376/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:726/0 lens 224/0 e 0 to 0 dl 1786109511 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109500.165810:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933237376:12345-0@lo:400:kworker.0 Request processed in 37us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109500.165816:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1786109500.165827:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1786109500.165833:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933237760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.165856:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933237760:12345-0@lo:400:kworker.0 Request processed in 23us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109500.165861:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1786109500.165879:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933238016 00000100:00100000:3.0:1786109500.165883:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933238016 00000100:00100000:3.0:1786109500.165902:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933237888 00000100:00100000:3.0:1786109500.165905:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933237888 00000100:00100000:3.0:1786109500.165920:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933238400 00000100:00100000:3.0:1786109500.165922:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933238400 00000100:00100000:3.0:1786109500.165939:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933238272 00000100:00100000:3.0:1786109500.165942:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933238272 00000100:00100000:3.0:1786109500.165958:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6933 00000100:00100000:3.0:1786109500.165964:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933238016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.165994:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933238016:12345-0@lo:400:kworker.0 Request processed in 30us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109500.166000:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6933 00000100:00100000:3.0:1786109500.166010:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6934 00000100:00100000:3.0:1786109500.166015:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933237888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.166055:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933237888:12345-0@lo:400:kworker.0 Request processed in 40us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109500.166062:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6934 00000100:00100000:3.0:1786109500.166071:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6935 00000100:00100000:3.0:1786109500.166077:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933238400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.166102:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933238400:12345-0@lo:400:kworker.0 Request processed in 25us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109500.166108:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6935 00000100:00100000:3.0:1786109500.166118:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6936 00000100:00100000:3.0:1786109500.166123:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933238272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.166147:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933238272:12345-0@lo:400:kworker.0 Request processed in 24us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109500.166152:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6936 00000100:00080000:3.0:1786109500.166173:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786109500.166176:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109500.166179:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109500.166230:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933237760:0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.166240:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933238272:0@lo:400:kworker.0 00010000:00080000:3.0:1786109500.166251:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930aa66efb80 x1872862933237376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109500.166259:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933237376:0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.166267:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933237888:0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.166275:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933238400:0@lo:400:kworker.0 00000100:00100000:0.0:1786109500.166404:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933238528:0@lo:400:kworker.0 00000100:00100000:0.0:1786109500.166453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1786109500.166478:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ab7f16d80 x1872862933237632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109500.166487:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933237632:0@lo:400:kworker.0 00010000:00080000:0.0:1786109500.166497:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ab1c21500 x1872862933238144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109500.166503:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933238144:0@lo:400:kworker.0 00000100:00100000:0.0:1786109500.166519:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933237504:0@lo:400:kworker.0 00000100:00100000:0.0:1786109500.166529:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933238016:0@lo:400:kworker.0 00000100:00100000:3.0:1786109500.166660:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933238528 00000100:00100000:3.0:1786109500.166665:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933238528 00000100:00100000:3.0:1786109500.166706:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1786109500.166713:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933238528:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1786109500.166722:0:188678:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff930ab7d24700 x1872862933238528/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:726/0 lens 224/0 e 0 to 0 dl 1786109511 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109500.166772:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933238528:12345-0@lo:400:kworker.0 Request processed in 59us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109500.166779:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00010000:00080000:1.0:1786109500.166848:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ab1c23b80 x1872862933238528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109500.166858:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933238528:0@lo:400:kworker.0 00000100:00100000:2.0:1786109500.168280:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933237248 00000100:00100000:2.0:1786109500.168291:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933237248 00000100:00100000:2.0:1786109500.168354:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1786109500.168363:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933237248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109500.168717:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933237248:12345-0@lo:400:kworker.0 Request processed in 355us (3373us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109500.168728:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1786109500.168835:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933237248:0@lo:400:kworker.0 00010000:00010000:2.0:1786109500.996743:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109501.454865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109501.455151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109501.455202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109501.455235:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922091776 00000100:00100000:3.0:1786109501.455244:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922091776 00000100:00100000:3.0:1786109501.455628:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6937 00000100:00100000:3.0:1786109501.455641:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922091776:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109501.455718:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922091776:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 80us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109501.455725:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6937 00000100:00080000:3.0:1786109501.455745:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109501.455892:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922091520 00000100:00100000:0.0:1786109501.455898:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922091520 00000100:00100000:0.0:1786109501.455969:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:0.0:1786109501.455978:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922091520:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109501.456028:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922091520:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 51us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109501.456035:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:1.0:1786109501.456912:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922091648 00000100:00100000:1.0:1786109501.456920:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922091648 00000100:00100000:1.0:1786109501.458660:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:1.0:1786109501.458673:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922091648:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:3.0:1786109501.458914:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109501.458974:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922091648:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 303us (4115us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109501.458982:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:3.0:1786109501.998779:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109501.999103:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922091904 00000100:00100000:0.0:1786109501.999113:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922091904 00000100:00100000:2.0:1786109501.999330:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:2.0:1786109501.999344:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862922091904:12345-192.168.203.38@tcp:38:ptlrpcd_rcv.0 00010000:02000400:2.0:1786109501.999379:0:187901:0:(ldlm_lib.c:976:target_handle_reconnect()) lustre-MDT0000: Client 397d331e-10fc-4558-be87-308c3622e8eb (at 192.168.203.38@tcp) reconnected, waiting for 2 clients in recovery for 0:53 00010000:00080000:2.0:1786109502.010220:0:187901:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp recovering/t322122566376 exp ffff930986508000 cur 8358 last 1786109501 00000004:00100000:2.0:1786109502.010258:0:187901:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.203.38@tcp supports cksum type f7, return f7 00000100:00080000:2.0:1786109502.010284:0:187901:0:(import.c:65:import_set_state_nolock()) ffff930981e11000 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1786109502.010293:0:187901:0:(import.c:65:import_set_state_nolock()) ffff930981e11000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109502.010382:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862922091904:12345-192.168.203.38@tcp:38:ptlrpcd_rcv.0 Request processed in 11041us (11610us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109502.010394:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:3.0:1786109502.015049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109502.015281:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862920179840 00000100:00100000:2.0:1786109502.015291:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862920179840 00000100:00100000:2.0:1786109502.015391:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 973 00000100:00100000:2.0:1786109502.015410:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862920179840:12345-192.168.203.38@tcp:101:lfs.0 00010000:00080000:2.0:1786109502.015454:0:189813:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 330712481797, current: 322122566376, replaying 00010000:00010000:2.0:1786109502.015466:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109502.015494:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360200/0xdb52b77d7ca36a2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc494ce7 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109502.015555:0:189813:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff930a9780bb80 x1872862920179840/t0(322122566376) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:728/0 lens 520/3488 e 0 to 0 dl 1786109513 ref 1 fl Interpret:/606/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00000400:2.0:1786109502.015565:0:189813:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff930a9780bb80 x1872862920179840/t322122566376(322122566376) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:728/0 lens 520/3488 e 0 to 0 dl 1786109513 ref 1 fl Interpret:/606/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1786109502.020617:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:2.0:1786109502.028046:0:189813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20001a9e3:0x191b:0x0]: returning size 4096 00010000:00010000:2.0:1786109502.028102:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360200/0xdb52b77d7ca36a2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 7 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.028119:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ac0b06700) 00010000:00010000:2.0:1786109502.028122:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786109502.028127:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360200/0xdb52b77d7ca36a2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 7 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.028149:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360200, rc 0) 00000100:00100000:2.0:1786109502.028242:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862920179840:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 12841us (13210us total) trans 322122566376 rc 301/301 00000100:00100000:2.0:1786109502.028251:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 973 00000100:00100000:1.0:1786109502.034941:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109502.035047:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922081024 00000100:00100000:3.0:1786109502.035057:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922081024 00000100:00100000:3.0:1786109502.035166:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 974 00000100:00100000:3.0:1786109502.035221:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862922081024:12345-192.168.203.38@tcp:101:multiop.0 00010000:00080000:3.0:1786109502.035243:0:188678:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 330712481797, current: 330712481795, replaying 00010000:00010000:3.0:1786109502.035254:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109502.035279:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a35 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a14fa expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109502.035680:0:188678:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20001a9e3:0x1de2:0x0], cookie = 0xdb52b77d7ca3674f 00000004:00080000:3.0:1786109502.035684:0:188678:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xdb52b77d7ca3674f in new mfd 00010000:00010000:3.0:1786109502.035783:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a35 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14fa expref: 8 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.035797:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab8c04c00) 00010000:00010000:3.0:1786109502.035800:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109502.035804:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a35 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a14fa expref: 8 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.035821:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d800, rc 0) 00000100:00100000:3.0:1786109502.035921:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+7:2401:x1872862922081024:12345-192.168.203.38@tcp:101:multiop.0 Request processed in 744us (988us total) trans 330712481795 rc 301/301 00000100:00100000:3.0:1786109502.035928:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 974 00000100:00100000:3.0:1786109502.037963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109502.038062:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922083072 00000100:00100000:2.0:1786109502.038072:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922083072 00000100:00100000:2.0:1786109502.038188:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 975 00000100:00100000:2.0:1786109502.038200:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:2401:x1872862922083072:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00080000:2.0:1786109502.038218:0:187901:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 330712481797, current: 330712481797, replaying 00000100:00100000:2.0:1786109502.038244:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+7:2401:x1872862922083072:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 48us (304us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109502.038251:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 975 00000020:00080000:3.0:1786109502.038287:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109502.038292:0:192358:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 330712481797, next_transno: 330712481797 00010000:00080000:3.0:1786109502.038296:0:192358:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (330712481797) 00000020:00080000:3.0:1786109502.038299:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109502.038308:0:192358:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922083072 t330712481797 from 192.168.203.38@tcp req@ffff930aa66ec000 x1872862922083072/t0(330712481797) o36->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:728/0 lens 528/0 e 0 to 0 dl 1786109513 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1786109502.038500:0:192358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36a43 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.038518:0:192358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36a43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.038529:0:192358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36a43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.038585:0:192358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca36a4a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.038595:0:192358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca36a4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.038602:0:192358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca36a4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.038955:0:192358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36a43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.038963:0:192358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36a43 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.038970:0:192358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36a43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.038976:0:192358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109502.038980:0:192358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36a43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.038986:0:192358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36a43 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.038998:0:192358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab8c04900) 00010000:00010000:3.0:1786109502.039001:0:192358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109502.039005:0:192358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36a43 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.039011:0:192358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36a43 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109502.039026:0:192358:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be3711d9 reply state 00000000f25da0b7 transno 330712481797 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca36a4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.039036:0:192358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca36a4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.039042:0:192358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ab8c04000) 00010000:00010000:3.0:1786109502.039044:0:192358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109502.039046:0:192358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1786109502.039130:0:192358:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1786109502.039146:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109502.039148:0:192358:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 330712481798 00000020:00080000:3.0:1786109502.039152:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109502.039154:0:192358:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 330712481798 00000100:00100000:0.0:1786109502.041593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109502.041692:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922083584 00000100:00100000:2.0:1786109502.041701:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922083584 00000100:00100000:2.0:1786109502.041786:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 976 00000100:00100000:2.0:1786109502.041796:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+9:2401:x1872862922083584:12345-192.168.203.38@tcp:36:rm.0 00010000:00080000:2.0:1786109502.041817:0:189813:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 330712481798, current: 330712481798, replaying 00000100:00100000:2.0:1786109502.041844:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+9:2401:x1872862922083584:12345-192.168.203.38@tcp:36:rm.0 Request processed in 50us (264us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109502.041851:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 976 00000020:00080000:3.0:1786109502.041896:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109502.041900:0:192358:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 330712481798, next_transno: 330712481798 00010000:00080000:3.0:1786109502.041904:0:192358:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (330712481798) 00000020:00080000:3.0:1786109502.041907:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109502.041915:0:192358:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922083584 t330712481798 from 192.168.203.38@tcp req@ffff930ab7d24380 x1872862922083584/t0(330712481798) o36->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:728/0 lens 512/0 e 0 to 0 dl 1786109513 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1786109502.042007:0:192358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a51 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042026:0:192358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a51 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042037:0:192358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a51 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042048:0:192358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca36a58 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042056:0:192358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca36a58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042062:0:192358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca36a58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042139:0:192358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36a5f lrc: 3/0,1 mode: --/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042148:0:192358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36a5f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042155:0:192358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36a5f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042380:0:192358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36a5f lrc: 3/0,1 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042388:0:192358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36a5f lrc: 2/0,0 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042394:0:192358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36a5f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042400:0:192358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109502.042404:0:192358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36a5f lrc: 3/0,0 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042411:0:192358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36a5f lrc: 4/0,0 mode: EX/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042424:0:192358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de3:0x0].0x0 (ffff930ab8c04f00) 00010000:00010000:3.0:1786109502.042427:0:192358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109502.042475:0:192358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36a5f lrc: 2/0,0 mode: --/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042481:0:192358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36a5f lrc: 0/0,0 mode: --/EX res: [0x20001a9e3:0x1de3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042500:0:192358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a51 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042507:0:192358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a51 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042513:0:192358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a51 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042518:0:192358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109502.042521:0:192358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a51 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042528:0:192358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a51 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042540:0:192358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab8c04c00) 00010000:00010000:3.0:1786109502.042542:0:192358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109502.042545:0:192358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a51 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042551:0:192358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36a51 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109502.042563:0:192358:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd5ecb8a reply state 000000006d4a4d1a transno 330712481798 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca36a58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042573:0:192358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca36a58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.042579:0:192358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ab8c04000) 00010000:00010000:3.0:1786109502.042582:0:192358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109502.042584:0:192358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1786109502.042645:0:192358:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1786109502.042659:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109502.042662:0:192358:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 330712481799 00000020:00080000:3.0:1786109502.042665:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109502.042667:0:192358:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 330712481799 00000100:00100000:0.0:1786109502.046251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109502.046323:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109502.046596:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922092032 00000100:00100000:3.0:1786109502.046606:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922092032 00000100:00100000:2.0:1786109502.046766:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922092160 00000100:00100000:2.0:1786109502.046772:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922092160 00000100:00100000:1.0:1786109502.046810:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 977 00000100:00100000:1.0:1786109502.046821:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+12:2401:x1872862922092032:12345-192.168.203.38@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1786109502.046852:0:187900:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff930ac0b56300 x1872862922092032/t0(0) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:728/0 lens 328/0 e 0 to 0 dl 1786109513 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109502.046879:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+12:2401:x1872862922092032:12345-192.168.203.38@tcp:101:ldlm_lock_repla.0 Request processed in 61us (638us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109502.046885:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 977 00000100:00100000:1.0:1786109502.046894:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 978 00000100:00100000:1.0:1786109502.046900:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+12:2401:x1872862922092160:12345-192.168.203.38@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1786109502.046907:0:187900:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff930ac0b54000 x1872862922092160/t0(0) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:728/0 lens 328/0 e 0 to 0 dl 1786109513 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109502.046915:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+12:2401:x1872862922092160:12345-192.168.203.38@tcp:101:ldlm_lock_repla.0 Request processed in 16us (593us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109502.046920:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 978 00000020:00080000:0.0:1786109502.046957:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1786109502.046961:0:192358:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 330712481799 00010000:00080000:0.0:1786109502.046965:0:192358:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1786109502.046967:0:192358:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1786109502.046974:0:192358:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1786109502.046976:0:192358:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1786109502.046983:0:192358:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.203.38@tcp: req@ffff930ac0b56300 x1872862922092032/t0(0) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:728/0 lens 328/0 e 0 to 0 dl 1786109513 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1786109502.047000:0:192358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109502.047068:0:192358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca36a66 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc494ce7 expref: -99 pid: 192358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.047094:0:192358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca36a66 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 13 pid: 192358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.047115:0:192358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca36a66 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 13 pid: 192358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.047124:0:192358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2cc00, rc 0) 00010000:00080000:0.0:1786109502.047191:0:192358:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1786109502.047202:0:192358:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1786109502.047204:0:192358:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1786109502.047209:0:192358:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.203.38@tcp: req@ffff930ac0b54000 x1872862922092160/t0(0) o101->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:728/0 lens 328/0 e 0 to 0 dl 1786109513 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1786109502.047220:0:192358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109502.047230:0:192358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca36a6d lrc: 2/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc494c69 expref: -99 pid: 192358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.047242:0:192358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca36a6d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494c69 expref: 13 pid: 192358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.047252:0:192358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca36a6d lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494c69 expref: 13 pid: 192358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.047259:0:192358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2c000, rc 0) 00010000:00080000:0.0:1786109502.047278:0:192358:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1786109502.047284:0:192358:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1786109502.049721:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109502.049818:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922092288 00000100:00100000:2.0:1786109502.049828:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922092288 00000100:00100000:2.0:1786109502.049921:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:2.0:1786109502.049933:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+13:2401:x1872862922092288:12345-192.168.203.38@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1786109502.049959:0:189813:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ac1782d80 x1872862922092288/t0(0) o400->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:728/0 lens 224/0 e 0 to 0 dl 1786109513 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109502.049990:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+13:2401:x1872862922092288:12345-192.168.203.38@tcp:400:ptlrpcd_rcv.0 Request processed in 60us (277us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109502.050011:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 188 00010000:00080000:0.0:1786109502.050062:0:192358:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1786109502.050172:0:192358:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 78, last_transno is 335007449088 00000001:00100000:3.0:1786109502.051882:0:192325:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 397d331e-10fc-4558-be87-308c3622e8eb 00000001:00100000:3.0:1786109502.051891:0:192325:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1786109502.051948:0:192325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 330712481798 is committed 00000001:00080000:1.0:1786109502.052027:0:192358:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1786109502.052069:0:192358:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1786109502.052081:0:192358:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff930ab9632680 x1872862933234944/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:728/0 lens 224/0 e 1 to 0 dl 1786109513 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1786109502.052219:0:192358:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.203.38@tcp: req@ffff930ac1782d80 x1872862922092288/t0(0) o400->397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp:728/0 lens 224/0 e 0 to 0 dl 1786109513 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1786109502.052285:0:192358:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:16, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1786109502.053275:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1786109502.053287:0:3645:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff930ab9631180 x1872862933234944/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1786109518 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109502.053296:0:3645:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff930ab9631180 x1872862933234944/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1786109518 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109502.053302:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1786109502.053323:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1786109502.053330:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000015c5cfb9): req@ffff930ab7c51880 x1872862933212544/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109469 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109502.053346:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933234944:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1786109502.053464:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109502.053530:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933212544 00000100:00100000:2.0:1786109502.053536:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933212544 00000100:00100000:2.0:1786109502.053578:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12312 00000100:00100000:2.0:1786109502.053587:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933212544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109502.053618:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:2.0:1786109502.053660:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933212544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109502.053666:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12312 00000100:00100000:2.0:1786109502.053699:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933212544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109502.053754:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109502.053763:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933238656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109502.053787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109502.053821:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933238656 00000100:00100000:2.0:1786109502.053825:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933238656 00000100:00100000:2.0:1786109502.053849:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12313 00000100:00100000:2.0:1786109502.053855:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933238656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109502.053868:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:2.0:1786109502.053900:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933238656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109502.053906:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12313 00000100:00100000:2.0:1786109502.053932:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933238656:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1786109502.054992:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca36a4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055010:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca36a4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055017:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca36a4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055022:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109502.055026:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca36a4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055033:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca36a4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055048:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ab8c04000) 00010000:00010000:0.0:1786109502.055052:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109502.055056:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca36a4a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055062:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c200/0xdb52b77d7ca36a4a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055078:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca36a58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055084:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca36a58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055089:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca36a58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055095:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6ca00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109502.055099:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca36a58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055105:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca36a58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055112:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ab8c04000) 00010000:00010000:0.0:1786109502.055114:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109502.055117:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca36a58 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.055121:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ca00/0xdb52b77d7ca36a58 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1786109502.070052:0:192358:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa66f07f8fe10 00100000:10000000:1.0:1786109502.070066:0:192358:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1786109502.070555:0:192735:0:(mdd_orphans.c:363:mdd_orphan_key_test_and_delete()) Found orphan [0x20001a9e3:0x1de2:0x0] count 1, skip it 00000004:00080000:1.0:1786109502.071117:0:192344:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x1874:0x0] 00000100:00100000:1.0:1786109502.071161:0:192344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1782a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:192344:1872862933238784:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1786109502.071235:0:192344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109502.071274:0:192344:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab95b39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109502.071331:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933238784 00000100:00100000:3.0:1786109502.071338:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933238784 00000100:00100000:3.0:1786109502.071414:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23079 00000100:00100000:3.0:1786109502.071424:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:192344:x1872862933238784:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1786109502.071471:0:43915:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6369 -> diff = -109 00002000:02000040:3.0:1786109502.071476:0:43915:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6261 to 0x280000400:6369) 00000100:00080000:0.0:1786109502.072321:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1786109502.072508:0:192346:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x1882:0x0] 00000100:00100000:0.0:1786109502.072538:0:192346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:192346:1872862933238912:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1786109502.072577:0:192346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109502.072612:0:192346:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a978b2300 going to sleep for 11 seconds 00000100:00100000:1.0:1786109502.072658:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933238912 00000100:00100000:1.0:1786109502.072664:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933238912 00000100:00100000:1.0:1786109502.072716:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23080 00000100:00100000:1.0:1786109502.072724:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:192346:x1872862933238912:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1786109502.072742:0:179238:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6305 -> diff = -31 00002000:02000040:1.0:1786109502.072745:0:179238:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6275 to 0x2c0000401:6305) 00000100:00080000:0.0:1786109502.074257:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1786109502.085343:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.085358:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062e13a7d/0xdb52b77d7ca36a74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085381:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e1:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.085386:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.085392:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062e13a7d/0xdb52b77d7ca36a74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085421:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062e13a7d/0xdb52b77d7ca36a74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085447:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062e13a7d/0xdb52b77d7ca36a74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085456:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062e13a7d/0xdb52b77d7ca36a74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085489:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109502.085643:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.085649:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006323749d/0xdb52b77d7ca36a7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085657:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e0:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.085660:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.085664:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006323749d/0xdb52b77d7ca36a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085674:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006323749d/0xdb52b77d7ca36a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085682:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006323749d/0xdb52b77d7ca36a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085689:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006323749d/0xdb52b77d7ca36a7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085701:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786109502.085740:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.085745:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca36a82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085753:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18df:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.085756:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.085759:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca36a82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085767:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca36a82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085776:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca36a82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085783:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca36a82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085802:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1786109502.085812:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786109502.085817:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062e13a7d/0xdb52b77d7ca36a74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085825:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109502.085829:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062e13a7d/0xdb52b77d7ca36a74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085838:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062e13a7d/0xdb52b77d7ca36a74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085853:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062e13a7d/0xdb52b77d7ca36a74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085860:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062e13a7d/0xdb52b77d7ca36a74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085882:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786109502.085885:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006323749d/0xdb52b77d7ca36a7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085891:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109502.085894:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006323749d/0xdb52b77d7ca36a7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085905:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006323749d/0xdb52b77d7ca36a7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085913:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006323749d/0xdb52b77d7ca36a7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085920:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006323749d/0xdb52b77d7ca36a7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085930:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109502.085933:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca36a82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085939:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109502.085942:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca36a82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085950:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca36a82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085959:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca36a82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085965:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca36a82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.085981:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109502.085983:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109502.085985:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109502.086028:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.086034:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bec68d2/0xdb52b77d7ca36a89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.086042:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18de:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.086045:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.086049:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bec68d2/0xdb52b77d7ca36a89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.086057:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bec68d2/0xdb52b77d7ca36a89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.086064:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bec68d2/0xdb52b77d7ca36a89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.086071:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bec68d2/0xdb52b77d7ca36a89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.086089:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109502.086128:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.086134:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36a90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.086146:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18dd:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.086149:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.086153:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36a90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.086161:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36a90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.086169:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36a90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.087241:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109502.087250:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bec68d2/0xdb52b77d7ca36a89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.087260:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.087264:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bec68d2/0xdb52b77d7ca36a89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.087272:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bec68d2/0xdb52b77d7ca36a89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.087286:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bec68d2/0xdb52b77d7ca36a89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.087292:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bec68d2/0xdb52b77d7ca36a89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.087311:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.087313:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.087314:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.087321:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109502.087485:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36a90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087503:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109502.087576:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.087581:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca36a97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087590:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18dc:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.087593:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.087597:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca36a97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087608:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca36a97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087616:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca36a97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087623:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca36a97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087634:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786109502.087672:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.087678:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36a9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087685:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18db:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.087688:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.087691:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36a9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087700:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36a9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087707:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36a9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087713:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36a9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087731:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1786109502.087769:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.087773:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca36aa5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087781:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18da:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.087783:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.087788:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca36aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087796:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca36aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087803:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca36aa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087809:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca36aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087816:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1786109502.087852:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.087857:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36aac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087864:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d9:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.087868:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.087872:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36aac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087880:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36aac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087887:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36aac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087893:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36aac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087901:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1786109502.087935:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.087940:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36ab3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087948:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d8:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.087951:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.087955:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087963:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087971:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087978:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.087986:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1786109502.088021:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.088026:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca36aba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.088034:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d7:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.088036:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.088040:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca36aba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.088049:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca36aba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.088057:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca36aba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.088063:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca36aba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.088071:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1786109502.088104:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.088109:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36ac1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.088117:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d6:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.088120:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.088123:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.088132:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.088139:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.088146:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.088154:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1786109502.088475:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1786109502.088481:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36a90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088490:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.088494:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36a90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088502:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36a90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088516:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36a90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088523:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca36a90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088588:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1786109502.088593:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca36a97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088600:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ac00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.088604:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca36a97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088612:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca36a97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088622:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca36a97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088629:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca36a97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088641:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786109502.088644:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36a9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088651:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.088654:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36a9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088660:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36a9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088670:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36a9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088677:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca36a9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088688:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786109502.088692:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca36aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088699:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628bc00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.088702:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca36aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088708:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca36aa5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088717:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca36aa5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088723:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca36aa5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088734:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786109502.088738:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36aac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088743:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.088746:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36aac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088754:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36aac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088763:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36aac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088770:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca36aac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088782:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109502.088785:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088792:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ba00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.088795:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088803:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36ab3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088812:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36ab3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088819:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca36ab3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088831:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109502.088835:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca36aba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088841:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.088845:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca36aba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088858:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca36aba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088868:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca36aba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088875:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca36aba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088886:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109502.088890:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088896:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.088899:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088907:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36ac1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088916:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36ac1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088923:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091467a5e/0xdb52b77d7ca36ac1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.088940:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.088942:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.088944:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.088952:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.088956:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.089499:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109502.090267:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.090276:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca36ac8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.090289:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d5:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.090292:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.090297:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca36ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.090309:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca36ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.090319:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca36ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.090326:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca36ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.090389:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109502.090482:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.090488:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca36acf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.090495:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d4:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.090498:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.090502:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca36acf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.090510:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca36acf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.090517:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca36acf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.090524:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca36acf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786109502.091913:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.091924:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ad6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.091935:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a1:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.091938:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.091942:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.091958:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.091965:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ad6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.091972:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092068:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109502.092077:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca36ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092085:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628be00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.092090:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca36ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092099:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca36ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092115:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca36ac8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092123:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca36ac8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092141:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109502.092145:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca36acf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092156:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.092159:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca36acf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092166:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca36acf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092186:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca36acf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092193:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109502.092196:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092202:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.092205:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092213:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092222:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ad6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.092228:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.092231:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.092233:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109502.092305:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1786109502.092311:0:43915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7847f81/0xdb52b77d7ca36acf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786109502.092423:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109502.092578:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109502.092612:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca36add lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092623:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d3:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.092626:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.092630:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca36add lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092640:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca36add lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092648:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca36add lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092656:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca36add lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092681:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109502.092722:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.092727:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca36ae4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092736:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d2:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.092739:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.092743:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca36ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092752:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca36ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092759:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca36ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092765:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca36ae4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092822:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786109502.092859:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.092864:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca36aeb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092871:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d1:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.092874:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.092878:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca36aeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092886:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca36aeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092894:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca36aeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092901:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca36aeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092913:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1786109502.092947:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.092952:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca36af2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092959:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d0:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.092962:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.092966:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca36af2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092974:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca36af2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092983:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca36af2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.092989:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca36af2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093006:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1786109502.093044:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.093049:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca36af9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093057:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18cf:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.093060:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.093064:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca36af9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093073:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca36af9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093081:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca36af9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093087:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca36af9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093096:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1786109502.093126:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.093131:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca36b00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093139:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ce:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.093142:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.093146:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca36b00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093154:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca36b00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093162:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca36b00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093170:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca36b00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093191:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1786109502.093220:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.093225:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca36b07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093231:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18cd:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.093234:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.093238:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca36b07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093246:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca36b07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093253:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca36b07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093261:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca36b07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093269:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1786109502.093297:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.093302:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca36b0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093309:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18cc:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.093311:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.093316:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca36b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093324:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca36b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093332:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca36b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093338:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca36b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093346:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1786109502.093372:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.093376:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca36b15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093384:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18cb:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.093387:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.093391:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca36b15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093484:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca36b15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093493:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca36b15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093501:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca36b15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093510:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1786109502.093549:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.093554:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca36b1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093562:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ca:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.093564:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.093568:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca36b1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093577:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca36b1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093585:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca36b1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093592:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca36b1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093600:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1786109502.093636:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.093641:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca36b23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093648:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c9:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.093651:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.093655:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca36b23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093663:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca36b23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093670:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca36b23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093677:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca36b23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093692:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1786109502.093729:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.093734:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca36b2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093741:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c8:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.093744:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.093747:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca36b2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093754:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca36b2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093762:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca36b2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093768:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca36b2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093776:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1786109502.093808:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.093813:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca36b31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093821:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c7:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.093824:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.093828:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca36b31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093836:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca36b31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093843:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca36b31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093850:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca36b31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093859:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1786109502.093889:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.093894:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca36b38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093901:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c6:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.093904:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.093909:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca36b38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093917:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca36b38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093924:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca36b38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093931:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca36b38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093938:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1786109502.093964:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.093968:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca36b3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093975:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c5:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.093978:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.093982:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca36b3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093990:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca36b3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.093997:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca36b3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.094003:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca36b3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.094011:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1786109502.094037:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.094042:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36b46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.094050:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c4:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.094052:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.094056:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36b46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.094065:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36b46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.094072:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36b46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.094080:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36b46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.094088:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1786109502.094121:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.094126:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca36b4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.094134:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c3:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.094137:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.094140:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca36b4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.094149:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca36b4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.094155:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca36b4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.094160:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca36b4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.094168:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00010000:00010000:3.0:1786109502.094236:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:3.0:1786109502.094243:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca36add lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094252:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094256:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca36add lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094265:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca36add lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094280:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca36add lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094286:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca36add lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094308:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:3.0:1786109502.094312:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca36ae4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094318:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628aa00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094321:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca36ae4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094332:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca36ae4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094342:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca36ae4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094349:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084471168/0xdb52b77d7ca36ae4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094362:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1786109502.094365:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca36aeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094371:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094373:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca36aeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094380:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca36aeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094388:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca36aeb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094395:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca36aeb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094426:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1786109502.094445:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca36af2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094452:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ae00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094455:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca36af2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094463:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca36af2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094472:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca36af2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094477:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca36af2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094488:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1786109502.094491:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca36af9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094496:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094499:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca36af9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094509:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca36af9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094516:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca36af9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094522:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca36af9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094533:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1786109502.094536:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca36b00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094542:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094545:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca36b00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094552:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca36b00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094562:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca36b00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094569:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7804840/0xdb52b77d7ca36b00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094584:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1786109502.094588:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca36b07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094595:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094598:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca36b07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094605:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca36b07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094615:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca36b07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094622:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca36b07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094632:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1786109502.094636:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca36b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094642:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094645:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca36b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094656:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca36b0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094665:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca36b0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094672:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca36b0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094682:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1786109502.094685:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca36b15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094692:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094695:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca36b15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094702:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca36b15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094711:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca36b15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094717:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca36b15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094732:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1786109502.094735:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca36b1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094741:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094744:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca36b1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094750:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca36b1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094759:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca36b1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094766:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca36b1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094775:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1786109502.094778:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca36b23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094784:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094787:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca36b23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094797:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca36b23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094806:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca36b23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094812:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca36b23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094822:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786109502.094826:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca36b2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094832:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094834:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca36b2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094841:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca36b2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094850:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca36b2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094857:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca36b2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094870:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786109502.094872:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca36b31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094878:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094881:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca36b31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094888:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca36b31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094897:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca36b31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094904:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca36b31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094914:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786109502.094917:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca36b38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094923:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094926:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca36b38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094939:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca36b38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094948:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca36b38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094956:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca36b38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094966:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109502.094969:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca36b3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094975:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.094979:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca36b3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094986:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca36b3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.094995:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca36b3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.095002:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca36b3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.095017:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109502.095020:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36b46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.095026:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.095029:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36b46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.095037:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36b46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.095047:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36b46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.095054:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca36b46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.095065:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109502.095069:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca36b4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.095075:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.095078:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca36b4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.095088:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca36b4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.095097:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca36b4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.095103:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca36b4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.095114:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.095116:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.095118:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.095128:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.095133:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109502.095295:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109502.095301:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36b54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.095310:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c2:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:2.0:1786109502.095314:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109502.095319:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36b54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.095329:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36b54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.095338:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36b54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.095346:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36b54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.095408:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1786109502.095879:0:43915:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:6260 00000100:00100000:2.0:1786109502.095970:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:192344:x1872862933238784:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24545us (24731us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109502.095979:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23079 00000100:00100000:2.0:1786109502.096068:0:192344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1782a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:192344:1872862933238784:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1786109502.096083:0:192344:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x18e1:0x0] from OST, last_created [0x280000400:0x18e1:0x0]last_used is [0x280000400:0x1874:0x0] 00000100:00100000:2.0:1786109502.096148:0:192344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:192344:1872862933239168:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1786109502.096257:0:192344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109502.096283:0:192344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309850c4540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109502.096300:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933239040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109502.096325:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109502.096358:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933239168 00000100:00100000:2.0:1786109502.096365:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933239168 00010000:00010000:1.0:1786109502.096513:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109502.096522:0:179238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ad6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786109502.096615:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.096621:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36b5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096630:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a0:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.096634:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.096639:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36b5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096649:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36b5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096660:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36b5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096667:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36b5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096681:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1786109502.096719:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x189f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.096723:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36b62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096730:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x189f:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.096733:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x189f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.096737:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096744:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096751:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36b62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096757:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096771:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1786109502.096810:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x189e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.096814:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36b69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096821:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x189e:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.096824:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x189e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.096828:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096836:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096842:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096848:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36b69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096856:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1786109502.096891:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x189d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.096896:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36b70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096904:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x189d:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.096907:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x189d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.096911:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096919:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096926:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096933:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096941:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1786109502.096977:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x189c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.096982:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36b77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.096989:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x189c:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.096992:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x189c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.096996:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097005:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097013:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097021:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097030:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1786109502.097064:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x189b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.097068:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36b7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097076:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x189b:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.097079:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x189b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.097083:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36b7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097091:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36b7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097099:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36b7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097106:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36b7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097114:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1786109502.097206:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x189a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.097211:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36b85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097219:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x189a:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.097221:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x189a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.097225:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36b85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097234:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36b85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097242:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36b85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097249:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097258:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1786109502.097291:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1899:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.097296:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36b8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097304:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1899:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.097307:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1899:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.097311:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36b8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097320:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36b8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097328:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36b8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097335:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36b8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097342:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1786109502.097384:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1898:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.097389:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36b93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.097395:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1898:0x0].0x0 since=8358s v=(0 0) 00000100:00100000:2.0:1786109502.097486:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23081 00000100:00100000:2.0:1786109502.097498:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:192344:x1872862933239168:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1786109502.097531:0:43918:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 6370 00010000:00010000:1.0:1786109502.098217:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1898:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.098223:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098235:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098243:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36b93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098251:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098266:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1786109502.098311:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1897:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.098317:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36b9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098325:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1897:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.098328:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1897:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.098332:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098341:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098347:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36b9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098354:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098363:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1786109502.098484:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1896:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.098490:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36ba1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098499:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1896:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.098502:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1896:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.098506:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098515:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098522:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36ba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098528:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098538:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1786109502.098576:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1895:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.098581:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36ba8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098588:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1895:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.098591:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1895:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.098595:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36ba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098605:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36ba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098612:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36ba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098619:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36ba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098627:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1786109502.098660:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1894:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.098664:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36baf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098672:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1894:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.098674:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1894:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.098678:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36baf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098686:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36baf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098694:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36baf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098701:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36baf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098708:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:1.0:1786109502.098742:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1893:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.098747:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36bb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098755:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1893:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.098759:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1893:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.098763:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098772:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098780:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36bb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098787:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098795:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:1.0:1786109502.098830:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1892:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.098835:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36bbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098843:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1892:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.098846:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1892:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.098850:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098858:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098865:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36bbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098872:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098880:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:1.0:1786109502.098929:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1891:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.098935:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca36bc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098943:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1891:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.098946:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1891:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.098949:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca36bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098958:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca36bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098965:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca36bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098971:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca36bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.098985:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:1.0:1786109502.099022:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1890:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.099027:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca36bcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.099034:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1890:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.099037:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1890:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.099041:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca36bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.099050:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca36bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.099058:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca36bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.099065:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca36bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.099074:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:1.0:1786109502.099106:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x188f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.099110:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dec43826/0xdb52b77d7ca36bd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.099117:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x188f:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.099122:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x188f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.099125:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dec43826/0xdb52b77d7ca36bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.099134:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dec43826/0xdb52b77d7ca36bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.099141:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dec43826/0xdb52b77d7ca36bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.099148:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dec43826/0xdb52b77d7ca36bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.099157:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00010000:00010000:0.0:1786109502.099231:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:0.0:1786109502.099240:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36b54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099248:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099253:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36b54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099261:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36b54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099277:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36b54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099284:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca36b54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099304:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1786109502.099309:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36b5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099315:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099318:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36b5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099325:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36b5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099335:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36b5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099342:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36b5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099374:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1786109502.099378:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099385:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099389:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36b62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099412:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36b62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099424:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36b62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099445:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36b62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x189f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099458:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1786109502.099462:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36b69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099468:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099471:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36b69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099478:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36b69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099487:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36b69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099493:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36b69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x189e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099521:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1786109502.099525:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099532:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099535:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099542:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36b70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099551:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36b70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099559:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36b70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x189d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099570:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1786109502.099573:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099579:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099582:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099589:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36b77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099599:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36b77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099606:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36b77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x189c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099617:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1786109502.099619:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36b7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099625:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099628:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36b7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099634:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36b7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099644:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36b7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099651:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36b7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x189b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099663:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1786109502.099666:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099672:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099675:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36b85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099682:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36b85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099691:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36b85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099698:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36b85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x189a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099709:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1786109502.099712:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36b8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099719:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099722:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36b8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099734:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36b8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099743:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36b8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099750:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36b8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1899:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099761:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1786109502.099765:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099771:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099774:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099781:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36b93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099789:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36b93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099796:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36b93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1898:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099811:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1786109502.099814:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099820:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099823:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36b9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099830:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36b9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099838:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36b9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099844:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36b9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1897:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099853:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1786109502.099856:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099862:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099865:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099876:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36ba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099883:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36ba1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099890:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36ba1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1896:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099900:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1786109502.099903:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36ba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099908:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099912:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36ba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099919:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36ba8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099927:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36ba8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099934:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36ba8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1895:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099949:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1786109502.099952:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36baf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099957:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.099961:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36baf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099967:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36baf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099975:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36baf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099982:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36baf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1894:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099991:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1786109502.099994:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.099999:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.100002:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100013:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36bb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100021:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36bb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100027:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36bb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1893:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100039:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1786109502.100043:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100050:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.100053:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100060:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36bbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100069:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36bbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100076:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36bbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1892:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100093:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786109502.100096:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca36bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100102:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.100105:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca36bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100112:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca36bc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100121:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca36bc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100127:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca36bc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1891:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100137:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109502.100140:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca36bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100147:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.100150:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca36bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100162:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca36bcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100171:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca36bcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100213:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca36bcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1890:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100225:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109502.100228:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dec43826/0xdb52b77d7ca36bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100233:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.100237:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dec43826/0xdb52b77d7ca36bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100244:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dec43826/0xdb52b77d7ca36bd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100254:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dec43826/0xdb52b77d7ca36bd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100261:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dec43826/0xdb52b77d7ca36bd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x188f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.100276:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109502.100277:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109502.100279:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109502.100525:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x188e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.100531:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca36bd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100540:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x188e:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.100544:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x188e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.100549:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca36bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100560:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca36bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100567:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca36bd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100574:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca36bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100593:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109502.100643:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x188d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.100649:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b472d87/0xdb52b77d7ca36be0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100657:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x188d:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.100660:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x188d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.100664:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b472d87/0xdb52b77d7ca36be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100672:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b472d87/0xdb52b77d7ca36be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100679:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b472d87/0xdb52b77d7ca36be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100685:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b472d87/0xdb52b77d7ca36be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100693:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1786109502.100726:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x188c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.100731:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42d5afe/0xdb52b77d7ca36be7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100739:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x188c:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.100742:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x188c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.100746:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d42d5afe/0xdb52b77d7ca36be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100755:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d42d5afe/0xdb52b77d7ca36be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100763:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42d5afe/0xdb52b77d7ca36be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100770:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d42d5afe/0xdb52b77d7ca36be7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100777:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1786109502.100802:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x188b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.100806:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca36bee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100812:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x188b:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.100815:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x188b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.100819:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca36bee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100828:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca36bee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100835:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca36bee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100842:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca36bee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100850:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1786109502.100872:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x188a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.100876:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000374748a0/0xdb52b77d7ca36bf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100883:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x188a:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.100886:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x188a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.100889:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000374748a0/0xdb52b77d7ca36bf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100898:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000374748a0/0xdb52b77d7ca36bf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100905:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000374748a0/0xdb52b77d7ca36bf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100912:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000374748a0/0xdb52b77d7ca36bf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100925:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1786109502.100947:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1889:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.100951:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36bfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100959:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1889:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.100961:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1889:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.100965:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36bfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100973:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36bfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100981:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36bfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100988:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.100995:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1786109502.101024:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1888:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.101028:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca36c03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.101035:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1888:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.101038:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1888:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.101042:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca36c03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.101050:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca36c03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.101058:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca36c03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.101065:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca36c03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.101074:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1786109502.101106:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1887:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.101111:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083043f31/0xdb52b77d7ca36c0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.101118:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1887:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.101121:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1887:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.101125:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083043f31/0xdb52b77d7ca36c0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.101133:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083043f31/0xdb52b77d7ca36c0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.101141:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083043f31/0xdb52b77d7ca36c0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.101148:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083043f31/0xdb52b77d7ca36c0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.101157:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1786109502.101256:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1786109502.101262:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca36bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101269:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.101273:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca36bd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101281:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca36bd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101293:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca36bd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101301:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca36bd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x188e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101315:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1786109502.101318:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b472d87/0xdb52b77d7ca36be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101324:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.101327:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b472d87/0xdb52b77d7ca36be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101335:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b472d87/0xdb52b77d7ca36be0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101345:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b472d87/0xdb52b77d7ca36be0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101352:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b472d87/0xdb52b77d7ca36be0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x188d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101363:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1786109502.101366:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d42d5afe/0xdb52b77d7ca36be7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101372:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.101375:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42d5afe/0xdb52b77d7ca36be7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101382:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42d5afe/0xdb52b77d7ca36be7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101391:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d42d5afe/0xdb52b77d7ca36be7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101412:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d42d5afe/0xdb52b77d7ca36be7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x188c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101426:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1786109502.101443:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca36bee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101451:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.101454:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca36bee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101463:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca36bee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101473:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca36bee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101480:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca36bee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x188b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101492:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1786109502.101495:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000374748a0/0xdb52b77d7ca36bf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101501:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.101505:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000374748a0/0xdb52b77d7ca36bf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101518:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000374748a0/0xdb52b77d7ca36bf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101528:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000374748a0/0xdb52b77d7ca36bf5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101536:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000374748a0/0xdb52b77d7ca36bf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x188a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101547:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786109502.101551:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101557:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.101560:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36bfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101567:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36bfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101576:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36bfc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101583:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36bfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1889:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101599:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109502.101602:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca36c03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101609:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.101612:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca36c03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101618:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca36c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101627:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca36c03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101634:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca36c03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1888:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101645:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109502.101648:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083043f31/0xdb52b77d7ca36c0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101655:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109502.101658:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083043f31/0xdb52b77d7ca36c0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101669:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083043f31/0xdb52b77d7ca36c0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101678:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083043f31/0xdb52b77d7ca36c0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101684:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083043f31/0xdb52b77d7ca36c0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1887:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109502.101695:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109502.101697:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109502.101699:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109502.102531:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109502.102536:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109502.103069:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1886:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.103077:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca36c11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103089:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1886:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.103093:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1886:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.103098:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca36c11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103110:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca36c11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103118:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca36c11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103126:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca36c11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103143:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109502.103151:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109502.103156:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca36c11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103164:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109502.103167:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca36c11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103189:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca36c11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103203:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca36c11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103210:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca36c11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1886:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103226:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109502.103228:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109502.103229:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109502.103278:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1885:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.103284:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000241be023/0xdb52b77d7ca36c18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103292:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1885:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.103296:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1885:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.103300:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000241be023/0xdb52b77d7ca36c18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103314:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000241be023/0xdb52b77d7ca36c18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103322:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000241be023/0xdb52b77d7ca36c18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103328:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000241be023/0xdb52b77d7ca36c18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103339:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109502.103346:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109502.103350:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000241be023/0xdb52b77d7ca36c18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103356:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109502.103359:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000241be023/0xdb52b77d7ca36c18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103366:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000241be023/0xdb52b77d7ca36c18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103375:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000241be023/0xdb52b77d7ca36c18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103381:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000241be023/0xdb52b77d7ca36c18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1885:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103393:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109502.103395:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109502.103498:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:192344:x1872862933239168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6000us (7237us total) trans 34359738459 rc 0/0 00000100:00100000:2.0:1786109502.103508:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23081 00000100:00100000:2.0:1786109502.103546:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933239040 00000100:00100000:2.0:1786109502.103553:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933239040 00000100:00100000:2.0:1786109502.103590:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5793 00000100:00100000:2.0:1786109502.103598:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933239040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109502.103621:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109502.103662:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933239040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (7335us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109502.103669:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5793 00000100:00100000:2.0:1786109502.103714:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933239040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786109502.103804:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109502.103849:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109502.103899:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1884:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.103905:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eccb6d90/0xdb52b77d7ca36c1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103913:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1884:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.103916:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1884:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.103920:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eccb6d90/0xdb52b77d7ca36c1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103929:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eccb6d90/0xdb52b77d7ca36c1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103937:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eccb6d90/0xdb52b77d7ca36c1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103944:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eccb6d90/0xdb52b77d7ca36c1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.103967:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109502.104007:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1883:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109502.104012:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca36c26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.104023:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1883:0x0].0x0 since=8358s v=(0 0) 00010000:00010000:1.0:1786109502.104026:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1883:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109502.104030:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca36c26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.104039:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca36c26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.104046:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca36c26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.104053:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca36c26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109502.104076:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1786109502.104112:0:179238:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6274 00000100:00100000:1.0:1786109502.104159:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:192346:x1872862933238912:12345-0@lo:5:osp-pre-1-0.0 Request processed in 31436us (31580us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109502.104166:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23080 00000100:00100000:1.0:1786109502.104211:0:192346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:192346:1872862933238912:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1786109502.104223:0:192346:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x18a1:0x0] from OST, last_created [0x2c0000401:0x18a1:0x0]last_used is [0x2c0000401:0x1882:0x0] 00000100:00100000:1.0:1786109502.104277:0:192346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1782a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:192346:1872862933239424:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1786109502.104311:0:192346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109502.104333:0:192346:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985db9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109502.104346:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933239296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109502.104370:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786109502.104502:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109502.104508:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eccb6d90/0xdb52b77d7ca36c1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.104516:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.104519:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eccb6d90/0xdb52b77d7ca36c1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.104527:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eccb6d90/0xdb52b77d7ca36c1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.104544:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eccb6d90/0xdb52b77d7ca36c1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.104551:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eccb6d90/0xdb52b77d7ca36c1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.104570:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109502.104573:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca36c26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.104579:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109502.104582:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca36c26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.104590:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca36c26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.104599:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca36c26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.104606:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca36c26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109502.104617:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.104619:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109502.104621:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109502.104663:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933239424 00000100:00100000:1.0:1786109502.104669:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933239424 00000100:00100000:1.0:1786109502.104712:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23082 00000100:00100000:1.0:1786109502.104720:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:192346:x1872862933239424:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1786109502.104749:0:8443:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6306 00010000:00010000:2.0:1786109502.105557:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109502.106774:0:192344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:192344:1872862933239168:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1786109502.106789:0:192344:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x18e1:0x0]-[0x280000400:0x1901:0x0] 00000100:00100000:1.0:1786109502.106987:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:192346:x1872862933239424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2266us (2673us total) trans 4294975822 rc 0/0 00000100:00100000:1.0:1786109502.106996:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23082 00000100:00100000:1.0:1786109502.107032:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933239296 00000100:00100000:1.0:1786109502.107038:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933239296 00000100:00100000:0.0:1786109502.107131:0:192346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1782a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:192346:1872862933239424:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1786109502.107140:0:192346:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x18a1:0x0]-[0x2c0000401:0x18c1:0x0] 00000100:00100000:1.0:1786109502.107186:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5794 00000100:00100000:1.0:1786109502.107195:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933239296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109502.107217:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109502.107260:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933239296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109502.107266:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5794 00000100:00100000:0.0:1786109502.107315:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933239296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109502.112657:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109502.112755:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922091008 00000100:00100000:2.0:1786109502.112765:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922091008 00000100:00100000:2.0:1786109502.112824:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 979 00000100:00100000:2.0:1786109502.112834:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+8:160439:x1872862922091008:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109502.112854:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109502.112876:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca36c2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1547 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.112959:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca36c34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.112971:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca36c34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.112984:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca36c34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109502.113033:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:2.0:1786109502.113037:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109502.113061:0:188678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca36c34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.113086:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76600/0xdb52b77d7ca36c2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1547 expref: 10 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.113103:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca36c34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1547 expref: 9 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109502.113110:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a83bfc400) 00010000:00010000:2.0:1786109502.113113:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109502.113116:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77200, rc 0) 00000100:00100000:2.0:1786109502.113254:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+9:160439:x1872862922091008:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 421us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109502.113261:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 979 00000100:00100000:0.0:1786109502.119125:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109502.119248:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922092416 00000100:00100000:1.0:1786109502.119258:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922092416 00000100:00100000:1.0:1786109502.119351:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 980 00000100:00100000:1.0:1786109502.119363:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+9:160439:x1872862922092416:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:1.0:1786109502.119395:0:187900:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:0.0:1786109502.119771:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+9:160439:x1872862922092416:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 409us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109502.119780:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 980 00000100:00100000:1.0:1786109502.123371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109502.123622:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922092544 00000100:00100000:2.0:1786109502.123632:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922092544 00000100:00100000:2.0:1786109502.123731:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 981 00000100:00100000:2.0:1786109502.123742:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:160439:x1872862922092544:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1786109502.123783:0:189813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1786109502.123864:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:160439:x1872862922092544:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 123us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109502.123871:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 981 00000100:00100000:2.0:1786109502.129886:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109502.130032:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922092672 00000100:00100000:3.0:1786109502.130042:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922092672 00000100:00100000:3.0:1786109502.130135:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23083 00000100:00100000:3.0:1786109502.130144:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2401:x1872862922092672:12345-192.168.203.38@tcp:8:lfs.0 00010000:00080000:3.0:1786109502.130193:0:40692:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 397d331e-10fc-4558-be87-308c3622e8eb@192.168.203.38@tcp t30064776137 exp 0000000000000000 cur 8358 last 0 00000020:00000080:3.0:1786109502.130224:0:40692:0:(genops.c:1406:class_connect()) connect: client 397d331e-10fc-4558-be87-308c3622e8eb, cookie 0xdb52b77d7ca36c3b 00002000:00100000:3.0:1786109502.130236:0:40692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 397d331e-10fc-4558-be87-308c3622e8eb/ffff93098c888800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786109502.130248:0:40692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786109502.130314:0:40692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1786109502.130341:0:40692:0:(import.c:65:import_set_state_nolock()) ffff93098c88a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786109502.130420:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862922092672:12345-192.168.203.38@tcp:8:lfs.0 Request processed in 274us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109502.130427:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23083 00000100:00100000:3.0:1786109502.132851:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109502.132969:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922092800 00000100:00100000:2.0:1786109502.132979:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922092800 00000100:00100000:2.0:1786109502.133104:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5795 00000100:00100000:2.0:1786109502.133114:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:160439:x1872862922092800:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1786109502.133142:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109502.133225:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:160439:x1872862922092800:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 112us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109502.133235:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5795 00000100:00080000:0.0:1786109502.133890:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109502.136535:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109502.136636:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922092928 00000100:00100000:2.0:1786109502.136645:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922092928 00000100:00100000:2.0:1786109502.136700:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5796 00000100:00100000:2.0:1786109502.136711:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:160439:x1872862922092928:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1786109502.136737:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109502.136803:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:160439:x1872862922092928:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 93us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109502.136811:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5796 00010000:00010000:1.0:1786109503.044881:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109504.068857:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109504.262716:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109504.262741:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933239552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109504.262809:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109504.263108:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933239552 00000100:00100000:0.0:1786109504.263116:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933239552 00000100:00100000:0.0:1786109504.263187:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5797 00000100:00100000:0.0:1786109504.263197:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933239552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109504.263299:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109504.263354:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933239552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109504.263361:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5797 00000100:00080000:0.0:1786109504.263390:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109504.263552:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933239552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109504.265170:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109504.265188:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933239680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109504.265307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109504.266008:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933239680 00000100:00100000:2.0:1786109504.266017:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933239680 00000100:00100000:2.0:1786109504.267479:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5798 00000100:00100000:2.0:1786109504.267497:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933239680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109504.267535:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109504.267617:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933239680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (2309us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109504.267625:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5798 00000100:00080000:2.0:1786109504.267651:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109504.267699:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933239680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109504.778399:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933239808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109504.778509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109504.782256:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933239808 00000100:00100000:3.0:1786109504.782271:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933239808 00000100:00100000:3.0:1786109504.782332:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12314 00000100:00100000:3.0:1786109504.782343:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933239808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786109504.782379:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:3.0:1786109504.785389:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933239808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3039us (6870us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109504.785405:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12314 00000100:00100000:2.0:1786109504.788260:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933239808:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786109505.092556:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109505.285293:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933240064:0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.285404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109505.285525:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933240576:0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.285557:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109505.285596:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933241088:0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.285644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109505.285689:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1786109505.285698:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933240192:0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.285725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109505.285749:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933240704:0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.285779:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109505.285803:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933241216:0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.285831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109505.285881:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933240064 00000100:00100000:3.0:1786109505.285903:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933240064 00000100:00100000:3.0:1786109505.285971:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933240192 00000100:00100000:3.0:1786109505.285975:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933240192 00000100:00100000:3.0:1786109505.286006:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1786109505.286021:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933240064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.286102:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933240064:12345-0@lo:400:kworker.0 Request processed in 86us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109505.286112:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1786109505.286134:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1786109505.286144:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933240192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.286193:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933240192:12345-0@lo:400:kworker.0 Request processed in 50us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109505.286201:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1786109505.286228:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933240576 00000100:00100000:3.0:1786109505.286233:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933240576 00000100:00100000:3.0:1786109505.286266:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12315 00000100:00100000:3.0:1786109505.286273:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933240576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.286315:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933240576:12345-0@lo:400:kworker.0 Request processed in 43us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109505.286323:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12315 00000100:00080000:3.0:1786109505.286348:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109505.286354:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786109505.286572:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933240192:0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.286588:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933240064:0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.286598:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933240576:0@lo:400:kworker.0 00000100:00100000:0.0:1786109505.287258:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933241088 00000100:00100000:0.0:1786109505.287274:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933241088 00000100:00100000:0.0:1786109505.287329:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933240704 00000100:00100000:0.0:1786109505.287332:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933240704 00000100:00100000:0.0:1786109505.287351:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933241216 00000100:00100000:0.0:1786109505.287354:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933241216 00000100:00100000:0.0:1786109505.287383:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6938 00000100:00100000:0.0:1786109505.287393:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933241088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109505.287528:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933241088:12345-0@lo:400:kworker.0 Request processed in 136us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109505.287536:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6938 00000100:00100000:0.0:1786109505.287552:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6939 00000100:00100000:0.0:1786109505.287559:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933240704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109505.287589:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933240704:12345-0@lo:400:kworker.0 Request processed in 31us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109505.287595:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6939 00000100:00100000:0.0:1786109505.287607:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6940 00000100:00100000:0.0:1786109505.287613:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933241216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109505.287639:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933241216:12345-0@lo:400:kworker.0 Request processed in 27us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109505.287645:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6940 00000100:00100000:2.0:1786109505.289322:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933239936:0@lo:400:kworker.0 00000100:00100000:2.0:1786109505.289463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109505.289546:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933240448:0@lo:400:kworker.0 00000100:00100000:2.0:1786109505.289583:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109505.289607:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933240960:0@lo:400:kworker.0 00000100:00100000:1.0:1786109505.290595:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933240320:0@lo:400:kworker.0 00000100:00080000:3.0:1786109505.291227:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109505.291238:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109505.291307:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933240704:0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.291330:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933241216:0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.291349:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933241088:0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.293372:0:192336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933239936 00000100:00100000:3.0:1786109505.293396:0:192336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933239936 00000100:00100000:3.0:1786109505.293502:0:192336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1786109505.293514:0:192336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933239936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109505.294564:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109505.294623:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933240832:0@lo:400:kworker.0 00000100:00100000:1.0:1786109505.294665:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109505.294687:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933241344:0@lo:400:kworker.0 00000100:00100000:1.0:1786109505.294715:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109505.294757:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109505.294851:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933240448 00000100:00100000:2.0:1786109505.294859:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933240448 00000100:00100000:2.0:1786109505.294920:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933240320 00000100:00100000:2.0:1786109505.294924:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933240320 00000100:00100000:2.0:1786109505.294943:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933241344 00000100:00100000:2.0:1786109505.294946:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933241344 00000100:00100000:2.0:1786109505.294957:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933240960 00000100:00100000:2.0:1786109505.294960:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933240960 00000100:00100000:2.0:1786109505.294977:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1786109505.294989:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933240448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109505.295857:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933240448:12345-0@lo:400:kworker.0 Request processed in 864us (6267us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109505.295868:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1786109505.295901:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1786109505.295912:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933240320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109505.295962:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933240320:12345-0@lo:400:kworker.0 Request processed in 53us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109505.295968:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1786109505.295981:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1786109505.295988:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933241344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109505.296026:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933241344:12345-0@lo:400:kworker.0 Request processed in 37us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109505.296045:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1786109505.296062:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1786109505.296071:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933240960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109505.296819:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933240960:12345-0@lo:400:kworker.0 Request processed in 747us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109505.296829:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:2.0:1786109505.296875:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786109505.296881:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109505.296926:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933240448:0@lo:400:kworker.0 00000100:00100000:2.0:1786109505.296939:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933240960:0@lo:400:kworker.0 00000100:00100000:1.0:1786109505.300207:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933241344:0@lo:400:kworker.0 00000100:00100000:1.0:1786109505.300253:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933240320:0@lo:400:kworker.0 00000100:00100000:1.0:1786109505.300294:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933240832 00000100:00100000:1.0:1786109505.300301:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933240832 00000100:00100000:1.0:1786109505.300356:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6941 00000100:00100000:3.0:1786109505.300993:0:192336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933239936:12345-0@lo:400:kworker.0 Request processed in 7471us (11522us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109505.301011:0:192336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1786109505.301054:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933240832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109505.301237:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933240832:12345-0@lo:400:kworker.0 Request processed in 193us (6570us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109505.301245:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6941 00000100:00100000:2.0:1786109505.302842:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933239936:0@lo:400:kworker.0 00000100:00100000:3.0:1786109505.305645:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933240832:0@lo:400:kworker.0 00010000:00010000:3.0:1786109506.117719:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109506.579128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109506.579216:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109506.579292:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109506.579330:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109506.579359:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922093056 00000100:00100000:0.0:1786109506.579368:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922093056 00000100:00100000:0.0:1786109506.579419:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:0.0:1786109506.579454:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2405:x1872862922093056:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109506.579522:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2405:x1872862922093056:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 95us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109506.579530:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:1.0:1786109506.579656:0:179241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922093568 00000100:00100000:1.0:1786109506.579661:0:179241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922093568 00000100:00100000:1.0:1786109506.579719:0:179241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6942 00000100:00100000:1.0:1786109506.579728:0:179241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922093568:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109506.579758:0:179241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922093568:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109506.579764:0:179241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6942 00000100:00080000:0.0:1786109506.579995:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109506.580285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109506.580345:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922093440 00000100:00100000:1.0:1786109506.580349:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922093440 00000100:00100000:1.0:1786109506.580389:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6943 00000100:00100000:1.0:1786109506.580397:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922093440:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109506.580450:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922093440:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109506.580457:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6943 00000100:00080000:2.0:1786109506.580613:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109506.580736:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922093312 00000100:00100000:3.0:1786109506.580740:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922093312 00000100:00100000:0.0:1786109506.580815:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922093184 00000100:00100000:0.0:1786109506.580819:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922093184 00000100:00100000:2.0:1786109506.580928:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 195 00000100:00100000:2.0:1786109506.580937:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+9:2405:x1872862922093184:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109506.580977:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+9:2405:x1872862922093184:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 42us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109506.580984:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 195 00000100:00080000:0.0:1786109506.581389:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109506.581531:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:1.0:1786109506.581539:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922093312:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109506.581578:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922093312:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 40us (2362us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109506.581584:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00080000:0.0:1786109506.581886:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1786109507.140627:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109507.332633:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933241472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109507.332705:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109507.333048:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933241600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109507.333075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109507.333106:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109507.333112:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933241728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109507.333135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109507.333227:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933241600 00000100:00100000:0.0:1786109507.333234:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933241600 00000100:00100000:0.0:1786109507.333290:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933241728 00000100:00100000:0.0:1786109507.333294:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933241728 00000100:00100000:0.0:1786109507.333314:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5799 00000100:00100000:0.0:1786109507.333323:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933241600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109507.333351:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109507.333393:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933241600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109507.333399:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5799 00000100:00100000:0.0:1786109507.333415:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5800 00000100:00100000:0.0:1786109507.333421:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933241728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109507.333459:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109507.333486:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933241728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109507.333492:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5800 00000100:00080000:2.0:1786109507.333626:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109507.333631:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109507.333663:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933241728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109507.333676:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933241600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109507.333781:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933241472 00000100:00100000:3.0:1786109507.333786:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933241472 00000100:00100000:3.0:1786109507.333852:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12316 00000100:00100000:3.0:1786109507.333858:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933241472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786109507.333878:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:3.0:1786109507.333926:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933241472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109507.333931:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12316 00000100:00100000:0.0:1786109507.333992:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933241472:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1786109508.164613:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786109508.368193:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975822 is committed 00000001:00100000:0.0:1786109508.368785:0:184688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 397d331e-10fc-4558-be87-308c3622e8eb 00000001:00080000:0.0:1786109508.368797:0:184688:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 34359738459 is committed 00000001:02000400:0.0:1786109508.865068:0:192930:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1786109509.188530:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109509.386913:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109509.386934:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933241856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109509.386996:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109509.387046:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933241856 00000100:00100000:2.0:1786109509.387053:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933241856 00000100:00100000:2.0:1786109509.387106:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5801 00000100:00100000:2.0:1786109509.387117:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933241856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109509.388035:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109509.388100:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933241856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 984us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109509.388109:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5801 00000100:00080000:2.0:1786109509.388147:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109509.388191:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933241856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109509.388256:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933241984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109509.388282:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109509.388314:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933241984 00000100:00100000:2.0:1786109509.388319:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933241984 00000100:00100000:2.0:1786109509.388603:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5802 00000100:00100000:2.0:1786109509.388615:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933241984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109509.388634:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109509.388669:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933241984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109509.388675:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5802 00000100:00080000:2.0:1786109509.388694:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109509.388716:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933241984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109509.892757:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933242112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109509.892826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109509.892984:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933242112 00000100:00100000:3.0:1786109509.893004:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933242112 00000100:00100000:3.0:1786109509.893089:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12317 00000100:00100000:3.0:1786109509.893098:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933242112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786109509.893153:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:3.0:1786109509.893209:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933242112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109509.893216:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12317 00000100:00100000:2.0:1786109509.893284:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933242112:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786109510.213532:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109510.405847:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109510.405872:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933242624:0@lo:400:kworker.0 00000100:00100000:0.0:1786109510.405939:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933242752:0@lo:400:kworker.0 00000100:00100000:2.0:1786109510.405952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109510.406084:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109510.406189:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933243264:0@lo:400:kworker.0 00000100:00100000:0.0:1786109510.406216:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109510.406294:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933243776:0@lo:400:kworker.0 00000100:00100000:0.0:1786109510.406323:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109510.406346:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933242624 00000100:00100000:3.0:1786109510.406365:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933242624 00000100:00100000:3.0:1786109510.406416:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933242752 00000100:00100000:3.0:1786109510.406420:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933242752 00000100:00100000:3.0:1786109510.406597:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933243264 00000100:00100000:3.0:1786109510.406601:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933243264 00000100:00100000:3.0:1786109510.406627:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1786109510.406637:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933242624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109510.406694:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933242624:12345-0@lo:400:kworker.0 Request processed in 58us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109510.406701:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1786109510.406718:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1786109510.406725:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933242752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109510.406760:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933242752:12345-0@lo:400:kworker.0 Request processed in 35us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109510.406766:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1786109510.406779:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1786109510.406786:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933243264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109510.406818:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933243264:12345-0@lo:400:kworker.0 Request processed in 33us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109510.406823:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1786109510.407194:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933242752:0@lo:400:kworker.0 00000100:00100000:2.0:1786109510.407199:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933242624:0@lo:400:kworker.0 00000100:00100000:2.0:1786109510.407211:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933242240:0@lo:400:kworker.0 00000100:00100000:0.0:1786109510.407214:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933243264:0@lo:400:kworker.0 00000100:00100000:0.0:1786109510.407237:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786109510.407245:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933243136:0@lo:400:kworker.0 00000100:00100000:2.0:1786109510.407251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109510.407284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109510.407312:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933242496:0@lo:400:kworker.0 00000100:00100000:0.0:1786109510.407313:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933243648:0@lo:400:kworker.0 00000100:00100000:0.0:1786109510.407365:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109510.407397:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933242368:0@lo:400:kworker.0 00000100:00100000:0.0:1786109510.407424:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109510.407576:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109510.407581:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933242880:0@lo:400:kworker.0 00000100:00100000:0.0:1786109510.407609:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109510.407629:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933243392:0@lo:400:kworker.0 00000100:00100000:0.0:1786109510.407658:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109510.407762:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933243776 00000100:00100000:3.0:1786109510.407768:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933243776 00000100:00100000:3.0:1786109510.407795:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933242368 00000100:00100000:3.0:1786109510.407798:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933242368 00000100:00100000:3.0:1786109510.407815:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1786109510.407822:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933243776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109510.407866:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933243776:12345-0@lo:400:kworker.0 Request processed in 44us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109510.407876:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1786109510.407888:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1786109510.407895:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933242368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109510.407927:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933242368:12345-0@lo:400:kworker.0 Request processed in 32us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109510.407933:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1786109510.408587:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933243136 00000100:00100000:3.0:1786109510.408593:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933243136 00000100:00100000:3.0:1786109510.408620:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933243648 00000100:00100000:3.0:1786109510.408623:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933243648 00000100:00100000:3.0:1786109510.408645:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6944 00000100:00100000:3.0:1786109510.408652:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933243136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109510.408694:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933243136:12345-0@lo:400:kworker.0 Request processed in 43us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109510.408701:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6944 00000100:00100000:3.0:1786109510.408713:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6945 00000100:00100000:3.0:1786109510.408719:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933243648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109510.410212:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933243648:12345-0@lo:400:kworker.0 Request processed in 1484us (2838us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109510.410226:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6945 00000100:00100000:2.0:1786109510.410226:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933243008:0@lo:400:kworker.0 00000100:00100000:3.0:1786109510.410272:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933242240 00000100:00100000:3.0:1786109510.410279:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933242240 00000100:00100000:2.0:1786109510.410279:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109510.410308:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933243520:0@lo:400:kworker.0 00000100:00100000:3.0:1786109510.410319:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1786109510.410330:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933242240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109510.410337:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109510.410378:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933242880 00000100:00100000:2.0:1786109510.410383:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933242880 00000100:00100000:2.0:1786109510.410412:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933243392 00000100:00100000:2.0:1786109510.410415:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933243392 00000100:00100000:2.0:1786109510.410451:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12318 00000100:00100000:2.0:1786109510.410458:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933242880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109510.410500:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933242880:12345-0@lo:400:kworker.0 Request processed in 43us (2891us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109510.410506:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12318 00000100:00100000:2.0:1786109510.410520:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12319 00000100:00100000:2.0:1786109510.410526:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933243392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109510.410555:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933243392:12345-0@lo:400:kworker.0 Request processed in 29us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109510.410560:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12319 00000100:00100000:2.0:1786109510.410578:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933243008 00000100:00100000:2.0:1786109510.410582:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933243008 00000100:00100000:2.0:1786109510.410603:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933243520 00000100:00100000:2.0:1786109510.410605:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933243520 00000100:00100000:2.0:1786109510.410624:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6946 00000100:00100000:2.0:1786109510.410629:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933243008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109510.410658:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933243008:12345-0@lo:400:kworker.0 Request processed in 29us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109510.410663:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6946 00000100:00100000:2.0:1786109510.410672:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6947 00000100:00100000:2.0:1786109510.410677:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933243520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109510.410700:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933243520:12345-0@lo:400:kworker.0 Request processed in 23us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109510.410704:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6947 00000100:00100000:2.0:1786109510.410753:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933242496 00000100:00100000:2.0:1786109510.410756:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933242496 00000100:00100000:2.0:1786109510.410779:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1786109510.410785:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933242496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109510.410813:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933242496:12345-0@lo:400:kworker.0 Request processed in 29us (3239us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109510.410819:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1786109510.410852:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933242496:0@lo:400:kworker.0 00000100:00100000:2.0:1786109510.410861:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933243008:0@lo:400:kworker.0 00000100:00100000:2.0:1786109510.410868:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738459 gen 2 00000100:00100000:2.0:1786109510.410882:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933243520:0@lo:400:kworker.0 00000100:00100000:3.0:1786109510.411843:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933242240:12345-0@lo:400:kworker.0 Request processed in 1510us (4589us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109510.411856:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1786109510.412353:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933242240:0@lo:400:kworker.0 00000100:00100000:1.0:1786109510.412618:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933243136:0@lo:400:kworker.0 00000100:00100000:1.0:1786109510.412632:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975822 gen 2 00000100:00100000:1.0:1786109510.412644:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933243648:0@lo:400:kworker.0 00000100:00100000:1.0:1786109510.412658:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933243776:0@lo:400:kworker.0 00000100:00080000:3.0:1786109510.412704:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786109510.412710:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109510.412713:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109510.412715:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109510.413815:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933242368:0@lo:400:kworker.0 00000100:00100000:0.0:1786109510.413831:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933242880:0@lo:400:kworker.0 00000100:00100000:0.0:1786109510.413842:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933243392:0@lo:400:kworker.0 00000001:02000400:3.0:1786109510.830030:0:192978:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1786109511.236910:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109511.694880:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109511.694928:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109511.695021:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109511.695057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109511.695140:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109511.695181:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922094080 00000100:00100000:1.0:1786109511.695190:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922094080 00000100:00100000:1.0:1786109511.695261:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922094208 00000100:00100000:1.0:1786109511.695264:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922094208 00000100:00100000:1.0:1786109511.695293:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6948 00000100:00100000:1.0:1786109511.695305:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+5:2404:x1872862922094080:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109511.695376:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+5:2404:x1872862922094080:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109511.695384:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6948 00000100:00100000:1.0:1786109511.695399:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6949 00000100:00100000:1.0:1786109511.695405:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922094208:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109511.695428:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922094208:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109511.695466:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6949 00000100:00100000:2.0:1786109511.695560:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922093824 00000100:00100000:2.0:1786109511.695564:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922093824 00000100:00100000:2.0:1786109511.695605:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922093952 00000100:00100000:2.0:1786109511.695608:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922093952 00000100:00100000:2.0:1786109511.695629:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 203 00000100:00100000:2.0:1786109511.695636:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+9:2405:x1872862922093824:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109511.695666:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+9:2405:x1872862922093824:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 31us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109511.695672:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 203 00000100:00100000:2.0:1786109511.695688:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:2.0:1786109511.695694:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922093952:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109511.695719:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922093952:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109511.695725:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00080000:3.0:1786109511.695921:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109511.695925:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786109511.695928:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109511.695929:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109511.696217:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922093696 00000100:00100000:0.0:1786109511.696222:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922093696 00000100:00100000:0.0:1786109511.696299:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:0.0:1786109511.696307:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922093696:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109511.696365:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922093696:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 58us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109511.696372:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00010000:00010000:3.0:1786109512.260699:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109512.452616:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786109512.452637:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933243904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109512.452715:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109512.452751:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933244032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109512.452773:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109512.452780:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933243904 00000100:00100000:1.0:1786109512.452789:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933243904 00000100:00100000:2.0:1786109512.452793:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab911b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933244160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109512.452815:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109512.452833:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933244032 00000100:00100000:1.0:1786109512.452837:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933244032 00000100:00100000:1.0:1786109512.452858:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5803 00000100:00100000:1.0:1786109512.452867:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933243904:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109512.452875:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5804 00000100:00100000:2.0:1786109512.452881:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933244032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109512.452899:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00002000:00000024:1.0:1786109512.452926:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109512.452940:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933244032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109512.452954:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933243904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109512.452960:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5803 00000100:00100000:1.0:1786109512.453012:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933244160 00000100:00100000:1.0:1786109512.453016:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933244160 00000100:00100000:1.0:1786109512.453041:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12320 00000100:00100000:1.0:1786109512.453047:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933244160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109512.453084:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:1.0:1786109512.453127:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933244160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109512.453133:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12320 00000100:00080000:3.0:1786109512.453730:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786109512.453736:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109512.453807:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab911b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933244160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109512.453822:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933243904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109512.453835:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933244032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109512.454755:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5804 00000100:00100000:2.0:1786109512.954207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109512.954281:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922094336 00000100:00100000:0.0:1786109512.954290:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922094336 00000100:00100000:0.0:1786109512.954387:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 982 00000100:00100000:0.0:1786109512.954399:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+9:160910:x1872862922094336:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:0.0:1786109512.954502:0:187899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:0.0:1786109512.954585:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+9:160910:x1872862922094336:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 187us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109512.954592:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 982 00000100:00100000:1.0:1786109512.957882:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109512.957987:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922094464 00000100:00100000:3.0:1786109512.957996:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922094464 00000100:00100000:3.0:1786109512.958086:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 983 00000100:00100000:3.0:1786109512.958095:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:160910:x1872862922094464:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:3.0:1786109512.958140:0:189813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:3.0:1786109512.958207:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:160910:x1872862922094464:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 113us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109512.958215:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 983 00000100:00100000:3.0:1786109512.961081:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109512.961210:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922094592 00000100:00100000:1.0:1786109512.961219:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922094592 00000100:00100000:1.0:1786109512.961314:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5805 00000100:00100000:1.0:1786109512.961324:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+5:160910:x1872862922094592:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109512.961391:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109512.961518:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+5:160910:x1872862922094592:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 195us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109512.961526:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5805 00000100:00100000:0.0:1786109512.965536:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109512.965650:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922094720 00000100:00100000:1.0:1786109512.965660:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922094720 00000100:00100000:1.0:1786109512.965765:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5806 00000100:00100000:1.0:1786109512.965776:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:160910:x1872862922094720:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109512.965802:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109512.965872:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:397d331e-10fc-4558-be87-308c3622e8eb+6:160910:x1872862922094720:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 98us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109512.965880:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5806 00000100:00100000:3.0:1786109512.986979:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109512.987085:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922094976 00000100:00100000:0.0:1786109512.987093:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922094976 00000100:00100000:0.0:1786109512.987198:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 984 00000100:00100000:0.0:1786109512.987209:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+9:160008:x1872862922094976:12345-192.168.203.38@tcp:36:multiop.0 00010000:00010000:0.0:1786109512.987286:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca36c42 lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109512.987301:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca36c42 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109512.987313:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca36c42 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109512.987589:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006dc8762b reply state 00000000f67ddf66 transno 335007449089 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca36c42 lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109512.987603:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca36c42 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109512.987610:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de2:0x0].0x0 (ffff930984516800) 00010000:00010000:0.0:1786109512.987613:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1786109512.987616:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109512.987708:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+11:160008:x1872862922094976:12345-192.168.203.38@tcp:36:multiop.0 Request processed in 500us (736us total) trans 335007449089 rc 0/0 00000100:00100000:0.0:1786109512.987719:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 984 00000100:00100000:3.0:1786109512.997219:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109512.997322:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922095104 00000100:00100000:0.0:1786109512.997342:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922095104 00000100:00100000:0.0:1786109512.997476:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 985 00000100:00100000:0.0:1786109512.997487:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+11:160008:x1872862922095104:12345-192.168.203.38@tcp:101:multiop.0 00010000:00010000:0.0:1786109512.997512:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109512.997532:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca36c49 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a154e expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109512.997593:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca36c49 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a154e expref: 12 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109512.997609:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca36c49 lrc: 3/0,0 mode: CR/CR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a154e expref: 12 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109512.997628:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de2:0x0].0x0 (ffff930984516800) 00010000:00010000:0.0:1786109512.997632:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786109512.997636:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2dc00, rc 0) 00000100:00100000:0.0:1786109512.997699:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397d331e-10fc-4558-be87-308c3622e8eb+12:160008:x1872862922095104:12345-192.168.203.38@tcp:101:multiop.0 Request processed in 214us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109512.997706:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 985 00000100:00100000:1.0:1786109513.002922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109513.003020:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922095232 00000100:00100000:2.0:1786109513.003029:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922095232 00000100:00100000:2.0:1786109513.003113:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23084 00000100:00100000:2.0:1786109513.003125:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:397d331e-10fc-4558-be87-308c3622e8eb+6:2405:x1872862922095232:12345-192.168.203.38@tcp:2:multiop.0 00002000:00010000:2.0:1786109513.003297:0:179238:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1882:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786109513.003301:0:179238:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1882:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1786109513.003303:0:179238:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1882:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786109513.003306:0:179238:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1882:0x0] updating lvb ctime from disk: 0 -> 1786109512 00002000:00010000:2.0:1786109513.003308:0:179238:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1882:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786109513.003376:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:397d331e-10fc-4558-be87-308c3622e8eb+7:2405:x1872862922095232:12345-192.168.203.38@tcp:2:multiop.0 Request processed in 253us (462us total) trans 4294975823 rc 0/0 00000100:00100000:2.0:1786109513.003384:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23084 00000100:00080000:3.0:1786109513.003451:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109513.011127:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109513.011231:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922095360 00000100:00100000:1.0:1786109513.011240:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922095360 00000100:00100000:1.0:1786109513.011313:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 986 00000100:00100000:1.0:1786109513.011323:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+12:160008:x1872862922095360:12345-192.168.203.38@tcp:101:multiop.0 00010000:00010000:1.0:1786109513.011344:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109513.011367:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38600/0xdb52b77d7ca36c50 lrc: 2/0,0 mode: --/CR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1555 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109513.011464:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38000/0xdb52b77d7ca36c57 lrc: 3/1,0 mode: --/PR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109513.011477:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38000/0xdb52b77d7ca36c57 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109513.011489:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38000/0xdb52b77d7ca36c57 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109513.011539:0:189813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786109513.011559:0:189813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38000/0xdb52b77d7ca36c57 lrc: 3/1,0 mode: PR/PR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109513.011584:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38600/0xdb52b77d7ca36c50 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1555 expref: 14 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109513.011604:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38000/0xdb52b77d7ca36c57 lrc: 3/0,0 mode: PR/PR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1555 expref: 13 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109513.011612:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de2:0x0].0x0 (ffff930984516800) 00010000:00010000:1.0:1786109513.011615:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786109513.011618:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f38000, rc 0) 00000100:00100000:1.0:1786109513.011683:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+13:160008:x1872862922095360:12345-192.168.203.38@tcp:101:multiop.0 Request processed in 361us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109513.011690:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 986 00000100:00080000:3.0:1786109513.011882:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109513.016213:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109513.016342:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922095616 00000100:00100000:3.0:1786109513.016351:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922095616 00000100:00100000:3.0:1786109513.016567:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:3.0:1786109513.016579:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:397d331e-10fc-4558-be87-308c3622e8eb+13:160008:x1872862922095616:12345-192.168.203.38@tcp:35:multiop.0 00000004:00080000:3.0:1786109513.016864:0:187903:0:(mdd_object.c:4016:mdd_close()) Object [0x20001a9e3:0x1de2:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1786109513.016926:0:187903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13a:0x0].2, 64 off8320 00000004:00080000:3.0:1786109513.016938:0:187903:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8369683506117ns, next at 8370683503879ns, rc = 0 00010000:00010000:3.0:1786109513.016989:0:187903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c5e lrc: 3/0,1 mode: --/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.017004:0:187903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c5e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010080000000 pid: 187903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.017015:0:187903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c5e lrc: 3/0,1 mode: PW/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 187903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.017024:0:187903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c5e lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 187903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.017030:0:187903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c5e lrc: 4/0,1 mode: PW/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 187903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.017037:0:187903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c5e lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 187903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.017053:0:187903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786109513.017206:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:397d331e-10fc-4558-be87-308c3622e8eb+14:160008:x1872862922095616:12345-192.168.203.38@tcp:35:multiop.0 Request processed in 630us (1002us total) trans 335007449090 rc 0/0 00000100:00100000:3.0:1786109513.017214:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00010000:00010000:0.0:1786109513.017659:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109513.017666:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c5e lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 187903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109513.017674:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109513.017678:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c5e lrc: 2/0,0 mode: PW/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 187903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109513.017687:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c5e lrc: 3/0,0 mode: PW/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 187903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109513.017701:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de2:0x0].0x0 (ffff930984516800) 00010000:00010000:0.0:1786109513.017704:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109513.017708:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c5e lrc: 1/0,0 mode: --/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 187903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109513.017715:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c5e lrc: 0/0,0 mode: --/PW res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 187903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109513.017728:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109513.017729:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109513.017731:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109513.030064:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109513.030257:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922095744 00000100:00100000:3.0:1786109513.030266:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922095744 00000100:00100000:3.0:1786109513.030554:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 987 00000100:00100000:3.0:1786109513.030565:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+14:159871:x1872862922095744:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1786109513.030590:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109513.030611:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36c65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a155c expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.030666:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36c6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031124:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36c6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031139:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36c6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031156:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031162:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031168:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031236:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36c6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031243:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36c6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031249:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36c6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031258:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109513.031261:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36c6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031268:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36c6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031281:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a83bfc400) 00010000:00010000:3.0:1786109513.031284:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109513.031288:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36c6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031293:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c400/0xdb52b77d7ca36c6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031307:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031313:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031319:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031346:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109513.031349:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031355:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031366:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14f3cc3 (ffff930ab8c04c00) 00010000:00010000:3.0:1786109513.031368:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109513.031371:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031376:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c000/0xdb52b77d7ca36c73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14f3cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031412:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36c65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a155c expref: 15 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031422:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a83bfc400) 00010000:00010000:3.0:1786109513.031424:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109513.031428:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d800/0xdb52b77d7ca36c65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a155c expref: 15 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109513.031483:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d800, rc 0) 00000100:00100000:3.0:1786109513.031898:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+14:159871:x1872862922095744:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1333us (1840us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109513.031907:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 987 00010000:00010000:3.0:1786109513.309010:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109514.372872:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109514.502078:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933244288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109514.503936:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109514.504020:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933244416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109514.504075:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933244288 00000100:00100000:1.0:1786109514.504075:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109514.504136:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933244416 00000100:00100000:1.0:1786109514.504145:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933244416 00000100:00100000:3.0:1786109514.504200:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933244288 00000100:00100000:1.0:1786109514.504207:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5807 00000100:00100000:1.0:1786109514.504223:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933244416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109514.504258:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109514.504277:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5808 00000100:00100000:3.0:1786109514.504292:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933244288:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109514.504315:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933244416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109514.504328:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5807 00002000:00000024:3.0:1786109514.504329:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923496960 avail 3691974656 00000100:00080000:1.0:1786109514.504361:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109514.504367:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109514.504415:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933244288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109514.504419:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933244416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109514.504462:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5808 00000100:00100000:1.0:1786109514.504501:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933244288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109515.013759:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933244544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109515.013969:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109515.014103:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933244544 00000100:00100000:1.0:1786109515.014110:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933244544 00000100:00100000:1.0:1786109515.014212:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12321 00000100:00100000:1.0:1786109515.014223:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933244544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109515.014255:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:1.0:1786109515.014315:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933244544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109515.014322:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12321 00000100:00100000:3.0:1786109515.014393:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933244544:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786109515.396552:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109515.524656:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933244800:0@lo:400:kworker.0 00000100:00100000:1.0:1786109515.524731:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933244928:0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.524734:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109515.524841:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933244672:0@lo:400:kworker.0 00000100:00100000:0.0:1786109515.525293:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933245056:0@lo:400:kworker.0 00000100:00100000:2.0:1786109515.525458:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109515.525471:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933245312:0@lo:400:kworker.0 00000100:00100000:2.0:1786109515.525501:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933245184:0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.525507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109515.525536:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933245824:0@lo:400:kworker.0 00000100:00100000:2.0:1786109515.525542:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109515.525571:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933245696:0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.525572:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109515.525604:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109515.525622:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933244800 00000100:00100000:2.0:1786109515.525628:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933246208:0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.525631:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933244800 00000100:00100000:3.0:1786109515.525682:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1786109515.525693:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933244800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.525744:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933244800:12345-0@lo:400:kworker.0 Request processed in 54us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109515.525751:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1786109515.525767:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933245184 00000100:00100000:3.0:1786109515.525770:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933245184 00000100:00100000:3.0:1786109515.525787:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933245696 00000100:00100000:3.0:1786109515.525789:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933245696 00000100:00100000:3.0:1786109515.525801:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1786109515.525806:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933245184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.525835:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933245184:12345-0@lo:400:kworker.0 Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109515.525841:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1786109515.525853:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1786109515.525859:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933245696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.525884:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933245696:12345-0@lo:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109515.525890:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1786109515.525926:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933244800:0@lo:400:kworker.0 00000100:00100000:2.0:1786109515.525943:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109515.525973:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933246208 00000100:00100000:3.0:1786109515.525978:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933246208 00000100:00100000:2.0:1786109515.525983:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933245184:0@lo:400:kworker.0 00000100:00100000:2.0:1786109515.525998:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933245696:0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.526005:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1786109515.526012:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933246208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.526056:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933246208:12345-0@lo:400:kworker.0 Request processed in 44us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109515.526064:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933246208:0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.526065:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1786109515.526104:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933244672 00000100:00100000:3.0:1786109515.526108:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933244672 00000100:00100000:3.0:1786109515.526136:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1786109515.526143:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933244672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.526175:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933244672:12345-0@lo:400:kworker.0 Request processed in 33us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109515.526181:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1786109515.526216:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933245312 00000100:00100000:3.0:1786109515.526219:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933245312 00000100:00100000:3.0:1786109515.526241:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933245824 00000100:00100000:3.0:1786109515.526243:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933245824 00000100:00100000:3.0:1786109515.526258:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12322 00000100:00100000:3.0:1786109515.526263:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933245312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.526297:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933245312:12345-0@lo:400:kworker.0 Request processed in 33us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109515.526303:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12322 00000100:00100000:3.0:1786109515.526314:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12323 00000100:00100000:3.0:1786109515.526320:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933245824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.526347:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933245824:12345-0@lo:400:kworker.0 Request processed in 28us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109515.526352:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12323 00000100:00100000:3.0:1786109515.526379:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933245312:0@lo:400:kworker.0 00000100:00100000:2.0:1786109515.526400:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933244672:0@lo:400:kworker.0 00000100:00100000:3.0:1786109515.526401:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933245824:0@lo:400:kworker.0 00000100:00080000:2.0:1786109515.526470:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109515.526475:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109515.529207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109515.529426:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933245440:0@lo:400:kworker.0 00000100:00100000:1.0:1786109515.529487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109515.529512:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933245952:0@lo:400:kworker.0 00000100:00100000:1.0:1786109515.529533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109515.529571:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933245440 00000100:00100000:1.0:1786109515.529578:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933245440 00000100:00100000:1.0:1786109515.529617:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933245952 00000100:00100000:1.0:1786109515.529619:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933245952 00000100:00100000:1.0:1786109515.529649:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6950 00000100:00100000:1.0:1786109515.529658:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9676300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933245440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109515.529707:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9676300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933245440:12345-0@lo:400:kworker.0 Request processed in 50us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109515.529715:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6950 00000100:00100000:1.0:1786109515.529729:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6951 00000100:00100000:1.0:1786109515.529735:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9674700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933245952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109515.529763:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9674700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933245952:12345-0@lo:400:kworker.0 Request processed in 28us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109515.529768:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6951 00000100:00080000:1.0:1786109515.529783:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109515.529811:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933245440:0@lo:400:kworker.0 00000100:00100000:1.0:1786109515.529821:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933245952:0@lo:400:kworker.0 00000100:00100000:0.0:1786109515.530294:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109515.530392:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933245568:0@lo:400:kworker.0 00000100:00100000:0.0:1786109515.530425:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109515.530464:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933246080:0@lo:400:kworker.0 00000100:00100000:0.0:1786109515.530486:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109515.530518:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933245568 00000100:00100000:0.0:1786109515.530522:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933245568 00000100:00100000:0.0:1786109515.530550:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933246080 00000100:00100000:0.0:1786109515.530553:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933246080 00000100:00100000:0.0:1786109515.530579:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6952 00000100:00100000:0.0:1786109515.530585:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933245568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109515.530622:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933245568:12345-0@lo:400:kworker.0 Request processed in 37us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109515.530628:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6952 00000100:00100000:0.0:1786109515.530639:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6953 00000100:00100000:0.0:1786109515.530645:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933246080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109515.530670:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933246080:12345-0@lo:400:kworker.0 Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109515.530676:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6953 00000100:00100000:0.0:1786109515.530696:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933244928 00000100:00100000:0.0:1786109515.530699:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933244928 00000100:00100000:0.0:1786109515.530724:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933245056 00000100:00100000:0.0:1786109515.530727:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933245056 00000100:00100000:0.0:1786109515.530747:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1786109515.530754:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933244928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109515.530788:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933244928:12345-0@lo:400:kworker.0 Request processed in 34us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109515.530793:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1786109515.530805:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1786109515.530812:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933245056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109515.530840:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933245056:12345-0@lo:400:kworker.0 Request processed in 29us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109515.530845:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:1.0:1786109515.531502:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786109515.531508:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109515.531511:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109515.531544:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933244928:0@lo:400:kworker.0 00000100:00100000:1.0:1786109515.531790:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933245056:0@lo:400:kworker.0 00000100:00100000:1.0:1786109515.531804:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933245568:0@lo:400:kworker.0 00000100:00100000:1.0:1786109515.531814:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9118380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933246080:0@lo:400:kworker.0 00010000:00010000:1.0:1786109516.421036:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109516.816020:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109516.816111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109516.816146:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109516.816185:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109516.816215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109516.816242:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922096000 00000100:00100000:1.0:1786109516.816251:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922096000 00000100:00100000:1.0:1786109516.816307:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922096128 00000100:00100000:1.0:1786109516.816311:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922096128 00000100:00100000:1.0:1786109516.816339:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 211 00000100:00100000:1.0:1786109516.816350:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+14:2405:x1872862922096000:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109516.816419:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+14:2405:x1872862922096000:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109516.816426:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 211 00000100:00100000:1.0:1786109516.816482:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:1.0:1786109516.816489:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922096128:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109516.816516:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397d331e-10fc-4558-be87-308c3622e8eb+6:2404:x1872862922096128:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109516.816523:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:1.0:1786109516.816542:0:179241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922096256 00000100:00100000:1.0:1786109516.816546:0:179241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922096256 00000100:00100000:1.0:1786109516.816572:0:179241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922096384 00000100:00100000:1.0:1786109516.816575:0:179241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922096384 00000100:00100000:1.0:1786109516.816599:0:179241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6954 00000100:00100000:1.0:1786109516.816606:0:179241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:397d331e-10fc-4558-be87-308c3622e8eb+5:2405:x1872862922096256:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109516.816632:0:179241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:397d331e-10fc-4558-be87-308c3622e8eb+5:2405:x1872862922096256:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109516.816639:0:179241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6954 00000100:00100000:1.0:1786109516.816651:0:179241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6955 00000100:00100000:1.0:1786109516.816658:0:179241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9676680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:397d331e-10fc-4558-be87-308c3622e8eb+7:2404:x1872862922096384:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109516.816682:0:179241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9676680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:397d331e-10fc-4558-be87-308c3622e8eb+7:2404:x1872862922096384:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109516.816688:0:179241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6955 00000100:00080000:1.0:1786109516.816703:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109516.816707:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109516.816710:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109516.816712:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786109516.817178:0:192332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922095872 00000100:00100000:3.0:1786109516.817185:0:192332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922095872 00000100:00100000:3.0:1786109516.817265:0:192332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:3.0:1786109516.817274:0:192332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922095872:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109516.817374:0:192332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2404:x1872862922095872:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 101us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109516.817382:0:192332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00010000:00010000:3.0:1786109517.447838:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109517.714540:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933246336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109517.714604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109517.714942:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933246336 00000100:00100000:0.0:1786109517.714950:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933246336 00000100:00100000:0.0:1786109517.715005:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5809 00000100:00100000:0.0:1786109517.715015:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933246336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109517.715055:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109517.715118:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933246336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (512us total) trans 0 rc 0/0 00000100:00080000:2.0:1786109517.715119:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109517.715128:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5809 00000100:00100000:0.0:1786109517.715175:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933246336:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1786109517.716194:0:192346:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8374382761532ns, next at 8375382759338ns, rc = 0 00000100:00100000:0.0:1786109517.716704:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109517.716723:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933246464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109517.716776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109517.717168:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933246464 00000100:00100000:2.0:1786109517.717176:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933246464 00000100:00100000:2.0:1786109517.717242:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5810 00000100:00100000:2.0:1786109517.717252:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933246464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786109517.717277:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923496960 avail 3691974656 00000100:00080000:3.0:1786109517.717732:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109517.719027:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933246464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1771us (2245us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109517.719039:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5810 00000100:00100000:0.0:1786109517.719132:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933246464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109517.957999:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933246592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109517.958065:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109517.958163:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933246592 00000100:00100000:1.0:1786109517.958171:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933246592 00000100:00100000:1.0:1786109517.958217:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12324 00000100:00100000:1.0:1786109517.958225:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933246592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109517.958258:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:1.0:1786109517.958313:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933246592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109517.958320:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12324 00000100:00100000:0.0:1786109517.958389:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933246592:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1786109518.088591:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975823 is committed 00000004:00080000:0.0:1786109518.088598:0:192325:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1786109518.088676:0:192325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 335007449090 is committed 00000004:00080000:0.0:1786109518.088681:0:192325:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1786109518.088731:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca36c42 lrc: 3/0,1 mode: TXN/TXN res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.088744:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca36c42 lrc: 2/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.088753:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca36c42 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.088758:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109518.088763:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca36c42 lrc: 3/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.088770:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca36c42 lrc: 4/0,0 mode: TXN/TXN res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.088786:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de2:0x0].0x0 (ffff930984516800) 00010000:00010000:1.0:1786109518.088789:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786109518.088794:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca36c42 lrc: 2/0,0 mode: --/TXN res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.088800:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c200/0xdb52b77d7ca36c42 lrc: 0/0,0 mode: --/TXN res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109518.088957:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933246720:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786109518.089025:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109518.089252:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933246720 00000100:00100000:1.0:1786109518.089260:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933246720 00000100:00100000:1.0:1786109518.089341:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23085 00000100:00100000:1.0:1786109518.089351:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933246720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786109518.089377:0:179253:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:6274 count 1 00010000:00010000:1.0:1786109518.089403:0:179253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.089428:0:179253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca36764 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1508 expref: 5 pid: 9990 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.089485:0:179253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1882:0x0].0x0 since=76s v=(0 0) 00010000:00010000:1.0:1786109518.089489:0:179253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1882:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109518.089494:0:179253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.089524:0:179253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca36764 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1508 expref: 5 pid: 9990 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.089539:0:179253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca36764 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1508 expref: 5 pid: 9990 timeout: 8474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109518.089552:0:179253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9677800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0001_UUID:179253:1872862933246848:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109518.089627:0:179253:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9ebef00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109518.095851:0:179253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9677800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_025:lustre-OST0001_UUID:179253:1872862933246848:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109518.095894:0:179253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109518.097841:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109518.098063:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922096512 00000100:00100000:2.0:1786109518.098081:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922096512 00010000:00010000:2.0:1786109518.098172:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca36764 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1508 expref: 6 pid: 9990 timeout: 8474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109518.098216:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12637 00000100:00100000:2.0:1786109518.098226:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9677800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:397d331e-10fc-4558-be87-308c3622e8eb+6:2402:x1872862922096512:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786109518.098241:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109518.098246:0:177416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca36764 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1882:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1508 expref: 6 pid: 9990 timeout: 8474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109518.098259:0:177416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca36764 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1882:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1508 expref: 6 pid: 9990 timeout: 8474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109518.098281:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca36764 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1882:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1508 expref: 6 pid: 9990 timeout: 8474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109518.098398:0:177416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1882:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109518.098403:0:177416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1882:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109518.098409:0:177416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109518.098420:0:177416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109518.098537:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109518.098588:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9677800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:397d331e-10fc-4558-be87-308c3622e8eb+5:2402:x1872862922096512:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 364us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109518.098596:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12637 00000100:00080000:3.0:1786109518.098714:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786109518.098748:0:179253:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.098758:0:179253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.098768:0:179253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.098777:0:179253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109518.098841:0:179253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786109518.099009:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933246720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9659us (9983us total) trans 4294975824 rc 0/0 00000100:00100000:1.0:1786109518.099017:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23085 00000004:00080000:2.0:1786109518.099462:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab992a680/2, rc 0, transno 4294975824 00000100:00100000:2.0:1786109518.099470:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933246720:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786109518.099554:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109518.099562:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109518.099571:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109518.099575:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109518.099584:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109518.099603:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109518.099610:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca36c7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1882:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109518.099629:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109518.099631:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109518.099633:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109518.468750:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109519.492698:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109519.620621:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109519.620646:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933246976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109519.620718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109519.620772:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933247104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109519.620800:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109519.620979:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933246976 00000100:00100000:3.0:1786109519.620987:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933246976 00000100:00100000:2.0:1786109519.621098:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933247104 00000100:00100000:2.0:1786109519.621103:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933247104 00000100:00100000:3.0:1786109519.621218:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5811 00000100:00100000:3.0:1786109519.621229:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933246976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109519.621257:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109519.621307:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933246976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109519.621314:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5811 00000100:00100000:1.0:1786109519.621374:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5812 00000100:00100000:1.0:1786109519.621384:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933247104:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1786109519.621389:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109519.621395:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1786109519.621400:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109519.621465:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933247104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109519.621473:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5812 00000100:00100000:0.0:1786109519.621478:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933246976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109519.621506:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933247104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109520.145476:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933247232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109520.145551:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109520.145839:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933247232 00000100:00100000:1.0:1786109520.145847:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933247232 00000100:00100000:1.0:1786109520.145945:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12325 00000100:00100000:1.0:1786109520.145956:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933247232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109520.145992:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446109184 avail 1299869696 00000100:00100000:1.0:1786109520.146294:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933247232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 339us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109520.146304:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12325 00000100:00100000:0.0:1786109520.146397:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933247232:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786109520.533973:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109520.645733:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933247488:0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.645805:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109520.645841:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933248000:0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.645864:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109520.646523:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933247488 00000100:00100000:1.0:1786109520.646532:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933247488 00000100:00100000:1.0:1786109520.646605:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1786109520.646616:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933247488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109520.646676:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933247488:12345-0@lo:400:kworker.0 Request processed in 62us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109520.646683:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1786109520.646711:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933247616:0@lo:400:kworker.0 00000100:00100000:1.0:1786109520.646740:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109520.646762:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933248128:0@lo:400:kworker.0 00000100:00100000:1.0:1786109520.646801:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109520.646834:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933247616 00000100:00100000:1.0:1786109520.646838:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933247616 00000100:00100000:1.0:1786109520.646864:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1786109520.646871:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933247616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109520.647713:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933248000 00000100:00100000:0.0:1786109520.647720:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933248000 00000100:00100000:0.0:1786109520.647758:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12326 00000100:00100000:0.0:1786109520.647765:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933248000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109520.647838:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933248000:12345-0@lo:400:kworker.0 Request processed in 73us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109520.647845:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12326 00000100:00080000:0.0:1786109520.647867:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109520.647872:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109520.648280:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933248128 00000100:00100000:2.0:1786109520.648286:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933248128 00000100:00100000:0.0:1786109520.648514:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933248640:0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.648709:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933248000:0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.648732:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933248512:0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.648757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109520.648785:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933247488:0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.648817:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933248512 00000100:00100000:3.0:1786109520.648820:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933248512 00000100:00100000:3.0:1786109520.648846:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12327 00000100:00100000:3.0:1786109520.648853:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933248512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.649271:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6956 00000100:00100000:2.0:1786109520.649283:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933248128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109520.649471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109520.650294:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933248128:12345-0@lo:400:kworker.0 Request processed in 770us (3261us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109520.650306:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6956 00000100:00100000:0.0:1786109520.651347:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933248128:0@lo:400:kworker.0 00000100:00100000:0.0:1786109520.651530:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933248640 00000100:00100000:0.0:1786109520.651536:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933248640 00000100:00100000:2.0:1786109520.651697:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933247744:0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.651746:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109520.651767:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933248256:0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.651789:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109520.651805:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933248768:0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.651823:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109520.651841:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1786109520.651847:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933247360:0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.651872:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109520.651903:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933247872:0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.651922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109520.651939:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933248384:0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.651958:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109520.651975:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933248896:0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.651994:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109520.652019:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933247744 00000100:00100000:2.0:1786109520.652022:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933247744 00000100:00100000:2.0:1786109520.652049:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933247872 00000100:00100000:2.0:1786109520.652065:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933247872 00000100:00100000:2.0:1786109520.652081:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933248384 00000100:00100000:2.0:1786109520.652083:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933248384 00000100:00100000:2.0:1786109520.652094:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933248896 00000100:00100000:2.0:1786109520.652096:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933248896 00000100:00100000:2.0:1786109520.652108:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1786109520.652116:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933247744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.652175:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933247744:12345-0@lo:400:kworker.0 Request processed in 59us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109520.652182:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1786109520.652198:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1786109520.652204:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933247872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.652234:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933247872:12345-0@lo:400:kworker.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109520.652240:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1786109520.652253:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1786109520.652258:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933248384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.652283:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933248384:12345-0@lo:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109520.652288:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1786109520.652298:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1786109520.652304:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933248896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.652325:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933248896:12345-0@lo:400:kworker.0 Request processed in 22us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109520.652331:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1786109520.652347:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933248256 00000100:00100000:2.0:1786109520.652350:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933248256 00000100:00100000:1.0:1786109520.652856:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933247616:12345-0@lo:400:kworker.0 Request processed in 5983us (6113us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109520.652866:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1786109520.653839:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933247616:0@lo:400:kworker.0 00000100:00100000:1.0:1786109520.654419:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933248768 00000100:00100000:1.0:1786109520.654427:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933248768 00000100:00100000:3.0:1786109520.654527:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933248512:12345-0@lo:400:kworker.0 Request processed in 5671us (5766us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109520.654538:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12327 00000100:00100000:3.0:1786109520.654633:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933247360 00000100:00100000:3.0:1786109520.654637:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933247360 00000100:00100000:3.0:1786109520.654676:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1786109520.654684:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933247360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.654857:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933247360:12345-0@lo:400:kworker.0 Request processed in 173us (2983us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109520.654864:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1786109520.658341:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6957 00000100:00100000:0.0:1786109520.658361:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933248640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109520.658459:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933248640:12345-0@lo:400:kworker.0 Request processed in 108us (9907us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109520.658467:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6957 00000100:00080000:0.0:1786109520.658500:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109520.658506:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109520.658509:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109520.658512:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109520.658595:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933248640:0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.658903:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933248512:0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.658942:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933247360:0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.658955:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933247872:0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.658967:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c38ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933248384:0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.658982:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933248896:0@lo:400:kworker.0 00000100:00100000:3.0:1786109520.658993:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933247744:0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.662035:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6958 00000100:00100000:2.0:1786109520.662066:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933248256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109520.662158:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933248256:12345-0@lo:400:kworker.0 Request processed in 112us (10367us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109520.662165:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6958 00000100:00100000:3.0:1786109520.662346:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933248256:0@lo:400:kworker.0 00000100:00100000:1.0:1786109520.662984:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6959 00000100:00100000:1.0:1786109520.662997:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933248768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109520.663067:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933248768:12345-0@lo:400:kworker.0 Request processed in 75us (11242us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109520.663074:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6959 00000100:00100000:2.0:1786109520.663123:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933248768:0@lo:400:kworker.0 00010000:00010000:0.0:1786109521.542830:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786109521.570813:0:193175:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 74: Ensure applications don't fail waiting for OST recovery ========================================================== 09:31:59 (1786109519) 00000100:00100000:1.0:1786109521.937230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109521.937284:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109521.937381:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922096640 00000100:00100000:0.0:1786109521.937391:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922096640 00000100:00100000:0.0:1786109521.937477:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:0.0:1786109521.937488:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2403:x1872862922096640:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109521.937561:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2403:x1872862922096640:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 75us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109521.937569:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:1.0:1786109521.938461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109521.938492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109521.938717:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922097152 00000100:00100000:0.0:1786109521.938724:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922097152 00000100:00100000:0.0:1786109521.938773:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6960 00000100:00100000:0.0:1786109521.938782:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922097152:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109521.938834:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922097152:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 53us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109521.938841:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6960 00000100:00080000:3.0:1786109521.939057:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109521.940945:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109521.941026:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922097024 00000100:00100000:3.0:1786109521.941034:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922097024 00000100:00100000:3.0:1786109521.941112:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6961 00000100:00100000:3.0:1786109521.941122:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922097024:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109521.941188:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:397d331e-10fc-4558-be87-308c3622e8eb+5:2403:x1872862922097024:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 68us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109521.941195:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6961 00000100:00100000:2.0:1786109521.942127:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922096896 00000100:00100000:2.0:1786109521.942135:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922096896 00000100:00080000:1.0:1786109521.942312:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109521.942317:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109521.943376:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922096768 00000100:00100000:0.0:1786109521.943389:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922096768 00000100:00100000:0.0:1786109521.943539:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 219 00000100:00100000:0.0:1786109521.943551:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922096896:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109521.943625:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+6:2403:x1872862922096896:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 76us (6339us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109521.943632:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 219 00000100:00100000:0.0:1786109521.943650:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:0.0:1786109521.943656:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+11:2403:x1872862922096768:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109521.943681:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:397d331e-10fc-4558-be87-308c3622e8eb+11:2403:x1872862922096768:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (5187us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109521.943686:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00080000:1.0:1786109521.946615:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786109522.564606:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109523.167368:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109523.167504:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922097408 00000100:00100000:3.0:1786109523.167515:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922097408 00000100:00080000:2.0:1786109523.167886:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786109523.167959:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:3.0:1786109523.167971:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:397d331e-10fc-4558-be87-308c3622e8eb+11:161524:x1872862922097408:12345-192.168.203.38@tcp:35:umount.0 00000100:00100000:3.0:1786109523.168228:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:397d331e-10fc-4558-be87-308c3622e8eb+12:161524:x1872862922097408:12345-192.168.203.38@tcp:35:umount.0 Request processed in 258us (867us total) trans 335007449091 rc 0/0 00000100:00100000:3.0:1786109523.168236:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1786109523.206026:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933249024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109523.206106:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109523.206177:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933249024 00000100:00100000:0.0:1786109523.206184:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933249024 00000100:00100000:0.0:1786109523.206236:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5813 00000100:00100000:0.0:1786109523.206246:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933249024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109523.206354:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581312 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109523.206402:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933249024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109523.206410:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5813 00000100:00100000:0.0:1786109523.206485:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933249024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109523.206590:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109523.206599:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933249152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109523.206628:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109523.206659:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933249152 00000100:00100000:2.0:1786109523.206663:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933249152 00000100:00100000:2.0:1786109523.206692:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5814 00000100:00100000:2.0:1786109523.206700:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933249152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109523.206717:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109523.206750:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933249152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109523.206756:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5814 00000100:00100000:2.0:1786109523.206787:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933249152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786109523.206804:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109523.206808:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109523.207010:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933249280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109523.207052:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109523.207170:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933249280 00000100:00100000:0.0:1786109523.207175:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933249280 00000100:00100000:0.0:1786109523.207215:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12328 00000100:00100000:0.0:1786109523.207223:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933249280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786109523.207248:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445683200 avail 1299443712 00000100:00100000:0.0:1786109523.207573:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933249280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 349us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109523.207580:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12328 00000100:00100000:2.0:1786109523.207661:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933249280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109523.208192:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109523.208228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109523.208312:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922097536 00000100:00100000:1.0:1786109523.208318:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922097536 00000100:00100000:1.0:1786109523.208359:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922097792 00000100:00100000:1.0:1786109523.208362:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922097792 00000100:00100000:1.0:1786109523.208397:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4507 00000100:00100000:1.0:1786109523.208406:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fea1ac35-e793-43ec-a86d-d40dc5658dad+11:2402:x1872862922097536:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109523.208418:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109523.208457:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6dc00/0xdb52b77d7ca3680c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a152b expref: 11 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109523.208473:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109523.208513:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fea1ac35-e793-43ec-a86d-d40dc5658dad+10:2402:x1872862922097536:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 108us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109523.208520:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4507 00000100:00100000:1.0:1786109523.208535:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4508 00000100:00100000:1.0:1786109523.208542:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fea1ac35-e793-43ec-a86d-d40dc5658dad+9:2402:x1872862922097792:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109523.208550:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109523.208560:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6d000/0xdb52b77d7ca36813 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1532 expref: 9 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109523.208568:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109523.208585:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fea1ac35-e793-43ec-a86d-d40dc5658dad+8:2402:x1872862922097792:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 44us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109523.208591:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4508 00000100:00100000:0.0:1786109523.209077:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109523.209107:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109523.209165:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922097920 00000100:00100000:2.0:1786109523.209170:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922097920 00000100:00100000:2.0:1786109523.209227:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23086 00000100:00100000:2.0:1786109523.209236:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:397d331e-10fc-4558-be87-308c3622e8eb+5:2401:x1872862922097920:12345-192.168.203.38@tcp:9:umount.0 00000020:00000080:2.0:1786109523.209257:0:17009:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca33098 00000100:00080000:2.0:1786109523.209264:0:17009:0:(import.c:65:import_set_state_nolock()) ffff930ab2abb800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786109523.209309:0:17009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975824 00000100:00100000:2.0:1786109523.209453:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:397d331e-10fc-4558-be87-308c3622e8eb+2:2401:x1872862922097920:12345-192.168.203.38@tcp:9:umount.0 Request processed in 194us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109523.209461:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23086 00010000:00010000:2.0:1786109523.209479:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109523.209755:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922097664 00000100:00100000:1.0:1786109523.209759:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922097664 00000100:00100000:1.0:1786109523.209783:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4509 00000100:00100000:1.0:1786109523.209790:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fea1ac35-e793-43ec-a86d-d40dc5658dad+8:2402:x1872862922097664:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109523.209799:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109523.209811:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9412200/0xdb52b77d7ca36939 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1540 expref: 8 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109523.209823:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109523.209848:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fea1ac35-e793-43ec-a86d-d40dc5658dad+7:2402:x1872862922097664:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 59us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109523.209855:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4509 00000100:00080000:3.0:1786109523.209988:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1786109523.211868:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 397d331e-10fc-4558-be87-308c3622e8eb 00000020:00000080:2.0:1786109523.211876:0:9518:0:(genops.c:906:class_export_put()) final put ffff930ab2ab8800/397d331e-10fc-4558-be87-308c3622e8eb 00000001:00080000:2.0:1786109523.211937:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975824 is committed 00000020:00000080:0.0:1786109523.212171:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2ab8800/397d331e-10fc-4558-be87-308c3622e8eb for lustre-OST0001 00000020:00000080:0.0:1786109523.212354:0:181792:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab2abb800 for lustre-OST0001 00000100:00100000:0.0:1786109523.218392:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109523.218500:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922098048 00000100:00100000:2.0:1786109523.218510:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922098048 00000100:00100000:2.0:1786109523.218609:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23087 00000100:00100000:2.0:1786109523.218619:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:397d331e-10fc-4558-be87-308c3622e8eb+5:2401:x1872862922098048:12345-192.168.203.38@tcp:9:umount.0 00000020:00000080:2.0:1786109523.218648:0:151898:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36c3b 00000100:00080000:2.0:1786109523.218656:0:151898:0:(import.c:65:import_set_state_nolock()) ffff93098c88a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786109523.218704:0:151898:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 8, last_transno is 34359738459 00000100:00100000:2.0:1786109523.218840:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:397d331e-10fc-4558-be87-308c3622e8eb+2:2401:x1872862922098048:12345-192.168.203.38@tcp:9:umount.0 Request processed in 223us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109523.218847:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23087 00010000:00010000:1.0:1786109523.219153:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786109523.219230:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109523.236628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109523.236679:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922098560 00000100:00100000:0.0:1786109523.236687:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922098560 00000100:00100000:0.0:1786109523.236751:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 988 00000100:00100000:0.0:1786109523.236761:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+12:2401:x1872862922098560:12345-192.168.203.38@tcp:39:umount.0 00000020:00000080:0.0:1786109523.236798:0:187900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36883 00000020:00010000:0.0:1786109523.236978:0:187900:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930986508000: total 0 00000100:00080000:0.0:1786109523.236984:0:187900:0:(import.c:65:import_set_state_nolock()) ffff930981e11000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786109523.237011:0:187900:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 78, last_transno is 335007449091 00000100:00100000:0.0:1786109523.237285:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397d331e-10fc-4558-be87-308c3622e8eb+10:2401:x1872862922098560:12345-192.168.203.38@tcp:39:umount.0 Request processed in 525us (664us total) trans 335007449092 rc 0/0 00000100:00100000:0.0:1786109523.237294:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 988 00000020:00010000:1.0:1786109523.238986:0:29734:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930986508000: total 0 00010000:00010000:1.0:1786109523.238995:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109523.239129:0:29734:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930986508000, canceled 0 locks, left on hash table 5. 00010000:00010000:1.0:1786109523.239166:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83abd200) 00010000:00010000:1.0:1786109523.239170:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786109523.239181:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2c000/0xdb52b77d7ca36a6d lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494c69 expref: 9 pid: 192358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109523.239201:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de2:0x0].0x0 (ffff930984516800) 00010000:00010000:1.0:1786109523.239204:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786109523.239208:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2dc00/0xdb52b77d7ca36c49 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a154e expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109523.239219:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x191b:0x0].0x0 (ffff930a83abd200) 00010000:00010000:1.0:1786109523.239221:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786109523.239225:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac0b2cc00/0xdb52b77d7ca36a66 lrc: 0/0,0 mode: --/CR res: [0x20001a9e3:0x191b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc494ce7 expref: 7 pid: 192358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109523.239241:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001a9e3:0x1de2:0x0].0x0 (ffff930984516800) 00010000:00010000:1.0:1786109523.239243:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786109523.239246:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38000/0xdb52b77d7ca36c57 lrc: 0/0,0 mode: --/PR res: [0x20001a9e3:0x1de2:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1555 expref: 6 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109523.239262:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a83bfc400) 00010000:00010000:1.0:1786109523.239265:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109523.239269:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca36c34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1547 expref: 5 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109523.239282:0:29734:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930986508000, canceled 5 locks, left on hash table 0. 00010000:00010000:1.0:1786109523.239295:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109523.239297:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109523.239299:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109523.245389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109523.245544:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922098688 00000100:00100000:0.0:1786109523.245554:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922098688 00000100:00080000:3.0:1786109523.245613:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109523.245629:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 989 00000100:00100000:0.0:1786109523.245641:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+6:2401:x1872862922098688:12345-192.168.203.38@tcp:39:umount.0 00000020:00000080:0.0:1786109523.245678:0:188678:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca307f6 00000100:00080000:0.0:1786109523.245691:0:188678:0:(import.c:65:import_set_state_nolock()) ffff930a87b2e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786109523.245717:0:188678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769804568 00010000:00010000:3.0:1786109523.245761:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109523.246480:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397d331e-10fc-4558-be87-308c3622e8eb+3:2401:x1872862922098688:12345-192.168.203.38@tcp:39:umount.0 Request processed in 838us (1095us total) trans 25769804569 rc 0/0 00000100:00100000:0.0:1786109523.246490:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 989 00000100:00100000:3.0:1786109523.265920:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109523.266685:0:192331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922098944 00000100:00100000:0.0:1786109523.266695:0:192331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922098944 00000100:00100000:0.0:1786109523.267009:0:192331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:0.0:1786109523.267020:0:192331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1ac35-e793-43ec-a86d-d40dc5658dad+7:2401:x1872862922098944:12345-192.168.203.38@tcp:251:umount.0 00000020:00000080:0.0:1786109523.267320:0:192331:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca367fe 00000020:00010000:0.0:1786109523.267329:0:192331:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930ac0b7d000: total 0 00000100:00080000:0.0:1786109523.267497:0:192331:0:(import.c:65:import_set_state_nolock()) ffff930ac0b7a800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1786109523.267575:0:192331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1ac35-e793-43ec-a86d-d40dc5658dad+3:2401:x1872862922098944:12345-192.168.203.38@tcp:251:umount.0 Request processed in 556us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109523.267584:0:192331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 90 00000020:00010000:2.0:1786109523.268513:0:6515:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930ac0b7d000: total 0 00010000:00010000:2.0:1786109523.268571:0:6515:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930ac0b7d000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1786109523.268608:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6d400/0xdb52b77d7ca3681a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1539 expref: 2 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109523.268627:0:6515:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930ac0b7d000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1786109523.268638:0:6515:0:(genops.c:906:class_export_put()) final put ffff930ac0b7d000/fea1ac35-e793-43ec-a86d-d40dc5658dad 00010000:00010000:2.0:1786109523.268660:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109523.268663:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109523.268664:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786109523.269160:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0b7d000/fea1ac35-e793-43ec-a86d-d40dc5658dad for MGS 00000020:00000080:1.0:1786109523.269201:0:181792:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac0b7a800 for MGS 00010000:00010000:1.0:1786109523.588677:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109524.612761:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109524.741603:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933249408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109524.741673:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109524.741729:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933249408 00000100:00100000:0.0:1786109524.741736:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933249408 00000100:00100000:1.0:1786109524.741957:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933249536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109524.741986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109524.742050:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933249536 00000100:00100000:1.0:1786109524.742054:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933249536 00000100:00100000:1.0:1786109524.742236:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5815 00000100:00100000:1.0:1786109524.742248:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933249536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109524.742301:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109524.742347:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933249536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109524.742859:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5815 00000100:00100000:1.0:1786109524.742916:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933249536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109524.743018:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5816 00000100:00100000:0.0:1786109524.743043:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933249408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109524.743062:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109524.743116:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933249408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109524.743122:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5816 00000100:00080000:0.0:1786109524.743138:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109524.743142:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109524.743163:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933249408:0@lo:13:osp-pre-0-1.0 00000020:01000004:1.0:1786109525.207713:0:193272:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1786109525.207765:0:193272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109525.207779:0:193272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109525.207786:0:193272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109525.207793:0:193272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109525.207821:0:193272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1786109525.207827:0:193272:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1786109525.207861:0:193272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786109525.207866:0:193272:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1786109525.207871:0:193272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1786109525.207896:0:193272:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1786109525.208103:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109525.208110:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.208118:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361400 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:0.0:1786109525.208122:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.208131:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786109525.208138:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109525.208144:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786109525.208146:0:10402:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1786109525.208148:0:10402:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1786109525.208174:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.208180:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109525.208207:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.208214:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca369a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca369a9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.208225:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109525.208226:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109525.208229:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109525.208236:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109525.208252:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933249792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109525.208313:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109525.208376:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933249792 00000100:00100000:0.0:1786109525.208383:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933249792 00000100:00100000:0.0:1786109525.208455:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4510 00000100:00100000:0.0:1786109525.208465:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933249792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109525.208477:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109525.208491:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6ce00/0xdb52b77d7ca369a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca369a2 expref: 24 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.208504:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109525.209620:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3646:x1872862933249792:12345-0@lo:103:ldlm_bl.0 Request processed in 1153us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109525.209631:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4510 00000100:00100000:2.0:1786109525.209753:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933249664:0@lo:39:umount.0 00000100:00100000:2.0:1786109525.209799:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109525.214774:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933249664 00000100:00100000:0.0:1786109525.214786:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933249664 00000100:00100000:0.0:1786109525.214864:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1786109525.214876:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872862933249664:12345-0@lo:39:umount.0 00000020:00000080:0.0:1786109525.214905:0:187901:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36a19 00000100:00080000:0.0:1786109525.214914:0:187901:0:(import.c:65:import_set_state_nolock()) ffff93098617e000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1786109525.215037:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+1:3645:x1872862933249664:12345-0@lo:39:umount.0 Request processed in 165us (5238us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109525.215045:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000020:00000080:0.0:1786109525.215055:0:187901:0:(genops.c:906:class_export_put()) final put ffff930986178000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:0.0:1786109525.215078:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1786109525.215092:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff930986178000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109525.215136:0:181792:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098617e000 for lustre-MDT0000 00010000:00010000:2.0:1786109525.215743:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109525.215781:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098617d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1786109525.215798:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933249664:0@lo:39:umount.0 00000100:00080000:0.0:1786109525.217152:0:193272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109525.217158:0:193272:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1786109525.217168:0:193272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1786109525.217235:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933249792:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1786109525.218316:0:193272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1786109525.218319:0:193272:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1786109525.218325:0:193272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1786109525.218346:0:193272:0:(import.c:65:import_set_state_nolock()) ffff930983c45800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1786109525.219704:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933249920:0@lo:39:umount.0 00000100:00100000:1.0:1786109525.219775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109525.219894:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933249920 00000100:00100000:0.0:1786109525.219901:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933249920 00000100:00100000:0.0:1786109525.219976:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1786109525.219986:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8c50c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872862933249920:12345-0@lo:39:umount.0 00000020:00000080:0.0:1786109525.221196:0:187900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca33075 00000100:00080000:0.0:1786109525.221209:0:187900:0:(import.c:65:import_set_state_nolock()) ffff930ab2abe000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1786109525.221296:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8c50c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+1:3645:x1872862933249920:12345-0@lo:39:umount.0 Request processed in 1309us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109525.221306:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000020:00000080:0.0:1786109525.221317:0:187900:0:(genops.c:906:class_export_put()) final put ffff930ab2ab9000/lustre-MDT0001-lwp-OST0000_UUID 00000100:00080000:1.0:1786109525.221637:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1786109525.221649:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786109525.221682:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983c45800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1786109525.221695:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933249920:0@lo:39:umount.0 00000100:00080000:1.0:1786109525.222191:0:193272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1786109525.222196:0:193272:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1786109525.222200:0:193272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1786109525.223673:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2ab9000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1786109525.223742:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab2abe000 for lustre-MDT0001 00010000:00010000:1.0:1786109525.228394:0:193272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109525.228415:0:193272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109525.228423:0:193272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109525.228447:0:193272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109525.228477:0:193272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109525.228485:0:193272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109525.228492:0:193272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109525.228499:0:193272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109525.229625:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109525.229637:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109525.229648:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d600 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:2.0:1786109525.229652:0:29734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109525.229660:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109525.229667:0:29734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109525.229673:0:29734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1786109525.229676:0:29734:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1786109525.229710:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109525.229716:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786109525.229739:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109525.229746:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca369b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca369b7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109525.229756:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109525.229758:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109525.229760:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109525.229775:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933250048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109525.229830:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786109525.229936:0:193272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109525.230728:0:193272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1786109525.230737:0:193272:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1786109525.230743:0:193272:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1786109525.230803:0:193272:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1786109525.230808:0:193272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:1.0:1786109525.230813:0:193272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1786109525.230819:0:193272:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:0.0:1786109525.231609:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109525.231618:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.231634:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360a00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:0.0:1786109525.231638:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.231646:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786109525.231653:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109525.231658:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1786109525.231660:0:10402:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1786109525.231662:0:10402:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1786109525.231696:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.231703:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109525.231715:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.231722:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9360a00/0xdb52b77d7ca369be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca369c5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.231734:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109525.231736:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109525.231738:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109525.231845:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109525.231918:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933250176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109525.232467:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109525.234127:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933250048 00000100:00100000:0.0:1786109525.234143:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933250048 00000100:00100000:0.0:1786109525.234206:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933250176 00000100:00100000:0.0:1786109525.234210:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933250176 00000100:00100000:0.0:1786109525.234238:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4511 00000100:00100000:0.0:1786109525.234247:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933250048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109525.234261:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109525.234281:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2ce00/0xdb52b77d7ca369b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca369b0 expref: 24 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.234297:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109525.234361:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3648:x1872862933250048:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (4530us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109525.234368:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4511 00000100:00100000:0.0:1786109525.234385:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4512 00000100:00100000:0.0:1786109525.234391:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3648:x1872862933250176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109525.234398:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109525.234407:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6de00/0xdb52b77d7ca369c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca369be expref: 22 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109525.234416:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109525.234455:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3648:x1872862933250176:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109525.234462:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4512 00002000:00000080:1.0:1786109525.241411:0:193272:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:1.0:1786109525.241473:0:193272:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000100:00100000:1.0:1786109525.244163:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933250176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109525.244189:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933250048:0@lo:103:ldlm_bl.0 00000001:00100000:3.0:1786109525.249360:0:184688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 397d331e-10fc-4558-be87-308c3622e8eb 00000020:00000080:3.0:1786109525.249371:0:184688:0:(genops.c:906:class_export_put()) final put ffff93098c888800/397d331e-10fc-4558-be87-308c3622e8eb 00000020:00000080:0.0:1786109525.249666:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff93098c888800/397d331e-10fc-4558-be87-308c3622e8eb for lustre-OST0000 00000020:00000080:0.0:1786109525.249720:0:181792:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098c88a800 for lustre-OST0000 00000020:00000080:1.0:1786109525.250319:0:193272:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1786109525.250328:0:193272:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff930ac1268800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 34359738459 stale:0 00000020:00080000:1.0:1786109525.250334:0:193272:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff930ac0b39800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 34359738456 stale:0 00000020:00080000:1.0:1786109525.250339:0:193272:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff93098478b380) has exports, disconnecting them 00000020:00080000:1.0:1786109525.250343:0:193272:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff930ac1268800), last request at 1786109523 00000020:00000080:1.0:1786109525.250348:0:193272:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca368d7 00000100:00080000:1.0:1786109525.250359:0:193272:0:(import.c:65:import_set_state_nolock()) ffff93098666d000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1786109525.250419:0:193272:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ac1268800): rc 0 00000020:00000080:1.0:1786109525.250422:0:193272:0:(genops.c:906:class_export_put()) final put ffff930ac1268800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:1.0:1786109525.250457:0:193272:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff930ac0b39800), last request at 1786109524 00000020:00000080:1.0:1786109525.250461:0:193272:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30827 00000100:00080000:1.0:1786109525.250466:0:193272:0:(import.c:65:import_set_state_nolock()) ffff930ac0b38800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1786109525.250506:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac1268800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1786109525.250536:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098666d000 for lustre-OST0000 00010000:00010000:2.0:1786109525.250606:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1786109525.250708:0:193272:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ac0b39800): rc 0 00000020:00000080:1.0:1786109525.250711:0:193272:0:(genops.c:906:class_export_put()) final put ffff930ac0b39800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:1.0:1786109525.250774:0:193272:0:(genops.c:1579:class_disconnect_exports()) OBD device 19 (ffff93098478b380) has no exports 00010000:00010000:2.0:1786109525.252010:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109525.253001:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109525.253028:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933250304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109525.253098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109525.253147:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933250304 00000100:00100000:2.0:1786109525.253154:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933250304 00000100:00100000:2.0:1786109525.253201:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12329 00000100:00100000:2.0:1786109525.253209:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933250304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109525.253241:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1786109525.253282:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933250304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109525.253290:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12329 00000100:00100000:2.0:1786109525.253336:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933250304:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1786109525.253948:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0b39800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1786109525.253988:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac0b38800 for lustre-OST0000 00000020:01000000:1.0:1786109525.254332:0:193272:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ab8e39780 - data ffff930aa41c90d8/ffff930ac0b63800 00000020:01000000:1.0:1786109525.254637:0:193272:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ab8e39840 - data ffff930abfa96d80/ffff930ac0b61400 00100000:10000000:2.0:1786109525.275148:0:193272:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1786109525.288097:0:193272:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7c9f84e6 00000020:00000080:2.0:1786109525.288109:0:193272:0:(genops.c:906:class_export_put()) final put ffff93098e2bc000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1786109525.288227:0:193272:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930ab7c47000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1786109525.288231:0:193272:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab7c47000 2 00000020:01000004:2.0:1786109525.288235:0:193272:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff930ab7c47000 from lustre-OST0000 00000020:00000080:2.0:1786109525.288258:0:193272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786109525.288269:0:193272:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1786109525.288273:0:193272:0:(genops.c:906:class_export_put()) final put ffff930ab8da4800/lustre-OST0000_UUID 00000020:00000080:2.0:1786109525.288276:0:193272:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab8da4800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1786109525.288283:0:193272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1786109525.288329:0:193272:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1786109525.288333:0:193272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1786109525.288336:0:193272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786109525.288341:0:193272:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1786109525.288348:0:193272:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff930ab1989800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1786109525.288354:0:193272:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff930ab7c48000) has exports, disconnecting them 00000020:00080000:2.0:1786109525.288359:0:193272:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff930ab1989800), last request at 1786109082 00000020:00000080:2.0:1786109525.288363:0:193272:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7c9f8525 00000020:00080000:2.0:1786109525.288372:0:193272:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab1989800): rc 0 00000020:00000080:2.0:1786109525.288377:0:193272:0:(genops.c:906:class_export_put()) final put ffff930ab1989800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1786109525.288487:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e2bc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1786109525.289053:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab1989800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1786109525.293602:0:193272:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1786109525.293610:0:193272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786109525.293615:0:193272:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1786109525.293623:0:193272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786109525.293778:0:193272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109525.293791:0:193272:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1786109525.293797:0:193272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1786109525.293802:0:193272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109525.293807:0:193272:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1786109525.293815:0:193272:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff93098e2be000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786109525.293821:0:193272:0:(genops.c:1574:class_disconnect_exports()) OBD device 21 (ffff930ab99d3380) has exports, disconnecting them 00000020:00080000:3.0:1786109525.293825:0:193272:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff93098e2be000), last request at 1786109082 00000020:00000080:3.0:1786109525.293829:0:193272:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7c9f853a 00000020:00080000:3.0:1786109525.293843:0:193272:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93098e2be000): rc 0 00000020:00000080:3.0:1786109525.293849:0:193272:0:(genops.c:906:class_export_put()) final put ffff93098e2be000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1786109525.294513:0:181792:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098617d000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1786109525.294522:0:181792:0:(genops.c:906:class_export_put()) final put ffff93098e2be800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1786109525.294525:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e2be800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1786109525.294532:0:181792:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1786109525.294621:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e2be000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1786109525.297545:0:193272:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1786109525.297554:0:193272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1786109525.297559:0:193272:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1786109525.297566:0:193272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1786109525.297709:0:193272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786109525.297722:0:193272:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1786109525.297731:0:193272:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab7c47000 1 00000020:00000080:2.0:1786109525.297737:0:193272:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7c9f84ca 00000020:00000080:2.0:1786109525.297745:0:193272:0:(genops.c:906:class_export_put()) final put ffff930ac126d800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1786109525.297750:0:193272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1786109525.297755:0:193272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786109525.297760:0:193272:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1786109525.297763:0:193272:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff930984788000) has no exports 00000020:00000080:0.0:1786109525.298056:0:181792:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930983c45800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1786109525.298066:0:181792:0:(genops.c:906:class_export_put()) final put ffff93098e2bf000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1786109525.298069:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e2bf000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1786109525.298075:0:181792:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1786109525.298162:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac126d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1786109525.362387:0:193272:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109525.362404:0:193272:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1786109525.362409:0:193272:0:(genops.c:906:class_export_put()) final put ffff930ac125f000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1786109525.362414:0:193272:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac125f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1786109525.362424:0:193272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1786109525.362737:0:193272:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff930ab7c42000 00000020:02000400:0.0:1786109525.362796:0:193272:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1786109525.636927:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109525.768178:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933250432:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.768261:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.768311:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933250944:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.768338:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.768355:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933251456:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.768372:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.768391:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786109525.768396:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933250816:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.768417:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.768462:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933251328:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.768483:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.768514:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933250560:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.768538:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.768557:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933251072:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.768577:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.768595:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933251584:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.768612:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.768628:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1786109525.768632:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933250688:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.768649:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.768664:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933251200:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.768682:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.768696:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933251712:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.768715:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.768744:0:192330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933250432 00000100:00100000:1.0:1786109525.768751:0:192330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933250432 00000100:00100000:1.0:1786109525.768799:0:192330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1786109525.768807:0:192330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3647:x1872862933250432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.768853:0:192330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3647:x1872862933250432:12345-0@lo:400:kworker.0 Request processed in 46us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109525.768860:0:192330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1786109525.768891:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933250944 00000100:00100000:1.0:1786109525.768895:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933250944 00000100:00100000:1.0:1786109525.768911:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933251456 00000100:00100000:1.0:1786109525.768913:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933251456 00000100:00100000:1.0:1786109525.768924:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933251072 00000100:00100000:1.0:1786109525.768926:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933251072 00000100:00100000:1.0:1786109525.768944:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933251584 00000100:00100000:1.0:1786109525.768946:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933251584 00000100:00100000:1.0:1786109525.768973:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6962 00000100:00100000:1.0:1786109525.768979:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933251072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.769012:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933251072:12345-0@lo:400:kworker.0 Request processed in 33us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109525.770078:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6962 00000100:00100000:1.0:1786109525.770103:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6963 00000100:00100000:1.0:1786109525.770112:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933251584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.770160:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933251584:12345-0@lo:400:kworker.0 Request processed in 51us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109525.770166:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6963 00000100:00100000:1.0:1786109525.770178:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23088 00000100:00100000:1.0:1786109525.770182:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1872862933250944:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1786109525.770187:0:9990:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109525.770210:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1872862933250944:12345-0@lo:400:kworker.0 Request processed in 27us (1871us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109525.770214:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23088 00000100:00100000:1.0:1786109525.770224:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23089 00000100:00100000:1.0:1786109525.770227:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1872862933251456:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1786109525.770231:0:9990:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109525.770404:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1872862933251456:12345-0@lo:400:kworker.0 Request processed in 174us (2029us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109525.770410:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23089 00000100:00100000:1.0:1786109525.770495:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933250816 00000100:00100000:1.0:1786109525.770501:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933250816 00000100:00100000:1.0:1786109525.770572:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933251328 00000100:00100000:1.0:1786109525.770576:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933251328 00000100:00100000:0.0:1786109525.774161:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12330 00000100:00100000:0.0:1786109525.774178:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933250816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109525.774281:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933250816:12345-0@lo:400:kworker.0 Request processed in 108us (5862us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109525.774289:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12330 00000100:00100000:0.0:1786109525.774312:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12331 00000100:00100000:0.0:1786109525.774320:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933251328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109525.774352:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933251328:12345-0@lo:400:kworker.0 Request processed in 33us (5867us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109525.774357:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12331 00000100:00100000:3.0:1786109525.774551:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933250560 00000100:00100000:3.0:1786109525.774560:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933250560 00000100:00100000:3.0:1786109525.774615:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933250688 00000100:00100000:3.0:1786109525.774619:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933250688 00000100:00100000:3.0:1786109525.774634:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933251200 00000100:00100000:3.0:1786109525.774636:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933251200 00000100:00100000:3.0:1786109525.774645:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933251712 00000100:00100000:3.0:1786109525.774648:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933251712 00000100:00100000:3.0:1786109525.774659:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1786109525.774666:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933250560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109525.774704:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933250560:12345-0@lo:400:kworker.0 Request processed in 39us (6165us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109525.774710:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1786109525.774722:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1786109525.774728:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933250688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109525.774755:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933250688:12345-0@lo:400:kworker.0 Request processed in 28us (6105us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109525.774760:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1786109525.774771:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1786109525.774776:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933251200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109525.774800:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933251200:12345-0@lo:400:kworker.0 Request processed in 24us (6117us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109525.774806:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1786109525.774817:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1786109525.774823:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933251712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109525.774849:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933251712:12345-0@lo:400:kworker.0 Request processed in 27us (6133us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109525.774854:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1786109525.775424:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109525.775572:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786109525.775576:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109525.775620:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933250688:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.775635:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933251200:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.775647:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933251712:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.775656:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933250560:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.775667:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933251072:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.775677:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975824 gen 2 00000004:00080000:1.0:1786109525.775681:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab992a680, transno 4294975824 00000100:00100000:1.0:1786109525.775703:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933251584:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.775744:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933250816:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.775753:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933251328:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.775762:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933250432:0@lo:400:kworker.0 00000100:00080000:1.0:1786109525.775772:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786109525.775777:0:3647:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1786109525.775781:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1786109525.775792:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1786109525.775795:0:3647:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109525.775799:0:3647:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8176 00000100:00080000:1.0:1786109525.775805:0:3647:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930a89106800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109525.775830:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c28380 x1872862933251840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109525.775848:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933250944:0@lo:400:kworker.0 00000100:00080000:1.0:1786109525.775859:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786109525.775862:0:3647:0:(import.c:65:import_set_state_nolock()) ffff93098650c000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1786109525.775866:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1786109525.775872:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1786109525.775874:0:3647:0:(import.c:65:import_set_state_nolock()) ffff93098650c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109525.775877:0:3647:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 8341 00000100:00080000:1.0:1786109525.775880:0:3647:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93098650c000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109525.775891:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c2bb80 x1872862933251968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109525.775900:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933251456:0@lo:400:kworker.0 00000100:00100000:1.0:1786109525.775929:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933251840:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1786109525.775966:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.775988:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933251968:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1786109525.776005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109525.776054:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933251840 00000100:00100000:1.0:1786109525.776059:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933251840 00000100:00100000:1.0:1786109525.776080:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933251968 00000100:00100000:1.0:1786109525.776083:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933251968 00000100:00100000:1.0:1786109525.776096:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23090 00000100:00100000:1.0:1786109525.776101:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3645:x1872862933251840:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:1.0:1786109525.776119:0:43912:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109525.776156:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3645:x1872862933251840:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 53us (189us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109525.776162:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23090 00000100:00100000:1.0:1786109525.776175:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23091 00000100:00100000:1.0:1786109525.776178:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3645:x1872862933251968:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:1.0:1786109525.776188:0:43912:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109525.776210:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3645:x1872862933251968:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 29us (203us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109525.776215:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23091 00000100:00080000:1.0:1786109525.776239:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109525.776497:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109525.776501:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933251840:0@lo:8:ptlrpcd_00_01.0 00000100:00080000:1.0:1786109525.776513:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098650c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109525.776516:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109525.776519:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933251968:0@lo:8:ptlrpcd_00_01.0 00010000:00010000:0.0:1786109526.665629:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109527.710390:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109528.324866:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109528.325674:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933252224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109528.325738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109528.325782:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933252096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109528.325806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109528.325906:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933252096 00000100:00100000:2.0:1786109528.325915:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933252096 00000100:00100000:2.0:1786109528.325970:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12332 00000100:00100000:2.0:1786109528.325980:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933252096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109528.326024:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445683200 avail 1299443712 00000100:00100000:2.0:1786109528.326075:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933252096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109528.326082:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12332 00000100:00100000:1.0:1786109528.326138:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933252224 00000100:00100000:1.0:1786109528.326142:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933252224 00000100:00100000:1.0:1786109528.326193:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5817 00000100:00100000:1.0:1786109528.326200:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933252224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109528.326219:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109528.326254:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933252224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109528.326261:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5817 00000100:00080000:2.0:1786109528.326310:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109528.326496:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933252224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109528.326511:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933252096:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1786109528.734549:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786109529.377862:0:192325:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 397d331e-10fc-4558-be87-308c3622e8eb 00000001:00080000:0.0:1786109529.377875:0:192325:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 335007449092 is committed 00000020:00000080:0.0:1786109529.377881:0:192325:0:(genops.c:906:class_export_put()) final put ffff930986508000/397d331e-10fc-4558-be87-308c3622e8eb 00000020:00000080:0.0:1786109529.377909:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930986508000/397d331e-10fc-4558-be87-308c3622e8eb for lustre-MDT0000 00000020:00000080:0.0:1786109529.377966:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930981e11000 for lustre-MDT0000 00000001:00100000:2.0:1786109529.378065:0:187891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 397d331e-10fc-4558-be87-308c3622e8eb 00000001:00080000:2.0:1786109529.378074:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804569 is committed 00000020:00000080:2.0:1786109529.378076:0:187891:0:(genops.c:906:class_export_put()) final put ffff930ab1997800/397d331e-10fc-4558-be87-308c3622e8eb 00000020:00000080:0.0:1786109529.378264:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab1997800/397d331e-10fc-4558-be87-308c3622e8eb for lustre-MDT0001 00000020:00000080:0.0:1786109529.378304:0:181792:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a87b2e800 for lustre-MDT0001 00000020:01000004:2.0:1786109529.472926:0:193473:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1786109529.472975:0:193473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.472988:0:193473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.473008:0:193473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.473015:0:193473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.473034:0:193473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1786109529.473039:0:193473:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1786109529.473063:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109529.473069:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.473076:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413400 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:2.0:1786109529.473080:0:29734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.473087:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109529.473093:0:29734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109529.473099:0:29734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1786109529.473101:0:29734:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1786109529.473104:0:29734:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1786109529.481022:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.481038:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:3.0:1786109529.481183:0:193473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786109529.481188:0:193473:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1786109529.481194:0:193473:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1786109529.481208:0:193473:0:(import.c:65:import_set_state_nolock()) ffff930ab1981000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1786109529.481339:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.481348:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca36916 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3691d expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.481363:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109529.481366:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109529.481369:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109529.481377:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109529.481396:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933252352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109529.481475:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109529.481542:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933252352 00000100:00100000:2.0:1786109529.481549:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933252352 00000100:00100000:2.0:1786109529.481603:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4513 00000100:00100000:2.0:1786109529.481614:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3649:x1872862933252352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109529.481628:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109529.481645:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9412600/0xdb52b77d7ca3691d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36916 expref: 21 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.481658:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109529.481691:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:3649:x1872862933252352:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109529.481698:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4513 00000100:00100000:2.0:1786109529.481737:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933252352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109529.482123:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933252480:0@lo:39:umount.0 00000100:00100000:3.0:1786109529.482157:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109529.482197:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933252480 00000100:00100000:3.0:1786109529.482202:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933252480 00000100:00100000:3.0:1786109529.482307:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1786109529.482315:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872862933252480:12345-0@lo:39:umount.0 00000020:00000080:3.0:1786109529.482338:0:187899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36a27 00000100:00080000:3.0:1786109529.482345:0:187899:0:(import.c:65:import_set_state_nolock()) ffff93098e510800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1786109529.482397:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1872862933252480:12345-0@lo:39:umount.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109529.483308:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00080000:2.0:1786109529.483316:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab1981000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:3.0:1786109529.483318:0:187899:0:(genops.c:906:class_export_put()) final put ffff93098617f800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1786109529.483329:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933252480:0@lo:39:umount.0 00000020:00000080:3.0:1786109529.483343:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff93098617f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1786109529.483359:0:193473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786109529.483362:0:193473:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1786109529.483366:0:193473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786109529.483388:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098e510800 for lustre-MDT0000 00010000:00010000:2.0:1786109529.485855:0:193473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.485873:0:193473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.485880:0:193473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.485888:0:193473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.485906:0:193473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109529.485913:0:193473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.485921:0:193473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.485928:0:193473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.485934:0:193473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.485950:0:193473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1786109529.485969:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786109529.485974:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.485981:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361c00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:2.0:1786109529.485984:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.486005:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109529.486014:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109529.486020:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1786109529.486023:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1786109529.486051:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.486111:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109529.486117:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.486124:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412e00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109529.486127:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.486133:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109529.486139:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109529.486144:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1786109529.486146:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1786109529.486148:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1786109529.486165:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.486175:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109529.486197:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.486204:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9412e00/0xdb52b77d7ca3694e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36955 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.486279:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109529.486281:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109529.486283:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109529.486301:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933252736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109529.486363:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109529.487104:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933252736 00000100:00100000:3.0:1786109529.487112:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933252736 00000100:00100000:3.0:1786109529.487164:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4514 00000100:00100000:3.0:1786109529.487173:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9928a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:3649:x1872862933252736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109529.487187:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109529.487203:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9361200/0xdb52b77d7ca36955 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3694e expref: 20 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.488037:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109529.488113:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9928a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3649:x1872862933252736:12345-0@lo:103:ldlm_bl.0 Request processed in 940us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109529.488122:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4514 00000100:00100000:3.0:1786109529.488176:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933252736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109529.490268:0:193473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490292:0:193473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490299:0:193473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490305:0:193473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490334:0:193473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109529.490341:0:193473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490348:0:193473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490354:0:193473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490360:0:193473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490374:0:193473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1786109529.490378:0:193473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1786109529.490384:0:193473:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1786109529.490630:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109529.490637:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490648:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c400 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109529.490652:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490660:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109529.490667:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109529.490672:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1786109529.490675:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1786109529.490677:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1786109529.490709:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490716:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109529.490738:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490745:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36908 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3690f expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490757:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109529.490760:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490765:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361a00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109529.490767:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490774:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109529.490780:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109529.490785:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1786109529.490786:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1786109529.490788:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1786109529.490800:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490805:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109529.490810:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490816:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9361a00/0xdb52b77d7ca3682f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36836 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109529.490825:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109529.490827:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109529.490828:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109529.490845:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933252992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109529.490903:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109529.490959:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109529.490965:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933252864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109529.490989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1786109529.491039:0:193473:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1786109529.491043:0:193473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1786109529.491048:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1786109529.491053:0:193473:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1786109529.491187:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109529.493162:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933252992 00000100:00100000:1.0:1786109529.493174:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933252992 00000100:00100000:1.0:1786109529.493233:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933252864 00000100:00100000:1.0:1786109529.493236:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933252864 00000100:00100000:1.0:1786109529.493263:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4515 00000100:00100000:1.0:1786109529.493272:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:3647:x1872862933252992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109529.493286:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109529.493304:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9360400/0xdb52b77d7ca36836 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3682f expref: 20 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109529.493327:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109529.493393:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3647:x1872862933252992:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (2489us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109529.493413:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4515 00000100:00100000:1.0:1786109529.493446:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4516 00000100:00100000:1.0:1786109529.493453:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:3647:x1872862933252864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109529.493461:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109529.493471:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2d800/0xdb52b77d7ca3690f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36908 expref: 18 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109529.494201:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109529.494623:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:3647:x1872862933252864:12345-0@lo:103:ldlm_bl.0 Request processed in 1168us (3631us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109529.494632:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4516 00000100:00100000:1.0:1786109529.494707:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933252864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109529.494716:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933252992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109529.494920:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786109529.494948:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.494955:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9361c00/0xdb52b77d7ca3683d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36844 expref: -99 pid: 192324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.494973:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109529.495062:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933252608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109529.495100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109529.495930:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933252608 00000100:00100000:2.0:1786109529.495939:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933252608 00000100:00100000:2.0:1786109529.495987:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4517 00000100:00100000:2.0:1786109529.496406:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:3648:x1872862933252608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109529.496423:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109529.496462:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6da00/0xdb52b77d7ca36844 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3683d expref: 17 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109529.496478:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109529.496528:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:3648:x1872862933252608:12345-0@lo:103:ldlm_bl.0 Request processed in 533us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109529.496536:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4517 00000100:00100000:2.0:1786109529.496576:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933252608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109529.496595:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109529.496598:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109529.496600:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1786109529.508892:0:193473:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:2.0:1786109529.518121:0:193473:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1786109529.518138:0:193473:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930986179000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1786109529.518145:0:193473:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff93098617e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1786109529.518149:0:193473:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff93098650b800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 326417514497 stale:0 00000020:00080000:2.0:1786109529.518154:0:193473:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff930984ea99c0) has exports, disconnecting them 00000020:00080000:2.0:1786109529.518159:0:193473:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930986179000), last request at 1786109489 00000020:00000080:2.0:1786109529.518166:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36a20 00000100:00080000:2.0:1786109529.518175:0:193473:0:(import.c:65:import_set_state_nolock()) ffff93098617f000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1786109529.518370:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1786109529.518382:0:193473:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930986179000): rc 0 00000020:00000080:3.0:1786109529.518385:0:193473:0:(genops.c:906:class_export_put()) final put ffff930986179000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1786109529.518867:0:193473:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93098617e800), last request at 1786109525 00000020:00000080:3.0:1786109529.518873:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36a12 00000100:00080000:3.0:1786109529.518882:0:193473:0:(import.c:65:import_set_state_nolock()) ffff93098617c000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1786109529.518938:0:193473:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93098617e800): rc 0 00000020:00000080:3.0:1786109529.518940:0:193473:0:(genops.c:906:class_export_put()) final put ffff93098617e800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1786109529.519658:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786109529.520603:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff930986179000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109529.521088:0:181792:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098617f000 for lustre-MDT0000 00000020:00080000:3.0:1786109529.521176:0:193473:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93098650b800), last request at 1786109484 00000020:00000080:3.0:1786109529.521185:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3688a 00000100:00080000:3.0:1786109529.521199:0:193473:0:(import.c:65:import_set_state_nolock()) ffff930981e16800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1786109529.521355:0:193473:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93098650b800): rc 0 00000020:00000080:3.0:1786109529.521358:0:193473:0:(genops.c:906:class_export_put()) final put ffff93098650b800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:3.0:1786109529.521366:0:193473:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa66f00d93ae0 00000100:00080000:3.0:1786109529.521391:0:193473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1786109529.521395:0:193473:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1786109529.521407:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786109529.525305:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff93098617e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109529.525354:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff93098650b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109529.525377:0:181792:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098617c000 for lustre-MDT0000 00000020:00000080:0.0:1786109529.525381:0:181792:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930981e16800 for lustre-MDT0000 00000100:00080000:2.0:1786109529.527038:0:193473:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1786109529.527069:0:193473:0:(import.c:65:import_set_state_nolock()) ffff930a9788c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1786109529.530666:0:193473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1786109529.530675:0:193473:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738459 gen 3 00000004:00080000:2.0:1786109529.530695:0:193473:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1786109529.530754:0:193473:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1786109529.530760:0:193473:0:(import.c:65:import_set_state_nolock()) ffff93098650c000 lustre-OST0000_UUID: changing import state from DISCONN to CLOSED 00000004:00080000:2.0:1786109529.530764:0:193473:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1786109529.530766:0:193473:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1786109529.530770:0:193473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1786109529.530772:0:193473:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975824 gen 3 00000004:00080000:2.0:1786109529.530779:0:193473:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109529.532273:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933253120:0@lo:39:umount.0 00000100:00100000:3.0:1786109529.532349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109529.533028:0:193473:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1786109529.533746:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933253120 00000100:00100000:1.0:1786109529.533758:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933253120 00000100:00100000:1.0:1786109529.533830:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12333 00000100:00100000:1.0:1786109529.533841:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933253120:12345-0@lo:39:umount.0 00000020:00000080:1.0:1786109529.533872:0:177399:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca368c9 00000100:00080000:1.0:1786109529.533890:0:177399:0:(import.c:65:import_set_state_nolock()) ffff930a87b2c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786109529.534289:0:177399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769804569 00000100:00080000:2.0:1786109529.534371:0:193473:0:(import.c:65:import_set_state_nolock()) ffff930ac125d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1786109529.534518:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933253248:0@lo:9:umount.0 00000100:00100000:3.0:1786109529.534559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1786109529.534848:0:193473:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff930984ea99c0) has no exports 00000100:00100000:1.0:1786109529.534989:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3645:x1872862933253120:12345-0@lo:39:umount.0 Request processed in 1150us (2639us total) trans 25769804570 rc 0/0 00000100:00080000:3.0:1786109529.535007:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a9788c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1786109529.535015:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933253120:0@lo:39:umount.0 00000100:00100000:1.0:1786109529.535105:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12333 00000100:00100000:3.0:1786109529.535325:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933253248 00000100:00100000:3.0:1786109529.535332:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933253248 00000100:00100000:3.0:1786109529.535370:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23092 00000100:00100000:3.0:1786109529.535378:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933253248:12345-0@lo:9:umount.0 00000020:00000080:3.0:1786109529.535397:0:43919:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca368f3 00000100:00080000:3.0:1786109529.535404:0:43919:0:(import.c:65:import_set_state_nolock()) ffff930982c94800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1786109529.535833:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1786109529.535929:0:43919:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975824 00000100:00100000:3.0:1786109529.536910:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3645:x1872862933253248:12345-0@lo:9:umount.0 Request processed in 1528us (2346us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109529.536923:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23092 00010000:00010000:0.0:1786109529.537571:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1786109529.538158:0:193473:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff930984ea99c0) has no exports 00000100:00080000:2.0:1786109529.538649:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ac125d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1786109529.538671:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1786109529.538674:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786109529.538678:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933253248:0@lo:9:umount.0 00000020:00000080:3.0:1786109529.602675:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3689f 00000020:00000080:3.0:1786109529.602693:0:193473:0:(genops.c:906:class_export_put()) final put ffff930a87b2d000/lustre-QMT0000_UUID 00000020:01000000:3.0:1786109529.602756:0:193473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1786109529.602841:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786109529.602856:0:193473:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1786109529.602860:0:193473:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff930ac11b0000) has no exports 00000020:00000080:2.0:1786109529.603233:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36898 00000020:00000080:2.0:1786109529.603239:0:193473:0:(genops.c:906:class_export_put()) final put ffff930ab2a20800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786109529.603314:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b2d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1786109529.603750:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2a20800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1786109529.603824:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786109529.603834:0:193473:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1786109529.603837:0:193473:0:(genops.c:906:class_export_put()) final put ffff930ab2a27800/lustre-QMT0000_UUID 00000020:00000080:2.0:1786109529.603840:0:193473:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2a27800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1786109529.603847:0:193473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1786109529.603975:0:193473:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930982772060 - data ffff930abfb68870/ffff930a87bb9400 00000020:01000000:2.0:1786109529.604148:0:193473:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ac0f1fcc0 - data ffff93098a1b95e8/ffff93098c21e000 00000100:00080000:1.0:1786109529.637139:0:193473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1786109529.637147:0:193473:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1786109529.637160:0:193473:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff930a8909ad80 x1872862933253120/t25769804570(25769804570) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109539 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109529.637182:0:193473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1786109529.639518:0:193473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1786109529.639525:0:193473:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738459 gen 4 00000004:00080000:1.0:1786109529.639536:0:193473:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786109529.639538:0:193473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1786109529.639854:0:192343:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1786109529.639859:0:192343:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x138:0x0] index 1 count 1 00000040:00080000:3.0:1786109529.639870:0:192343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 78 count 2 00000100:00080000:1.0:1786109529.640723:0:193473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1786109529.640727:0:193473:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975824 gen 4 00000004:00080000:1.0:1786109529.640746:0:193473:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786109529.640748:0:193473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1786109529.641003:0:192345:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1786109529.641007:0:192345:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x13a:0x0] index 2 count 1 00000040:00080000:3.0:1786109529.641016:0:192345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 78 count 2 00000020:00000080:3.0:1786109529.643251:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36859 00000020:00000080:3.0:1786109529.643262:0:193473:0:(genops.c:906:class_export_put()) final put ffff93098650f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786109529.643617:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff93098650f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1786109529.644103:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3686e 00000020:00000080:3.0:1786109529.644110:0:193473:0:(genops.c:906:class_export_put()) final put ffff930ac0af6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1786109529.644126:0:193473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1786109529.644131:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109529.644142:0:193473:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1786109529.644146:0:193473:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff930984ea8000) has no exports 00000004:01000000:3.0:1786109529.644425:0:193473:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1786109529.644504:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca368ec 00000020:00000080:3.0:1786109529.644509:0:193473:0:(genops.c:906:class_export_put()) final put ffff930983498000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1786109529.644514:0:193473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1786109529.644518:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109529.644524:0:193473:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786109529.644528:0:193473:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff930ab99d0000) has no exports 00000020:00000080:3.0:1786109529.644533:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca368e5 00000020:00000080:3.0:1786109529.644536:0:193473:0:(genops.c:906:class_export_put()) final put ffff930ac1259000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1786109529.644851:0:193473:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1786109529.644856:0:193473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1786109529.644860:0:193473:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975824 gen 5 00000004:00080000:3.0:1786109529.644866:0:193473:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109529.644868:0:193473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786109529.644895:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109529.644902:0:193473:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109529.644909:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca368d0 00000020:00000080:3.0:1786109529.644913:0:193473:0:(genops.c:906:class_export_put()) final put ffff930985b79800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1786109529.644917:0:193473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='F') 00000020:00000080:3.0:1786109529.644920:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109529.644924:0:193473:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786109529.644926:0:193473:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff930ab99d4d40) has no exports 00000020:00000080:3.0:1786109529.644930:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca368c2 00000020:00000080:3.0:1786109529.644932:0:193473:0:(genops.c:906:class_export_put()) final put ffff930986509800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786109529.645450:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0af6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1786109529.645459:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930983498000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1786109529.645463:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac1259000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786109529.645554:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac125d800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1786109529.645561:0:183576:0:(genops.c:906:class_export_put()) final put ffff930985b7e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786109529.645563:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930985b7e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1786109529.645568:0:183576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109529.645644:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930985b79800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1786109529.645649:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930986509800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1786109529.645730:0:193473:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1786109529.645734:0:193473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1786109529.645736:0:193473:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738459 gen 5 00000004:00080000:3.0:1786109529.645741:0:193473:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109529.645742:0:193473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786109529.645807:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109529.645814:0:193473:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1786109529.645825:0:193473:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1786109529.645830:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca368b4 00000020:00000080:3.0:1786109529.645834:0:193473:0:(genops.c:906:class_export_put()) final put ffff930985b78000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786109529.646304:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098650c000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1786109529.646311:0:183576:0:(genops.c:906:class_export_put()) final put ffff930985b7b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786109529.646313:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930985b7b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1786109529.646317:0:183576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1786109529.646400:0:193473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1786109529.646405:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109529.646411:0:193473:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786109529.646414:0:193473:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9309824819c0) has no exports 00000020:00000080:3.0:1786109529.646419:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca368ad 00000020:00000080:3.0:1786109529.646423:0:193473:0:(genops.c:906:class_export_put()) final put ffff930a9788b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786109529.647796:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930985b78000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1786109529.647807:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a9788b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1786109529.660151:0:193473:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1786109529.660160:0:193473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1786109529.660165:0:193473:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1786109529.660172:0:193473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786109529.660322:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109529.660336:0:193473:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109529.660368:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109529.660372:0:193473:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109529.660377:0:193473:0:(genops.c:906:class_export_put()) final put ffff93098650a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786109529.660382:0:193473:0:(genops.c:865:class_export_destroy()) destroying export ffff93098650a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1786109529.660390:0:193473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109529.660547:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36875 00000020:00000080:3.0:1786109529.660555:0:193473:0:(genops.c:906:class_export_put()) final put ffff930ac0af6800/lustre-MDD0000_UUID 00000020:00000080:0.0:1786109529.660673:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a9788c000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1786109529.660679:0:183576:0:(genops.c:906:class_export_put()) final put ffff93098650f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786109529.660681:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff93098650f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1786109529.660688:0:183576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1786109529.661081:0:193473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1786109529.661086:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109529.661092:0:193473:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1786109529.661096:0:193473:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff930984eacd40) has no exports 00000020:00000080:3.0:1786109529.661117:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109529.661121:0:193473:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1786109529.661125:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3687c 00000020:00000080:3.0:1786109529.661130:0:193473:0:(genops.c:906:class_export_put()) final put ffff930ac0af2800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1786109529.661194:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0af6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1786109529.661199:0:183576:0:(genops.c:906:class_export_put()) final put ffff930986508800/lustre-MDD0000_UUID 00000020:00000080:1.0:1786109529.661201:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930986508800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1786109529.661210:0:183576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1786109529.661366:0:193473:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93098365d000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1786109529.661374:0:193473:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93098365d000 3 00000020:01000004:3.0:1786109529.661378:0:193473:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93098365d000 from lustre-MDT0000 00000020:00000080:3.0:1786109529.661448:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109529.661453:0:193473:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1786109529.661456:0:193473:0:(genops.c:906:class_export_put()) final put ffff93098650b000/lustre-MDT0000_UUID 00000020:00000080:3.0:1786109529.661458:0:193473:0:(genops.c:865:class_export_destroy()) destroying export ffff93098650b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1786109529.661467:0:193473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1786109529.661510:0:193473:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1786109529.661514:0:193473:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1786109529.661518:0:193473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1786109529.661520:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109529.661523:0:193473:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1786109529.661529:0:193473:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff93098e513000 aeab97cc-8463-4daa-a678-1bb2ad93cc69 0@lo 15 (0 0 10) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786109529.661534:0:193473:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff930ab99d19c0) has exports, disconnecting them 00000020:00080000:3.0:1786109529.661537:0:193473:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93098e513000), last request at 1786109484 00000020:00000080:3.0:1786109529.661549:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36821 00000020:00010000:3.0:1786109529.661553:0:193473:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93098e513000: total 1 00000100:00080000:3.0:1786109529.661556:0:193473:0:(import.c:65:import_set_state_nolock()) ffff93098e510000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1786109529.661568:0:193473:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93098e513000): rc 0 00000020:00080000:3.0:1786109529.661571:0:193473:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff930ab99d19c0) has no exports 00000100:00100000:3.0:1786109529.661622:0:192336:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff930ab8f65000:192336] 3 exiting: rc = 0 00000100:00100000:3.0:1786109529.661697:0:192332:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9309851d6200:192332] 2 exiting: rc = 0 00000020:00010000:0.0:1786109529.661766:0:10402:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93098e513000: total 1 00010000:00010000:0.0:1786109529.661800:0:10402:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93098e513000, canceled 0 locks, left on hash table 10. 00010000:00010000:0.0:1786109529.661827:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6c600/0xdb52b77d7ca36a0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36a04 expref: 11 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109529.661844:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2da00/0xdb52b77d7ca3699b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36994 expref: 10 pid: 192332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109529.661855:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9413000/0xdb52b77d7ca369e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca369da expref: 9 pid: 192336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109529.661865:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9361800/0xdb52b77d7ca36971 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3696a expref: 8 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109529.661882:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6d200/0xdb52b77d7ca369d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca369cc expref: 7 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109529.661892:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca36963 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3695c expref: 6 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109529.661905:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9413600/0xdb52b77d7ca369ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca369e8 expref: 5 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109529.661916:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca3697f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36978 expref: 4 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109529.661926:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9413c00/0xdb52b77d7ca369fd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca369f6 expref: 3 pid: 192331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109529.661936:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca3698d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36986 expref: 2 pid: 192330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109529.661948:0:10402:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93098e513000, canceled 10 locks, left on hash table 0. 00000020:00000080:0.0:1786109529.661959:0:10402:0:(genops.c:906:class_export_put()) final put ffff93098e513000/aeab97cc-8463-4daa-a678-1bb2ad93cc69 00010000:00010000:0.0:1786109529.661976:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109529.661978:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109529.661980:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109529.662023:0:192331:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff930ab28ffa00:192331] 1 exiting: rc = 0 00000020:00000080:1.0:1786109529.662167:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0af2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1786109529.662174:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e513000/aeab97cc-8463-4daa-a678-1bb2ad93cc69 for MGS 00000020:00000080:1.0:1786109529.662318:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098e510000 for MGS 00000100:00100000:1.0:1786109529.662341:0:192330:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff930ac0911600:192330] 0 exiting: rc = 1 00000100:00100000:3.0:1786109529.662552:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662560:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662565:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662570:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662575:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662580:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662585:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662591:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662596:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662601:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662607:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662612:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662618:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662623:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662627:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662632:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662638:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662643:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662648:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662655:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662660:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662665:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662705:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662710:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662715:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662721:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662726:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662730:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662736:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662741:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662746:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662751:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662756:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662761:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662766:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662771:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662776:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662781:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662786:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662791:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662795:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662800:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662804:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662808:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662814:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662819:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662824:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662830:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662834:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662840:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662844:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662850:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662856:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662862:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662868:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662873:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662878:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662884:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662889:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662894:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662899:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662904:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662909:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786109529.662914:0:193473:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1786109529.663833:0:193473:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930982519b40 - data ffff930abfb69d80/ffff930ac104c800 00000020:01000000:3.0:1786109529.664004:0:193473:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ac0ab5de0 - data ffff930abf8b3e58/ffff930ac1796c00 00000020:00000080:3.0:1786109529.664400:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca367f7 00000020:00000080:3.0:1786109529.664407:0:193473:0:(genops.c:906:class_export_put()) final put ffff930a901fc000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1786109529.664422:0:193473:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93098365d000 from MGS, refs=2 00000020:01000004:3.0:1786109529.664426:0:193473:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93098365d000 2 00000020:01000004:3.0:1786109529.664450:0:193473:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93098365d000 from MGS 00000020:00000080:3.0:1786109529.664496:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109529.664564:0:193473:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1786109529.664566:0:193473:0:(genops.c:906:class_export_put()) final put ffff930a901fa000/MGS 00000020:00000080:3.0:1786109529.664569:0:193473:0:(genops.c:865:class_export_destroy()) destroying export ffff930a901fa000/MGS for MGS 00000020:01000000:3.0:1786109529.664576:0:193473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1786109529.664641:0:193473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1786109529.664644:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109529.664651:0:193473:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1786109529.664657:0:193473:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93098e517000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786109529.664662:0:193473:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff930a97cb99c0) has exports, disconnecting them 00000020:00080000:3.0:1786109529.664666:0:193473:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93098e517000), last request at 1786109484 00000020:00000080:3.0:1786109529.664669:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3692b 00000020:00080000:3.0:1786109529.664677:0:193473:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93098e517000): rc 0 00000020:00000080:3.0:1786109529.664681:0:193473:0:(genops.c:906:class_export_put()) final put ffff93098e517000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1786109529.665233:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a901fc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786109529.665242:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e517000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1786109529.670922:0:193473:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1786109529.670932:0:193473:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786109529.670936:0:193473:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1786109529.670942:0:193473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786109529.671022:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab1981000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1786109529.671193:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109529.671204:0:193473:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1786109529.671209:0:193473:0:(genops.c:906:class_export_put()) final put ffff93098e517800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1786109529.671212:0:193473:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e517800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1786109529.671280:0:193473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1786109529.671407:0:193473:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93098365d000 1 00000020:00000080:3.0:1786109529.671412:0:193473:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca367e9 00000020:00000080:3.0:1786109529.671418:0:193473:0:(genops.c:906:class_export_put()) final put ffff930a901f9000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1786109529.671482:0:193473:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1786109529.671487:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109529.671491:0:193473:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1786109529.671494:0:193473:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff930985213380) has no exports 00000020:00000080:0.0:1786109529.673687:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a901f9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1786109529.712679:0:193473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109529.712692:0:193473:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1786109529.712698:0:193473:0:(genops.c:906:class_export_put()) final put ffff930ac096c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1786109529.712703:0:193473:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac096c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1786109529.712714:0:193473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1786109529.712828:0:193473:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff930ac0b3c800 00000020:02000400:1.0:1786109529.712887:0:193473:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1786109529.735119:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109529.862675:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109529.862698:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933253376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109529.862766:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109529.866066:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933253376 00000100:00100000:0.0:1786109529.866081:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933253376 00000100:00100000:0.0:1786109529.866162:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5818 00000100:00100000:0.0:1786109529.866174:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933253376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109529.866203:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109529.866279:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933253376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (3512us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109529.866285:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5818 00000100:00100000:0.0:1786109529.866343:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933253376:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1786109529.866415:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786109530.756615:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109530.890214:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933253504:0@lo:400:kworker.0 00000400:00000100:1.0:1786109530.890344:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933253504 offset 0 length 224: 4 00000100:00100000:1.0:1786109530.890399:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109530.890405:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933253632:0@lo:400:kworker.0 00000100:00100000:1.0:1786109530.890538:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109530.890594:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933253632 00000100:00100000:1.0:1786109530.890601:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933253632 00000100:00100000:1.0:1786109530.890639:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:1.0:1786109530.890646:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1872862933253632:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1786109530.890654:0:187901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109530.890705:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1872862933253632:12345-0@lo:400:kworker.0 Request processed in 58us (168us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109530.890713:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00080000:1.0:1786109530.891347:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786109530.891353:0:3646:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1786109530.891357:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1786109530.891361:0:3646:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109530.891365:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8346 00000100:00080000:1.0:1786109530.891372:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109530.891397:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c2bb80 x1872862933253888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109530.891525:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933253632:0@lo:400:kworker.0 00000100:00100000:3.0:1786109530.893685:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933253888:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1786109530.893834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109530.893967:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109530.893972:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1786109530.893974:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109530.893980:0:181792:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8382 00000100:00100000:0.0:1786109530.896097:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933253760:0@lo:400:kworker.0 00000100:00100000:0.0:1786109530.896158:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109530.896607:0:181792:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109530.896616:0:181792:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930a89106800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109530.896644:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89099180 x1872862933254144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109530.896713:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933254016:0@lo:400:kworker.0 00000100:00100000:2.0:1786109530.898014:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109530.898091:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933254144:0@lo:8:kworker.0 00000100:00100000:2.0:1786109530.898125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109530.898157:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933254272:0@lo:400:kworker.0 00000100:00100000:2.0:1786109530.901705:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109530.901848:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109530.901861:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933254400:0@lo:400:kworker.0 00000100:00100000:2.0:1786109530.901918:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933254016 00000100:00100000:2.0:1786109530.901925:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933254016 00000100:00100000:2.0:1786109530.901964:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12334 00000100:00100000:2.0:1786109530.901972:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1872862933254016:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1786109530.901980:0:8451:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1786109530.902040:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1872862933254016:12345-0@lo:400:kworker.0 Request processed in 67us (4028us total) trans 0 rc -107/-107 00000100:00100000:2.0:1786109530.902047:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12334 00000100:00100000:2.0:1786109530.902071:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933254144 00000100:00100000:2.0:1786109530.902075:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933254144 00000100:00100000:2.0:1786109530.902092:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933254272 00000100:00100000:2.0:1786109530.902095:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933254272 00000100:00100000:2.0:1786109530.902120:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6964 00000100:00100000:2.0:1786109530.902125:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933254272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109530.902167:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933254272:12345-0@lo:400:kworker.0 Request processed in 41us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109530.902173:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6964 00000100:00100000:2.0:1786109530.902184:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23093 00000100:00100000:2.0:1786109530.902188:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1872862933254144:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1786109530.902204:0:8441:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109530.902232:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1872862933254144:12345-0@lo:8:kworker.0 Request processed in 42us (4106us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109530.902238:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23093 00000100:00080000:2.0:1786109530.902272:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1786109530.902278:0:3649:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1786109530.902281:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1786109530.902287:0:3649:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109530.902291:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8346 00000100:00080000:2.0:1786109530.902297:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109530.902322:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89099f80 x1872862933254528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109530.902339:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933254016:0@lo:400:kworker.0 00000100:00100000:2.0:1786109530.902371:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933254528:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1786109530.902397:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109530.902423:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1786109530.904166:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933253888 00000100:00100000:0.0:1786109530.904175:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933253888 00000100:00100000:0.0:1786109530.904207:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933253760 00000100:00100000:0.0:1786109530.904210:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933253760 00000100:00100000:0.0:1786109530.905961:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1786109530.906003:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933253760:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786109530.906023:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109530.906034:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933254144:0@lo:8:kworker.0 00000100:00100000:2.0:1786109530.906083:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933254528 00000100:00100000:0.0:1786109530.906088:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933253760:12345-0@lo:400:kworker.0 Request processed in 109us (9929us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109530.906090:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933254528 00000100:00100000:0.0:1786109530.906094:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1786109530.906114:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1786109530.906119:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933253888:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1786109530.906121:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12335 00000100:00100000:2.0:1786109530.906125:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933254528:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1786109530.906136:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109530.906172:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933253888:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 52us (12339us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109530.906178:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00080000:0.0:1786109530.906205:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109530.906236:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109530.906242:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109530.906245:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933253888:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1786109530.907628:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933253760:0@lo:400:kworker.0 00010000:00020000:2.0:1786109530.910564:0:8452:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109530.910663:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933254528:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 4534us (8262us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109530.910675:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12335 00000100:00080000:0.0:1786109530.910707:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109530.910713:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109530.910717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109530.910717:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933254528:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1786109530.910757:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933254272:0@lo:400:kworker.0 00000100:00100000:2.0:1786109530.910781:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933254400 00000100:00100000:2.0:1786109530.910787:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933254400 00000100:00100000:2.0:1786109530.910813:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1786109530.910819:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1872862933254400:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1786109530.910826:0:188678:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1786109530.910871:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1872862933254400:12345-0@lo:400:kworker.0 Request processed in 50us (153us total) trans 0 rc -107/-107 00000100:00100000:2.0:1786109530.910878:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00080000:0.0:1786109530.912566:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1786109530.912572:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1786109530.912586:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1786109530.912591:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109530.912595:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8346 00000100:00080000:0.0:1786109530.912603:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109530.912634:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986553b80 x1872862933254656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109530.912673:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933254400:0@lo:400:kworker.0 00000100:00100000:1.0:1786109530.912694:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933254656:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1786109530.912746:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109530.912927:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933254656 00000100:00100000:0.0:1786109530.912933:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933254656 00000100:00100000:0.0:1786109530.912975:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1786109530.912993:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933254656:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1786109530.913010:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109530.913049:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933254656:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 67us (302us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109530.913055:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00080000:1.0:1786109530.913119:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109530.913124:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109530.913127:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933254656:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1786109531.784475:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109532.804715:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109533.838689:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109534.857133:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109534.980665:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933254784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109534.980727:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109534.980809:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933254784 00000100:00100000:1.0:1786109534.980817:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933254784 00000100:00100000:1.0:1786109534.980888:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5819 00000100:00100000:1.0:1786109534.980901:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933254784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109534.980932:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923496960 avail 3691974656 00000100:00080000:2.0:1786109534.981015:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109534.981136:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933254784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 236us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109534.981146:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5819 00000100:00100000:0.0:1786109534.981458:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933254784:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1786109535.501914:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786109535.501924:0:9518:0:(genops.c:906:class_export_put()) final put ffff930982c97000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786109535.502104:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff930982c97000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1786109535.502319:0:181792:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930982c94800 for lustre-OST0001 00000001:00100000:1.0:1786109535.502546:0:187891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1786109535.502563:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804570 is committed 00000020:00000080:1.0:1786109535.502569:0:187891:0:(genops.c:906:class_export_put()) final put ffff930a87b2f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786109535.502662:0:181792:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b2f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1786109535.502938:0:181792:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a87b2c800 for lustre-MDT0001 00010000:00010000:0.0:1786109535.876689:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109536.004633:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109536.004642:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109536.004647:0:181792:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109536.004659:0:181792:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8387 00000100:00080000:2.0:1786109536.004678:0:181792:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109536.004686:0:181792:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109536.004720:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89098000 x1872862933255040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109536.004849:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109536.004872:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933255040:0@lo:38:kworker.0 00000100:00100000:1.0:1786109536.005018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109536.005038:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933254912:0@lo:400:kworker.0 00000400:00000100:3.0:1786109536.005064:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933254912 offset 0 length 224: 4 00000100:00080000:2.0:1786109536.005137:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109536.005141:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109536.005143:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109536.005147:0:181792:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8387 00000100:00080000:2.0:1786109536.005151:0:181792:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109536.005155:0:181792:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109536.005172:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89099f80 x1872862933255296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109536.005185:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109536.005188:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1786109536.005190:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109536.005194:0:181792:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8387 00000100:00080000:2.0:1786109536.005197:0:181792:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109536.005201:0:181792:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930a89106800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109536.005212:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89099c00 x1872862933255424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109536.005234:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1786109536.005241:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933255168:0@lo:400:kworker.0 00000100:00080000:2.0:1786109536.005252:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109536.005254:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109536.005257:0:181792:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8387 00000100:00080000:2.0:1786109536.005261:0:181792:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109536.005264:0:181792:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109536.005268:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109536.005275:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a0e00 x1872862933255680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109536.005299:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933255552:0@lo:400:kworker.0 00000100:00100000:2.0:1786109536.005303:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933255040 00000100:00100000:2.0:1786109536.005311:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933255040 00000100:00100000:1.0:1786109536.005326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109536.005343:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933255168 00000100:00100000:2.0:1786109536.005346:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933255168 00000100:00100000:1.0:1786109536.005365:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933255552 00000100:00100000:1.0:1786109536.005368:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933255552 00000100:00100000:2.0:1786109536.005392:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1786109536.005401:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6965 00000100:00100000:2.0:1786109536.005403:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933255168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109536.005411:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933255552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109536.005486:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933255168:12345-0@lo:400:kworker.0 Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109536.005494:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1786109536.005512:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1786109536.005517:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933255040:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109536.005537:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1786109536.005539:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109536.005543:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109536.005612:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933255296:0@lo:38:kworker.0 00000100:00100000:1.0:1786109536.005655:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933255552:12345-0@lo:400:kworker.0 Request processed in 248us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109536.005665:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6965 00000100:00100000:2.0:1786109536.005666:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933255040:12345-0@lo:38:kworker.0 Request processed in 147us (648us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109536.005671:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1786109536.005703:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933255552:0@lo:400:kworker.0 00000100:00100000:3.0:1786109536.005825:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933255168:0@lo:400:kworker.0 00000100:00100000:0.0:1786109536.005897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109536.005927:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933255424:0@lo:8:kworker.0 00000100:00100000:0.0:1786109536.005959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109536.005965:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933255296 00000100:00100000:2.0:1786109536.005970:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933255296 00000100:00100000:0.0:1786109536.005980:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933255680:0@lo:38:kworker.0 00000100:00100000:2.0:1786109536.006000:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12336 00000100:00100000:0.0:1786109536.006001:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109536.006005:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933255296:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109536.006017:0:8451:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1786109536.006022:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109536.006026:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109536.006030:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933255040:0@lo:38:kworker.0 00000100:00100000:2.0:1786109536.006043:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933255296:12345-0@lo:38:kworker.0 Request processed in 37us (146us total) trans 0 rc -19/-19 00000100:00080000:0.0:1786109536.006046:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1786109536.006049:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12336 00000100:00080000:0.0:1786109536.006049:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109536.006052:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933255296:0@lo:38:kworker.0 00000100:00100000:1.0:1786109536.006106:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933255424 00000100:00100000:1.0:1786109536.006110:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933255424 00000100:00100000:1.0:1786109536.006140:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23094 00000100:00100000:1.0:1786109536.006145:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1872862933255424:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1786109536.006155:0:8443:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109536.006178:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933255680 00000100:00100000:2.0:1786109536.006183:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933255680 00000100:00100000:1.0:1786109536.006194:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1872862933255424:12345-0@lo:8:kworker.0 Request processed in 48us (244us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109536.006200:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23094 00000100:00100000:2.0:1786109536.006201:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1786109536.006205:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933255680:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109536.006214:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109536.006255:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933255680:12345-0@lo:38:kworker.0 Request processed in 49us (252us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109536.006261:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00080000:0.0:1786109536.006306:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109536.006311:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109536.006314:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933255424:0@lo:8:kworker.0 00000100:00080000:0.0:1786109536.006323:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109536.006326:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109536.006329:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933255680:0@lo:38:kworker.0 00010000:00010000:0.0:1786109536.901281:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109537.924663:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109538.948650:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109539.972680:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109540.100826:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933255808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109540.100897:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109540.101630:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933255808 00000100:00100000:0.0:1786109540.101639:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933255808 00000100:00100000:0.0:1786109540.103141:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5820 00000100:00100000:0.0:1786109540.103154:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933255808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109540.103185:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109540.103255:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933255808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109540.103262:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5820 00000100:00080000:3.0:1786109540.103309:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109540.103619:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933255808:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1786109541.005745:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109541.124773:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109541.124781:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109541.124785:0:181792:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109541.124794:0:181792:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8392 00000100:00080000:2.0:1786109541.124799:0:181792:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109541.124806:0:181792:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109541.124831:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a3480 x1872862933256064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109541.124884:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109541.124898:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933255936:0@lo:400:kworker.0 00000100:00100000:0.0:1786109541.125063:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933256064:0@lo:38:kworker.0 00000100:00100000:0.0:1786109541.125149:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109541.125199:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109541.125202:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109541.125204:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109541.125208:0:181792:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8392 00000100:00080000:2.0:1786109541.125211:0:181792:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109541.125216:0:181792:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109541.125229:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a1180 x1872862933256320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109541.125239:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109541.125242:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1786109541.125244:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109541.125247:0:181792:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8392 00000100:00080000:2.0:1786109541.125249:0:181792:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786109541.125253:0:181792:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930a89106800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109541.125264:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a2300 x1872862933256448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109541.125281:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109541.125284:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109541.125286:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109541.125289:0:181792:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8392 00000100:00080000:2.0:1786109541.125292:0:181792:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109541.125294:0:181792:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109541.125305:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a1500 x1872862933256704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109541.125327:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933256576:0@lo:400:kworker.0 00000100:00100000:2.0:1786109541.125359:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109541.125426:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109541.125452:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933256192:0@lo:400:kworker.0 00000100:00100000:2.0:1786109541.125508:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933256576 00000100:00100000:2.0:1786109541.125514:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933256576 00000100:00100000:2.0:1786109541.125557:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6966 00000100:00100000:2.0:1786109541.125565:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933256576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109541.125613:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933256576:12345-0@lo:400:kworker.0 Request processed in 49us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109541.125620:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6966 00000400:00000100:3.0:1786109541.128728:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933255936 offset 0 length 224: 4 00000100:00100000:0.0:1786109541.129310:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933256320:0@lo:38:kworker.0 00000100:00100000:0.0:1786109541.129352:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109541.129381:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933256448:0@lo:8:kworker.0 00000100:00100000:0.0:1786109541.129408:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109541.129427:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933256704:0@lo:38:kworker.0 00000100:00100000:0.0:1786109541.129469:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109541.129518:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933256448 00000100:00100000:0.0:1786109541.129525:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933256448 00000100:00100000:0.0:1786109541.129554:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23095 00000100:00100000:0.0:1786109541.129561:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3645:x1872862933256448:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1786109541.129579:0:40692:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109541.129618:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3645:x1872862933256448:12345-0@lo:8:kworker.0 Request processed in 57us (209us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109541.129626:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23095 00000100:00100000:3.0:1786109541.130883:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933256320 00000100:00100000:3.0:1786109541.130892:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933256320 00000100:00100000:3.0:1786109541.130938:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12337 00000100:00100000:3.0:1786109541.130945:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933256320:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109541.130961:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109541.131010:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933256320:12345-0@lo:38:kworker.0 Request processed in 65us (1658us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109541.131017:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12337 00000100:00100000:3.0:1786109541.131064:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933256064 00000100:00100000:3.0:1786109541.131069:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933256064 00000100:00100000:3.0:1786109541.131085:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933256704 00000100:00100000:3.0:1786109541.131100:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933256704 00000100:00100000:3.0:1786109541.131116:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1786109541.131122:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933256064:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109541.131131:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109541.131159:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933256064:12345-0@lo:38:kworker.0 Request processed in 36us (6020us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109541.131165:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1786109541.131177:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1786109541.131181:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933256704:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109541.131190:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109541.131214:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933256704:12345-0@lo:38:kworker.0 Request processed in 31us (1744us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109541.131220:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00080000:3.0:1786109541.131262:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109541.131268:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109541.131272:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933256320:0@lo:38:kworker.0 00000100:00080000:3.0:1786109541.131282:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109541.131285:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109541.131288:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933256448:0@lo:8:kworker.0 00000100:00080000:3.0:1786109541.131295:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109541.131298:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109541.131301:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933256704:0@lo:38:kworker.0 00000100:00080000:3.0:1786109541.131308:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109541.131311:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109541.131313:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933256064:0@lo:38:kworker.0 00000100:00100000:1.0:1786109541.133064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109541.134276:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933256576:0@lo:400:kworker.0 00000100:00100000:1.0:1786109541.134315:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933256192 00000100:00100000:1.0:1786109541.134321:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933256192 00000100:00100000:1.0:1786109541.134383:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1786109541.134392:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933256192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109541.134477:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933256192:12345-0@lo:400:kworker.0 Request processed in 85us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109541.134485:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:1.0:1786109541.134504:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109541.134527:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933256192:0@lo:400:kworker.0 00010000:00010000:2.0:1786109542.020658:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109543.044646:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109544.073264:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109545.094534:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109545.221617:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933256832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109545.221710:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109545.222586:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933256832 00000100:00100000:2.0:1786109545.222596:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933256832 00000100:00100000:2.0:1786109545.222698:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5821 00000100:00100000:2.0:1786109545.222710:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933256832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109545.222737:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109545.222805:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933256832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109545.222813:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5821 00000100:00100000:3.0:1786109545.222901:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933256832:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1786109545.222967:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786109546.116633:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109546.248160:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109546.248168:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109546.248172:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109546.248180:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8397 00000100:00080000:0.0:1786109546.248186:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1786109546.248193:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109546.248195:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933256960:0@lo:400:kworker.0 00000100:00100000:0.0:1786109546.248215:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986552300 x1872862933257088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1786109546.248246:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933256960 offset 0 length 224: 4 00000100:00100000:3.0:1786109546.248324:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933257088:0@lo:38:kworker.0 00000100:00080000:0.0:1786109546.248340:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109546.248344:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109546.248346:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109546.248350:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8397 00000100:00080000:0.0:1786109546.248353:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1786109546.248357:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109546.248358:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109546.248370:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986552a00 x1872862933257344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109546.248379:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1786109546.248382:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933257344:0@lo:38:kworker.0 00000100:00080000:0.0:1786109546.248382:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1786109546.248384:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109546.248387:0:183576:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8397 00000100:00080000:0.0:1786109546.248389:0:183576:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109546.248393:0:183576:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930a89106800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109546.248402:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986550700 x1872862933257472/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109546.248403:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109546.248417:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109546.248420:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1786109546.248421:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933257472:0@lo:8:kworker.0 00000100:00080000:0.0:1786109546.248422:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109546.248425:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8397 00000100:00080000:0.0:1786109546.248443:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1786109546.248448:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109546.248459:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986551500 x1872862933257728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109546.248461:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109546.248481:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933257728:0@lo:38:kworker.0 00000100:00100000:0.0:1786109546.248486:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933257600:0@lo:400:kworker.0 00000100:00100000:3.0:1786109546.248500:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109546.248509:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109546.248527:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933257088 00000100:00100000:0.0:1786109546.248527:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109546.248533:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933257088 00000100:00100000:0.0:1786109546.248545:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933257216:0@lo:400:kworker.0 00000100:00100000:3.0:1786109546.248560:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933257728 00000100:00100000:3.0:1786109546.248564:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933257728 00000100:00100000:0.0:1786109546.248566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109546.248578:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933257216 00000100:00100000:3.0:1786109546.248581:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933257216 00000100:00100000:0.0:1786109546.248601:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933257472 00000100:00100000:0.0:1786109546.248604:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933257472 00000100:00100000:3.0:1786109546.248614:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1786109546.248620:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933257600 00000100:00100000:0.0:1786109546.248622:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933257600 00000100:00100000:0.0:1786109546.248646:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6967 00000100:00100000:0.0:1786109546.248653:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933257600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109546.248700:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933257600:12345-0@lo:400:kworker.0 Request processed in 48us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109546.248706:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933257216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109546.248707:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6967 00000100:00100000:0.0:1786109546.248722:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23096 00000100:00100000:0.0:1786109546.248727:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3645:x1872862933257472:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1786109546.248735:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933257216:12345-0@lo:400:kworker.0 Request processed in 31us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109546.248740:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00020000:0.0:1786109546.248742:0:43914:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109546.248753:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1786109546.248758:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933257088:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109546.248766:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109546.248770:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3645:x1872862933257472:12345-0@lo:8:kworker.0 Request processed in 43us (308us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109546.248775:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23096 00000100:00100000:3.0:1786109546.248786:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933257088:12345-0@lo:38:kworker.0 Request processed in 27us (428us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109546.248791:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1786109546.248795:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1786109546.248799:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933257728:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1786109546.248807:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933257344 00010000:00020000:0.0:1786109546.248808:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109546.248810:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933257344 00000100:00100000:3.0:1786109546.248831:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12338 00000100:00100000:0.0:1786109546.248832:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933257728:12345-0@lo:38:kworker.0 Request processed in 32us (331us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109546.248835:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933257344:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1786109546.248838:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00010000:00020000:3.0:1786109546.248844:0:179257:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109546.248865:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933257344:12345-0@lo:38:kworker.0 Request processed in 29us (461us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109546.248870:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12338 00000100:00080000:0.0:1786109546.248871:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109546.248875:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109546.248878:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933257728:0@lo:38:kworker.0 00000100:00080000:3.0:1786109546.248908:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109546.248916:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109546.248919:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109546.248922:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933257472:0@lo:8:kworker.0 00000100:00080000:0.0:1786109546.248929:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109546.248932:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109546.248935:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933257344:0@lo:38:kworker.0 00000100:00080000:0.0:1786109546.248941:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109546.248944:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109546.248947:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933257088:0@lo:38:kworker.0 00000100:00100000:0.0:1786109546.248980:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933257216:0@lo:400:kworker.0 00000100:00100000:0.0:1786109546.248989:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933257600:0@lo:400:kworker.0 00000100:00000400:2.0:1786109546.248992:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109530/real 1786109530] req@ffff930a89098a80 x1872862933253504/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109546 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109546.249009:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff930a89098a80 x1872862933253504/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109546 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109546.249018:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1786109546.249021:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1786109546.249024:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.138@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1786109546.249026:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1786109546.249029:0:3646:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930a89098a80 x1872862933253504/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109546 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109546.249037:0:3646:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930a8909a300 x1872862933254912/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109552 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109546.249058:0:3646:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930aa60a3800 x1872862933255936/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109557 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109546.249065:0:3646:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930986550e00 x1872862933256960/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109562 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1786109546.249075:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1786109546.249077:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1786109546.249078:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1786109546.249081:0:3646:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1786109546.249095:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933253504:0@lo:400:kworker.0 00000100:00100000:3.0:1786109546.249221:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933256960:0@lo:400:kworker.0 00000100:00100000:0.0:1786109546.249283:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933255936:0@lo:400:kworker.0 00000100:00100000:0.0:1786109546.249290:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933254912:0@lo:400:kworker.0 00000100:00080000:0.0:1786109546.249311:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109546.249315:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1786109546.249317:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109546.249321:0:183576:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8340 00000100:00080000:0.0:1786109546.249325:0:183576:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109546.249340:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986551f80 x1872862933257856/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109546.249405:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933257856:0@lo:250:kworker.0 00000400:00000100:3.0:1786109546.249426:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933257856 offset 0 length 520: 4 00010000:00010000:0.0:1786109547.144594:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109548.165622:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1786109548.642806:0:193895:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1786109548.642812:0:193895:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1786109548.642813:0:193895:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1786109548.643153:0:193895:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff930ab29d1000 00000020:01000004:3.0:1786109548.643168:0:193895:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1786109548.643181:0:193895:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1786109548.643195:0:193895:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff930ab99d19c0) 00000020:00000080:3.0:1786109548.643214:0:193895:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1786109548.690680:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1786109548.691696:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.692756:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1786109548.692957:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1786109548.693328:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1786109548.693606:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1786109548.693987:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1786109548.694244:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1786109548.694473:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1786109548.694701:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1786109548.694892:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1786109548.695135:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1786109548.695389:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1786109548.695704:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1786109548.699702:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1786109548.700774:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.700983:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.701261:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.701524:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.701747:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.701993:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.702223:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.702453:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.702698:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.702967:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.703200:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.703399:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.703726:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.704050:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.704350:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.704632:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.704823:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.705079:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.705340:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.705590:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.705788:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.706033:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.706290:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.706574:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.706775:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.706988:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.707204:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.707393:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.707612:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.707810:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.708073:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1786109548.708319:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1786109548.709835:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1786109548.710309:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1786109548.710544:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1786109548.710964:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1786109548.711180:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1786109548.711372:0:193895:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1786109548.711965:0:193895:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1786109548.712275:0:193895:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1786109548.712284:0:193895:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786109548.712294:0:193895:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36c88 00000020:01000004:3.0:1786109548.712301:0:193895:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1786109548.712311:0:193895:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1786109548.712315:0:193895:0:(tgt_mount.c:101:server_register_mount()) register mount ffff930ab29d1000 from MGS 00000020:01000004:3.0:1786109548.712319:0:193895:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1786109548.712329:0:193895:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff930ab99d4d40) 00000020:00000080:3.0:1786109548.712340:0:193895:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1786109548.712395:0:193895:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930ab29d1000 from MGS, refs=2 00080000:01000000:3.0:1786109548.712401:0:193895:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1786109548.712406:0:193895:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36c96 00010000:00010000:3.0:1786109548.712728:0:193895:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:3.0:1786109548.716398:0:193895:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1786109548.719220:0:193899:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1786109548.719266:0:193895:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1786109548.719309:0:193895:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1786109548.720062:0:193895:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1786109548.720357:0:193895:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786109548.720566:0:193895:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1786109548.720573:0:193895:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1786109548.723349:0:193895:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1786109548.723487:0:193895:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1786109548.723909:0:193895:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1786109548.723915:0:193895:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1786109548.724419:0:193895:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1786109548.724560:0:193895:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1786109548.724562:0:193895:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1786109548.724565:0:193895:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1786109548.724569:0:193895:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff930a8a640000 already not connected (conn 13797, was 0): CONNECTING 00000100:00100000:0.0:1786109548.724573:0:193895:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00010000:00010000:0.0:1786109549.193306:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109550.223750:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109550.367811:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933257984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109550.368008:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109550.368228:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933257984 00000100:00100000:2.0:1786109550.368235:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933257984 00000100:00080000:3.0:1786109550.368287:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109550.368336:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5822 00000100:00100000:2.0:1786109550.368347:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933257984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109550.368375:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109550.368453:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933257984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109550.368460:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5822 00000100:00100000:0.0:1786109550.368536:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933257984:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1786109551.236655:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786109551.364747:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109551.364755:0:181792:0:(pinger.c:247:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1786109551.364758:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109551.364762:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109551.364766:0:181792:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109551.364774:0:181792:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8402 00000100:00080000:3.0:1786109551.364778:0:181792:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109551.364785:0:181792:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109551.364821:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab992b800 x1872862933258112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109551.364907:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109551.364911:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109551.364913:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109551.364916:0:181792:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8402 00000100:00080000:3.0:1786109551.364929:0:181792:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109551.364934:0:181792:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109551.364947:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89098a80 x1872862933258368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109551.364955:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109551.364958:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1786109551.364959:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109551.364962:0:181792:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8402 00000100:00080000:3.0:1786109551.364964:0:181792:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109551.364968:0:181792:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930a89106800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109551.365014:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933258112:0@lo:38:kworker.0 00000100:00100000:1.0:1786109551.365098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109551.365101:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89099500 x1872862933258496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109551.365131:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109551.365135:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109551.365137:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109551.365141:0:181792:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8402 00000100:00080000:3.0:1786109551.365143:0:181792:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109551.365148:0:181792:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109551.365163:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89099c00 x1872862933258752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109551.365170:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933258368:0@lo:38:kworker.0 00000100:00100000:2.0:1786109551.365236:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933258624:0@lo:400:kworker.0 00000100:00100000:2.0:1786109551.365305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109551.365356:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933258240:0@lo:400:kworker.0 00000100:00100000:2.0:1786109551.365383:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109551.365420:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933258624 00000100:00100000:3.0:1786109551.365454:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933258624 00000100:00100000:0.0:1786109551.365526:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933258112 00000100:00100000:0.0:1786109551.365530:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933258112 00000100:00100000:0.0:1786109551.365557:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933258240 00000100:00100000:0.0:1786109551.365561:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933258240 00000100:00100000:1.0:1786109551.365584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109551.365609:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1786109551.365621:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933258240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109551.365627:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933258496:0@lo:8:kworker.0 00000100:00100000:1.0:1786109551.365655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109551.365677:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933258752:0@lo:38:kworker.0 00000100:00100000:0.0:1786109551.365686:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933258240:12345-0@lo:400:kworker.0 Request processed in 68us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109551.365693:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1786109551.365703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109551.365761:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933258752 00000100:00100000:0.0:1786109551.365765:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933258752 00000100:00100000:0.0:1786109551.365784:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:0.0:1786109551.365789:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933258112:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1786109551.365792:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933258368 00000100:00100000:1.0:1786109551.365797:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933258368 00010000:00020000:0.0:1786109551.365807:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109551.365823:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12339 00000100:00100000:1.0:1786109551.365829:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933258368:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109551.365840:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109551.365860:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933258112:12345-0@lo:38:kworker.0 Request processed in 57us (750us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109551.365867:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:0.0:1786109551.365885:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1786109551.365890:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933258368:12345-0@lo:38:kworker.0 Request processed in 58us (304us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109551.365895:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933258752:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1786109551.365903:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12339 00010000:00020000:0.0:1786109551.365983:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109551.366012:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933258752:12345-0@lo:38:kworker.0 Request processed in 119us (310us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109551.366078:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933258496 00000100:00100000:2.0:1786109551.366083:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933258496 00000100:00100000:2.0:1786109551.366104:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6968 00000100:00100000:0.0:1786109551.366104:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1786109551.366117:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933258624:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1786109551.366133:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109551.366162:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933258624:12345-0@lo:400:kworker.0 Request processed in 47us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109551.366170:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6968 00000100:00100000:0.0:1786109551.366178:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23097 00000100:00100000:0.0:1786109551.366185:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3645:x1872862933258496:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1786109551.366196:0:179240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109551.366216:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933258240:0@lo:400:kworker.0 00000100:00100000:0.0:1786109551.366231:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3645:x1872862933258496:12345-0@lo:8:kworker.0 Request processed in 44us (574us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109551.366242:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23097 00000100:00100000:2.0:1786109551.366251:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933258624:0@lo:400:kworker.0 00000100:00080000:0.0:1786109551.366284:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109551.366290:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109551.366294:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933258496:0@lo:8:kworker.0 00000100:00080000:0.0:1786109551.366302:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109551.366306:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109551.366308:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933258752:0@lo:38:kworker.0 00000100:00080000:0.0:1786109551.366316:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109551.366319:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109551.366321:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933258112:0@lo:38:kworker.0 00000100:00080000:0.0:1786109551.366328:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109551.366331:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109551.366333:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933258368:0@lo:38:kworker.0 00010000:00010000:1.0:1786109552.260647:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109553.284768:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109554.308665:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109555.333885:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109555.460776:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933258880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109555.460856:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109555.461083:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933258880 00000100:00100000:1.0:1786109555.461091:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933258880 00000100:00100000:1.0:1786109555.461227:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5823 00000100:00100000:1.0:1786109555.461238:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933258880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109555.461267:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109555.461310:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933258880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109555.461316:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5823 00000100:00100000:0.0:1786109555.461466:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933258880:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1786109555.461568:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786109556.356640:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109556.490209:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109546/real 1786109546] req@ffff930986551f80 x1872862933257856/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786109556 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109556.490239:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff930986551f80 x1872862933257856/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786109556 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109556.490258:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109556.490274:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1786109556.490290:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933257856:0@lo:250:kworker.0 00000100:00080000:0.0:1786109556.490293:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109556.490299:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1786109556.490302:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109556.491190:0:181792:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8402 00000100:00080000:0.0:1786109556.491196:0:181792:0:(import.c:589:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1786109556.491204:0:181792:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109556.491231:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986552a00 x1872862933259008/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109556.491246:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109556.491249:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109556.491251:0:181792:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109556.491255:0:181792:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8408 00000100:00080000:0.0:1786109556.491257:0:181792:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109556.491260:0:181792:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109556.491271:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986550700 x1872862933259136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1786109556.491335:0:193895:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1786109556.491351:0:193895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9361000/0xdb52b77d7ca369f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca369fd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109556.491363:0:193895:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9361000/0xdb52b77d7ca369f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca369fd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109556.491373:0:193895:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00020000:1.0:1786109556.491463:0:3645:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff930986552a00 x1872862933259008/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109556.491475:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109556.491529:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:1.0:1786109556.491533:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:0:1872862933259008:0@lo:250:kworker.0 00000100:00100000:1.0:1786109556.491541:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933259136:0@lo:38:kworker.0 00000100:00100000:1.0:1786109556.491604:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.491692:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933259264:0@lo:400:kworker.0 00000100:00100000:1.0:1786109556.491708:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933259136 00000100:00100000:1.0:1786109556.491716:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933259136 00000100:00100000:3.0:1786109556.491742:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786109556.491787:0:193895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109556.491797:0:193895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9361000/0xdb52b77d7ca369f6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca369fd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.491830:0:193895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca3695c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36963 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109556.491838:0:193895:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca3695c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36963 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109556.491844:0:193895:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109556.491849:0:193895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109556.491855:0:193895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca3695c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36963 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.491864:0:193895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9412000/0xdb52b77d7ca36978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3697f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109556.491870:0:193895:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412000/0xdb52b77d7ca36978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3697f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109556.491875:0:193895:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109556.491879:0:193895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109556.491882:0:193895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9412000/0xdb52b77d7ca36978 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3697f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.491890:0:193895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9360600/0xdb52b77d7ca369cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca369d3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109556.491901:0:193895:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9360600/0xdb52b77d7ca369cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca369d3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109556.491906:0:193895:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109556.491909:0:193895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109556.491912:0:193895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9360600/0xdb52b77d7ca369cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca369d3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.491921:0:193895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9360800/0xdb52b77d7ca369da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca369e1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109556.491927:0:193895:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9360800/0xdb52b77d7ca369da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca369e1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109556.491933:0:193895:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109556.491936:0:193895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109556.491939:0:193895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9360800/0xdb52b77d7ca369da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca369e1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.491947:0:193895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9360000/0xdb52b77d7ca36a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36a0b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109556.491953:0:193895:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9360000/0xdb52b77d7ca36a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36a0b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109556.491959:0:193895:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109556.491964:0:193895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109556.491967:0:193895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9360000/0xdb52b77d7ca36a04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36a0b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.491985:0:193895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9412a00/0xdb52b77d7ca3696a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36971 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109556.491992:0:193895:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412a00/0xdb52b77d7ca3696a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36971 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109556.491997:0:193895:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109556.492000:0:193895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109556.492004:0:193895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9412a00/0xdb52b77d7ca3696a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36971 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.492017:0:193895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9413e00/0xdb52b77d7ca36986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3698d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109556.492024:0:193895:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9413e00/0xdb52b77d7ca36986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3698d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109556.492029:0:193895:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109556.492032:0:193895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109556.492035:0:193895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9413e00/0xdb52b77d7ca36986 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3698d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.492046:0:193895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9412400/0xdb52b77d7ca36994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3699b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109556.492053:0:193895:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412400/0xdb52b77d7ca36994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3699b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109556.492058:0:193895:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786109556.492061:0:193895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109556.492065:0:193895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9412400/0xdb52b77d7ca36994 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3699b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.492072:0:193895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c800/0xdb52b77d7ca369e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca369ef expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109556.492079:0:193895:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c800/0xdb52b77d7ca369e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca369ef expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109556.492084:0:193895:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786109556.492087:0:193895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109556.492090:0:193895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c800/0xdb52b77d7ca369e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca369ef expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786109556.492104:0:193895:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff930a8a640000 already not connected (conn 13798, was 0): DISCONN 00000100:00080000:2.0:1786109556.492108:0:193895:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109556.492111:0:193895:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8413 00000100:00080000:2.0:1786109556.492114:0:193895:0:(import.c:589:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109556.492117:0:193895:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109556.492134:0:193895:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a3100 x1872862933259392/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109556.492163:0:193895:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1786109556.492210:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933259264 00000100:00100000:1.0:1786109556.492214:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933259264 00000100:00100000:1.0:1786109556.492258:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1786109556.492269:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933259264:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1786109556.492316:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109556.492323:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109556.492325:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109556.492330:0:181792:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8408 00000100:00080000:0.0:1786109556.492333:0:181792:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109556.492338:0:181792:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109556.492343:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1786109556.492350:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933259136:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1786109556.492358:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986552a00 x1872862933259520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00020000:2.0:1786109556.492370:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1786109556.492371:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109556.492377:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1786109556.492379:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109556.492382:0:181792:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8408 00000100:00080000:0.0:1786109556.492385:0:181792:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1786109556.492389:0:181792:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930a89106800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109556.492405:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986551f80 x1872862933259648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109556.492415:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933259136:12345-0@lo:38:kworker.0 Request processed in 62us (808us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109556.492428:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1786109556.492490:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933259776:0@lo:400:kworker.0 00000100:00100000:2.0:1786109556.492530:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109556.492587:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933259776 00000100:00100000:2.0:1786109556.492590:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933259776 00000100:00100000:2.0:1786109556.492614:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6969 00000100:00100000:2.0:1786109556.492620:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933259776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109556.492655:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933259776:12345-0@lo:400:kworker.0 Request processed in 34us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109556.492660:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6969 00000100:00080000:2.0:1786109556.492676:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109556.492706:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933259776:0@lo:400:kworker.0 00000100:00100000:1.0:1786109556.492777:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933259264:12345-0@lo:400:kworker.0 Request processed in 510us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109556.492784:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1786109556.492806:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933259392:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1786109556.492847:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109556.492913:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109556.492918:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109556.492921:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1786109556.492923:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933259520:0@lo:38:kworker.0 00000100:00080000:0.0:1786109556.492928:0:181792:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8408 00000100:00080000:0.0:1786109556.492942:0:181792:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1786109556.492952:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109556.492956:0:181792:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109556.492975:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933259648:0@lo:8:kworker.0 00000100:00100000:0.0:1786109556.492976:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986550e00 x1872862933259904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109556.492999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786109556.493020:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109556.493024:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109556.493028:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933259136:0@lo:38:kworker.0 00000100:00100000:1.0:1786109556.493048:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933259648 00000100:00100000:1.0:1786109556.493051:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933259648 00000100:00100000:1.0:1786109556.493068:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23098 00000100:00100000:1.0:1786109556.493073:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:0+-99:3645:x1872862933259648:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1786109556.493084:0:179253:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109556.493113:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:0+-99:3645:x1872862933259648:12345-0@lo:8:kworker.0 Request processed in 38us (113us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109556.493119:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23098 00000100:00080000:1.0:1786109556.493143:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109556.493147:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109556.493189:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933259264:0@lo:400:kworker.0 00000100:00100000:3.0:1786109556.493215:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933259520 00000100:00100000:3.0:1786109556.493218:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933259520 00000100:00100000:3.0:1786109556.493241:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12340 00000100:00100000:3.0:1786109556.493245:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933259520:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109556.493256:0:179257:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1786109556.493272:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109556.493275:0:181792:0:(pinger.c:247:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1786109556.493284:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933259520:12345-0@lo:38:kworker.0 Request processed in 38us (333us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109556.493290:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12340 00000100:00100000:1.0:1786109556.493419:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933259648:0@lo:8:kworker.0 00000100:00100000:2.0:1786109556.493562:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933259392 00000100:00100000:2.0:1786109556.493567:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933259392 00000100:00100000:2.0:1786109556.493590:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933259904:0@lo:38:kworker.0 00000100:00100000:2.0:1786109556.493616:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109556.493640:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109556.493644:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109556.493647:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933259520:0@lo:38:kworker.0 00000100:00100000:3.0:1786109556.493778:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786109556.493783:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1872862933259392:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1786109556.493800:0:193901:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from aeab97cc-8463-4daa-a678-1bb2ad93cc69@0@lo t0 exp 0000000000000000 cur 8413 last 0 00000100:00100000:1.0:1786109556.493974:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933259904 00000100:00100000:1.0:1786109556.494143:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933259904 00000100:00100000:1.0:1786109556.494171:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1786109556.494175:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933259904:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109556.494186:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109556.494223:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933259904:12345-0@lo:38:kworker.0 Request processed in 46us (606us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109556.494229:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00080000:1.0:1786109556.494258:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109556.494262:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109556.494265:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933259904:0@lo:38:kworker.0 00000020:00000080:3.0:1786109556.494519:0:193901:0:(genops.c:1406:class_connect()) connect: client aeab97cc-8463-4daa-a678-1bb2ad93cc69, cookie 0xdb52b77d7ca36c9d 00000100:00080000:3.0:1786109556.494643:0:193901:0:(import.c:65:import_set_state_nolock()) ffff930a88c18800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786109556.494689:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+5:3645:x1872862933259392:12345-0@lo:250:mount.lustre.0 Request processed in 904us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109556.494697:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786109556.494721:0:3645:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.138@tcp: committing for last_committed 0 gen 79 00000100:00080000:3.0:1786109556.494728:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.138@tcp: connect to target with instance 0 00000100:00080000:3.0:1786109556.494734:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1786109556.494871:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1786109556.494875:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1786109556.494878:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1786109556.494936:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1786109556.494947:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933259392:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1786109556.494970:0:193895:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1786109556.494978:0:193895:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1786109556.495009:0:193895:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1786109556.495014:0:193895:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1786109556.495111:0:193895:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1786109556.495146:0:193895:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1786109556.495149:0:193895:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1786109556.495151:0:193895:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786109556.495152:0:193895:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109556.495153:0:193895:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109556.495154:0:193895:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109556.495155:0:193895:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109556.495156:0:193895:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786109556.495157:0:193895:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786109556.495159:0:193895:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109556.495160:0:193895:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786109556.495162:0:193895:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1786109556.495164:0:193895:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786109556.495165:0:193895:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786109556.495166:0:193895:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109556.495167:0:193895:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109556.495168:0:193895:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109556.495169:0:193895:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109556.495170:0:193895:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786109556.495170:0:193895:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786109556.495171:0:193895:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109556.495172:0:193895:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786109556.495187:0:193895:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1786109556.495199:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933260032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1786109556.495233:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.495281:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f9c0 going to sleep for 11 seconds 00000020:01000000:1.0:1786109556.495660:0:181792:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.138@tcp 10000000:01000000:1.0:1786109556.495672:0:181792:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1786109556.495674:0:181792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1786109556.495675:0:181792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786109556.495677:0:181792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109556.495678:0:181792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109556.495679:0:181792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109556.495680:0:181792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109556.495681:0:181792:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786109556.495683:0:181792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109556.495684:0:181792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1786109556.495703:0:181792:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1786109556.495706:0:181792:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1786109556.495708:0:181792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1786109556.495709:0:181792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1786109556.495710:0:181792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109556.495711:0:181792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109556.495712:0:181792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109556.495713:0:181792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109556.495715:0:181792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786109556.495716:0:181792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109556.495716:0:181792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1786109556.495732:0:181792:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1786109556.495803:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933260160:0@lo:253:kworker.0 00000100:00100000:3.0:1786109556.495847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.495894:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109556.495900:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933260288:0@lo:253:kworker.0 00000100:00100000:3.0:1786109556.495928:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.495960:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933260032 00000100:00100000:3.0:1786109556.495965:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933260032 00000100:00100000:3.0:1786109556.495987:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933260160 00000100:00100000:3.0:1786109556.495989:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933260160 00000100:00100000:3.0:1786109556.495998:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933260288 00000100:00100000:3.0:1786109556.496000:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933260288 00000100:00100000:3.0:1786109556.496012:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786109556.496019:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:193895:x1872862933260032:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1786109556.496059:0:193901:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1786109556.496063:0:193901:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1786109556.496065:0:193901:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1786109556.496169:0:193906:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1786109556.496370:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786109556.496383:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:3646:x1872862933260160:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1786109556.496397:0:193902:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1786109556.496760:0:193901:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 325 20000000:01000000:0.0:1786109556.498287:0:193907:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1786109556.498294:0:193907:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1786109556.498297:0:193907:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1786109556.498300:0:193907:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1786109556.498606:0:193907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1786109556.498833:0:193901:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1786109556.498883:0:193902:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1786109556.498994:0:193901:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1786109556.501179:0:193902:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1786109556.501200:0:193902:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1786109556.501331:0:193906:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1786109556.501335:0:193906:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1786109556.501358:0:193906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36ca4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.501375:0:193906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36ca4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786109556.501384:0:193906:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000049437s 00010000:00010000:0.0:1786109556.501389:0:193906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36ca4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.501402:0:193906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36ca4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.501409:0:193906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36ca4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.501416:0:193906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36ca4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.501422:0:193906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109556.501427:0:193906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36ca4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.501465:0:193906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36ca4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.501475:0:193906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36ca4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.501482:0:193906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36ca4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.501487:0:193906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36ca4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109556.501713:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:3646:x1872862933260160:12345-0@lo:253:kworker.0 Request processed in 5327us (5861us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.501726:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786109556.501762:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786109556.501772:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+6:3646:x1872862933260288:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1786109556.501797:0:193902:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1786109556.501809:0:193902:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:1.0:1786109556.502677:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1786109556.502681:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786109556.502682:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109556.502684:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109556.502685:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109556.502687:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109556.502689:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786109556.502690:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109556.502692:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1786109556.502696:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933260160:0@lo:253:kworker.0 20000000:01000000:1.0:1786109556.503056:0:193902:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1786109556.503071:0:193902:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1786109556.503232:0:193906:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1786109556.503236:0:193906:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1786109556.503251:0:193906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ac0b2c200/0xdb52b77d7ca36cab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.503263:0:193906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2c200/0xdb52b77d7ca36cab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786109556.503271:0:193906:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000049437s 00010000:00010000:0.0:1786109556.503274:0:193906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ac0b2c200/0xdb52b77d7ca36cab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.503282:0:193906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ac0b2c200/0xdb52b77d7ca36cab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.503288:0:193906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ac0b2c200/0xdb52b77d7ca36cab lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.503295:0:193906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ac0b2c200/0xdb52b77d7ca36cab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.503301:0:193906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109556.503304:0:193906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ac0b2c200/0xdb52b77d7ca36cab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.503312:0:193906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ac0b2c200/0xdb52b77d7ca36cab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.503321:0:193906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ac0b2c200/0xdb52b77d7ca36cab lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.503332:0:193906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ac0b2c200/0xdb52b77d7ca36cab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.503339:0:193906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2c200/0xdb52b77d7ca36cab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109556.503498:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+6:3646:x1872862933260288:12345-0@lo:253:kworker.0 Request processed in 1727us (7567us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109556.503507:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1786109556.503591:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1786109556.503594:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1786109556.503595:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109556.503596:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109556.503597:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109556.503598:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109556.503600:0:3646:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786109556.503601:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109556.503602:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1786109556.503606:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933260288:0@lo:253:kworker.0 00000100:00100000:3.0:1786109556.505725:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+5:193895:x1872862933260032:12345-0@lo:253:mount.lustre.0 Request processed in 9698us (10483us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109556.505738:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786109556.505904:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933260032:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786109556.505917:0:193895:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1786109556.505920:0:193895:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786109556.505921:0:193895:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786109556.505923:0:193895:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109556.505924:0:193895:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109556.505925:0:193895:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109556.505927:0:193895:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109556.505928:0:193895:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786109556.505929:0:193895:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786109556.505931:0:193895:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109556.505931:0:193895:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1786109556.505951:0:193895:0:(tgt_mount.c:101:server_register_mount()) register mount ffff930ab29d1000 from lustre-MDT0000 10000000:01000000:0.0:1786109556.505986:0:193895:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1786109556.505989:0:193895:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1786109556.505997:0:193895:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff930ab29d1000 10000000:01000000:0.0:1786109556.506000:0:193895:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1786109556.506006:0:193895:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff930ab29d1000 10000000:01000000:0.0:1786109556.506009:0:193895:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1786109556.506012:0:193895:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff930ab29d1000 from 1 10000000:01000000:0.0:1786109556.506014:0:193895:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1786109556.506119:0:193895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.506129:0:193895:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.506140:0:193895:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109556.506159:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933260416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109556.506198:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.506277:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff930986044b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109556.506313:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933260416 00000100:00100000:2.0:1786109556.506319:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933260416 00000100:00100000:2.0:1786109556.506403:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786109556.506413:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+5:193895:x1872862933260416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109556.506425:0:193903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109556.506506:0:193903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd77800/0xdb52b77d7ca36cb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36cb2 expref: -99 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.506529:0:193903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd77800/0xdb52b77d7ca36cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36cb2 expref: 6 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.506540:0:193903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd77800/0xdb52b77d7ca36cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36cb2 expref: 6 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.506548:0:193903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77800, rc 0) 00000100:00100000:2.0:1786109556.506585:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+6:193895:x1872862933260416:12345-0@lo:101:mount.lustre.0 Request processed in 173us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109556.506592:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786109556.506703:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933260416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109556.506717:0:193895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.506726:0:193895:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109556.506740:0:193895:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1786109556.506762:0:193895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.506769:0:193895:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109556.506780:0:193895:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1786109556.506784:0:193895:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786109556.506788:0:193895:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff930ab29d1000 10000000:01000000:0.0:1786109556.506791:0:193895:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1786109556.506794:0:193895:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1786109556.506796:0:193895:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786109556.506810:0:193895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.506829:0:193895:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.506836:0:193895:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109556.506848:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933260544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109556.506875:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.507080:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff930986044b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109556.507190:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933260544 00000100:00100000:1.0:1786109556.507195:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933260544 00000100:00100000:2.0:1786109556.507272:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786109556.507280:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+6:193895:x1872862933260544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109556.507288:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109556.507297:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd76800/0xdb52b77d7ca36cc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36cc0 expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.507311:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd76800/0xdb52b77d7ca36cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36cc0 expref: 7 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.507320:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd76800/0xdb52b77d7ca36cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36cc0 expref: 7 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.507328:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76800, rc 0) 00000100:00100000:2.0:1786109556.507401:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:193895:x1872862933260544:12345-0@lo:101:mount.lustre.0 Request processed in 120us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109556.507407:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786109556.507577:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933260544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109556.507589:0:193895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.507597:0:193895:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109556.507648:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933260672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109556.507673:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.507734:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff930986044b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109556.507767:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933260672 00000100:00100000:2.0:1786109556.507771:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933260672 00000100:00100000:2.0:1786109556.507839:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786109556.507847:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:193895:x1872862933260672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109556.508022:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:193895:x1872862933260672:12345-0@lo:501:mount.lustre.0 Request processed in 175us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109556.508030:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786109556.508134:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933260672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109556.508164:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933260800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109556.508209:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.508300:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984b8dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.508386:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933260800 00000100:00100000:0.0:1786109556.508390:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933260800 00000100:00100000:0.0:1786109556.508414:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786109556.508420:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:193895:x1872862933260800:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109556.509101:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:193895:x1872862933260800:12345-0@lo:503:mount.lustre.0 Request processed in 679us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.509109:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786109556.509243:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933260800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109556.509621:0:193908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193908:1872862933260928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109556.509663:0:193908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.509703:0:193908:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984b8d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.509747:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933260928 00000100:00100000:0.0:1786109556.509753:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933260928 00000100:00100000:0.0:1786109556.509776:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786109556.509783:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:193908:x1872862933260928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109556.510322:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:193908:x1872862933260928:12345-0@lo:502:llog_process_th.0 Request processed in 538us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.510329:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786109556.510411:0:193908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193908:1872862933260928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786109556.510470:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109556.510482:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.510484:0:193908:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1786109556.510487:0:193908:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1786109556.510490:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109556.510502:0:193908:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff930ab99d0000) 00000020:00000080:3.0:1786109556.510520:0:193908:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1786109556.510525:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1786109556.510599:0:193908:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1786109556.510608:0:193908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36cd5 00000020:00000080:3.0:1786109556.510809:0:193908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1786109556.510826:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109556.510830:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.510832:0:193908:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1786109556.510835:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109556.510838:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.510840:0:193908:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1786109556.510843:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109556.510849:0:193908:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff930ab99d3380) 00000020:00000080:3.0:1786109556.510862:0:193908:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1786109556.510866:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1786109556.510868:0:193908:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1786109556.510871:0:193908:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1786109556.510877:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1786109556.510923:0:193908:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930ab29d1000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1786109556.510935:0:193908:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff930984ea99c0) 00000020:00000080:3.0:1786109556.510943:0:193908:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1786109556.510991:0:193908:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1786109556.510995:0:193908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca36cea 00000020:00000080:3.0:1786109556.511093:0:193908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1786109556.511099:0:193908:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1786109556.511103:0:193908:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdb52b77d7ca36cf1 00080000:01000000:3.0:1786109556.511107:0:193908:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1786109556.511111:0:193908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36cf8 00010000:00010000:3.0:1786109556.561967:0:193908:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00080000:3.0:1786109556.562593:0:193908:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 326417514497 srv lr: 335007449091 lx: 0 gen 23 00000001:00000004:3.0:1786109556.562637:0:193908:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 79, last_transno is 335007449091 00000001:00080000:3.0:1786109556.562921:0:193908:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1786109556.562976:0:193908:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930984b8d000: xid 1872862932692352, transno 326417514497, client gen 23, slot idx 0 00000001:00080000:3.0:1786109556.562988:0:193908:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff93098c74af00: xid 1872862932692096, transno 322122568361, client gen 23, slot idx 4 00000001:00080000:3.0:1786109556.562993:0:193908:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff93098c74a3c0: xid 1872862932691584, transno 322122568360, client gen 23, slot idx 5 00000020:00000080:3.0:1786109556.563524:0:193908:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff930984eacd40) 00000020:00000080:3.0:1786109556.563542:0:193908:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1786109556.563610:0:193908:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1786109556.563616:0:193908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36d0d 00000020:00000080:0.0:1786109556.564060:0:193908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1786109556.567565:0:193908:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdb52b77d7ca36d14 00000020:00000080:3.0:1786109556.570633:0:193908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1786109556.570646:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109556.570653:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.570655:0:193908:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1786109556.570659:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1786109556.570661:0:193908:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1786109556.570663:0:193908:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109556.570664:0:193908:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109556.570666:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1786109556.570668:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.570670:0:193908:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1786109556.570672:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109556.570676:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.570677:0:193908:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1786109556.570682:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1786109556.570729:0:193908:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1786109556.570745:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109556.570748:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.570750:0:193908:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1786109556.570752:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109556.570755:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.570757:0:193908:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1786109556.570760:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1786109556.570765:0:193908:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:3.0:1786109556.570786:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109556.570801:0:193908:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff930984ea8000) 00000020:00000080:3.0:1786109556.570973:0:193908:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1786109556.570982:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1786109556.571052:0:193908:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1786109556.571059:0:193908:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:3.0:1786109556.571065:0:193908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36d22 00010000:00080000:3.0:1786109556.571095:0:193908:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930981dba800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1786109556.575211:0:193908:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-7 is initialized 00000020:00000080:3.0:1786109556.576629:0:193908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109556.576641:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1786109556.576677:0:193908:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1786109556.576697:0:193908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca36d29 00000100:00080000:3.0:1786109556.576707:0:193908:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786109556.576713:0:193908:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930981dba800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109556.576747:0:193908:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89099880 x1872862933261056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109556.576773:0:193908:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1786109556.576836:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109556.576840:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.576842:0:193908:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1786109556.576845:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1786109556.576848:0:193908:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1786109556.576849:0:193908:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109556.576851:0:193908:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109556.576852:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1786109556.576855:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.576856:0:193908:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1786109556.576859:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786109556.576864:0:193908:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1786109556.576867:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.576869:0:193908:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1786109556.576872:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1786109556.576875:0:193908:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1786109556.576897:0:193908:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1786109556.576900:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109556.576912:0:193908:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9309827299c0) 00000020:00000080:3.0:1786109556.576926:0:193908:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1786109556.576930:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1786109556.576989:0:193908:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1786109556.576994:0:193908:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:3.0:1786109556.576999:0:193908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36d37 00010000:00080000:3.0:1786109556.577026:0:193908:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930ab7c42000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1786109556.577289:0:193908:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1786109556.577656:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933261056:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786109556.577720:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.577793:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933261056 00000100:00100000:0.0:1786109556.577801:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933261056 00000100:00100000:0.0:1786109556.577845:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12341 00000100:00100000:0.0:1786109556.577852:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933261056:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1786109556.577875:0:8451:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8413 last 0 00000020:00000080:0.0:1786109556.577906:0:8451:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca36d3e 00000004:00100000:0.0:1786109556.577920:0:8451:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109556.578008:0:8451:0:(import.c:65:import_set_state_nolock()) ffff93098e160000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109556.578072:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933261056:12345-0@lo:38:llog_process_th.0 Request processed in 218us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.578079:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12341 00000100:00100000:0.0:1786109556.578119:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786109556.578127:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 6 00000100:00080000:0.0:1786109556.578134:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1786109556.578139:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1786109556.578141:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981dba800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786109556.578147:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933261056:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1786109556.578543:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109556.578553:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933261184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109556.578586:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109556.578635:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933261184 00000100:00100000:1.0:1786109556.578640:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933261184 00000100:00100000:1.0:1786109556.578671:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12342 00000100:00100000:1.0:1786109556.578678:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933261184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109556.578700:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446109184 avail 1299869696 00000100:00100000:1.0:1786109556.578735:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933261184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109556.578741:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12342 00000100:00100000:1.0:1786109556.578785:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933261184:0@lo:41:osp-pre-1-0.0 00000040:01000000:3.0:1786109556.579138:0:193908:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1786109556.579467:0:193908:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1786109556.581958:0:193908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109556.582165:0:193908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].79, 64 off13248 00000040:00080000:3.0:1786109556.582302:0:193908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13c:0x0].1, 64 off8256 00000040:00080000:3.0:1786109556.583119:0:193914:0:(llog.c:805:llog_process_thread()) index: 79, lh_last_idx: 79 synced_idx: 79 lgh_last_idx: 79 00000040:00080000:3.0:1786109556.583124:0:193914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13c:0x0] at index 79 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1786109556.583790:0:193908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109556.583801:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1786109556.583849:0:193908:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1786109556.583870:0:193908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca36d45 00000100:00080000:3.0:1786109556.583880:0:193908:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786109556.583886:0:193908:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff930ab7c42000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109556.583916:0:193908:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89099880 x1872862933261312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109556.583966:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933261312:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1786109556.584027:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109556.584121:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933261312 00000100:00100000:2.0:1786109556.584127:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933261312 00000100:00100000:2.0:1786109556.584162:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23099 00000100:00100000:2.0:1786109556.584170:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3645:x1872862933261312:12345-0@lo:8:llog_process_th.0 00010000:00020000:2.0:1786109556.584188:0:43920:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1786109556.584276:0:193908:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1786109556.584338:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109556.584342:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.584344:0:193908:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1786109556.584347:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1786109556.584349:0:193908:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1786109556.584351:0:193908:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109556.584353:0:193908:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109556.584354:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1786109556.584357:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.584358:0:193908:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1786109556.584361:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786109556.584365:0:193908:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1786109556.584368:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.584369:0:193908:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1786109556.584371:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1786109556.584375:0:193908:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1786109556.584394:0:193908:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1786109556.584397:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109556.584408:0:193908:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93098272b380) 00000020:00000080:3.0:1786109556.584421:0:193908:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type osp with refcount 2 00000020:00000080:3.0:1786109556.584426:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1786109556.584505:0:193908:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1786109556.584511:0:193908:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:3.0:1786109556.584517:0:193908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca36d53 00010000:00080000:3.0:1786109556.584543:0:193908:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930a8a47c800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1786109556.584727:0:193908:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-9 is initialized 00000040:01000000:3.0:1786109556.584784:0:193908:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1786109556.584798:0:193908:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1786109556.586354:0:193908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109556.586615:0:193908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].79, 64 off13248 00000040:00080000:3.0:1786109556.586737:0:193908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13e:0x0].1, 64 off8256 00000100:00100000:2.0:1786109556.587186:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3645:x1872862933261312:12345-0@lo:8:llog_process_th.0 Request processed in 3010us (3153us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109556.587197:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23099 00000100:00080000:0.0:1786109556.587340:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109556.587346:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109556.587350:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933261312:0@lo:8:llog_process_th.0 00000040:00080000:2.0:1786109556.587985:0:193916:0:(llog.c:805:llog_process_thread()) index: 79, lh_last_idx: 79 synced_idx: 79 lgh_last_idx: 79 00000040:00080000:2.0:1786109556.587991:0:193916:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13e:0x0] at index 79 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1786109556.589007:0:193908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109556.589019:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1786109556.589115:0:193908:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1786109556.589138:0:193908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca36d5a 00000100:00080000:3.0:1786109556.589147:0:193908:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786109556.589152:0:193908:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff930a8a47c800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109556.589188:0:193908:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89098000 x1872862933261440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109556.589238:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933261440:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1786109556.589304:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786109556.589369:0:193908:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1786109556.589451:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109556.589456:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.589458:0:193908:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1786109556.589461:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109556.589465:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.589467:0:193908:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1786109556.589470:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1786109556.589472:0:193908:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1786109556.589474:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109556.589476:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.589477:0:193908:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1786109556.589479:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109556.589482:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.589483:0:193908:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1786109556.589486:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1786109556.589514:0:193908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193908:1872862933261568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109556.589559:0:193908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.589693:0:193908:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8b512240 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.589760:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933261440 00000100:00100000:0.0:1786109556.589766:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933261440 00000100:00100000:0.0:1786109556.589806:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23100 00000100:00100000:0.0:1786109556.589832:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3645:x1872862933261440:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1786109556.589856:0:43919:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8413 last 0 00000020:00000080:0.0:1786109556.589882:0:43919:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca36d61 00002000:00100000:0.0:1786109556.589897:0:43919:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff930ab9965800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1786109556.589901:0:43919:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1786109556.589905:0:43919:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1786109556.589976:0:43919:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786109556.590006:0:43919:0:(import.c:65:import_set_state_nolock()) ffff930ab9961000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109556.590169:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933261440:12345-0@lo:8:llog_process_th.0 Request processed in 354us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.590177:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23100 00000100:00100000:0.0:1786109556.590210:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786109556.590217:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1786109556.590224:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1786109556.590229:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1786109556.590231:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1786109556.590248:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1786109556.590253:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933261440:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1786109556.590327:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:1.0:1786109556.590384:0:193916:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1786109556.590470:0:193916:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8413257038841ns, next at 0ns, rc = 0 00080000:00080000:1.0:1786109556.590477:0:193916:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1786109556.592307:0:193896:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1786109556.592472:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933261568 00000100:00100000:2.0:1786109556.592482:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933261568 00000100:00100000:2.0:1786109556.592526:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786109556.592535:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:193908:x1872862933261568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786109556.592693:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:193908:x1872862933261568:12345-0@lo:502:llog_process_th.0 Request processed in 158us (3132us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109556.592701:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786109556.593083:0:193908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193908:1872862933261568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786109556.593117:0:193908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109556.593126:0:193908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109556.593129:0:193908:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1786109556.593133:0:193908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1786109556.593465:0:193895:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1786109556.593494:0:193895:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786109556.593508:0:193895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.593519:0:193895:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109556.593527:0:193895:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930ab29d1000 from 1 10000000:01000000:0.0:1786109556.593529:0:193895:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786109556.593560:0:193895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.593567:0:193895:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.593580:0:193895:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109556.593600:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933261824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109556.593640:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.593680:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a88ff2780 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.593698:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933261824 00000100:00100000:0.0:1786109556.593702:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933261824 00000100:00100000:0.0:1786109556.593738:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786109556.593745:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:193895:x1872862933261824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109556.593754:0:193901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109556.593765:0:193901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36d68 expref: -99 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.593784:0:193901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36d68 expref: 9 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.593793:0:193901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36d68 expref: 9 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.593801:0:193901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d400, rc 0) 00000100:00100000:0.0:1786109556.593845:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:193895:x1872862933261824:12345-0@lo:101:mount.lustre.0 Request processed in 101us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.593851:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786109556.593885:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933261824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109556.593897:0:193895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36d6f expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.593906:0:193895:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36d6f expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109556.594481:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933261952:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1786109556.594517:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.594545:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a88ff2780 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.594563:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933261952 00000100:00100000:0.0:1786109556.594566:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933261952 00000100:00100000:0.0:1786109556.594589:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786109556.594595:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:193895:x1872862933261952:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1786109556.594607:0:193902:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1786109556.594624:0:193902:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1786109556.594628:0:193902:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1786109556.594631:0:193902:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 327 00000100:00100000:0.0:1786109556.594702:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:193895:x1872862933261952:12345-0@lo:256:mount.lustre.0 Request processed in 106us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.594708:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786109556.594767:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933261952:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1786109556.595418:0:193895:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786109556.595427:0:193895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36d6f expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.595461:0:193895:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36d6f expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109556.595469:0:193895:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930ab29d1000 from 1 10000000:01000000:0.0:1786109556.595473:0:193895:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786109556.595495:0:193895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.595504:0:193895:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.595513:0:193895:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109556.595526:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933262080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109556.595555:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.595584:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a88ff2780 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.595601:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933262080 00000100:00100000:0.0:1786109556.595604:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933262080 00000100:00100000:0.0:1786109556.595629:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786109556.595635:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:193895:x1872862933262080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109556.595643:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109556.595655:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0b2dc00/0xdb52b77d7ca36d7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36d76 expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.595673:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2dc00/0xdb52b77d7ca36d7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36d76 expref: 10 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.595683:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0b2dc00/0xdb52b77d7ca36d7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36d76 expref: 10 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.595691:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2dc00, rc 0) 00000100:00100000:0.0:1786109556.595720:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:193895:x1872862933262080:12345-0@lo:101:mount.lustre.0 Request processed in 85us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.595731:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786109556.595766:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933262080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109556.595777:0:193895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.595786:0:193895:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109556.596551:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933261696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109556.596596:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.596645:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933261696 00000100:00100000:3.0:1786109556.596651:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933261696 00000100:00100000:3.0:1786109556.596704:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5824 00000100:00100000:3.0:1786109556.596712:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933261696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109556.596729:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109556.596767:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933261696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109556.596773:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5824 00000100:00100000:3.0:1786109556.596809:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933261696:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1786109556.596880:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109556.597142:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933262208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109556.597176:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.597249:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab2e9b480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109556.597311:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933262208 00000100:00100000:2.0:1786109556.597315:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933262208 00000100:00100000:2.0:1786109556.597391:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786109556.597400:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:193895:x1872862933262208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109556.597574:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:193895:x1872862933262208:12345-0@lo:501:mount.lustre.0 Request processed in 175us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109556.597581:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786109556.597697:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933262208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109556.597733:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933262336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109556.597782:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109556.597921:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098e3496c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.597951:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933262336 00000100:00100000:0.0:1786109556.597955:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933262336 00000100:00100000:0.0:1786109556.597978:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786109556.597986:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:193895:x1872862933262336:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109556.598119:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:193895:x1872862933262336:12345-0@lo:503:mount.lustre.0 Request processed in 133us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.598127:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786109556.598250:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933262336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109556.598754:0:193918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193918:1872862933262464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109556.598795:0:193918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.598865:0:193918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a88ff2780 going to sleep for 11 seconds 00000100:00100000:2.0:1786109556.598900:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933262464 00000100:00100000:2.0:1786109556.598905:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933262464 00000100:00100000:2.0:1786109556.598972:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786109556.598980:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:193918:x1872862933262464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786109556.599834:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:193918:x1872862933262464:12345-0@lo:502:llog_process_th.0 Request processed in 852us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109556.599843:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786109556.599925:0:193918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193918:1872862933262464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786109556.599956:0:193918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109556.599965:0:193918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.599967:0:193918:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1786109556.599973:0:193918:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff930ab29d1000 00000020:00000080:3.0:1786109556.599976:0:193918:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1786109556.599984:0:193918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109556.599986:0:193918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.599987:0:193918:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1786109556.599990:0:193918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109556.599992:0:193918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.599993:0:193918:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1786109556.599996:0:193918:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff930ab29d1000 00000020:00000080:3.0:1786109556.599998:0:193918:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1786109556.600085:0:193918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193918:1872862933262592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109556.600126:0:193918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.601934:0:193918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8b512240 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.604888:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933262592 00000100:00100000:0.0:1786109556.604901:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933262592 00000100:00100000:0.0:1786109556.604953:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786109556.604963:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:193918:x1872862933262592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109556.605142:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:193918:x1872862933262592:12345-0@lo:502:llog_process_th.0 Request processed in 180us (5015us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.605243:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786109556.605394:0:193918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193918:1872862933262592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786109556.605458:0:193918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109556.605466:0:193918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109556.605469:0:193918:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1786109556.605473:0:193918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1786109556.605629:0:193895:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1786109556.605651:0:193895:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786109556.605673:0:193895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.605684:0:193895:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109556.605732:0:193895:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1786109556.605736:0:193895:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff930ab29d1000 10000000:01000000:0.0:1786109556.605738:0:193895:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff930ab29d1000 10000000:01000000:0.0:1786109556.605742:0:193895:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786109556.605747:0:193895:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930ab29d1000 from 1 10000000:01000000:0.0:1786109556.605749:0:193895:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786109556.605775:0:193895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.605781:0:193895:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.605789:0:193895:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109556.605807:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933262720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109556.605857:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.605893:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a905c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.605907:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933262720 00000100:00100000:0.0:1786109556.605911:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933262720 00000100:00100000:0.0:1786109556.605931:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786109556.605937:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:193895:x1872862933262720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109556.605945:0:193901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109556.605956:0:193901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0b2d800/0xdb52b77d7ca36d8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36d84 expref: -99 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.605977:0:193901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2d800/0xdb52b77d7ca36d8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36d84 expref: 11 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.605987:0:193901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0b2d800/0xdb52b77d7ca36d8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36d84 expref: 11 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.605994:0:193901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d800, rc 0) 00000100:00100000:0.0:1786109556.606022:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193895:x1872862933262720:12345-0@lo:101:mount.lustre.0 Request processed in 85us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.606028:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786109556.606131:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933262720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109556.606144:0:193895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.606211:0:193895:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109556.606260:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933262848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109556.606286:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.606299:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a905c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.606312:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933262848 00000100:00100000:0.0:1786109556.606315:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933262848 00000100:00100000:0.0:1786109556.606332:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786109556.606337:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193895:x1872862933262848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109556.606457:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193895:x1872862933262848:12345-0@lo:501:mount.lustre.0 Request processed in 119us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.606463:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786109556.606490:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933262848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109556.606513:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933262976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109556.606547:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.606559:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a905c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.606570:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933262976 00000100:00100000:0.0:1786109556.606573:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933262976 00000100:00100000:0.0:1786109556.606588:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786109556.606593:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193895:x1872862933262976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109556.606660:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193895:x1872862933262976:12345-0@lo:503:mount.lustre.0 Request processed in 66us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.606666:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786109556.606700:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933262976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109556.606896:0:193921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193921:1872862933263104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109556.606925:0:193921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.606942:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933263104 00000100:00100000:0.0:1786109556.606945:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933263104 00000100:00100000:0.0:1786109556.606961:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786109556.606967:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193921:x1872862933263104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109556.607491:0:193921:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977000 going to sleep for 11 seconds 00000100:00100000:3.0:1786109556.607507:0:193921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193921:1872862933263104:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1786109556.607560:0:193921:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1786109556.607574:0:193921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff930982728000) 00000020:00000080:3.0:1786109556.607595:0:193921:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1786109556.607754:0:193921:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930ab29d1000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786109556.607759:0:193921:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930ab29d1000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786109556.607761:0:193921:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab29d1000 4 00010000:00080000:3.0:1786109556.607786:0:193921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930985f23800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.138@tcp at head 00000100:00100000:0.0:1786109556.609145:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193921:x1872862933263104:12345-0@lo:502:llog_process_th.0 Request processed in 2171us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.610142:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1786109556.613156:0:193921:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-10 is initialized 00000020:00000080:3.0:1786109556.613257:0:193921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1786109556.613299:0:193921:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786109556.613309:0:193921:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdb52b77d7ca36d99 00000100:00080000:3.0:1786109556.613319:0:193921:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786109556.613325:0:193921:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff930985f23800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109556.613356:0:193921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89099500 x1872862933263232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109556.613376:0:193921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1786109556.613892:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933263232:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786109556.613959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.614158:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933263232 00000100:00100000:3.0:1786109556.614166:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933263232 00000100:00100000:3.0:1786109556.614202:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1786109556.614210:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933263232:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1786109556.614269:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933263232:12345-0@lo:38:llog_process_th.0 Request processed in 57us (308us total) trans 0 rc -11/-11 00000100:00100000:3.0:1786109556.614277:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1786109556.614456:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786109556.614464:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109556.614469:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1786109556.614473:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933263232:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1786109556.614768:0:193921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193921:1872862933263360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109556.614827:0:193921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.614862:0:193921:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.616267:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933263360 00000100:00100000:0.0:1786109556.616278:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933263360 00000100:00100000:0.0:1786109556.616324:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786109556.616333:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193921:x1872862933263360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109556.616515:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193921:x1872862933263360:12345-0@lo:502:llog_process_th.0 Request processed in 181us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.616523:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786109556.618973:0:193921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193921:1872862933263360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109556.619186:0:193921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193921:1872862933263488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109556.619257:0:193921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.619307:0:193921:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.619630:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933263488 00000100:00100000:0.0:1786109556.619637:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933263488 00000100:00100000:0.0:1786109556.619670:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786109556.619679:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193921:x1872862933263488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109556.619800:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193921:x1872862933263488:12345-0@lo:502:llog_process_th.0 Request processed in 122us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.619807:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786109556.620157:0:193921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193921:1872862933263488:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786109556.620184:0:193921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1786109556.620342:0:193895:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1786109556.620366:0:193895:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786109556.620387:0:193895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.620399:0:193895:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1786109556.620473:0:193895:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1786109556.620476:0:193895:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786109556.620477:0:193895:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109556.620478:0:193895:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109556.620480:0:193895:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109556.620481:0:193895:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109556.620483:0:193895:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786109556.620484:0:193895:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786109556.620486:0:193895:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109556.620487:0:193895:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786109556.620491:0:193895:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1786109556.620493:0:193895:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786109556.620494:0:193895:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786109556.620496:0:193895:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109556.620497:0:193895:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109556.620498:0:193895:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109556.620499:0:193895:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109556.620500:0:193895:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786109556.620501:0:193895:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786109556.620503:0:193895:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109556.620504:0:193895:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786109556.620521:0:193895:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1786109556.620533:0:193895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933263616:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1786109556.620572:0:193895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109556.620589:0:193895:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.620605:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933263616 00000100:00100000:0.0:1786109556.620609:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933263616 00000100:00100000:0.0:1786109556.620632:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786109556.620639:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193895:x1872862933263616:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786109556.620661:0:193902:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1786109556.620674:0:193902:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1786109556.623916:0:193902:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786109556.624026:0:193902:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1786109556.628475:0:193906:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1786109556.628483:0:193906:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1786109556.628508:0:193906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109556.628525:0:193906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36d68 expref: 11 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109556.628534:0:193906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109556.628574:0:193906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca36d68 expref: 11 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109556.628588:0:193906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36d6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb52b77d7ca36d68 expref: 11 pid: 193901 timeout: 8513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109556.628603:0:193906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193906:1872862933263744:0@lo:104: 00000100:00100000:3.0:1786109556.628664:0:193906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.628715:0:193906:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109556.628983:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933263744 00000100:00100000:2.0:1786109556.628991:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933263744 00000100:00100000:0.0:1786109556.629229:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:193895:x1872862933263616:12345-0@lo:253:mount.lustre.0 Request processed in 8588us (8654us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.629238:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786109556.629291:0:193895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:193895:1872862933263616:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786109556.629304:0:193895:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1786109556.629307:0:193895:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786109556.629309:0:193895:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786109556.629310:0:193895:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109556.629311:0:193895:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109556.629312:0:193895:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109556.629314:0:193895:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109556.629315:0:193895:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786109556.629316:0:193895:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786109556.629318:0:193895:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109556.629319:0:193895:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1786109556.629335:0:193895:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1786109556.630201:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5261 00000100:00100000:2.0:1786109556.630216:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:193906:x1872862933263744:12345-0@lo:104: 00010000:00010000:2.0:1786109556.630232:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca36d6f expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630313:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786109556.630319:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:193906:x1872862933263744:12345-0@lo:104: Request processed in 110us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109556.630325:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5261 00010000:00010000:2.0:1786109556.630351:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109556.630357:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca36d6f expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630365:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c200 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:2.0:1786109556.630369:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb52b77d7ca36d6f expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630377:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca36d6f expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109556.630385:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca36d6f expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109556.630391:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109556.630424:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36d6f expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630451:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786109556.630470:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36d6f expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630477:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36d68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36d6f expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630492:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109556.630493:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109556.630495:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109556.630513:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933263872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109556.630546:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109556.630609:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933263872 00000100:00100000:2.0:1786109556.630616:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933263872 00010000:00010000:2.0:1786109556.630636:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36d6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca36d68 expref: 11 pid: 193901 timeout: 8513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109556.630659:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12638 00000100:00100000:2.0:1786109556.630666:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:3646:x1872862933263872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109556.630676:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109556.630682:0:43921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36d6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca36d68 expref: 11 pid: 193901 timeout: 8513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630693:0:43921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36d6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb52b77d7ca36d68 expref: 11 pid: 193901 timeout: 8513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630711:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630719:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786109556.630734:0:43921:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002251709s 00010000:00010000:2.0:1786109556.630738:0:43921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630746:0:43921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630753:0:43921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630759:0:43921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630766:0:43921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109556.630770:0:43921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630778:0:43921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630787:0:43921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109556.630797:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109556.630838:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:3646:x1872862933263872:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109556.630844:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12638 00000100:00100000:2.0:1786109556.630880:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933263872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109556.632269:0:193906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2d400/0xdb52b77d7ca36d6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca36d68 expref: 10 pid: 193901 timeout: 8513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109556.632282:0:193906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193906:1872862933263744:0@lo:104: 00010000:00010000:0.0:1786109556.632304:0:193906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.632313:0:193906:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.632320:0:193906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109556.632327:0:193906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930aa628b200/0xdb52b77d7ca36da0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1786109556.639809:0:193895:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 322122568692 00000040:01000000:0.0:1786109556.640104:0:193895:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1786109556.640300:0:193926:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 322122568692 00000020:00080000:3.0:1786109556.640304:0:193926:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 322122568692 00000040:01000000:0.0:1786109556.640415:0:193927:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1786109556.645564:0:193895:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1786109556.647265:0:193927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1786109556.647344:0:193927:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1786109556.647805:0:193928:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193928:1872862933264000:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109556.647886:0:193928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109556.647923:0:193928:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098261cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.647973:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933264000 00000100:00100000:0.0:1786109556.647980:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933264000 00000100:00100000:0.0:1786109556.648024:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12343 00000100:00100000:0.0:1786109556.648045:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193928:x1872862933264000:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1786109556.648131:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193928:x1872862933264000:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 99us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.648139:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12343 00000100:00100000:2.0:1786109556.648259:0:193928:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193928:1872862933264000:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1786109556.648285:0:193928:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1786109556.648309:0:193928:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193928:1872862933264128:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109556.648336:0:193928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109556.648362:0:193928:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977780 going to sleep for 11 seconds 00000100:00100000:3.0:1786109556.648408:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933264128 00000100:00100000:3.0:1786109556.648413:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933264128 00000100:00100000:3.0:1786109556.648475:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12344 00000100:00100000:3.0:1786109556.648483:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193928:x1872862933264128:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1786109556.648588:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193928:x1872862933264128:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 106us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109556.648595:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12344 00000100:00100000:2.0:1786109556.648851:0:193928:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193928:1872862933264128:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109556.648904:0:193928:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193928:1872862933264256:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109556.648929:0:193928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109556.648948:0:193928:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977780 going to sleep for 11 seconds 00000100:00100000:0.0:1786109556.649013:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933264256 00000100:00100000:0.0:1786109556.649017:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933264256 00000100:00100000:0.0:1786109556.649110:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12345 00000100:00100000:0.0:1786109556.649119:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193928:x1872862933264256:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1786109556.649212:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193928:x1872862933264256:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 95us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109556.649219:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12345 00000040:01000000:1.0:1786109556.649703:0:193895:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1786109556.649741:0:193895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1786109556.650366:0:193895:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1786109556.650374:0:193895:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1786109556.650413:0:193895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786109556.651560:0:193928:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193928:1872862933264256:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1786109556.651845:0:193895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1786109556.652064:0:193928:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193928:1872862933264384:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1786109556.652151:0:193928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109556.652193:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933264384 00000100:00100000:3.0:1786109556.652199:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933264384 00000100:00100000:3.0:1786109556.652247:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12346 00000100:00100000:3.0:1786109556.652255:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193928:x1872862933264384:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1786109556.652683:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:193928:x1872862933264384:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 427us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109556.652691:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12346 00000100:00100000:3.0:1786109556.652713:0:193928:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06600 going to sleep for 11 seconds 00000100:00100000:3.0:1786109556.652729:0:193928:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:193928:1872862933264384:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1786109556.655355:0:193928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1786109556.655534:0:193928:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1786109556.655539:0:193928:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1786109556.656258:0:193895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1786109556.656298:0:193895:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1786109556.656410:0:193895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1786109556.657216:0:193895:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x82:0x0] (8/32) registered 00010000:00080000:3.0:1786109556.659394:0:193895:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-MDT0000, 1 recoverable clients, last_transno 335007449091 00010000:00080000:2.0:1786109556.660164:0:193929:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 193929 00010000:02000000:2.0:1786109556.660219:0:193929:0:(ldlm_lib.c:2336:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1786109556.660222:0:193929:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:2.0:1786109556.660226:0:193929:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00000020:01000004:3.0:1786109556.660336:0:193895:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1786109556.660352:0:193895:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1786109556.660371:0:193895:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1786109556.660384:0:193895:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1786109556.663974:0:193895:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1786109556.664203:0:193895:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1786109557.380674:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1786109558.212659:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1786109558.212667:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930ab29d1000 from 328 10000000:01000000:2.0:1786109558.212672:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1786109558.212717:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.212728:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.212738:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109558.212773:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933264512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.212852:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109558.212906:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977780 going to sleep for 11 seconds 00000100:00100000:0.0:1786109558.213086:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933264512 00000100:00100000:0.0:1786109558.213094:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933264512 00000100:00100000:0.0:1786109558.213154:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786109558.213164:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:6524:x1872862933264512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109558.213178:0:193903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109558.213193:0:193903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0b2de00/0xdb52b77d7ca36dae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36da7 expref: -99 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.213217:0:193903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2de00/0xdb52b77d7ca36dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36da7 expref: 11 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.213227:0:193903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0b2de00/0xdb52b77d7ca36dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36da7 expref: 11 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.213236:0:193903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2de00, rc 0) 00000100:00100000:0.0:1786109558.213274:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933264512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109558.213281:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786109558.213742:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933264512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109558.213835:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36dae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.213846:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36dae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109558.213911:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933264640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.213947:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109558.213986:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977780 going to sleep for 11 seconds 00000100:00100000:0.0:1786109558.214045:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933264640 00000100:00100000:0.0:1786109558.214050:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933264640 00000100:00100000:0.0:1786109558.214085:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786109558.214093:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933264640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786109558.214106:0:193902:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786109558.214122:0:193902:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786109558.214125:0:193902:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 328 00000100:00100000:0.0:1786109558.214198:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933264640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109558.214205:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786109558.214509:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933264640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1786109558.214568:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786109558.214575:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36dae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.214708:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36dae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109558.214717:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786109558.214720:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930a92e3e800 from 52 10000000:01000000:2.0:1786109558.214723:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786109558.214744:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd76600/0xdb52b77d7ca36db5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.214751:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff93098cd76600/0xdb52b77d7ca36db5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.214769:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff93098cd76600/0xdb52b77d7ca36db5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109558.214782:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933264768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.214821:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109558.215062:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977780 going to sleep for 11 seconds 00000100:00100000:0.0:1786109558.215102:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933264768 00000100:00100000:0.0:1786109558.215108:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933264768 00000100:00100000:0.0:1786109558.215178:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786109558.215187:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933264768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109558.215198:0:193901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109558.215215:0:193901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0b2ca00/0xdb52b77d7ca36dbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36db5 expref: -99 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.215234:0:193901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2ca00/0xdb52b77d7ca36dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36db5 expref: 12 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.215243:0:193901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0b2ca00/0xdb52b77d7ca36dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36db5 expref: 12 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.215251:0:193901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2ca00, rc 0) 00000100:00100000:0.0:1786109558.215282:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933264768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109558.215288:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786109558.215310:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933264768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109558.215322:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff93098cd76600/0xdb52b77d7ca36db5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36dbc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.215330:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff93098cd76600/0xdb52b77d7ca36db5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36dbc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109558.215379:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933264896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.215403:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109558.215452:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977780 going to sleep for 11 seconds 00000100:00100000:3.0:1786109558.215473:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933264896 00000100:00100000:3.0:1786109558.215477:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933264896 00000100:00100000:3.0:1786109558.215504:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786109558.215511:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933264896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109558.215887:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933264896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109558.215894:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786109558.215928:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933264896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.215955:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.215993:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109558.216199:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933265024 00000100:00100000:2.0:1786109558.216203:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977780 going to sleep for 11 seconds 00000100:00100000:1.0:1786109558.216203:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933265024 00000100:00100000:1.0:1786109558.216226:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786109558.216233:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933265024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109558.216322:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933265024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109558.216329:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786109558.216884:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786109558.218261:0:194006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1786109558.218728:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1786109558.218751:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786109558.218773:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd76600/0xdb52b77d7ca36db5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36dbc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.218784:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff93098cd76600/0xdb52b77d7ca36db5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36dbc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109558.218793:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1786109558.218796:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930a92e3e800 from 326 10000000:01000000:0.0:1786109558.218798:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786109558.218905:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.218918:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.218933:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109558.218955:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109558.219009:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109558.219166:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.219200:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933265152 00000100:00100000:2.0:1786109558.219207:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933265152 00000100:00100000:2.0:1786109558.219286:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786109558.219295:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933265152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109558.219308:0:193903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109558.219320:0:193903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd77200/0xdb52b77d7ca36dca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36dc3 expref: -99 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.219343:0:193903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd77200/0xdb52b77d7ca36dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36dc3 expref: 13 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.219352:0:193903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd77200/0xdb52b77d7ca36dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36dc3 expref: 13 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.219360:0:193903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77200, rc 0) 00000100:00100000:2.0:1786109558.219400:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933265152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.219406:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786109558.219515:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109558.219528:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36dca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.219604:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36dca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109558.219655:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.219686:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109558.219701:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac09779c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.219713:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933265280 00000100:00100000:2.0:1786109558.219717:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933265280 00000100:00100000:2.0:1786109558.219895:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786109558.219903:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933265280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1786109558.219917:0:193901:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1786109558.219932:0:193901:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786109558.219936:0:193901:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1786109558.219939:0:193901:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1786109558.219941:0:193901:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 328 00000100:00100000:2.0:1786109558.220276:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933265280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 372us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.220284:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786109558.220342:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1786109558.220406:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786109558.220413:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36dca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.220420:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36dca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109558.220427:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1786109558.220535:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1786109558.220611:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1786109558.220632:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d000/0xdb52b77d7ca36dd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.220639:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d000/0xdb52b77d7ca36dd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.220647:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d000/0xdb52b77d7ca36dd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109558.220661:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109558.220690:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109558.220718:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.220947:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933265408 00000100:00100000:2.0:1786109558.220953:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933265408 00000100:00100000:2.0:1786109558.221016:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786109558.221025:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933265408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109558.221034:0:193903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109558.221044:0:193903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca36dd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36dd1 expref: -99 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.221063:0:193903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca36dd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36dd1 expref: 14 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.221071:0:193903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca36dd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36dd1 expref: 14 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.221078:0:193903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77000, rc 0) 00000100:00100000:2.0:1786109558.221109:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933265408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.221115:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786109558.221186:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109558.221198:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d000/0xdb52b77d7ca36dd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36dd8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.221206:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d000/0xdb52b77d7ca36dd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36dd8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109558.221255:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.221280:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109558.221912:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109558.221950:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933265536 00000100:00100000:1.0:1786109558.221955:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933265536 00000100:00100000:1.0:1786109558.222026:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786109558.222034:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933265536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109558.222210:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933265536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109558.222217:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786109558.222290:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.222325:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.222362:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109558.222391:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109558.222458:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933265664 00000100:00100000:0.0:1786109558.222462:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933265664 00000100:00100000:0.0:1786109558.222491:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786109558.222498:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933265664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109558.224378:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933265664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1874us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109558.224391:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1786109558.224529:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786109558.225585:0:194008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1786109558.225933:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1786109558.225954:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1786109558.225965:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d000/0xdb52b77d7ca36dd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36dd8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.225976:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d000/0xdb52b77d7ca36dd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36dd8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109558.225986:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1786109558.225988:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff930a92e3e800 from 1 10000000:01000000:0.0:1786109558.225991:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1786109558.226038:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c000/0xdb52b77d7ca36ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.226046:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c000/0xdb52b77d7ca36ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.226056:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c000/0xdb52b77d7ca36ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109558.226079:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109558.226131:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109558.226178:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.226278:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933265792 00000100:00100000:2.0:1786109558.226285:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933265792 00000100:00100000:2.0:1786109558.226330:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786109558.226339:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac12d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933265792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109558.226352:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109558.226364:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd77400/0xdb52b77d7ca36de6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36ddf expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.226385:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd77400/0xdb52b77d7ca36de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36ddf expref: 15 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.226394:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd77400/0xdb52b77d7ca36de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36ddf expref: 15 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.226402:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77400, rc 0) 00000100:00100000:2.0:1786109558.226461:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac12d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933265792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.226468:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786109558.226508:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109558.226520:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c000/0xdb52b77d7ca36ddf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36de6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.226529:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c000/0xdb52b77d7ca36ddf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36de6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109558.227650:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1786109558.227659:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c000/0xdb52b77d7ca36ddf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36de6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.227668:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c000/0xdb52b77d7ca36ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36de6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109558.227675:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786109558.227678:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930a92e3e800 from 7 10000000:01000000:2.0:1786109558.227680:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786109558.227702:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd77c00/0xdb52b77d7ca36ded lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.227709:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff93098cd77c00/0xdb52b77d7ca36ded lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.227719:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff93098cd77c00/0xdb52b77d7ca36ded lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109558.227737:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.227791:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109558.227835:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109558.227956:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933265920 00000100:00100000:0.0:1786109558.227962:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933265920 00000100:00100000:0.0:1786109558.228000:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786109558.228008:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac12db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933265920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109558.228017:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109558.228094:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0b2da00/0xdb52b77d7ca36df4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36ded expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.228114:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2da00/0xdb52b77d7ca36df4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36ded expref: 16 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.228123:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0b2da00/0xdb52b77d7ca36df4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36ded expref: 16 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.228130:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2da00, rc 0) 00000100:00100000:0.0:1786109558.228167:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac12db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933265920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109558.228174:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786109558.228287:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933265920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109558.228298:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff93098cd77c00/0xdb52b77d7ca36ded lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36df4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109558.228306:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff93098cd77c00/0xdb52b77d7ca36ded lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36df4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109558.228354:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109558.228378:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109558.228399:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.228462:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933266048 00000100:00100000:2.0:1786109558.228466:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933266048 00000100:00100000:2.0:1786109558.228494:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1786109558.228500:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac12d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933266048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.228606:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac12d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933266048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.228613:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786109558.228743:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109558.228849:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109558.228891:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109558.228912:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109558.229119:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933266176 00000100:00100000:0.0:1786109558.229124:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933266176 00000100:00100000:0.0:1786109558.229155:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786109558.229163:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac12da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933266176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109558.229244:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac12da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933266176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109558.229250:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786109558.229363:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109558.233682:0:194009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1786109558.233974:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1786109558.233996:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786109558.234008:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd77c00/0xdb52b77d7ca36ded lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36df4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.234020:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff93098cd77c00/0xdb52b77d7ca36ded lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36df4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109558.234043:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786109558.234046:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930aa6612000 from 52 10000000:01000000:2.0:1786109558.234049:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786109558.234089:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca36dfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.234098:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca36dfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.234108:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca36dfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109558.234133:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.234197:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109558.234257:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a7240 going to sleep for 11 seconds 00000100:00100000:0.0:1786109558.234369:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933266304 00000100:00100000:0.0:1786109558.234376:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933266304 00000100:00100000:0.0:1786109558.234426:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786109558.234459:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac12db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933266304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109558.234472:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109558.234485:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac0b2d600/0xdb52b77d7ca36e02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36dfb expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.234507:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac0b2d600/0xdb52b77d7ca36e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36dfb expref: 17 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.234517:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac0b2d600/0xdb52b77d7ca36e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36dfb expref: 17 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.234526:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac0b2d600, rc 0) 00000100:00100000:0.0:1786109558.234638:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac12db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933266304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109558.234645:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1786109558.234883:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109558.234898:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca36dfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e02 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.234908:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca36dfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36e02 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109558.234962:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.234991:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109558.235017:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a7240 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.235095:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933266432 00000100:00100000:2.0:1786109558.235099:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933266432 00000100:00100000:2.0:1786109558.235165:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786109558.235174:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac12d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933266432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.235288:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac12d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933266432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.235295:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786109558.236934:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.236982:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.237384:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109558.237491:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a7240 going to sleep for 11 seconds 00000100:00100000:1.0:1786109558.237679:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933266560 00000100:00100000:1.0:1786109558.237686:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933266560 00000100:00100000:1.0:1786109558.237730:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1786109558.237739:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933266560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109558.238038:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933266560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 299us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109558.238046:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786109558.238158:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786109558.239854:0:194010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1786109558.240118:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1786109558.240138:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786109558.240150:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca36dfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e02 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.240161:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca36dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e02 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109558.240170:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1786109558.240173:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1786109558.240176:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1786109558.240208:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d400/0xdb52b77d7ca36e09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.240222:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d400/0xdb52b77d7ca36e09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.240230:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d400/0xdb52b77d7ca36e09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109558.240253:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109558.240307:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109558.240358:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a82b69000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.240404:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933266688 00000100:00100000:2.0:1786109558.240411:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933266688 00000100:00100000:2.0:1786109558.240550:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1786109558.240560:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933266688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109558.240571:0:193903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109558.240584:0:193903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd76200/0xdb52b77d7ca36e10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36e09 expref: -99 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.240605:0:193903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd76200/0xdb52b77d7ca36e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36e09 expref: 18 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.240615:0:193903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd76200/0xdb52b77d7ca36e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36e09 expref: 18 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.240622:0:193903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76200, rc 0) 00000100:00100000:2.0:1786109558.240858:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933266688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 299us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.240866:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786109558.240998:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109558.241012:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d400/0xdb52b77d7ca36e09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e10 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.241021:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d400/0xdb52b77d7ca36e09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36e10 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109558.241143:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109558.241169:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109558.241232:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a82b69000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.241262:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933266816 00000100:00100000:2.0:1786109558.241266:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933266816 00000100:00100000:2.0:1786109558.241321:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1786109558.241328:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933266816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.241662:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933266816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.241670:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786109558.241896:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109558.241926:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109558.244297:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109558.244360:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a82b69000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.244415:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933266944 00000100:00100000:2.0:1786109558.244423:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933266944 00000100:00100000:2.0:1786109558.244502:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1786109558.244512:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933266944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.245417:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933266944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 903us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.245426:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786109558.245608:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933266944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786109558.246850:0:194011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1786109558.247183:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1786109558.247203:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1786109558.247213:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d400/0xdb52b77d7ca36e09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e10 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109558.247225:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d400/0xdb52b77d7ca36e09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e10 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109558.247233:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786109558.247236:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930aa6612000 from 7 10000000:01000000:1.0:1786109558.247239:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786109558.247271:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f39600/0xdb52b77d7ca36e17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109558.247278:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac1f39600/0xdb52b77d7ca36e17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109558.247287:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac1f39600/0xdb52b77d7ca36e17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109558.247308:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933267072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109558.247359:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109558.247473:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.247686:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933267072 00000100:00100000:2.0:1786109558.247693:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933267072 00000100:00100000:2.0:1786109558.247735:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786109558.247745:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933267072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109558.247756:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109558.247849:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd76a00/0xdb52b77d7ca36e1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36e17 expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.247873:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd76a00/0xdb52b77d7ca36e1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36e17 expref: 19 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.247884:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd76a00/0xdb52b77d7ca36e1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36e17 expref: 19 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.247892:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76a00, rc 0) 00000100:00100000:2.0:1786109558.247944:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933267072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.247950:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1786109558.248035:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933267072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109558.248050:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac1f39600/0xdb52b77d7ca36e17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e1e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109558.248059:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac1f39600/0xdb52b77d7ca36e17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36e1e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109558.248114:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933267200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109558.248142:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109558.248176:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.248267:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933267200 00000100:00100000:2.0:1786109558.248272:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933267200 00000100:00100000:2.0:1786109558.248303:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786109558.248311:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933267200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.248408:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933267200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.248415:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786109558.248467:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933267200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.248495:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933267328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.248535:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109558.248565:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a7840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.248577:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933267328 00000100:00100000:2.0:1786109558.248580:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933267328 00000100:00100000:2.0:1786109558.248597:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786109558.248603:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933267328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.248673:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933267328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.248680:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786109558.248714:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933267328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786109558.249681:0:194012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1786109558.250145:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1786109558.250171:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786109558.250179:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f39600/0xdb52b77d7ca36e17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e1e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109558.250189:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac1f39600/0xdb52b77d7ca36e17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e1e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109558.250198:0:6524:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1786109558.250200:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff930a8a73cd40 from 1 10000000:01000000:3.0:1786109558.250203:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1786109558.250228:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628aa00/0xdb52b77d7ca36e25 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109558.250236:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930aa628aa00/0xdb52b77d7ca36e25 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109558.250245:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930aa628aa00/0xdb52b77d7ca36e25 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109558.250261:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933267456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109558.250299:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109558.250362:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.250391:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933267456 00000100:00100000:2.0:1786109558.250396:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933267456 00000100:00100000:2.0:1786109558.250732:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786109558.250741:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933267456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109558.250751:0:193903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109558.250775:0:193903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd77600/0xdb52b77d7ca36e2c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36e25 expref: -99 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.250793:0:193903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd77600/0xdb52b77d7ca36e2c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36e25 expref: 20 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.250873:0:193903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd77600/0xdb52b77d7ca36e2c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36e25 expref: 20 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109558.250881:0:193903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77600, rc 0) 00000100:00100000:2.0:1786109558.250965:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933267456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109558.250972:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1786109558.251042:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933267456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109558.251057:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930aa628aa00/0xdb52b77d7ca36e25 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e2c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.251065:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930aa628aa00/0xdb52b77d7ca36e25 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36e2c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109558.251081:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1786109558.251085:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628aa00/0xdb52b77d7ca36e25 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e2c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.251091:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930aa628aa00/0xdb52b77d7ca36e25 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e2c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109558.251098:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1786109558.251100:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff930a8a73cd40 from 1 10000000:01000000:0.0:1786109558.251102:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786109558.251118:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.251126:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.251133:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109558.251146:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933267584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109558.251172:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109558.251325:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a82b69e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109558.251395:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933267584 00000100:00100000:3.0:1786109558.251400:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933267584 00000100:00100000:3.0:1786109558.251456:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786109558.251465:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933267584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109558.251472:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109558.251481:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930aa628b400/0xdb52b77d7ca36e3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36e33 expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109558.251496:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930aa628b400/0xdb52b77d7ca36e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36e33 expref: 21 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109558.251504:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930aa628b400/0xdb52b77d7ca36e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36e33 expref: 21 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109558.251510:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628b400, rc 0) 00000100:00100000:3.0:1786109558.251619:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933267584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109558.251626:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1786109558.251701:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933267584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109558.251714:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e3a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.251722:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36e3a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109558.251783:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933267712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109558.251882:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109558.251914:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a82b69e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109558.251924:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933267712 00000100:00100000:2.0:1786109558.251929:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933267712 00000100:00100000:2.0:1786109558.251959:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786109558.251966:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933267712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.252262:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933267712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (379us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786109558.252264:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986550e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933267712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109558.252269:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 10000000:01000000:3.0:1786109558.252288:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1786109558.252294:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e3a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109558.252302:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e3a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109558.404571:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109559.428609:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786109560.358761:0:194176:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1786109560.453910:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109560.580745:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933267840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109560.580826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109560.580913:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933267840 00000100:00100000:2.0:1786109560.580921:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933267840 00000100:00100000:2.0:1786109560.580980:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5825 00000100:00100000:2.0:1786109560.580989:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933267840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109560.581027:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109560.581070:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933267840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109560.581077:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5825 00000100:00080000:0.0:1786109560.581187:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109560.581229:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933267840:0@lo:13:osp-pre-1-1.0 00000020:00000004:0.0:1786109561.147368:0:194228:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1786109561.147887:0:194228:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1786109561.476644:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109561.604627:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933267968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109561.604695:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109561.605556:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933267968 00000100:00100000:3.0:1786109561.605566:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933267968 00000100:00100000:3.0:1786109561.605630:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12347 00000100:00100000:3.0:1786109561.605640:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933267968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786109561.605674:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446109184 avail 1299869696 00000100:00100000:3.0:1786109561.605745:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933267968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109561.605753:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12347 00000100:00100000:3.0:1786109561.605814:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933267968:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1786109561.888949:0:194278:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1786109561.889219:0:194278:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1786109562.088115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109562.088197:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922099072 00000100:00100000:3.0:1786109562.088207:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922099072 00000100:00100000:3.0:1786109562.088260:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:3.0:1786109562.088269:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2401:x1872862922099072:12345-192.168.203.38@tcp:250:mount.lustre.0 00010000:00080000:3.0:1786109562.088298:0:193902:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 4929093a-da1f-45c7-90e6-dcd2fb5a5df4@192.168.203.38@tcp t0 exp 0000000000000000 cur 8418 last 0 00000020:00000080:3.0:1786109562.088405:0:193902:0:(genops.c:1406:class_connect()) connect: client 4929093a-da1f-45c7-90e6-dcd2fb5a5df4, cookie 0xdb52b77d7ca36e41 00000100:00080000:3.0:1786109562.088911:0:193902:0:(import.c:65:import_set_state_nolock()) ffff93098650d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786109562.089074:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+5:2401:x1872862922099072:12345-192.168.203.38@tcp:250:mount.lustre.0 Request processed in 802us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109562.089084:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00080000:2.0:1786109562.117305:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109562.117311:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109562.117314:0:192991:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109562.117322:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8413 00000100:00080000:2.0:1786109562.117327:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109562.117334:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109562.117354:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a3480 x1872862933268224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109562.117379:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109562.117382:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109562.117383:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109562.117386:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8413 00000100:00080000:2.0:1786109562.117389:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109562.117392:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109562.117400:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a3800 x1872862933268480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109562.117408:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109562.117411:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1786109562.117412:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109562.117414:0:192991:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8413 00000100:00080000:2.0:1786109562.117416:0:192991:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109562.117419:0:192991:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930a89106800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109562.117452:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a2d80 x1872862933268608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109562.117470:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109562.117473:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109562.117474:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109562.117477:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8413 00000100:00080000:2.0:1786109562.117479:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109562.117482:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109562.117490:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098e50c000 x1872862933268864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109562.117499:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786109562.117502:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1786109562.117503:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109562.117505:0:192991:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 8413 00000100:00080000:2.0:1786109562.117507:0:192991:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109562.117510:0:192991:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff930ab7c42000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109562.117518:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098e50ea00 x1872862933268992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109562.117529:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1786109562.117531:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109562.117533:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109562.117536:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff930985f23800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109562.117543:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098e50dc00 x1872862933269248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109562.117565:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933268096:0@lo:400:kworker.0 00000100:00100000:1.0:1786109562.117954:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933268352:0@lo:400:kworker.0 00000100:00100000:0.0:1786109562.119322:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933268224:0@lo:38:kworker.0 00000100:00100000:2.0:1786109562.119411:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109562.119426:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109562.119493:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109562.119493:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109562.119502:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933269120:0@lo:400:kworker.0 00000100:00100000:1.0:1786109562.119502:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933268736:0@lo:400:kworker.0 00000100:00100000:1.0:1786109562.119528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109562.119538:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933268096 00000100:00100000:2.0:1786109562.119544:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933268096 00000100:00100000:1.0:1786109562.119574:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933268352 00000100:00100000:1.0:1786109562.119577:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933268352 00000100:00100000:2.0:1786109562.119583:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786109562.119591:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3649:x1872862933268096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109562.120065:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1786109562.120074:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933268352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109562.120120:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933268352:12345-0@lo:400:kworker.0 Request processed in 49us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109562.120127:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1786109562.120152:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933268736 00000100:00100000:1.0:1786109562.120156:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933268736 00000100:00100000:1.0:1786109562.120184:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6970 00000100:00100000:1.0:1786109562.120190:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933268736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109562.120222:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933268736:12345-0@lo:400:kworker.0 Request processed in 33us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109562.120229:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6970 00000100:00080000:1.0:1786109562.120244:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109562.120248:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109562.120376:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109562.120456:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933268736:0@lo:400:kworker.0 00000100:00100000:1.0:1786109562.120470:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933268352:0@lo:400:kworker.0 00000100:00100000:1.0:1786109562.120514:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933269120 00000100:00100000:1.0:1786109562.120518:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933269120 00000100:00100000:1.0:1786109562.120546:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6971 00000100:00100000:1.0:1786109562.120553:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933269120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109562.120589:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933269120:12345-0@lo:400:kworker.0 Request processed in 36us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109562.120595:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6971 00000100:00100000:0.0:1786109562.121048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109562.121075:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933268480:0@lo:38:kworker.0 00000100:00100000:0.0:1786109562.121325:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109562.121346:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933268608:0@lo:8:kworker.0 00000100:00100000:0.0:1786109562.121368:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109562.121384:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933268864:0@lo:38:kworker.0 00000100:00100000:0.0:1786109562.121401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109562.121420:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933268992:0@lo:8:kworker.0 00000100:00100000:0.0:1786109562.121458:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109562.121478:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933269248:0@lo:38:kworker.0 00000100:00100000:0.0:1786109562.121498:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109562.121536:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933268608 00000100:00100000:0.0:1786109562.121540:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933268608 00000100:00100000:0.0:1786109562.121561:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933268992 00000100:00100000:0.0:1786109562.121563:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933268992 00000100:00100000:0.0:1786109562.121578:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23101 00000100:00100000:0.0:1786109562.121584:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3645:x1872862933268608:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1786109562.121603:0:179239:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109562.121651:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3645:x1872862933268608:12345-0@lo:8:kworker.0 Request processed in 66us (281us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109562.121658:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23101 00000100:00100000:0.0:1786109562.121671:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23102 00000100:00100000:0.0:1786109562.121675:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3645:x1872862933268992:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1786109562.121684:0:179239:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1786109562.121756:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109562.121804:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933269120:0@lo:400:kworker.0 00000100:00100000:1.0:1786109562.121843:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933268480 00000100:00100000:1.0:1786109562.121847:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933268480 00000100:00100000:1.0:1786109562.121869:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12348 00000100:00100000:1.0:1786109562.121873:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933268480:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1786109562.121877:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:3645:x1872862933268992:12345-0@lo:8:kworker.0 Request processed in 33us (251us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109562.121885:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23102 00010000:00080000:1.0:1786109562.121891:0:8451:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff930ab198d000, cookie 0xdb52b77d7ca36cff 00010000:00080000:1.0:1786109562.121895:0:8451:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff930ab198d000 cur 8418 last 1786109556 00010000:02000400:1.0:1786109562.121902:0:8451:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects 00010000:00080000:1.0:1786109562.121908:0:8451:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1786109562.121923:0:8451:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109562.121988:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109562.121993:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109562.121996:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933268608:0@lo:8:kworker.0 00000100:00080000:0.0:1786109562.122006:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109562.122008:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109562.122011:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933268992:0@lo:8:kworker.0 00000100:00100000:0.0:1786109562.122170:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933268224 00000100:00100000:0.0:1786109562.122232:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933268224 00000100:00100000:0.0:1786109562.122253:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933268864 00000100:00100000:0.0:1786109562.122256:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933268864 00000100:00100000:0.0:1786109562.122268:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933269248 00000100:00100000:0.0:1786109562.122271:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933269248 00000100:00100000:0.0:1786109562.122281:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1786109562.122286:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933268224:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109562.122301:0:189813:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8418 last 0 00000020:00000080:0.0:1786109562.122332:0:189813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdb52b77d7ca36e48 00000004:00100000:0.0:1786109562.122340:0:189813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109562.122365:0:189813:0:(import.c:65:import_set_state_nolock()) ffff930a87b2b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109562.122410:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872862933268224:12345-0@lo:38:kworker.0 Request processed in 122us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109562.122416:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1786109562.122447:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1786109562.122451:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933268864:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109562.122463:0:189813:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8418 last 0 00000020:00000080:0.0:1786109562.122482:0:189813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdb52b77d7ca36e4f 00000004:00100000:0.0:1786109562.122487:0:189813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109562.122500:0:189813:0:(import.c:65:import_set_state_nolock()) ffff930a87b28800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109562.122528:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872862933268864:12345-0@lo:38:kworker.0 Request processed in 75us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109562.122533:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1786109562.122545:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1786109562.122549:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933269248:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109562.122563:0:189813:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8418 last 0 00000020:00000080:0.0:1786109562.122583:0:189813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdb52b77d7ca36e56 00000004:00100000:0.0:1786109562.122588:0:189813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109562.122600:0:189813:0:(import.c:65:import_set_state_nolock()) ffff930a87b2b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109562.122639:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872862933269248:12345-0@lo:38:kworker.0 Request processed in 88us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109562.122645:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00010000:00080000:0.0:1786109562.122679:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff930aa60a3480 x1872862933268224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109562.122691:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 79 00000100:00080000:1.0:1786109562.122825:0:8451:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786109562.122876:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933268480:12345-0@lo:38:kworker.0 Request processed in 1001us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109562.122884:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12348 00010000:00080000:1.0:1786109562.122940:0:193929:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:1.0:1786109562.122945:0:193929:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 335007449092 00000020:00080000:1.0:1786109562.122950:0:193929:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109562.122953:0:193929:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 335007449092 00000020:00080000:1.0:1786109562.122956:0:193929:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109562.122957:0:193929:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 335007449092 00000100:00100000:2.0:1786109562.123284:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3649:x1872862933268096:12345-0@lo:400:kworker.0 Request processed in 3692us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109562.123294:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786109562.123334:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933268096:0@lo:400:kworker.0 00000001:00100000:2.0:1786109562.126303:0:187891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:0.0:1786109562.127506:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff930aa60a3480 x1872862933268224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109577 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109562.127519:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109562.127523:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109562.127527:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109562.127533:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933268224:0@lo:38:kworker.0 00000100:00080000:0.0:1786109562.127572:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 79 00000100:00080000:0.0:1786109562.127583:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1786109562.127587:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1786109562.127589:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 326417514497 gen 2 00000100:00080000:0.0:1786109562.127593:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a89101800 from lustre-MDT0000_UUID committed 326417514497 last 0 00000100:00080000:0.0:1786109562.127596:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1786109562.129737:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933268480:0@lo:38:kworker.0 00010000:00080000:0.0:1786109562.129772:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93098e50c000 x1872862933268864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1786109562.129849:0:194290:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1786109562.129854:0:194290:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1786109562.129859:0:194290:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1786109562.129950:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 79 00000100:00100000:3.0:1786109562.130294:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109562.130325:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922099200 00000100:00100000:3.0:1786109562.130332:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922099200 00000100:00100000:3.0:1786109562.130376:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1786109562.130384:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+5:161841:x1872862922099200:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786109562.130398:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109562.130412:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930aa628ae00/0xdb52b77d7ca36e5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1571 expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.130455:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930aa628ae00/0xdb52b77d7ca36e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1571 expref: 6 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.130467:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930aa628ae00/0xdb52b77d7ca36e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1571 expref: 6 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.130476:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628ae00, rc 0) 00000100:00100000:3.0:1786109562.130517:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+6:161841:x1872862922099200:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 134us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109562.130524:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00080000:0.0:1786109562.132480:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff93098e50c000 x1872862933268864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109577 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109562.132494:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109562.132499:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109562.132503:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109562.132509:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933268864:0@lo:38:kworker.0 00010000:00080000:0.0:1786109562.132537:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93098e50dc00 x1872862933269248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109562.132551:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 79 00000100:00080000:0.0:1786109562.132559:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1786109562.132563:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786109562.132566:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786109562.132569:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933269248:0@lo:38:kworker.0 00000100:00080000:1.0:1786109562.132626:0:194290:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1786109562.133924:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933269376:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1786109562.134001:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109562.134276:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933269376 00000100:00100000:3.0:1786109562.134285:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933269376 00000100:00100000:3.0:1786109562.134339:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12349 00000100:00100000:3.0:1786109562.134348:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933269376:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1786109562.134372:0:177399:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ab1c28000 x1872862933269376/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:33/0 lens 224/0 e 0 to 0 dl 1786109573 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109562.134402:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933269376:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 55us (401us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109562.134409:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12349 00000020:00080000:0.0:1786109562.134481:0:193929:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1786109562.134485:0:193929:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 1, queue_len: 0, req_transno: 0, next_transno: 335007449092 00010000:00080000:0.0:1786109562.134488:0:193929:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1786109562.134490:0:193929:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1786109562.134495:0:193929:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1786109562.134498:0:193929:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1786109562.134589:0:193929:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 79, last_transno is 339302416384 00000001:00100000:1.0:1786109562.134620:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1786109562.136772:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109562.136880:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922099328 00000100:00100000:2.0:1786109562.136889:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922099328 00000100:00100000:2.0:1786109562.137099:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1786109562.137109:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+6:161841:x1872862922099328:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786109562.137253:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+6:161841:x1872862922099328:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 146us (489us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786109562.137261:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000001:00100000:1.0:1786109562.140556:0:193896:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1786109562.140738:0:193929:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1786109562.140793:0:193929:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1786109562.140807:0:193929:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff930ab1c28000 x1872862933269376/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:33/0 lens 224/0 e 0 to 0 dl 1786109573 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1786109562.140928:0:193929:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted. 00000100:00100000:3.0:1786109562.141326:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109562.141420:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922099456 00000100:00100000:1.0:1786109562.141427:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922099456 00000100:00100000:1.0:1786109562.141493:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:1.0:1786109562.141502:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+6:161841:x1872862922099456:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1786109562.141512:0:193901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109562.141530:0:193901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac1f39200/0xdb52b77d7ca36e64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1578 expref: -99 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.141554:0:193901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac1f39200/0xdb52b77d7ca36e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1578 expref: 7 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.141564:0:193901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac1f39200/0xdb52b77d7ca36e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1578 expref: 7 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.141574:0:193901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f39200, rc 0) 00000100:00100000:1.0:1786109562.141610:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+7:161841:x1872862922099456:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 109us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109562.141616:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00080000:2.0:1786109562.141817:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1786109562.141827:0:3645:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff930984ff0380 x1872862933269376/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109578 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109562.141836:0:3645:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff930984ff0380 x1872862933269376/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109578 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109562.141843:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1786109562.141944:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1786109562.141950:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933269376:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1786109562.142160:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933269504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109562.142196:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109562.142262:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933269504 00000100:00100000:3.0:1786109562.142267:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933269504 00000100:00100000:3.0:1786109562.142295:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12350 00000100:00100000:3.0:1786109562.142302:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933269504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786109562.142323:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445683200 avail 1299443712 00000100:00100000:3.0:1786109562.142602:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933269504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 299us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109562.142608:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12350 00000100:00100000:2.0:1786109562.142727:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933269504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109562.146600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109562.146755:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922099584 00000100:00100000:2.0:1786109562.146765:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922099584 00000100:00100000:2.0:1786109562.146829:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:2.0:1786109562.146839:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+7:161841:x1872862922099584:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786109562.148219:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161841:x1872862922099584:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 1372us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109562.148232:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:2.0:1786109562.153694:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109562.153783:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922099712 00000100:00100000:3.0:1786109562.153793:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922099712 00000100:00100000:3.0:1786109562.153848:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:3.0:1786109562.153858:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161841:x1872862922099712:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1786109562.154010:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161841:x1872862922099712:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 154us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109562.154019:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000004:00000080:0.0:1786109562.157257:0:193929:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa66f07ac3e10 00100000:10000000:0.0:1786109562.157272:0:193929:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:3.0:1786109562.157641:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109562.157669:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922099840 00000100:00100000:3.0:1786109562.157678:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922099840 00000100:00100000:3.0:1786109562.157726:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:3.0:1786109562.157734:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161859:x1872862922099840:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786109562.157869:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161859:x1872862922099840:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 135us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109562.157876:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000004:00080000:3.0:1786109562.159372:0:193917:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x1882:0x0] 00000100:00100000:3.0:1786109562.159412:0:193917:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:193917:1872862933269632:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1786109562.159501:0:193917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109562.159532:0:193917:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309827e4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109562.160013:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933269632 00000100:00100000:0.0:1786109562.160020:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933269632 00000100:00100000:0.0:1786109562.160066:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23103 00000100:00100000:0.0:1786109562.160075:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:193917:x1872862933269632:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1786109562.160102:0:17009:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6337 -> diff = -63 00002000:02000040:0.0:1786109562.160106:0:17009:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6275 to 0x2c0000401:6337) 00002000:00010000:0.0:1786109562.166338:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.166352:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36e6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166369:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c1:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.166374:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.166379:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166396:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166407:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166421:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36e6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166606:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1786109562.166707:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.166713:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36e72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166721:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c0:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.166724:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.166728:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36e72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166736:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36e72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166743:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36e72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166748:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36e72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166852:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1786109562.166894:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.166900:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36e79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166910:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18bf:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.166913:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.166917:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36e79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166925:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36e79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166933:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36e79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.166940:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36e79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167076:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109562.167083:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36e6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167091:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109562.167096:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36e6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167104:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36e6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167122:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36e6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167130:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca36e6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167150:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109562.167154:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36e72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167160:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109562.167163:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36e72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167169:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36e72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167178:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36e72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167185:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca36e72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167195:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109562.167197:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36e79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167204:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109562.167206:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36e79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167212:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36e79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167225:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36e79 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.167232:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.167234:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.167236:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.167570:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.169936:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.169951:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca36e79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.170092:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.170099:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36e80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.170113:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18be:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.170117:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.170123:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36e80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.170135:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36e80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.170144:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36e80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.170151:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36e80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.170862:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.170872:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36e80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.170882:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.170887:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36e80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.170896:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36e80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.170914:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36e80 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.170922:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.170924:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.170926:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.171090:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.171096:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca36e80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.171175:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.171180:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36e87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.171189:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18bd:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.171193:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.171197:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36e87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.171208:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36e87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.171223:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36e87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.171231:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36e87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.171266:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.171271:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36e87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.171279:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.171282:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36e87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.171296:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36e87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.171308:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36e87 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.171317:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.171319:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.171321:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.171390:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.171395:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca36e87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.171482:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.171488:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36e8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.171496:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18bc:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.171499:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.171503:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36e8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.171511:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36e8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.171519:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36e8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.171531:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36e8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.171632:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109562.171639:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36e8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.171647:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109562.171650:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36e8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.171658:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36e8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.171669:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36e8e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.171678:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.171679:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.171681:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.171748:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.171753:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca36e8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.171828:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.171834:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36e95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.171842:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18bb:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.171844:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.171848:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36e95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.171858:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36e95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.171866:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36e95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.171873:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36e95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.171912:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109562.171918:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36e95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.171930:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109562.171934:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36e95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.171942:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36e95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.171954:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36e95 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.171963:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.171965:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.171967:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.172092:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.172097:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca36e95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.172150:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.172155:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36e9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.172163:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ba:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.172167:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.172171:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36e9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.172181:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36e9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.172190:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36e9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.172199:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36e9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.172233:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.172238:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36e9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.172247:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.172250:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36e9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.172259:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36e9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.172271:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36e9c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.172279:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.172281:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.172283:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.172352:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.172357:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca36e9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.172412:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.172417:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36ea3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.172424:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b9:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.172427:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.172468:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36ea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.172477:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36ea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.172483:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36ea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.172489:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36ea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.172562:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.172569:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36ea3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.172576:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.172579:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36ea3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.172587:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36ea3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.172597:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36ea3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.172604:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.172606:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.172607:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.172694:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.172699:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca36ea3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.172754:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.172759:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36eaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.172772:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b8:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.172788:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.172792:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36eaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.172801:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36eaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.172809:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36eaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.172815:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36eaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.172845:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109562.172850:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36eaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.172861:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109562.172864:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36eaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.172870:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36eaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.172881:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36eaa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.172888:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.172889:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.172891:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.172957:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.172961:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca36eaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.173029:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.173034:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36eb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173042:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b7:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.173045:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.173049:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36eb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173057:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36eb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173064:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36eb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173070:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36eb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.173151:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109562.173156:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36eb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.173162:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109562.173165:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36eb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.173173:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36eb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.173184:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36eb1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.173193:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.173195:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.173197:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.173263:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.173267:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca36eb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.173320:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.173326:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36eb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173334:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b6:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.173337:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.173341:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36eb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173350:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36eb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173363:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36eb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173370:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36eb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.173403:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.173408:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36eb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.173415:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.173419:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36eb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.173426:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36eb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.173505:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36eb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.173513:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.173515:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.173516:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.173619:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.173624:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca36eb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.173679:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.173684:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36ebf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173692:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b5:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.173695:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.173699:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36ebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173708:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36ebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173717:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36ebf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173727:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36ebf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.173756:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.173760:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36ebf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.173768:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.173771:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36ebf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.173789:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36ebf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.173800:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36ebf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.173807:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.173809:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.173811:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.173875:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.173880:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca36ebf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.173933:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.173939:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36ec6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173947:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b4:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.173950:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.173954:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36ec6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173964:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36ec6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173971:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36ec6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.173978:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36ec6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.174077:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109562.174083:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36ec6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.174092:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109562.174095:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36ec6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.174102:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36ec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.174113:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36ec6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.174122:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.174124:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.174126:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.174188:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.174193:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca36ec6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.174245:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.174250:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36ecd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.174258:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b3:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.174261:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.174265:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36ecd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.174274:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36ecd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.174282:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36ecd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.174289:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36ecd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.174318:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109562.174323:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36ecd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.174330:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109562.174334:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36ecd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.174341:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36ecd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.174352:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36ecd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.174360:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.174361:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.174363:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.174459:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.174464:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca36ecd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.174516:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.174521:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ed4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.174529:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b2:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.174532:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.174536:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.174544:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.174550:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ed4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.174557:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ed4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.174694:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.174700:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ed4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.174712:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.174715:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ed4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.174722:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ed4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.174732:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ed4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.174740:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.174741:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.174743:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.174812:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.174817:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca36ed4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.174867:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.174872:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca36edb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.174884:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b1:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.174887:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.174891:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca36edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.174900:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca36edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.174906:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca36edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.174913:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca36edb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.174942:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.174946:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca36edb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.174953:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.174956:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca36edb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.174964:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca36edb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.174974:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca36edb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.174982:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.174984:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.174985:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.175103:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.175109:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca36edb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.175159:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.175164:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca36ee2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.175172:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b0:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.175175:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.175179:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca36ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.175188:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca36ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.175195:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca36ee2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.175202:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca36ee2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.175242:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109562.175247:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca36ee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.175253:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109562.175257:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca36ee2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.175265:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca36ee2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.175276:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca36ee2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.175284:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.175286:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.175288:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.175346:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.175351:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca36ee2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.175396:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.175401:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca36ee9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.175409:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18af:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.175412:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.175416:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca36ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.175425:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca36ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.175540:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca36ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.175547:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca36ee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.175585:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109562.175591:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca36ee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.175598:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109562.175601:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca36ee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.175610:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca36ee9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.175621:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca36ee9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.175629:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.175631:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.175633:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.175694:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.175699:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca36ee9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.175750:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.175756:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b12ce5eb/0xdb52b77d7ca36ef0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.175764:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ae:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.175768:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.175772:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b12ce5eb/0xdb52b77d7ca36ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.175794:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b12ce5eb/0xdb52b77d7ca36ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.175802:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b12ce5eb/0xdb52b77d7ca36ef0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.175814:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b12ce5eb/0xdb52b77d7ca36ef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.175844:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.175850:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b12ce5eb/0xdb52b77d7ca36ef0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.175857:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.175860:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b12ce5eb/0xdb52b77d7ca36ef0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.175868:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b12ce5eb/0xdb52b77d7ca36ef0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.175879:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b12ce5eb/0xdb52b77d7ca36ef0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.175887:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.175889:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.175891:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.175957:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.175963:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b12ce5eb/0xdb52b77d7ca36ef0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.176082:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.176088:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca36ef7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176096:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ad:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.176099:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.176103:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca36ef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176112:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca36ef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176119:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca36ef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176127:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca36ef7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.176163:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.176169:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca36ef7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.176177:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.176180:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca36ef7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.176189:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca36ef7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.176200:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca36ef7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.176208:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.176209:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.176211:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.176275:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.176280:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca36ef7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.176328:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.176333:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca36efe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176341:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ac:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.176345:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.176349:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca36efe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176358:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca36efe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176366:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca36efe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176374:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca36efe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.176405:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109562.176410:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca36efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.176417:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109562.176421:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca36efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.176458:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca36efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.176470:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca36efe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.176479:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.176481:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.176482:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.176609:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.176614:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca36efe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.176671:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.176675:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca36f05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176683:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ab:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.176687:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.176690:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca36f05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176699:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca36f05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176706:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca36f05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176713:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca36f05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.176739:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109562.176745:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca36f05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.176751:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109562.176754:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca36f05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.176761:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca36f05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.176772:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca36f05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.176790:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.176791:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.176794:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.176854:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.176859:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca36f05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.176910:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.176915:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007243a060/0xdb52b77d7ca36f0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176927:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18aa:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.176930:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.176934:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007243a060/0xdb52b77d7ca36f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176943:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007243a060/0xdb52b77d7ca36f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176951:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007243a060/0xdb52b77d7ca36f0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.176957:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007243a060/0xdb52b77d7ca36f0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.176985:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.176990:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007243a060/0xdb52b77d7ca36f0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.176996:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.177064:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007243a060/0xdb52b77d7ca36f0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.177072:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007243a060/0xdb52b77d7ca36f0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.177084:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007243a060/0xdb52b77d7ca36f0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.177092:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.177094:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.177096:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.177160:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.177165:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007243a060/0xdb52b77d7ca36f0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.177214:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.177219:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca0cb658/0xdb52b77d7ca36f13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.177227:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a9:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.177229:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.177233:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca0cb658/0xdb52b77d7ca36f13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.177241:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca0cb658/0xdb52b77d7ca36f13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.177247:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca0cb658/0xdb52b77d7ca36f13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.177256:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca0cb658/0xdb52b77d7ca36f13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.177291:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.177296:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca0cb658/0xdb52b77d7ca36f13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.177303:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.177308:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca0cb658/0xdb52b77d7ca36f13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.177316:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca0cb658/0xdb52b77d7ca36f13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.177327:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca0cb658/0xdb52b77d7ca36f13 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.177334:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.177335:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.177336:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.177402:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.177407:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca0cb658/0xdb52b77d7ca36f13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.177560:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.177565:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c7240a/0xdb52b77d7ca36f1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.177571:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a8:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.177574:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.177577:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c7240a/0xdb52b77d7ca36f1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.177587:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002c7240a/0xdb52b77d7ca36f1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.177600:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c7240a/0xdb52b77d7ca36f1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.177606:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002c7240a/0xdb52b77d7ca36f1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.177651:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109562.177656:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002c7240a/0xdb52b77d7ca36f1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.177663:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109562.177666:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c7240a/0xdb52b77d7ca36f1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.177675:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c7240a/0xdb52b77d7ca36f1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.177686:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002c7240a/0xdb52b77d7ca36f1a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.177694:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.177695:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.177697:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.177756:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.177761:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c7240a/0xdb52b77d7ca36f1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.177820:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.177824:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4943fe6/0xdb52b77d7ca36f21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.177832:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a7:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.177835:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.177839:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4943fe6/0xdb52b77d7ca36f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.177849:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4943fe6/0xdb52b77d7ca36f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.177856:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4943fe6/0xdb52b77d7ca36f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.177868:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4943fe6/0xdb52b77d7ca36f21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.177897:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109562.177903:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4943fe6/0xdb52b77d7ca36f21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.177910:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109562.177913:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4943fe6/0xdb52b77d7ca36f21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.177920:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4943fe6/0xdb52b77d7ca36f21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.177931:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4943fe6/0xdb52b77d7ca36f21 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.177938:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.177939:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.177940:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.178061:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.178066:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4943fe6/0xdb52b77d7ca36f21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.178118:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.178124:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca36f28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178132:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a6:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.178135:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.178139:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca36f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178149:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca36f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178156:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca36f28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178164:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca36f28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.178207:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.178212:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca36f28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.178219:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.178222:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca36f28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.178230:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca36f28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.178246:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca36f28 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.178255:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.178256:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.178258:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.178325:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.178330:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca36f28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.178379:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.178384:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca36f2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178392:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a5:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.178395:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.178399:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca36f2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178407:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca36f2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178415:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca36f2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178422:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca36f2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.178560:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.178564:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca36f2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.178572:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.178576:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca36f2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.178583:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca36f2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.178593:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca36f2f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.178600:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.178602:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.178603:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.178663:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.178668:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca36f2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.178721:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.178726:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36f36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178733:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a4:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.178736:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.178740:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36f36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178749:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36f36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178756:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36f36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178763:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36f36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.178799:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109562.178803:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36f36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.178810:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109562.178813:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36f36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.178820:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36f36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.178831:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36f36 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.178839:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.178840:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109562.178842:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.178900:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.178905:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca36f36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.178958:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.178963:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000646479e4/0xdb52b77d7ca36f3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178974:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a3:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.178977:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.178981:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000646479e4/0xdb52b77d7ca36f3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.178990:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000646479e4/0xdb52b77d7ca36f3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.179068:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000646479e4/0xdb52b77d7ca36f3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.179077:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000646479e4/0xdb52b77d7ca36f3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.179104:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109562.179109:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000646479e4/0xdb52b77d7ca36f3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.179115:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109562.179119:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000646479e4/0xdb52b77d7ca36f3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.179125:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000646479e4/0xdb52b77d7ca36f3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.179139:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000646479e4/0xdb52b77d7ca36f3d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.179146:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.179147:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109562.179149:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.179215:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.179220:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000646479e4/0xdb52b77d7ca36f3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109562.179271:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109562.179276:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca36f44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.179284:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a2:0x0].0x0 since=8418s v=(0 0) 00010000:00010000:0.0:1786109562.179287:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109562.179290:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca36f44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.179299:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca36f44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.179306:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca36f44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109562.179313:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca36f44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.179343:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109562.179349:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca36f44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.179362:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109562.179365:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca36f44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.179374:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca36f44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.179385:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca36f44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109562.179393:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.179395:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109562.179397:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109562.179593:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109562.179599:0:17009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b147261/0xdb52b77d7ca36f44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1786109562.179881:0:17009:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6274 00000100:00100000:0.0:1786109562.180078:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:193917:x1872862933269632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20000us (20573us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109562.180088:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23103 00010000:00010000:2.0:1786109562.180163:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109562.180311:0:193917:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:193917:1872862933269632:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1786109562.180325:0:193917:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x18c1:0x0] from OST, last_created [0x2c0000401:0x18c1:0x0]last_used is [0x2c0000401:0x1882:0x0] 00000100:00100000:1.0:1786109562.180406:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933269760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109562.180478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109562.180570:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933269760 00000100:00100000:0.0:1786109562.180577:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933269760 00000100:00100000:0.0:1786109562.180614:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5826 00000100:00100000:0.0:1786109562.180623:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933269760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109562.180641:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143552 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109562.180800:0:193917:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:193917:1872862933269888:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1786109562.180826:0:193917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109562.180844:0:193917:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309827e4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109562.180959:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933269760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 337us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109562.180968:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5826 00000100:00100000:0.0:1786109562.180994:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933269888 00000100:00100000:0.0:1786109562.181010:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933269888 00000100:00100000:0.0:1786109562.181140:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23104 00000100:00100000:0.0:1786109562.181150:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:193917:x1872862933269888:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1786109562.181181:0:40692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6338 00000100:00100000:0.0:1786109562.182762:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:193917:x1872862933269888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1610us (1931us total) trans 4294975825 rc 0/0 00000100:00100000:0.0:1786109562.182772:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23104 00000100:00100000:3.0:1786109562.182870:0:193917:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:193917:1872862933269888:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1786109562.182883:0:193917:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x18c1:0x0]-[0x2c0000401:0x18e1:0x0] 00000100:00100000:1.0:1786109562.183162:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933269760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109562.187392:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109562.187819:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922099968 00000100:00100000:3.0:1786109562.187830:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922099968 00000100:00100000:3.0:1786109562.187920:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1786109562.187931:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161859:x1872862922099968:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786109562.188315:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161859:x1872862922099968:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 385us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109562.188324:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1786109562.192757:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109562.193317:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922100096 00000100:00100000:2.0:1786109562.193327:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922100096 00000100:00100000:2.0:1786109562.193458:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:2.0:1786109562.193469:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161859:x1872862922100096:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786109562.193766:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161859:x1872862922100096:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 298us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109562.193786:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:2.0:1786109562.200701:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109562.200813:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922100224 00000100:00100000:3.0:1786109562.200822:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922100224 00000100:00100000:3.0:1786109562.200880:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1786109562.200890:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161841:x1872862922100224:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786109562.200906:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109562.200923:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca36f4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a15a9 expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.200951:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca36f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15a9 expref: 9 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.200963:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca36f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15a9 expref: 9 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109562.200972:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628a200, rc 0) 00000100:00100000:3.0:1786109562.201090:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161841:x1872862922100224:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 201us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109562.201098:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1786109562.203923:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109562.204116:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922100352 00000100:00100000:2.0:1786109562.204126:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922100352 00000100:00100000:2.0:1786109562.204215:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:2.0:1786109562.204225:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161841:x1872862922100352:12345-192.168.203.38@tcp:256:mount.lustre.0 20000000:01000000:2.0:1786109562.204250:0:193903:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1786109562.204274:0:193903:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1786109562.204278:0:193903:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1786109562.204281:0:193903:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1786109562.204284:0:193903:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 328 00000100:00100000:2.0:1786109562.206290:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161841:x1872862922100352:12345-192.168.203.38@tcp:256:mount.lustre.0 Request processed in 2059us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109562.206302:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1786109562.210302:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109562.210418:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922100480 00000100:00100000:1.0:1786109562.210505:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922100480 00000100:00100000:1.0:1786109562.210621:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:1.0:1786109562.210632:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161841:x1872862922100480:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1786109562.210650:0:193901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109562.210668:0:193901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac1f39800/0xdb52b77d7ca36f52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a15b0 expref: -99 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.210709:0:193901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac1f39800/0xdb52b77d7ca36f52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15b0 expref: 10 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.210720:0:193901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac1f39800/0xdb52b77d7ca36f52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15b0 expref: 10 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109562.210729:0:193901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f39800, rc 0) 00000100:00100000:1.0:1786109562.210795:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161841:x1872862922100480:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 165us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109562.210803:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:3.0:1786109562.212852:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109562.212955:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922100608 00000100:00100000:2.0:1786109562.212964:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922100608 00000100:00100000:2.0:1786109562.213051:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:2.0:1786109562.213062:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161841:x1872862922100608:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786109562.213205:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161841:x1872862922100608:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 145us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109562.213213:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:0.0:1786109562.215275:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109562.215381:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922100736 00000100:00100000:1.0:1786109562.215390:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922100736 00000100:00100000:1.0:1786109562.215495:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:1.0:1786109562.215506:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161841:x1872862922100736:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1786109562.215661:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161841:x1872862922100736:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 156us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109562.215669:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:0.0:1786109562.219501:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109562.219664:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922100864 00000100:00100000:2.0:1786109562.219673:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922100864 00000100:00100000:2.0:1786109562.219763:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:2.0:1786109562.219783:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161864:x1872862922100864:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786109562.219965:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161864:x1872862922100864:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 192us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109562.219973:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:2.0:1786109562.225028:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109562.225159:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922100992 00000100:00100000:1.0:1786109562.225169:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922100992 00000100:00100000:1.0:1786109562.225259:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:1.0:1786109562.225270:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161864:x1872862922100992:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786109562.225676:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161864:x1872862922100992:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 375us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109562.225685:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:0.0:1786109562.229718:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109562.229965:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922101120 00000100:00100000:1.0:1786109562.229975:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922101120 00000100:00100000:1.0:1786109562.230097:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1011 00000100:00100000:1.0:1786109562.230105:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922101120:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:1.0:1786109562.230135:0:189813:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp t0 exp 0000000000000000 cur 8418 last 0 00000020:00000080:1.0:1786109562.230180:0:189813:0:(genops.c:1406:class_connect()) connect: client fac74500-4523-4794-af20-dfdcdfae19c1, cookie 0xdb52b77d7ca36f59 00000004:00100000:1.0:1786109562.230202:0:189813:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1786109562.230386:0:189813:0:(import.c:65:import_set_state_nolock()) ffff930a9788e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786109562.230473:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922101120:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 367us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109562.230481:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1011 00000100:00100000:0.0:1786109562.236706:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109562.236800:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922101632 00000100:00100000:1.0:1786109562.236809:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922101632 00000100:00100000:1.0:1786109562.236891:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1012 00000100:00100000:1.0:1786109562.236901:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:161841:x1872862922101632:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1786109562.236934:0:187900:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445683200 avail 1299443712 00000100:00100000:1.0:1786109562.237183:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:161841:x1872862922101632:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 282us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109562.237192:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1012 00000100:00080000:2.0:1786109562.237378:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109562.237657:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109562.237696:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109562.237764:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922101376 00000100:00100000:0.0:1786109562.237770:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922101376 00000100:00100000:0.0:1786109562.237810:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922101248 00000100:00100000:0.0:1786109562.237813:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922101248 00000100:00100000:0.0:1786109562.237845:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1013 00000100:00100000:0.0:1786109562.237851:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1872862922101376:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1786109562.237874:0:188678:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp t0 exp 0000000000000000 cur 8418 last 0 00000020:00000080:0.0:1786109562.237931:0:188678:0:(genops.c:1406:class_connect()) connect: client fac74500-4523-4794-af20-dfdcdfae19c1, cookie 0xdb52b77d7ca36f60 00000004:00100000:0.0:1786109562.237952:0:188678:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1786109562.238053:0:188678:0:(import.c:65:import_set_state_nolock()) ffff930a87b2f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109562.238095:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922101376:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 243us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109562.238103:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1013 00000100:00100000:0.0:1786109562.238119:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1014 00000100:00100000:0.0:1786109562.238125:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:0:x1872862922101248:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1786109562.238140:0:188678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445683200 avail 1299443712 00000100:00100000:0.0:1786109562.238168:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:0:x1872862922101248:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 42us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109562.238174:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1014 00000100:00100000:0.0:1786109562.246382:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109562.246589:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922101504 00000100:00100000:1.0:1786109562.246603:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922101504 00000100:00080000:2.0:1786109562.246703:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109562.246831:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1015 00000100:00100000:1.0:1786109562.246843:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:0:x1872862922101504:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1786109562.246872:0:187900:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446109184 avail 1299869696 00000100:00100000:1.0:1786109562.246970:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:0:x1872862922101504:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 129us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109562.246977:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1015 00000100:00100000:0.0:1786109562.247812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109562.247886:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922101760 00000100:00100000:3.0:1786109562.247891:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922101760 00000100:00100000:3.0:1786109562.247988:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1016 00000100:00100000:3.0:1786109562.247997:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:161841:x1872862922101760:12345-192.168.203.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1786109562.248079:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:161841:x1872862922101760:12345-192.168.203.38@tcp:40:mount.lustre.0 Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109562.248086:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1016 00000100:00100000:2.0:1786109562.252182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109562.252322:0:187911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922102144 00000100:00100000:0.0:1786109562.252331:0:187911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922102144 00000100:00100000:0.0:1786109562.252426:0:187911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1786109562.252567:0:187911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fac74500-4523-4794-af20-dfdcdfae19c1+6:161841:x1872862922102144:12345-192.168.203.38@tcp:900:mount.lustre.0 00000100:00100000:0.0:1786109562.252685:0:187911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fac74500-4523-4794-af20-dfdcdfae19c1+6:161841:x1872862922102144:12345-192.168.203.38@tcp:900:mount.lustre.0 Request processed in 122us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109562.253115:0:187911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1786109562.254187:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109562.254271:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109562.254508:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922101888 00000100:00100000:1.0:1786109562.254529:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922101888 00000100:00100000:1.0:1786109562.254565:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922102016 00000100:00100000:1.0:1786109562.254569:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922102016 00000100:00100000:1.0:1786109562.254610:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23105 00000100:00100000:1.0:1786109562.254619:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1872862922101888:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00020000:1.0:1786109562.254642:0:9990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109562.254705:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1872862922101888:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 83us (519us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109562.254721:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23105 00000100:00100000:1.0:1786109562.254743:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23106 00000100:00100000:1.0:1786109562.254751:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1872862922102016:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:1.0:1786109562.254793:0:9990:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp t0 exp 0000000000000000 cur 8418 last 0 00000020:00000080:1.0:1786109562.254831:0:9990:0:(genops.c:1406:class_connect()) connect: client fac74500-4523-4794-af20-dfdcdfae19c1, cookie 0xdb52b77d7ca36f67 00002000:00100000:1.0:1786109562.254842:0:9990:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fac74500-4523-4794-af20-dfdcdfae19c1/ffff930a97cec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1786109562.254852:0:9990:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1786109562.254922:0:9990:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1786109562.254947:0:9990:0:(import.c:65:import_set_state_nolock()) ffff930a97ceb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786109562.255057:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922102016:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 245us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109562.255066:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23106 00000100:00100000:2.0:1786109562.256661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109562.256806:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922102272 00000100:00100000:3.0:1786109562.256814:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922102272 00000100:00100000:3.0:1786109562.256911:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:3.0:1786109562.256922:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:161841:x1872862922102272:12345-192.168.203.38@tcp:33:mount.lustre.0 00000004:00080000:2.0:1786109562.258083:0:187903:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1072us 00000004:00200000:0.0:1786109562.267118:0:187903:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000100:00100000:0.0:1786109562.267242:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:161841:x1872862922102272:12345-192.168.203.38@tcp:33:mount.lustre.0 Request processed in 10318us (10582us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109562.267256:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00010000:00010000:3.0:1786109562.500725:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109563.524623:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109564.550838:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109565.572770:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109565.757502:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933270016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109565.757570:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109565.757719:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933270016 00000100:00100000:2.0:1786109565.757727:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933270016 00000100:00100000:2.0:1786109565.757796:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5827 00000100:00100000:2.0:1786109565.757807:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933270016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109565.758125:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00080000:3.0:1786109565.758346:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109565.758577:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933270016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 772us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109565.758586:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5827 00000100:00100000:3.0:1786109565.758655:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933270016:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1786109566.604947:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109566.725997:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109566.726020:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933270144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109566.726259:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109566.726383:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933270144 00000100:00100000:2.0:1786109566.726391:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933270144 00000100:00100000:2.0:1786109566.726470:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12351 00000100:00100000:2.0:1786109566.726481:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933270144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109566.726514:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1786109566.726562:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933270144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109566.726569:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12351 00000100:00100000:1.0:1786109566.726665:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933270144:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1786109567.237846:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109567.237852:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1786109567.237856:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109567.237864:0:192991:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8418 00000100:00080000:2.0:1786109567.237870:0:192991:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786109567.237877:0:192991:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930a89106800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109567.237898:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098e50f100 x1872862933270784/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109567.237927:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786109567.237930:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1786109567.237932:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109567.237936:0:192991:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 8418 00000100:00080000:2.0:1786109567.237938:0:192991:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109567.237942:0:192991:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff930ab7c42000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109567.237952:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098e50dc00 x1872862933271168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109567.237989:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933270272:0@lo:400:kworker.0 00000100:00100000:2.0:1786109567.238055:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109567.238109:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933270912:0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.238111:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933270400:0@lo:400:kworker.0 00000100:00100000:2.0:1786109567.238134:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109567.238136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109567.238153:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933271040:0@lo:400:kworker.0 00000100:00100000:2.0:1786109567.238159:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933271552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109567.238170:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109567.238177:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109567.238187:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786109567.238192:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786109567.238192:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933270528:0@lo:400:kworker.0 00000100:00100000:2.0:1786109567.238196:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933270656:0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.238210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109567.238213:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109567.238226:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933271424:0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.238226:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933271296:0@lo:400:kworker.0 00000100:00100000:2.0:1786109567.238245:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109567.238245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109567.238270:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933270784:0@lo:8:kworker.0 00000100:00100000:0.0:1786109567.238270:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933270400 00000100:00100000:0.0:1786109567.238276:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933270400 00000100:00100000:2.0:1786109567.238290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109567.238306:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933271168:0@lo:8:kworker.0 00000100:00100000:2.0:1786109567.238330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109567.238357:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933270272 00000100:00100000:2.0:1786109567.238360:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933270272 00000100:00100000:2.0:1786109567.238398:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786109567.238406:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3649:x1872862933270272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.239223:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933271040 00000100:00100000:0.0:1786109567.239229:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933271040 00000100:00100000:0.0:1786109567.239243:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933270528 00000100:00100000:0.0:1786109567.239246:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933270528 00000100:00100000:0.0:1786109567.239257:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933271424 00000100:00100000:0.0:1786109567.239260:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933271424 00000100:00100000:0.0:1786109567.239273:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1786109567.239280:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933270400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.243621:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933270400:12345-0@lo:400:kworker.0 Request processed in 4335us (5477us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109567.243626:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109567.243637:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1786109567.243664:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1786109567.243675:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933271040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.244210:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933271040:12345-0@lo:400:kworker.0 Request processed in 537us (6036us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109567.244218:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1786109567.244233:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1786109567.244241:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933270528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.244269:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933270528:12345-0@lo:400:kworker.0 Request processed in 30us (6057us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109567.244274:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1786109567.244284:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1786109567.244290:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933271424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.244323:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933271424:12345-0@lo:400:kworker.0 Request processed in 34us (6077us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109567.244329:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1786109567.244357:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933270912 00000100:00100000:0.0:1786109567.244363:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933270912 00000100:00100000:0.0:1786109567.244396:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933271296 00000100:00100000:0.0:1786109567.244399:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933271296 00000100:00100000:0.0:1786109567.244457:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933270784 00000100:00100000:0.0:1786109567.244461:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933270784 00000100:00100000:0.0:1786109567.244473:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933271168 00000100:00100000:0.0:1786109567.244485:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933271168 00000100:00100000:0.0:1786109567.244500:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6972 00000100:00100000:0.0:1786109567.244506:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933270912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.244534:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933270912:12345-0@lo:400:kworker.0 Request processed in 29us (6399us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109567.244539:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6972 00000100:00100000:0.0:1786109567.244548:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6973 00000100:00100000:0.0:1786109567.244552:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933271296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.244572:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933271296:12345-0@lo:400:kworker.0 Request processed in 20us (6327us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109567.244576:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6973 00000100:00100000:0.0:1786109567.244584:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23107 00000100:00100000:0.0:1786109567.244588:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3645:x1872862933270784:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1786109567.244604:0:179240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109567.244630:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3645:x1872862933270784:12345-0@lo:8:kworker.0 Request processed in 41us (6339us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109567.244635:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23107 00000100:00100000:0.0:1786109567.244645:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23108 00000100:00100000:0.0:1786109567.244649:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3645:x1872862933271168:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1786109567.244658:0:179240:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109567.244680:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:3645:x1872862933271168:12345-0@lo:8:kworker.0 Request processed in 30us (6349us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109567.244685:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23108 00000100:00080000:0.0:1786109567.244704:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109567.244718:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109567.244720:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786109567.244767:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93098e50ea00 x1872862933271424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109567.244781:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933271424:0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.244794:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933270912:0@lo:400:kworker.0 00000100:00080000:0.0:1786109567.244845:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109567.244851:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109567.244854:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933270784:0@lo:8:kworker.0 00000100:00080000:0.0:1786109567.244863:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109567.244866:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109567.244868:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933271168:0@lo:8:kworker.0 00000100:00100000:3.0:1786109567.245318:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933271680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109567.246574:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933271552 00000100:00100000:1.0:1786109567.246584:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933271552 00000100:00100000:1.0:1786109567.246628:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933270656 00000100:00100000:0.0:1786109567.246629:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933270528:0@lo:400:kworker.0 00000100:00100000:1.0:1786109567.246631:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933270656 00000100:00100000:2.0:1786109567.246845:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3649:x1872862933270272:12345-0@lo:400:kworker.0 Request processed in 8438us (8788us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109567.246856:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1786109567.247000:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12352 00000100:00100000:1.0:1786109567.247010:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1872862933271552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109567.247040:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445683200 avail 1299443712 00000100:00100000:1.0:1786109567.247089:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1872862933271552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (8910us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109567.247095:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12352 00000100:00100000:1.0:1786109567.247111:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12353 00000100:00100000:1.0:1786109567.247117:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933270656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109567.247147:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933270656:12345-0@lo:400:kworker.0 Request processed in 30us (8932us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109567.247152:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12353 00000100:00100000:3.0:1786109567.247206:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109567.247305:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933271296:0@lo:400:kworker.0 00010000:00080000:0.0:1786109567.247591:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93098e50ca80 x1872862933270400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109567.247604:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933270400:0@lo:400:kworker.0 00010000:00080000:0.0:1786109567.247616:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93098e50f800 x1872862933271040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109567.247853:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933271040:0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.248534:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933270656:0@lo:400:kworker.0 00000100:00100000:0.0:1786109567.248551:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933271552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109567.248560:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933270272:0@lo:400:kworker.0 00000100:00100000:1.0:1786109567.275427:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933271680 00000100:00100000:1.0:1786109567.275458:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933271680 00000100:00100000:3.0:1786109567.277454:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5828 00000100:00100000:3.0:1786109567.277467:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933271680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109567.277509:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109567.277588:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933271680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (30381us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109567.277599:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5828 00000100:00100000:3.0:1786109567.277652:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933271680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109567.503548:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109567.503630:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922102400 00000100:00100000:3.0:1786109567.503639:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922102400 00000100:00100000:0.0:1786109567.503756:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109567.503784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109567.503801:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109567.503825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109567.503844:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922102528 00000100:00100000:3.0:1786109567.503919:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:3.0:1786109567.503929:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922102400:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109567.504004:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922102400:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 76us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109567.504012:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:0.0:1786109567.504063:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922102528 00000100:00100000:0.0:1786109567.504104:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922102656 00000100:00100000:0.0:1786109567.504107:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922102656 00000100:00100000:0.0:1786109567.504128:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 236 00000100:00100000:0.0:1786109567.504135:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922102528:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109567.504166:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922102528:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 32us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109567.504172:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 236 00000100:00100000:0.0:1786109567.504185:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 237 00000100:00100000:0.0:1786109567.504191:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2403:x1872862922102656:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109567.504216:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2403:x1872862922102656:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109567.504222:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 237 00000100:00080000:0.0:1786109567.504239:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109567.504242:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109567.504360:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922102784 00000100:00100000:0.0:1786109567.504364:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922102784 00000100:00100000:0.0:1786109567.504379:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922102912 00000100:00100000:0.0:1786109567.504381:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922102912 00000100:00100000:0.0:1786109567.504402:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6974 00000100:00100000:0.0:1786109567.504408:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922102912:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109567.504456:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922102912:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 48us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109567.504462:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6974 00000100:00100000:0.0:1786109567.504472:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23109 00000100:00100000:0.0:1786109567.504476:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2401:x1872862922102784:12345-192.168.203.38@tcp:8:kworker.0 00010000:00020000:0.0:1786109567.504494:0:43920:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109567.504512:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2401:x1872862922102784:12345-192.168.203.38@tcp:8:kworker.0 Request processed in 34us (728us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109567.504517:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23109 00000100:00080000:0.0:1786109567.504547:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786109567.636859:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1786109568.007734:0:194578:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1786109568.007750:0:194578:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1786109568.007752:0:194578:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1786109568.007882:0:194578:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff930a88c18000 00000020:01000004:3.0:1786109568.007898:0:194578:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1786109568.007911:0:194578:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1786109568.007924:0:194578:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93098272cd40) 00000020:00000080:3.0:1786109568.007943:0:194578:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1786109568.055485:0:194578:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1786109568.058179:0:194578:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1786109568.058902:0:194578:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1786109568.059261:0:194578:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1786109568.059647:0:194578:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1786109568.059841:0:194578:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1786109568.060138:0:194578:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1786109568.062317:0:194578:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1786109568.062764:0:194578:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1786109568.062777:0:194578:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1786109568.062865:0:194578:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdb52b77d7ca36f75 00000020:01000004:0.0:1786109568.062873:0:194578:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1786109568.062896:0:194578:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1786109568.062900:0:194578:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1786109568.062905:0:194578:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1786109568.062934:0:194578:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1786109568.062938:0:194578:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1786109568.074147:0:194578:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:1.0:1786109568.074183:0:194578:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1786109568.074188:0:194578:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1786109568.074190:0:194578:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786109568.074191:0:194578:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109568.074192:0:194578:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109568.074194:0:194578:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109568.074195:0:194578:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109568.074197:0:194578:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786109568.074198:0:194578:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109568.074199:0:194578:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786109568.074203:0:194578:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1786109568.074205:0:194578:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786109568.074206:0:194578:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786109568.074207:0:194578:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109568.074208:0:194578:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109568.074210:0:194578:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109568.074211:0:194578:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109568.074212:0:194578:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786109568.074213:0:194578:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109568.074214:0:194578:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786109568.074238:0:194578:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1786109568.074259:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933271808:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1786109568.074328:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109568.074420:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098e349240 going to sleep for 11 seconds 00000100:00100000:2.0:1786109568.074662:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933271808 00000100:00100000:2.0:1786109568.074669:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933271808 00000100:00100000:2.0:1786109568.074757:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1786109568.074767:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:194578:x1872862933271808:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1786109568.074797:0:193903:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1786109568.074800:0:193903:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1786109568.074804:0:193903:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000001:00100000:0.0:1786109568.075962:0:193896:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000100:00100000:2.0:1786109568.076187:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:194578:x1872862933271808:12345-0@lo:253:mount.lustre.0 Request processed in 1418us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109568.076197:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1786109568.076298:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933271808:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1786109568.076311:0:194578:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1786109568.076313:0:194578:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786109568.076315:0:194578:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1786109568.076316:0:194578:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109568.076318:0:194578:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109568.076319:0:194578:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109568.076320:0:194578:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109568.076321:0:194578:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786109568.076323:0:194578:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109568.076324:0:194578:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1786109568.076344:0:194578:0:(tgt_mount.c:101:server_register_mount()) register mount ffff930a88c18000 from lustre-OST0000 10000000:01000000:3.0:1786109568.076371:0:194578:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1786109568.076373:0:194578:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1786109568.076382:0:194578:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff930a8a73cd40 local copy 00010000:00010000:3.0:1786109568.076392:0:194578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e3a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109568.076620:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933271936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109568.076654:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109568.076883:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109568.076950:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933271936 00000100:00100000:1.0:1786109568.076965:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933271936 00000100:00100000:1.0:1786109568.076996:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786109568.077004:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:194578:x1872862933271936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109568.077190:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:194578:x1872862933271936:12345-0@lo:501:mount.lustre.0 Request processed in 186us (535us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786109568.077198:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1786109568.077270:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933271936:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1786109568.077285:0:194578:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1786109568.077303:0:194578:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1786109568.077309:0:194578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e3a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109568.077318:0:194578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36e3a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109568.077346:0:194578:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff930a88c18000 10000000:01000000:3.0:1786109568.077352:0:194578:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1786109568.077356:0:194578:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1786109568.077358:0:194578:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786109568.077363:0:194578:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1786109568.077365:0:194578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1786109568.077386:0:194578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628be00/0xdb52b77d7ca36f7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109568.077394:0:194578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930aa628be00/0xdb52b77d7ca36f7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109568.077404:0:194578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930aa628be00/0xdb52b77d7ca36f7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109568.077757:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786109568.077786:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109568.077814:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109568.077875:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933272064 00000100:00100000:1.0:1786109568.077880:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933272064 00000100:00100000:1.0:1786109568.077899:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786109568.077906:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:194578:x1872862933272064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109568.077915:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109568.077927:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac1f38600/0xdb52b77d7ca36f83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36f7c expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.077947:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac1f38600/0xdb52b77d7ca36f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36f7c expref: 22 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.077965:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac1f38600/0xdb52b77d7ca36f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36f7c expref: 22 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.077974:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f38600, rc 0) 00000100:00100000:1.0:1786109568.078162:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:194578:x1872862933272064:12345-0@lo:101:mount.lustre.0 Request processed in 255us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109568.078169:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1786109568.078362:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786109568.078376:0:194578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930aa628be00/0xdb52b77d7ca36f7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36f83 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109568.078385:0:194578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930aa628be00/0xdb52b77d7ca36f7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36f83 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786109568.079635:0:194578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 14 count 14 00000040:00080000:3.0:1786109568.080267:0:194578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109568.082715:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].1, 224 off8416 00000040:00080000:3.0:1786109568.082777:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].2, 128 off8544 00000040:00080000:3.0:1786109568.082792:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].3, 112 off8656 00000040:00080000:3.0:1786109568.082803:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].4, 224 off8880 00000040:00080000:3.0:1786109568.082815:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].5, 224 off9104 00000040:00080000:3.0:1786109568.082828:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].6, 80 off9184 00000040:00080000:3.0:1786109568.082842:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].7, 224 off9408 00000040:00080000:3.0:1786109568.082856:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].8, 224 off9632 00000040:00080000:3.0:1786109568.082869:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].9, 80 off9712 00000040:00080000:3.0:1786109568.082883:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].10, 224 off9936 00000040:00080000:3.0:1786109568.082896:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].11, 224 off10160 00000040:00080000:3.0:1786109568.082909:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].12, 120 off10280 00000040:00080000:3.0:1786109568.082930:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].13, 224 off10504 00000040:00080000:3.0:1786109568.082936:0:194578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 13 count 14 00000100:00100000:3.0:1786109568.083170:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109568.083234:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109568.083324:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109568.083371:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933272192 00000100:00100000:1.0:1786109568.083378:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933272192 00000100:00100000:1.0:1786109568.083606:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1786109568.083617:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:194578:x1872862933272192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109568.083800:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:194578:x1872862933272192:12345-0@lo:501:mount.lustre.0 Request processed in 184us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109568.083808:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786109568.083895:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109568.083928:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109568.083981:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109568.084012:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109568.084175:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933272320 00000100:00100000:0.0:1786109568.084180:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933272320 00000100:00100000:0.0:1786109568.084246:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786109568.084254:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:194578:x1872862933272320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109568.084980:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:194578:x1872862933272320:12345-0@lo:503:mount.lustre.0 Request processed in 726us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109568.084988:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786109568.085208:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272320:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1786109568.085712:0:194578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786109568.085792:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109568.085839:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109568.085883:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109568.085967:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933272448 00000100:00100000:1.0:1786109568.085973:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933272448 00000100:00100000:1.0:1786109568.086000:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1786109568.086008:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:194578:x1872862933272448:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786109568.086683:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:194578:x1872862933272448:12345-0@lo:502:mount.lustre.0 Request processed in 675us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109568.086690:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786109568.086829:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786109568.087132:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].1, 224 off8416 00000040:00080000:3.0:1786109568.087161:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].2, 128 off8544 00000040:00080000:3.0:1786109568.087176:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].3, 112 off8656 00000040:00080000:3.0:1786109568.087190:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].4, 224 off8880 00000040:00080000:3.0:1786109568.087205:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].5, 224 off9104 00000040:00080000:3.0:1786109568.087216:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].6, 80 off9184 00000040:00080000:3.0:1786109568.087229:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].7, 224 off9408 00000040:00080000:3.0:1786109568.087242:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].8, 224 off9632 00000040:00080000:3.0:1786109568.087256:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].9, 80 off9712 00000040:00080000:3.0:1786109568.087270:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].10, 224 off9936 00000040:00080000:3.0:1786109568.087284:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].11, 224 off10160 00000040:00080000:3.0:1786109568.087297:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].12, 120 off10280 00000100:00100000:3.0:1786109568.087324:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109568.087363:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109568.087461:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c540 going to sleep for 11 seconds 00000100:00100000:0.0:1786109568.087599:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933272576 00000100:00100000:0.0:1786109568.087604:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933272576 00000100:00100000:0.0:1786109568.087641:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786109568.087649:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:194578:x1872862933272576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786109568.087780:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:194578:x1872862933272576:12345-0@lo:502:mount.lustre.0 Request processed in 131us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109568.087787:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786109568.087933:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786109568.088037:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].13, 224 off10504 00000040:00080000:3.0:1786109568.088124:0:194578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1786109568.088855:0:194582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786109568.088864:0:194582:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1786109568.088871:0:194582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109568.088873:0:194582:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1786109568.088879:0:194582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786109568.088893:0:194582:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff930985213380) 00000020:00000080:1.0:1786109568.088915:0:194582:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1786109568.088921:0:194582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1786109568.089129:0:194582:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930a88c18000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1786109568.089138:0:194582:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1786109568.089145:0:194582:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdb52b77d7ca36f91 00010000:00010000:1.0:1786109568.093920:0:194582:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:1.0:1786109568.094813:0:194582:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 34359738456 srv lr: 34359738459 lx: 1872862932692864 gen 0 00000001:00080000:1.0:1786109568.094848:0:194582:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 34359738459 srv lr: 34359738459 lx: 1872862933239168 gen 0 00000001:00000004:1.0:1786109568.094866:0:194582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 34359738459 00080000:10000000:1.0:1786109568.097001:0:194582:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x11:0x0] (8/32) registered 00000020:00000080:2.0:1786109568.098302:0:194582:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1786109568.098315:0:194582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109568.098320:0:194582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109568.098323:0:194582:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1786109568.098326:0:194582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1786109568.098328:0:194582:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1786109568.098330:0:194582:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786109568.098331:0:194582:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786109568.098333:0:194582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1786109568.098336:0:194582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109568.098337:0:194582:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1786109568.098339:0:194582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109568.098341:0:194582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109568.098343:0:194582:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786109568.098345:0:194582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786109568.098347:0:194582:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1786109568.098348:0:194582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109568.098350:0:194582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109568.098351:0:194582:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1786109568.098353:0:194582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109568.098354:0:194582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109568.098355:0:194582:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1786109568.098358:0:194582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1786109568.098382:0:194582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109568.098385:0:194582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109568.098386:0:194582:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1786109568.098389:0:194582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x30:0x0] index 14 count 14 00000020:01000000:0.0:1786109568.098682:0:194578:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1786109568.098714:0:194578:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1786109568.098744:0:194578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628be00/0xdb52b77d7ca36f7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36f83 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109568.098756:0:194578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930aa628be00/0xdb52b77d7ca36f7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36f83 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109568.098763:0:194578:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930a88c18000 from 1 10000000:01000000:0.0:1786109568.098766:0:194578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786109568.098798:0:194578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca36fa6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109568.098807:0:194578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca36fa6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109568.098819:0:194578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca36fa6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109568.098841:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109568.098901:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109568.098935:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933272704 00000100:00100000:0.0:1786109568.098940:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933272704 00000100:00100000:0.0:1786109568.098987:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1786109568.098995:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:194578:x1872862933272704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109568.099007:0:193901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109568.099016:0:193901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c2a00/0xdb52b77d7ca36fad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36fa6 expref: -99 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109568.099036:0:193901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c2a00/0xdb52b77d7ca36fad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36fa6 expref: 23 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109568.099181:0:193901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c2a00/0xdb52b77d7ca36fad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36fa6 expref: 23 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109568.099190:0:193901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2a00, rc 0) 00000100:00100000:0.0:1786109568.099220:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:194578:x1872862933272704:12345-0@lo:101:mount.lustre.0 Request processed in 226us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109568.099227:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1786109568.099274:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97916cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109568.099292:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109568.099304:0:194578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca36fa6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36fad expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109568.099312:0:194578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca36fa6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36fad expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109568.100653:0:194578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 7 count 7 00000040:00080000:0.0:1786109568.100905:0:194578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786109568.101303:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].1, 224 off8416 00000040:00080000:0.0:1786109568.101328:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].2, 112 off8528 00000040:00080000:0.0:1786109568.101343:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].3, 224 off8752 00000040:00080000:0.0:1786109568.101356:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].4, 224 off8976 00000040:00080000:0.0:1786109568.101368:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].5, 112 off9088 00000040:00080000:0.0:1786109568.101385:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x31:0x0].6, 224 off9312 00000040:00080000:0.0:1786109568.101390:0:194578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 6 count 7 00000100:00100000:0.0:1786109568.101634:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109568.101693:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109568.101784:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97916900 going to sleep for 11 seconds 00000100:00100000:2.0:1786109568.104373:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933272832 00000100:00100000:2.0:1786109568.104386:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933272832 00000100:00100000:2.0:1786109568.104467:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1786109568.104478:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:194578:x1872862933272832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109568.104714:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:194578:x1872862933272832:12345-0@lo:501:mount.lustre.0 Request processed in 238us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109568.104722:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1786109568.104883:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109568.104934:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109568.104992:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109568.105039:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd17300 going to sleep for 11 seconds 00000100:00100000:2.0:1786109568.105204:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933272960 00000100:00100000:2.0:1786109568.105208:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933272960 00000100:00100000:2.0:1786109568.105242:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1786109568.105250:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:194578:x1872862933272960:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109568.105323:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:194578:x1872862933272960:12345-0@lo:503:mount.lustre.0 Request processed in 73us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109568.105330:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786109568.105417:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933272960:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1786109568.106134:0:194578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786109568.106203:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786109568.106250:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109568.106294:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd17300 going to sleep for 11 seconds 00000100:00100000:3.0:1786109568.106389:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933273088 00000100:00100000:3.0:1786109568.106394:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933273088 00000100:00100000:3.0:1786109568.106454:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1786109568.106462:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:194578:x1872862933273088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109568.106705:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:194578:x1872862933273088:12345-0@lo:502:mount.lustre.0 Request processed in 243us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109568.106712:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1786109568.106791:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273088:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786109568.107025:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].1, 224 off8416 00000040:00080000:1.0:1786109568.107129:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].2, 112 off8528 00000040:00080000:1.0:1786109568.107146:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].3, 224 off8752 00000040:00080000:1.0:1786109568.107160:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].4, 224 off8976 00000040:00080000:1.0:1786109568.107173:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].5, 112 off9088 00000100:00100000:1.0:1786109568.107197:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273216:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786109568.107232:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109568.107300:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd17300 going to sleep for 11 seconds 00000100:00100000:3.0:1786109568.110166:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933273216 00000100:00100000:3.0:1786109568.110178:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933273216 00000100:00100000:3.0:1786109568.110272:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1786109568.110282:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:194578:x1872862933273216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109568.110456:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:194578:x1872862933273216:12345-0@lo:502:mount.lustre.0 Request processed in 174us (3222us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109568.110464:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1786109568.111832:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786109568.111919:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x32:0x0].6, 224 off9312 00000040:00080000:1.0:1786109568.111931:0:194578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1786109568.113729:0:194586:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109568.113753:0:194586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109568.113756:0:194586:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1786109568.113764:0:194586:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff930a88c18000 00000020:00000080:1.0:1786109568.113766:0:194586:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786109568.113774:0:194586:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109568.113776:0:194586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109568.113778:0:194586:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1786109568.113781:0:194586:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109568.113783:0:194586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109568.113784:0:194586:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786109568.113788:0:194586:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff930a88c18000 00000020:00000080:1.0:1786109568.113790:0:194586:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786109568.113852:0:194586:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109568.113856:0:194586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109568.113857:0:194586:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1786109568.113860:0:194586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x32:0x0] index 7 count 7 00000020:01000000:1.0:1786109568.113903:0:194578:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1786109568.113931:0:194578:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786109568.113954:0:194578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca36fa6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36fad expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.113977:0:194578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca36fa6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36fad expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109568.114023:0:194578:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1786109568.114026:0:194578:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff930a88c18000 10000000:01000000:1.0:1786109568.114029:0:194578:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff930a88c18000 10000000:01000000:1.0:1786109568.114033:0:194578:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786109568.114039:0:194578:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930a88c18000 from 1 10000000:01000000:1.0:1786109568.114160:0:194578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786109568.114199:0:194578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f38c00/0xdb52b77d7ca36fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.114209:0:194578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac1f38c00/0xdb52b77d7ca36fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.114221:0:194578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac1f38c00/0xdb52b77d7ca36fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109568.114245:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109568.114312:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109568.117156:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd176c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109568.117267:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933273344 00000100:00100000:2.0:1786109568.117275:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933273344 00000100:00100000:2.0:1786109568.117322:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1786109568.117330:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:194578:x1872862933273344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109568.117345:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109568.117360:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd76e00/0xdb52b77d7ca36fbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36fb4 expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.117384:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd76e00/0xdb52b77d7ca36fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36fb4 expref: 24 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.117394:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd76e00/0xdb52b77d7ca36fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36fb4 expref: 24 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.117403:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd76e00, rc 0) 00000100:00100000:2.0:1786109568.120175:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933273344:12345-0@lo:101:mount.lustre.0 Request processed in 2835us (5853us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109568.120188:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1786109568.120254:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109568.120277:0:194578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac1f38c00/0xdb52b77d7ca36fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36fbb expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.120289:0:194578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac1f38c00/0xdb52b77d7ca36fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36fbb expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109568.124955:0:194578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 52 count 51 00000040:00080000:2.0:1786109568.125369:0:194578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786109568.125684:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].1, 224 off8416 00000040:00080000:2.0:1786109568.125711:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].2, 120 off8536 00000040:00080000:2.0:1786109568.125729:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].3, 168 off8704 00000040:00080000:2.0:1786109568.125757:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].4, 224 off8928 00000040:00080000:2.0:1786109568.125771:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].5, 224 off9152 00000040:00080000:2.0:1786109568.125785:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].6, 120 off9272 00000040:00080000:2.0:1786109568.125799:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].7, 168 off9440 00000040:00080000:2.0:1786109568.125811:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].8, 224 off9664 00000040:00080000:2.0:1786109568.125823:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].9, 224 off9888 00000040:00080000:2.0:1786109568.125836:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].10, 120 off10008 00000040:00080000:2.0:1786109568.125851:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].11, 224 off10232 00000040:00080000:2.0:1786109568.125867:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].12, 224 off10456 00000040:00080000:2.0:1786109568.125881:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].13, 88 off10544 00000040:00080000:2.0:1786109568.125897:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].14, 128 off10672 00000040:00080000:2.0:1786109568.125908:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].15, 144 off10816 00000040:00080000:2.0:1786109568.125921:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].16, 160 off10976 00000040:00080000:2.0:1786109568.125933:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].17, 224 off11200 00000040:00080000:2.0:1786109568.125945:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].18, 224 off11424 00000040:00080000:2.0:1786109568.126024:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].19, 80 off11504 00000040:00080000:2.0:1786109568.126121:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].20, 224 off11728 00000040:00080000:2.0:1786109568.126140:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].21, 224 off11952 00000040:00080000:2.0:1786109568.126153:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].22, 88 off12040 00000040:00080000:2.0:1786109568.126164:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].23, 128 off12168 00000040:00080000:2.0:1786109568.126178:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].24, 144 off12312 00000040:00080000:2.0:1786109568.126191:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].25, 160 off12472 00000040:00080000:2.0:1786109568.126203:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].26, 224 off12696 00000040:00080000:2.0:1786109568.126217:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].27, 224 off12920 00000040:00080000:2.0:1786109568.126231:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].28, 80 off13000 00000040:00080000:2.0:1786109568.126244:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].29, 224 off13224 00000040:00080000:2.0:1786109568.126258:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].30, 224 off13448 00000040:00080000:2.0:1786109568.126271:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].31, 88 off13536 00000040:00080000:2.0:1786109568.126286:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].32, 128 off13664 00000040:00080000:2.0:1786109568.126300:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].33, 144 off13808 00000040:00080000:2.0:1786109568.126315:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].34, 128 off13936 00000040:00080000:2.0:1786109568.126328:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].35, 224 off14160 00000040:00080000:2.0:1786109568.126342:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].36, 224 off14384 00000040:00080000:2.0:1786109568.126355:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].37, 80 off14464 00000040:00080000:2.0:1786109568.126367:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].38, 224 off14688 00000040:00080000:2.0:1786109568.126380:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].39, 224 off14912 00000040:00080000:2.0:1786109568.126394:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].40, 88 off15000 00000040:00080000:2.0:1786109568.126409:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].41, 128 off15128 00000040:00080000:2.0:1786109568.126423:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].42, 144 off15272 00000040:00080000:2.0:1786109568.126463:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].43, 128 off15400 00000040:00080000:2.0:1786109568.126485:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].44, 224 off15624 00000040:00080000:2.0:1786109568.126499:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].45, 224 off15848 00000040:00080000:2.0:1786109568.126512:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].46, 80 off15928 00000040:00080000:2.0:1786109568.127564:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].47, 224 off16152 00000040:00080000:2.0:1786109568.127606:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].48, 232 off16384 00000040:00080000:2.0:1786109568.128184:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].49, 224 off16608 00000040:00080000:2.0:1786109568.128209:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].50, 120 off16728 00000040:00080000:2.0:1786109568.128225:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x33:0x0].51, 224 off16952 00000040:00080000:2.0:1786109568.128229:0:194578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 51 count 51 00000100:00100000:2.0:1786109568.128345:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109568.128410:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109568.128614:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933273472 00000100:00100000:0.0:1786109568.128622:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933273472 00000100:00100000:2.0:1786109568.129171:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd176c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109568.129701:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1786109568.129715:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933273472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109568.129879:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933273472:12345-0@lo:501:mount.lustre.0 Request processed in 167us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109568.129887:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1786109568.133392:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109568.135247:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109568.135326:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109568.135382:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd176c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109568.135502:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933273600 00000100:00100000:1.0:1786109568.135509:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933273600 00000100:00100000:1.0:1786109568.135633:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1786109568.135643:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933273600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109568.135777:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933273600:12345-0@lo:503:mount.lustre.0 Request processed in 135us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109568.135784:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1786109568.135879:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1786109568.136477:0:194578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786109568.136633:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109568.136682:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109568.136721:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109568.136803:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933273728 00000100:00100000:2.0:1786109568.136808:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933273728 00000100:00100000:2.0:1786109568.136833:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1786109568.136841:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933273728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786109568.136933:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933273728:12345-0@lo:502:mount.lustre.0 Request processed in 92us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109568.136941:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1786109568.137141:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786109568.137309:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].1, 224 off8416 00000040:00080000:3.0:1786109568.137336:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].2, 120 off8536 00000040:00080000:3.0:1786109568.137350:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].3, 168 off8704 00000040:00080000:3.0:1786109568.137364:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].4, 224 off8928 00000040:00080000:3.0:1786109568.137376:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].5, 224 off9152 00000040:00080000:3.0:1786109568.137391:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].6, 120 off9272 00000040:00080000:3.0:1786109568.137405:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].7, 168 off9440 00000040:00080000:3.0:1786109568.137420:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].8, 224 off9664 00000040:00080000:3.0:1786109568.137466:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].9, 224 off9888 00000040:00080000:3.0:1786109568.137483:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].10, 120 off10008 00000040:00080000:3.0:1786109568.137496:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].11, 224 off10232 00000040:00080000:3.0:1786109568.137509:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].12, 224 off10456 00000040:00080000:3.0:1786109568.137717:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].13, 88 off10544 00000040:00080000:3.0:1786109568.137754:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].14, 128 off10672 00000040:00080000:3.0:1786109568.137771:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].15, 144 off10816 00000040:00080000:3.0:1786109568.137787:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].16, 160 off10976 00000040:00080000:3.0:1786109568.137802:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].17, 224 off11200 00000040:00080000:3.0:1786109568.137814:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].18, 224 off11424 00000040:00080000:3.0:1786109568.137825:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].19, 80 off11504 00000040:00080000:3.0:1786109568.137838:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].20, 224 off11728 00000040:00080000:3.0:1786109568.137853:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].21, 224 off11952 00000040:00080000:3.0:1786109568.137868:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].22, 88 off12040 00000040:00080000:3.0:1786109568.137884:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].23, 128 off12168 00000040:00080000:3.0:1786109568.137898:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].24, 144 off12312 00000040:00080000:3.0:1786109568.137913:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].25, 160 off12472 00000040:00080000:3.0:1786109568.137927:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].26, 224 off12696 00000040:00080000:3.0:1786109568.137939:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].27, 224 off12920 00000040:00080000:3.0:1786109568.137952:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].28, 80 off13000 00000040:00080000:3.0:1786109568.138123:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].29, 224 off13224 00000040:00080000:3.0:1786109568.138144:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].30, 224 off13448 00000040:00080000:3.0:1786109568.138159:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].31, 88 off13536 00000040:00080000:3.0:1786109568.138175:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].32, 128 off13664 00000040:00080000:3.0:1786109568.138188:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].33, 144 off13808 00000040:00080000:3.0:1786109568.138203:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].34, 128 off13936 00000040:00080000:3.0:1786109568.138217:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].35, 224 off14160 00000040:00080000:3.0:1786109568.138231:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].36, 224 off14384 00000040:00080000:3.0:1786109568.138246:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].37, 80 off14464 00000040:00080000:3.0:1786109568.138263:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].38, 224 off14688 00000040:00080000:3.0:1786109568.138279:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].39, 224 off14912 00000040:00080000:3.0:1786109568.138294:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].40, 88 off15000 00000040:00080000:3.0:1786109568.138309:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].41, 128 off15128 00000040:00080000:3.0:1786109568.138323:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].42, 144 off15272 00000040:00080000:3.0:1786109568.138338:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].43, 128 off15400 00000040:00080000:3.0:1786109568.138352:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].44, 224 off15624 00000040:00080000:3.0:1786109568.138367:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].45, 224 off15848 00000040:00080000:3.0:1786109568.138381:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].46, 80 off15928 00000040:00080000:3.0:1786109568.138398:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].47, 224 off16152 00000040:00080000:3.0:1786109568.138414:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].48, 232 off16384 00000100:00100000:3.0:1786109568.142848:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109568.142932:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109568.143473:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109568.146656:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933273856 00000100:00100000:0.0:1786109568.146670:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933273856 00000100:00100000:0.0:1786109568.146729:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1786109568.146751:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933273856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786109568.146916:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933273856:12345-0@lo:502:mount.lustre.0 Request processed in 177us (3983us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109568.146924:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1786109568.146997:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786109568.147646:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].49, 224 off16608 00000040:00080000:0.0:1786109568.147677:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].50, 120 off16728 00000100:00100000:0.0:1786109568.147717:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273984:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786109568.147778:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109568.147822:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab95ae840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109568.147895:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933273984 00000100:00100000:3.0:1786109568.147900:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933273984 00000100:00100000:3.0:1786109568.147941:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1786109568.147948:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933273984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109568.148264:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933273984:12345-0@lo:502:mount.lustre.0 Request processed in 314us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109568.148271:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1786109568.148396:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933273984:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786109568.148469:0:194578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x34:0x0].51, 224 off16952 00000040:00080000:0.0:1786109568.148479:0:194578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1786109568.149464:0:194589:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1786109568.149481:0:194589:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff930ab1d44d40) 00000020:00000080:3.0:1786109568.149506:0:194589:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1786109568.149753:0:194589:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930a88c18000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786109568.149757:0:194589:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930a88c18000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786109568.149760:0:194589:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930a88c18000 3 00010000:00080000:3.0:1786109568.149787:0:194589:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930981e11800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1786109568.155593:0:194589:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:3.0:1786109568.155709:0:194589:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1786109568.155770:0:194589:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786109568.155783:0:194589:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdb52b77d7ca36fc9 00000100:00080000:3.0:1786109568.155794:0:194589:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786109568.155799:0:194589:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109568.155834:0:194589:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1783800 x1872862933274112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109568.155984:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933274112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786109568.156067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109568.156722:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933274112 00000100:00100000:1.0:1786109568.156731:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933274112 00000100:00100000:1.0:1786109568.156780:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1786109568.156788:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933274112:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1786109568.156815:0:189813:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 8424 last 0 00000020:00000080:1.0:1786109568.156849:0:189813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdb52b77d7ca36fd0 00000004:00100000:1.0:1786109568.156864:0:189813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786109568.156894:0:189813:0:(import.c:65:import_set_state_nolock()) ffff93098e512800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1786109568.157008:0:194589:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1786109568.157731:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109568.157747:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1786109568.157749:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109568.157755:0:181792:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 8423 00000100:00080000:3.0:1786109568.157759:0:181792:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109568.157764:0:181792:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930a89106800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109568.157781:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1783100 x1872862933274624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109568.157820:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109568.157834:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933274240:0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.157875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109568.157907:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933274496:0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.157934:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109568.157954:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786109568.157960:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933274368:0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.157980:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109568.158004:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933274240 00000100:00100000:0.0:1786109568.158009:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933274240 00000100:00100000:0.0:1786109568.158213:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933274368 00000100:00100000:0.0:1786109568.158217:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933274368 00000100:00100000:0.0:1786109568.158243:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1786109568.158252:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933274240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.158294:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933274240:12345-0@lo:400:kworker.0 Request processed in 43us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109568.158300:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1786109568.158478:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1786109568.158487:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933274368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.158600:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933274368:12345-0@lo:400:kworker.0 Request processed in 38us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109568.158608:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00010000:00080000:0.0:1786109568.158651:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff930ac1783480 x1872862933274240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109568.158665:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933274240:0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.158690:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933274368:0@lo:400:kworker.0 00000100:00100000:2.0:1786109568.159227:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933274624:0@lo:8:kworker.0 00000100:00100000:2.0:1786109568.159264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109568.159424:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872862933274112:12345-0@lo:38:llog_process_th.0 Request processed in 2634us (3355us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109568.159445:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00080000:3.0:1786109568.162864:0:181792:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786109568.162870:0:181792:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1786109568.162874:0:181792:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109568.162881:0:181792:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 8423 00000100:00080000:3.0:1786109568.162886:0:181792:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1786109568.162892:0:181792:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff930ab7c42000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109568.162916:0:181792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9676300 x1872862933275136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109568.162983:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933274880:0@lo:400:kworker.0 00000100:00100000:3.0:1786109568.163058:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109568.163311:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786109568.163318:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933274752:0@lo:400:kworker.0 00000100:00100000:3.0:1786109568.163346:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109568.163444:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933275264:0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.163477:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933274880 00000100:00100000:0.0:1786109568.163485:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933274880 00000100:00100000:0.0:1786109568.163863:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1786109568.163873:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933274880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.163925:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933274880:12345-0@lo:400:kworker.0 Request processed in 53us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109568.163931:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00010000:00080000:2.0:1786109568.166406:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff930ac1783800 x1872862933274112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109568.166419:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786109568.166449:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 79 00000100:00080000:2.0:1786109568.166458:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1786109568.166463:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1786109568.166467:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1786109568.166474:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933274112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786109568.166504:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933275136:0@lo:8:kworker.0 00000100:00100000:2.0:1786109568.166645:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933275008:0@lo:400:kworker.0 00000100:00100000:2.0:1786109568.166671:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109568.166720:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933274496 00000100:00100000:2.0:1786109568.166727:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933274496 00000100:00100000:2.0:1786109568.166778:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933275008 00000100:00100000:2.0:1786109568.166781:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933275008 00000100:00100000:2.0:1786109568.166800:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12354 00000100:00100000:2.0:1786109568.166808:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933274496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109568.166862:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933274496:12345-0@lo:400:kworker.0 Request processed in 55us (8927us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109568.166869:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12354 00000100:00100000:2.0:1786109568.166885:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12355 00000100:00100000:2.0:1786109568.166891:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933275008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109568.166922:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933275008:12345-0@lo:400:kworker.0 Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109568.166928:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12355 00000100:00100000:2.0:1786109568.166975:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933275008:0@lo:400:kworker.0 00000100:00100000:3.0:1786109568.167387:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933275392:0@lo:400:kworker.0 00000100:00100000:3.0:1786109568.167422:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1786109568.167467:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff930ac1783480 x1872862933274880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109568.167478:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933274880:0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.167666:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933274624 00000100:00100000:0.0:1786109568.167672:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933274624 00000100:00100000:0.0:1786109568.167685:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933275392 00000100:00100000:0.0:1786109568.167687:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933275392 00000100:00100000:0.0:1786109568.167716:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1786109568.167724:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933275392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.167786:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933275392:12345-0@lo:400:kworker.0 Request processed in 64us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109568.167793:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00010000:00080000:3.0:1786109568.168122:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff930ab9676d80 x1872862933275392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109568.168133:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933275392:0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.168398:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933274752 00000100:00100000:0.0:1786109568.168402:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933274752 00000100:00100000:3.0:1786109568.168497:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109568.168612:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933274496:0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.168712:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6975 00000100:00100000:0.0:1786109568.168723:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9675500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933274752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.168824:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9675500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933274752:12345-0@lo:400:kworker.0 Request processed in 102us (5475us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109568.168831:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6975 00000100:00100000:0.0:1786109568.168842:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933275264 00000100:00100000:0.0:1786109568.168846:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933275264 00000100:00100000:0.0:1786109568.168867:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6976 00000100:00100000:0.0:1786109568.168874:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933275264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.168909:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933275264:12345-0@lo:400:kworker.0 Request processed in 36us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109568.168914:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6976 00000100:00100000:0.0:1786109568.168926:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23110 00000100:00100000:0.0:1786109568.168930:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:0+-99:3645:x1872862933274624:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1786109568.168988:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:0+-99:3645:x1872862933274624:12345-0@lo:8:kworker.0 Request processed in 55us (9722us total) trans 0 rc -11/-11 00000100:00100000:0.0:1786109568.168994:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23110 00000100:00100000:0.0:1786109568.169035:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933275264:0@lo:400:kworker.0 00000100:00100000:2.0:1786109568.169374:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109568.169423:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109568.169448:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1786109568.169452:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933274624:0@lo:8:kworker.0 00000020:01000004:2.0:1786109568.169500:0:194589:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1786109568.169513:0:194589:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff930982483380) 00000100:00100000:0.0:1786109568.169726:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933275136 00000100:00100000:0.0:1786109568.169731:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933275136 00000100:00100000:0.0:1786109568.169787:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23111 00000100:00100000:0.0:1786109568.169792:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3645:x1872862933275136:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1786109568.169916:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933274752:0@lo:400:kworker.0 00000100:00100000:0.0:1786109568.170200:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3645:x1872862933275136:12345-0@lo:8:kworker.0 Request processed in 405us (825us total) trans 0 rc -11/-11 00000100:00100000:0.0:1786109568.170208:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23111 00000020:00000080:2.0:1786109568.170245:0:194589:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1786109568.170412:0:194589:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930a88c18000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1786109568.170416:0:194589:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930a88c18000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1786109568.170419:0:194589:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930a88c18000 3 00010000:00080000:2.0:1786109568.170471:0:194589:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93098349d800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1786109568.177918:0:194589:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000100:00100000:3.0:1786109568.179229:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786109568.179244:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109568.179252:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1786109568.179257:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933275136:0@lo:8:kworker.0 00000020:00000080:2.0:1786109568.179477:0:194589:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1786109568.180178:0:194589:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1786109568.180193:0:194589:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xdb52b77d7ca36fde 00000100:00080000:2.0:1786109568.180201:0:194589:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786109568.180207:0:194589:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109568.180241:0:194589:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac17bd500 x1872862933275520/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109568.180271:0:194589:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1786109568.180509:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933275520:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786109568.180581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1786109568.181132:0:194589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x34:0x0] index 52 count 51 00000100:00100000:2.0:1786109568.181629:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933275520 00000100:00100000:2.0:1786109568.181636:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933275520 00000100:00100000:2.0:1786109568.181667:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1786109568.181675:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933275520:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1786109568.181702:0:189813:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 8424 last 0 00000020:00000080:2.0:1786109568.181756:0:189813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xdb52b77d7ca36fe5 00000004:00100000:2.0:1786109568.181772:0:189813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786109568.181802:0:189813:0:(import.c:65:import_set_state_nolock()) ffff930ac10a1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109568.181868:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872862933275520:12345-0@lo:38:llog_process_th.0 Request processed in 192us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109568.181875:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1786109568.181931:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786109568.181937:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 6 00000100:00080000:2.0:1786109568.181944:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1786109568.181949:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1786109568.181951:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1786109568.181956:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933275520:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1786109568.182308:0:194578:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1786109568.182340:0:194578:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786109568.182461:0:194578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f38c00/0xdb52b77d7ca36fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36fbb expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109568.182472:0:194578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac1f38c00/0xdb52b77d7ca36fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36fbb expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1786109568.182603:0:194578:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1786109568.182606:0:194578:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786109568.182607:0:194578:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109568.182609:0:194578:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109568.182610:0:194578:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109568.182611:0:194578:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109568.182613:0:194578:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786109568.182614:0:194578:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109568.182616:0:194578:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786109568.182620:0:194578:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1786109568.182623:0:194578:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786109568.182624:0:194578:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786109568.182625:0:194578:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109568.182626:0:194578:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109568.182627:0:194578:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109568.182628:0:194578:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109568.182629:0:194578:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786109568.182631:0:194578:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109568.182632:0:194578:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786109568.182650:0:194578:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1786109568.182664:0:194578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933275648:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1786109568.182707:0:194578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109568.182757:0:194578:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098be88d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109568.182923:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933275648 00000100:00100000:1.0:1786109568.182928:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933275648 00000100:00100000:1.0:1786109568.183270:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1786109568.183281:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933275648:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1786109568.183303:0:193903:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1786109568.183315:0:193903:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1786109568.189353:0:193903:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786109568.189403:0:193903:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1786109568.190344:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:194578:x1872862933275648:12345-0@lo:253:mount.lustre.0 Request processed in 7058us (7629us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109568.190357:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1786109568.190572:0:194578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:194578:1872862933275648:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1786109568.190585:0:194578:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1786109568.190588:0:194578:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786109568.190590:0:194578:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786109568.190591:0:194578:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109568.190592:0:194578:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109568.190593:0:194578:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109568.190595:0:194578:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109568.190596:0:194578:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786109568.190598:0:194578:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109568.190599:0:194578:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786109568.190615:0:194578:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1786109568.193893:0:193906:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1786109568.193900:0:193906:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786109568.193998:0:193906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.194017:0:193906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ac0b2de00/0xdb52b77d7ca36dae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36da7 expref: 23 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.194025:0:193906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93098cd77200/0xdb52b77d7ca36dca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36dc3 expref: 23 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.194035:0:193906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca36f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15a9 expref: 9 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.194200:0:193906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.194243:0:193906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca36f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15a9 expref: 9 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.194257:0:193906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca36f4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15a9 expref: 9 pid: 193902 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109568.194272:0:193906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193906:1872862933275776:192.168.203.38@tcp:104: 00010000:00010000:2.0:1786109568.194384:0:193906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93098cd77200/0xdb52b77d7ca36dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca36dc3 expref: 23 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.194393:0:193906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93098cd77200/0xdb52b77d7ca36dca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb52b77d7ca36dc3 expref: 23 pid: 193903 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109568.194403:0:193906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193906:1872862933275904:0@lo:104: 00000100:00100000:2.0:1786109568.194471:0:193906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786109568.194517:0:193906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ac0b2de00/0xdb52b77d7ca36dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca36da7 expref: 23 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109568.194620:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933275904 00000100:00100000:3.0:1786109568.194627:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933275904 00000100:00100000:3.0:1786109568.194677:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5262 00000100:00100000:3.0:1786109568.194686:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:193906:x1872862933275904:12345-0@lo:104: 00010000:00010000:3.0:1786109568.194699:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca36dca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109568.194760:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786109568.194767:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:193906:x1872862933275904:12345-0@lo:104: Request processed in 82us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109568.194773:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5262 00010000:00010000:3.0:1786109568.194794:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109568.194800:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca36dca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109568.194807:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d200 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109568.194811:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb52b77d7ca36dca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109568.194819:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca36dca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109568.194826:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca36dca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109568.194832:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109568.194857:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36dca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109568.194864:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109568.194882:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36dca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109568.194889:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d200/0xdb52b77d7ca36dc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36dca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109568.194901:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109568.194903:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109568.194905:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109568.194923:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933276160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109568.194950:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786109568.195175:0:193906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ac0b2de00/0xdb52b77d7ca36dae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb52b77d7ca36da7 expref: 23 pid: 193903 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109568.195185:0:193906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193906:1872862933276032:0@lo:104: 00000100:00100000:2.0:1786109568.195207:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933276160 00000100:00100000:2.0:1786109568.195210:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933276160 00010000:00010000:2.0:1786109568.195227:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93098cd77200/0xdb52b77d7ca36dca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca36dc3 expref: 24 pid: 193903 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109568.195253:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12639 00000100:00100000:2.0:1786109568.195260:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9674380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933276160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109568.195269:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109568.195274:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93098cd77200/0xdb52b77d7ca36dca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca36dc3 expref: 24 pid: 193903 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.195282:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93098cd77200/0xdb52b77d7ca36dca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb52b77d7ca36dc3 expref: 24 pid: 193903 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109568.195297:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109568.195329:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9674380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933276160:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109568.195335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12639 00000100:00100000:2.0:1786109568.195369:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933276160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109568.195407:0:193906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109568.195425:0:193906:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac09773c0 going to sleep for 11 seconds 00010000:00010000:2.0:1786109568.195463:0:193906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd77200/0xdb52b77d7ca36dca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca36dc3 expref: 23 pid: 193903 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109568.195472:0:193906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193906:1872862933275904:0@lo:104: 00000100:00100000:1.0:1786109568.198984:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1786109568.199007:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933276032 00000100:00100000:1.0:1786109568.199015:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933276032 00000100:00100000:1.0:1786109568.199072:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5263 00000100:00100000:1.0:1786109568.199080:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c815450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:193906:x1872862933276032:12345-0@lo:104: 00010000:00010000:1.0:1786109568.199217:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca36dae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1786109568.199370:0:194578:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-OST0000, 2 recoverable clients, last_transno 34359738459 00010000:00010000:1.0:1786109568.199398:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786109568.199405:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c815450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:193906:x1872862933276032:12345-0@lo:104: Request processed in 326us (3996us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109568.199412:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5263 00000100:00100000:3.0:1786109568.199591:0:193906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193906:1872862933276032:0@lo:104: 00010000:00010000:1.0:1786109568.199677:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109568.199684:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca36dae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.199692:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76400 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:1.0:1786109568.199696:0:29734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb52b77d7ca36dae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.199704:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca36dae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786109568.199711:0:29734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca36dae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109568.199716:0:29734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1786109568.199864:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36dae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.199872:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109568.199897:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36dae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.199905:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff93098cd76400/0xdb52b77d7ca36da7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca36dae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.199921:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109568.199923:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109568.199924:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109568.199932:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109568.199946:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933276288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109568.199985:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109568.200040:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933276288 00000100:00100000:1.0:1786109568.200044:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933276288 00010000:00010000:1.0:1786109568.200062:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ac0b2de00/0xdb52b77d7ca36dae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca36da7 expref: 23 pid: 193903 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109568.200164:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12640 00000100:00100000:1.0:1786109568.200177:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3649:x1872862933276288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109568.200189:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109568.200194:0:177416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930ac0b2de00/0xdb52b77d7ca36dae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca36da7 expref: 23 pid: 193903 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.200204:0:177416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ac0b2de00/0xdb52b77d7ca36dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb52b77d7ca36da7 expref: 23 pid: 193903 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.200219:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2de00/0xdb52b77d7ca36dae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca36da7 expref: 23 pid: 193903 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.200230:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109568.200325:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3649:x1872862933276288:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109568.200334:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12640 00000100:00100000:1.0:1786109568.200364:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933276288:0@lo:103:ldlm_bl.0 00010000:00080000:0.0:1786109568.203931:0:194595:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-OST0000: started recovery thread pid 194595 00010000:02000000:0.0:1786109568.204138:0:194595:0:(ldlm_lib.c:2336:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00000100:00100000:3.0:1786109568.204325:0:193906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:193906:1872862933275776:192.168.203.38@tcp:104: 00000020:01000004:2.0:1786109568.204483:0:194578:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1786109568.204541:0:194578:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1786109568.204561:0:194578:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1786109568.204586:0:194578:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00010000:00080000:1.0:1786109568.204690:0:194595:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1786109568.204695:0:194595:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1786109568.205177:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1786109568.205254:0:193906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109568.205492:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922103040 00000100:00100000:1.0:1786109568.205674:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922103040 00010000:00010000:1.0:1786109568.205704:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca36f4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15a9 expref: 10 pid: 193902 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109568.205732:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12641 00000100:00100000:1.0:1786109568.205752:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922103040:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109568.205766:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109568.205771:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca36f4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15a9 expref: 10 pid: 193902 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.206066:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca36f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15a9 expref: 10 pid: 193902 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.206084:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca36f4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15a9 expref: 10 pid: 193902 timeout: 8524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.206106:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.206114:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786109568.206129:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012230009s 00010000:00010000:1.0:1786109568.206134:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.206141:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.206148:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.206155:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.206161:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109568.206165:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.206173:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109568.206354:0:193906:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109568.206362:0:193906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.206391:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.206399:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd76000/0xdb52b77d7ca36fec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 193906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109568.206413:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000004:2.0:1786109568.207229:0:194578:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1786109568.209590:0:194578:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1786109568.209664:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:2403:x1872862922103040:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 3908us (4484us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109568.209676:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12641 00000001:00100000:3.0:1786109568.265579:0:187891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00100000:1.0:1786109568.269447:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00080000:1.0:1786109568.269465:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975825 is committed 00010000:00010000:1.0:1786109568.646075:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1786109569.168957:0:194644:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1786109569.169309:0:194644:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1786109569.671096:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786109569.796820:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786109569.796828:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930ab29d1000 from 329 10000000:01000000:3.0:1786109569.796834:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786109569.796880:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109569.796892:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109569.796902:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109569.796924:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9677800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933276416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109569.796995:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109569.797037:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109569.803209:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933276416 00000100:00100000:2.0:1786109569.803225:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933276416 00000100:00100000:2.0:1786109569.803550:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786109569.803576:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984bbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933276416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109569.803592:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109569.803612:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93098cd77a00/0xdb52b77d7ca36ffa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca36ff3 expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109569.803640:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93098cd77a00/0xdb52b77d7ca36ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca36ff3 expref: 23 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109569.804060:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93098cd77a00/0xdb52b77d7ca36ffa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca36ff3 expref: 23 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109569.804071:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93098cd77a00, rc 0) 00000100:00100000:2.0:1786109569.804157:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984bbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933276416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 598us (7160us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109569.804165:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1786109569.804390:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9677800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933276416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109569.804410:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109569.804420:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109569.804514:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9677800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933276544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786109569.804628:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109569.804721:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933276544 00000100:00100000:3.0:1786109569.804762:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109569.804803:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933276544 00000100:00100000:2.0:1786109569.805151:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786109569.805161:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933276544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1786109569.805177:0:193902:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1786109569.805194:0:193902:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786109569.805196:0:193902:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 329 00000100:00100000:2.0:1786109569.805294:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933276544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109569.805303:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1786109569.805319:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9677800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933276544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1786109569.805377:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786109569.805384:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109569.805393:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109569.805402:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786109569.805404:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930a92e3e800 from 329 10000000:01000000:3.0:1786109569.805407:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786109569.805425:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628b800/0xdb52b77d7ca37001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109569.805450:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930aa628b800/0xdb52b77d7ca37001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109569.805458:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930aa628b800/0xdb52b77d7ca37001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109569.805472:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9677800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933276672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109569.805500:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109569.805903:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109569.806002:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933276672 00000100:00100000:0.0:1786109569.806008:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933276672 00000100:00100000:0.0:1786109569.806194:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786109569.806203:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933276672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109569.806213:0:193901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109569.806391:0:193901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c2200/0xdb52b77d7ca37008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37001 expref: -99 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109569.806414:0:193901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c2200/0xdb52b77d7ca37008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37001 expref: 24 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109569.806424:0:193901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c2200/0xdb52b77d7ca37008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37001 expref: 24 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109569.806451:0:193901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2200, rc 0) 00000100:00100000:0.0:1786109569.806505:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933276672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 303us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109569.806512:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1786109569.807007:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9677800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933276672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109569.807191:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930aa628b800/0xdb52b77d7ca37001 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37008 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109569.807201:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930aa628b800/0xdb52b77d7ca37001 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37008 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109569.807260:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9677800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933276800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786109569.807295:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109569.808131:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109569.808167:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933276800 00000100:00100000:2.0:1786109569.808184:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933276800 00000100:00100000:1.0:1786109569.808350:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1786109569.808362:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933276800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1786109569.808381:0:193903:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1786109569.808399:0:193903:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1786109569.808402:0:193903:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 329 00000100:00100000:1.0:1786109569.808584:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933276800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 225us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109569.808592:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1786109569.808628:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9677800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933276800:0@lo:256:ll_cfg_requeue.0 00000100:00080000:3.0:1786109569.808805:0:6524:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff930a89106800 already not connected (conn 11, was 0): DISCONN 00010000:00080000:3.0:1786109569.808817:0:6524:0:(ldlm_lib.c:85:import_set_conn()) imp ffff930a89106800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.138@tcp, moved to head 00000100:00080000:3.0:1786109569.808822:0:6524:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109569.808828:0:6524:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930a89106800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109569.809161:0:6524:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9674a80 x1872862933276928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:3.0:1786109569.809211:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786109569.809219:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628b800/0xdb52b77d7ca37001 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37008 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109569.809228:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930aa628b800/0xdb52b77d7ca37001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37008 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109569.809270:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933276928:0@lo:8:ll_cfg_requeue.0 00000100:00100000:3.0:1786109569.809307:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109569.810463:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933276928 00000100:00100000:2.0:1786109569.810472:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933276928 00000100:00100000:2.0:1786109569.810508:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23112 00000100:00100000:2.0:1786109569.810516:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9677800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3645:x1872862933276928:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1786109569.811094:0:17009:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff93098e515800, cookie 0xdb52b77d7ca36f98 00010000:00080000:3.0:1786109569.811102:0:17009:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff93098e515800 cur 8426 last 1786109568 00010000:02000400:3.0:1786109569.811110:0:17009:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1786109569.811115:0:17009:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:3.0:1786109569.811131:0:17009:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93098e515800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1786109569.811135:0:17009:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1786109569.811138:0:17009:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1786109569.811258:0:17009:0:(import.c:65:import_set_state_nolock()) ffff930981e16800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786109569.813190:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9677800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1872862933276928:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 2666us (3874us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109569.813203:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23112 00010000:00080000:2.0:1786109569.814202:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ab9674a80 x1872862933276928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786109594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109569.814224:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 9 00000100:00080000:2.0:1786109569.814236:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1786109569.814241:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1786109569.814243:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 34359738456 gen 2 00000100:00080000:2.0:1786109569.814247:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a89106800 from lustre-OST0000_UUID committed 34359738456 last 0 00000100:00080000:2.0:1786109569.814250:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1786109569.816888:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933276928:0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1786109569.817169:0:194663:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1786109569.817174:0:194663:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1786109569.817179:0:194663:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:2.0:1786109569.817303:0:194663:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1786109569.817758:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933277056:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1786109569.817822:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109569.819166:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933277056 00000100:00100000:0.0:1786109569.819176:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933277056 00000100:00100000:1.0:1786109569.819518:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6977 00000100:00100000:1.0:1786109569.819532:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1872862933277056:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1786109569.819551:0:9990:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ab9674a80 x1872862933277056/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:40/0 lens 224/0 e 0 to 0 dl 1786109580 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109569.819668:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1872862933277056:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 139us (1845us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109569.819676:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6977 00010000:00080000:2.0:1786109569.819798:0:194595:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1786109570.145270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109570.145358:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922103168 00000100:00100000:3.0:1786109570.145367:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922103168 00000100:00100000:3.0:1786109570.145425:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:3.0:1786109570.145473:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922103168:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109570.145489:0:193902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109570.145622:0:193902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930aa628a800/0xdb52b77d7ca3700f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a15e1 expref: -99 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109570.145652:0:193902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930aa628a800/0xdb52b77d7ca3700f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15e1 expref: 10 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109570.145665:0:193902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930aa628a800/0xdb52b77d7ca3700f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15e1 expref: 10 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109570.145680:0:193902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628a800, rc 0) 00000100:00100000:3.0:1786109570.145770:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922103168:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 310us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109570.145777:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:0.0:1786109570.150335:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109570.150400:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922103296 00000100:00100000:2.0:1786109570.150408:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922103296 00000100:00100000:2.0:1786109570.150781:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:2.0:1786109570.150793:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922103296:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1786109570.150821:0:193901:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1786109570.150839:0:193901:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786109570.150843:0:193901:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 329 00000100:00100000:2.0:1786109570.158327:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922103296:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 Request processed in 7528us (7992us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109570.158343:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:2.0:1786109570.165125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109570.169403:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922103424 00000100:00100000:3.0:1786109570.169417:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922103424 00000100:00100000:3.0:1786109570.169508:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23113 00000100:00100000:3.0:1786109570.169517:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2401:x1872862922103424:12345-192.168.203.38@tcp:8:ll_cfg_requeue.0 00010000:00080000:3.0:1786109570.169552:0:43911:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp recovering/t0 exp 0000000000000000 cur 8426 last 0 00010000:02000400:3.0:1786109570.169560:0:43911:0:(ldlm_lib.c:1509:target_handle_connect()) lustre-OST0000: Denying connection for new client fac74500-4523-4794-af20-dfdcdfae19c1 (at 192.168.203.38@tcp), waiting for 2 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 1:09 00000100:00100000:3.0:1786109570.189299:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2401:x1872862922103424:12345-192.168.203.38@tcp:8:ll_cfg_requeue.0 Request processed in 19770us (24172us total) trans 0 rc -16/-16 00000100:00100000:3.0:1786109570.189316:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23113 00010000:00010000:0.0:1786109570.698648:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109570.823737:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933277184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109570.823808:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109570.823969:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933277184 00000100:00100000:0.0:1786109570.823977:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933277184 00000100:00100000:0.0:1786109570.824026:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5829 00000100:00100000:0.0:1786109570.824036:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933277184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109570.824064:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109570.824194:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933277184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109570.824202:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5829 00000100:00080000:0.0:1786109570.824228:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109570.830938:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933277184:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1786109571.719541:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109571.849924:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933277312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109571.850011:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109571.850134:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933277312 00000100:00100000:3.0:1786109571.850142:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933277312 00000100:00100000:3.0:1786109571.850193:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12356 00000100:00100000:3.0:1786109571.850203:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933277312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786109571.850234:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446109184 avail 1299869696 00000100:00100000:3.0:1786109571.858676:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933277312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8464us (8654us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109571.858690:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12356 00000100:00100000:1.0:1786109571.860162:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933277312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109572.356718:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933277440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109572.356788:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109572.358613:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933277440 00000100:00100000:1.0:1786109572.358625:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933277440 00000100:00100000:1.0:1786109572.358679:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12357 00000100:00100000:1.0:1786109572.358688:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933277440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109572.358733:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445683200 avail 1299443712 00000100:00100000:0.0:1786109572.359659:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933277568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109572.359720:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109572.359771:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933277568 00000100:00100000:0.0:1786109572.359777:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933277568 00000100:00100000:0.0:1786109572.359819:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5830 00000100:00100000:0.0:1786109572.359829:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933277568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109572.359851:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109572.359889:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933277568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109572.359896:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5830 00000100:00080000:0.0:1786109572.359914:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109572.359940:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975825 gen 2 00000100:00100000:0.0:1786109572.359961:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933277568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109572.363471:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933277440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4772us (6670us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109572.363561:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12357 00000100:00100000:2.0:1786109572.365629:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933277440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109572.635626:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109572.635681:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109572.635725:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109572.635751:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922103936 00000100:00100000:0.0:1786109572.635762:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922103936 00000100:00100000:3.0:1786109572.635774:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109572.635802:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922103552 00000100:00100000:3.0:1786109572.635807:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922103552 00000100:00100000:0.0:1786109572.635813:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23114 00000100:00100000:0.0:1786109572.635821:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9676300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:0+-99:2401:x1872862922103936:12345-192.168.203.38@tcp:8:kworker.0 00000100:00100000:3.0:1786109572.635850:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 94 00010000:00080000:0.0:1786109572.635860:0:179254:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp recovering/t0 exp 0000000000000000 cur 8429 last 0 00000100:00100000:3.0:1786109572.635862:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922103552:12345-192.168.203.38@tcp:400:kworker.0 00010000:02000400:0.0:1786109572.635871:0:179254:0:(ldlm_lib.c:1509:target_handle_connect()) lustre-OST0000: Denying connection for new client fac74500-4523-4794-af20-dfdcdfae19c1 (at 192.168.203.38@tcp), waiting for 2 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 1:07 00000100:00100000:0.0:1786109572.635925:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9676300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:0+-99:2401:x1872862922103936:12345-192.168.203.38@tcp:8:kworker.0 Request processed in 103us (308us total) trans 0 rc -16/-16 00000100:00100000:3.0:1786109572.635928:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922103552:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 68us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109572.635938:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23114 00000100:00100000:3.0:1786109572.635955:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:3.0:1786109572.635993:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922103808 00000100:00100000:3.0:1786109572.635998:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922103808 00000100:00100000:3.0:1786109572.636034:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922103680 00000100:00100000:3.0:1786109572.636038:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922103680 00000100:00100000:3.0:1786109572.636065:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 242 00000100:00100000:3.0:1786109572.636074:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922103808:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109572.636120:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922103808:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 48us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109572.636127:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 242 00000100:00100000:3.0:1786109572.636141:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 243 00000100:00100000:3.0:1786109572.636150:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922103680:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109572.636175:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922103680:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109572.636181:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 243 00000100:00080000:3.0:1786109572.636207:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786109572.636212:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109572.636482:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109572.636590:0:179241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922104064 00000100:00100000:0.0:1786109572.636596:0:179241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922104064 00000100:00100000:0.0:1786109572.636632:0:179241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6978 00000100:00100000:0.0:1786109572.636638:0:179241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922104064:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109572.636674:0:179241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922104064:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109572.636681:0:179241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6978 00000100:00080000:3.0:1786109572.636730:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786109572.740625:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109573.380696:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109573.380714:0:183576:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:0.0:1786109573.380732:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1786109573.380735:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1786109573.380739:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109573.380761:0:183576:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff930ab7c42000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109573.380782:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098e35aa00 x1872862933278592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109573.381073:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933277696:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381137:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.381182:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933278208:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381206:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.381242:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933278848:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381267:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.381288:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786109573.381294:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933278080:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381315:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.381332:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933278720:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381350:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.381377:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933277824:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.381417:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933278336:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.381471:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933278976:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381495:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.381513:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1786109573.381519:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933277952:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.381555:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933278464:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381573:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.381587:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933279104:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381602:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.381623:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933278592:0@lo:8:kworker.0 00000100:00100000:0.0:1786109573.381642:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.381670:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933277696 00000100:00100000:0.0:1786109573.381676:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933277696 00000100:00100000:0.0:1786109573.381729:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1786109573.381737:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933277696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381782:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933277696:12345-0@lo:400:kworker.0 Request processed in 46us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109573.381789:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1786109573.381821:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933278208 00000100:00100000:0.0:1786109573.381825:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933278208 00000100:00100000:0.0:1786109573.381856:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933278720 00000100:00100000:0.0:1786109573.381858:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933278720 00000100:00100000:0.0:1786109573.381873:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933278592 00000100:00100000:0.0:1786109573.381876:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933278592 00000100:00100000:0.0:1786109573.381890:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6979 00000100:00100000:0.0:1786109573.381896:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933278208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381928:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933278208:12345-0@lo:400:kworker.0 Request processed in 32us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109573.381934:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6979 00000100:00100000:0.0:1786109573.381945:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6980 00000100:00100000:0.0:1786109573.381951:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933278720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.381975:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933278720:12345-0@lo:400:kworker.0 Request processed in 26us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109573.381981:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6980 00000100:00100000:0.0:1786109573.381992:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23115 00000100:00100000:0.0:1786109573.381996:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:0+-99:3645:x1872862933278592:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1786109573.382017:0:179253:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff93098e510800, cookie 0xdb52b77d7ca36f9f 00010000:00080000:0.0:1786109573.382023:0:179253:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff93098e510800 cur 8430 last 1786109568 00002000:00100000:0.0:1786109573.382038:0:179253:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93098e510800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1786109573.382042:0:179253:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1786109573.382044:0:179253:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1786109573.382071:0:179253:0:(import.c:65:import_set_state_nolock()) ffff930ab28f6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109573.382111:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933278592:12345-0@lo:8:kworker.0 Request processed in 113us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109573.382117:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23115 00000100:00100000:0.0:1786109573.382135:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933278848 00000100:00100000:0.0:1786109573.382138:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933278848 00000100:00100000:0.0:1786109573.382206:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933277824 00000100:00100000:0.0:1786109573.382210:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933277824 00000100:00100000:0.0:1786109573.382224:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933278336 00000100:00100000:0.0:1786109573.382227:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933278336 00000100:00100000:0.0:1786109573.382235:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933278976 00000100:00100000:0.0:1786109573.382237:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933278976 00000100:00100000:0.0:1786109573.382248:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933277952 00000100:00100000:0.0:1786109573.382250:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933277952 00000100:00100000:0.0:1786109573.382263:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933279104 00000100:00100000:0.0:1786109573.382265:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933279104 00000100:00100000:0.0:1786109573.382277:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1786109573.382282:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933278848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.382316:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933278848:12345-0@lo:400:kworker.0 Request processed in 28us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109573.382322:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1786109573.382335:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1786109573.382342:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933277824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.382373:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933277824:12345-0@lo:400:kworker.0 Request processed in 32us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109573.382379:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1786109573.382391:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1786109573.382397:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933278336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.382462:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933278336:12345-0@lo:400:kworker.0 Request processed in 65us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109573.382468:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1786109573.382480:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1786109573.382485:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933278976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.382510:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933278976:12345-0@lo:400:kworker.0 Request processed in 26us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109573.382516:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1786109573.382528:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1786109573.382534:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933277952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.382560:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933277952:12345-0@lo:400:kworker.0 Request processed in 27us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109573.382566:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1786109573.382578:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1786109573.382583:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933279104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.382607:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933279104:12345-0@lo:400:kworker.0 Request processed in 24us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109573.382613:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1786109573.382632:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933278080 00000100:00100000:0.0:1786109573.382636:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933278080 00000100:00100000:0.0:1786109573.382657:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933278464 00000100:00100000:0.0:1786109573.382661:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933278464 00000100:00100000:0.0:1786109573.382677:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12358 00000100:00100000:0.0:1786109573.382682:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933278080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.382726:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933278080:12345-0@lo:400:kworker.0 Request processed in 44us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109573.382732:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12358 00000100:00100000:0.0:1786109573.382744:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12359 00000100:00100000:0.0:1786109573.382750:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933278464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.382775:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933278464:12345-0@lo:400:kworker.0 Request processed in 25us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109573.382780:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12359 00000100:00080000:0.0:1786109573.382825:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109573.382829:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109573.382831:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1786109573.382848:0:194595:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1786109573.382852:0:194595:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 34359738460 00010000:00080000:0.0:1786109573.382856:0:194595:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 34359738460 00010000:00080000:0.0:1786109573.382860:0:194595:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 34359738460 00010000:00080000:0.0:1786109573.382897:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93098e35aa00 x1872862933278592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786109598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109573.382907:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 34359738459 gen 2 00000100:00080000:0.0:1786109573.382914:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 9 00000100:00080000:0.0:1786109573.382922:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1786109573.382926:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1786109573.382928:0:3645:0:(import.c:1233:ptlrpc_connect_interpret()) connect to lustre-OST0000_UUID during recovery 00000100:00080000:0.0:1786109573.382930:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY_LOCKS 00000100:00080000:0.0:1786109573.382934:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1786109573.382953:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933278592:0@lo:8:kworker.0 00000100:00100000:0.0:1786109573.382970:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933279232:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1786109573.382992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109573.383019:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933279232 00000100:00100000:0.0:1786109573.383022:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933279232 00000100:00100000:0.0:1786109573.383044:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6981 00000100:00100000:0.0:1786109573.383050:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933279232:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1786109573.383060:0:43919:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ab9663480 x1872862933279232/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:44/0 lens 224/0 e 0 to 0 dl 1786109584 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109573.383073:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933279232:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 24us (81us total) trans 0 rc 0/-999 00000100:00100000:0.0:1786109573.383078:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6981 00010000:00080000:0.0:1786109573.383089:0:194595:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 34359738460 00010000:00080000:0.0:1786109573.383092:0:194595:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00010000:00080000:0.0:1786109573.383096:0:194595:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1786109573.383098:0:194595:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1786109573.383186:0:194595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705664 00000100:00100000:0.0:1786109573.383221:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933277952:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.383231:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933278464:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.383241:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933279104:0@lo:400:kworker.0 00010000:00080000:0.0:1786109573.383251:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93098e50fb80 x1872862933277824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109573.383260:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933277824:0@lo:400:kworker.0 00010000:00080000:0.0:1786109573.383269:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93098e35b100 x1872862933278336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109573.383278:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933278336:0@lo:400:kworker.0 00010000:00080000:0.0:1786109573.383287:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93098e359880 x1872862933278976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109573.383296:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933278976:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.383330:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933278080:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.383339:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933278720:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.383348:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933277696:0@lo:400:kworker.0 00000100:00100000:0.0:1786109573.383356:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933278208:0@lo:400:kworker.0 00010000:00080000:0.0:1786109573.383366:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93098e35b800 x1872862933278848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109573.383374:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933278848:0@lo:400:kworker.0 00000001:00100000:0.0:1786109573.460980:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1786109573.460993:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:1.0:1786109573.461871:0:194595:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:1.0:1786109573.461888:0:194595:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff930ab9674a80 x1872862933277056/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:40/0 lens 224/0 e 0 to 0 dl 1786109580 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1786109573.462602:0:194595:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff930ab9663480 x1872862933279232/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:44/0 lens 224/0 e 0 to 0 dl 1786109584 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1786109573.462645:0:194595:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-OST0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00002000:00080000:1.0:1786109573.465666:0:194595:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1786109573.465675:0:194595:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00010000:00080000:0.0:1786109573.467172:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac17bd500 x1872862933277056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786109585 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109573.467190:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1786109573.467196:0:3645:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff930ac17bd500 x1872862933277056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786109585 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109573.467204:0:3645:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff930ac17bd500 x1872862933277056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786109585 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109573.467211:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:0.0:1786109573.467515:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:0.0:1786109573.467519:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109573.467525:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933277056:0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1786109573.467561:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ab9660000 x1872862933279232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786109589 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109573.467570:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1786109573.467574:0:3645:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff930ab9660000 x1872862933279232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786109589 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109573.467582:0:3645:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff930ab9660000 x1872862933279232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786109589 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109573.467587:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000100:00100000:1.0:1786109573.467866:0:187922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:187922:1872862933279488:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1786109573.468146:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:0.0:1786109573.468149:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109573.468154:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933279232:0@lo:400:ptlrpcd_rcv.0 00000004:00080000:2.0:1786109573.468176:0:193915:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x1874:0x0] 00000100:00100000:2.0:1786109573.468190:0:193915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:193915:1872862933279744:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1786109573.468232:0:193914:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1786109573.468321:0:193914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8430134889859ns, next at 0ns, rc = 0 00000100:00100000:1.0:1786109573.468324:0:187922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:00080000:3.0:1786109573.468327:0:193914:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1786109573.468855:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933279488 00000100:00100000:0.0:1786109573.468862:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933279488 00000100:00100000:0.0:1786109573.468903:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23116 00000100:00100000:0.0:1786109573.468911:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:187922:x1872862933279488:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1786109573.469768:0:193915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109573.469802:0:193915:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109573.469818:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933279744 00000100:00100000:2.0:1786109573.469822:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933279744 00000100:00100000:2.0:1786109573.469852:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23117 00000100:00100000:2.0:1786109573.469860:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:193915:x1872862933279744:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1786109573.471684:0:187922:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a89d70000 going to sleep for 11 seconds 00000100:00100000:3.0:1786109573.471777:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933279360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109573.471827:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109573.471909:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109573.471917:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933279616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109573.471943:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1786109573.472741:0:193896:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1786109573.475751:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933279360 00000100:00100000:0.0:1786109573.475764:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933279360 00000100:00100000:2.0:1786109573.475892:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933279616 00000100:00100000:2.0:1786109573.475896:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933279616 00000100:00100000:2.0:1786109573.475930:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5831 00000100:00100000:2.0:1786109573.475940:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933279360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109573.475965:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109573.476045:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933279360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (4217us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109573.476055:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5831 00000100:00100000:2.0:1786109573.476071:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5832 00000100:00100000:2.0:1786109573.476079:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933279616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109573.476088:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109573.476114:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933279616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (4170us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109573.476120:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5832 00010000:00080000:2.0:1786109573.476178:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac17bfb80 x1872862933279616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786109589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109573.476198:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933279616:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1786109573.476210:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930984ff2680 x1872862933279360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786109589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109573.476221:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933279360:0@lo:13:osp-pre-0-1.0 00002000:00080000:2.0:1786109573.477591:0:43913:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1786109573.477597:0:43913:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x401:0x0] 00000100:00100000:2.0:1786109573.477661:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:187922:x1872862933279488:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8749us (9334us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109573.477670:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23116 00010000:00080000:2.0:1786109573.477729:0:187922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930984ff0380 x1872862933279488/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1786109589 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109573.477741:0:187922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:187922:1872862933279488:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1786109573.477751:0:187922:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000401:0x401:0x0] 00002000:00080000:2.0:1786109573.477900:0:179239:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1786109573.477906:0:179239:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6401 -> diff = -141 00002000:02000040:2.0:1786109573.477912:0:179239:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6261 to 0x280000400:6401) 00002000:00010000:2.0:1786109573.485391:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1901:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109573.485403:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37016 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1901:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.485419:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1901:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:2.0:1786109573.485424:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1901:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109573.485470:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.485489:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.485500:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.485509:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37016 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.485526:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109573.485537:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109573.485542:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37016 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.485720:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109573.485726:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37016 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.485741:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37016 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.485758:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37016 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.485765:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37016 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.485780:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109573.485782:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109573.485783:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109573.486201:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1900:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109573.486208:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3701d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1900:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.486218:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1900:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:2.0:1786109573.486221:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1900:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109573.486226:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3701d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.486236:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3701d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.486244:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3701d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.486252:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3701d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.486311:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109573.486629:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.486636:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3701d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.486645:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.486649:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3701d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.486656:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3701d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.486671:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3701d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.486679:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3701d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109573.486734:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109573.486737:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109573.486739:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109573.489848:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.489862:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca37024 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.489878:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ff:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.489883:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.489890:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca37024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.489905:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca37024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.489917:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca37024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.489925:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca37024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.489955:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109573.489997:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.490004:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca37024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.490017:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ba00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.490021:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca37024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.490030:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca37024 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.490045:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca37024 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.490052:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048b555b7/0xdb52b77d7ca37024 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.490072:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.490074:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.490076:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109573.490379:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.490385:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca3702b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.490394:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18fe:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.490397:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.490401:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca3702b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.490411:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca3702b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.490419:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca3702b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.490426:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca3702b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.490527:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109573.490605:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.490610:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca3702b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.490618:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.490622:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca3702b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.490630:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca3702b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.490642:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca3702b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.490649:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d934877/0xdb52b77d7ca3702b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.490665:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.490667:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.490668:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109573.490893:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.490899:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca37032 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.490908:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18fd:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.490911:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.490916:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca37032 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.490926:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca37032 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.490933:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca37032 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.490941:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca37032 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.490953:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109573.490981:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109573.490986:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca37032 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109573.490995:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628bc00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109573.490998:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca37032 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109573.491006:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca37032 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109573.491020:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca37032 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109573.491027:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca37032 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109573.491042:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109573.491044:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109573.491045:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109573.491207:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.491214:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca37039 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.491222:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18fc:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.491226:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.491230:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca37039 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.491239:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca37039 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.491247:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca37039 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.491255:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca37039 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.491305:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109573.491349:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.491355:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca37039 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.491363:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.491366:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca37039 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.491374:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca37039 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.491386:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca37039 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.491393:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca37039 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.491413:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.491415:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.491417:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109573.491758:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.491764:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca37040 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.491773:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18fb:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.491776:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.491780:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca37040 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.491789:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca37040 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.491798:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca37040 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.491805:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca37040 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.491833:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109573.491904:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.491909:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca37040 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.491921:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ac00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.491938:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca37040 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.491947:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca37040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.491958:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca37040 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.491966:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c706528f/0xdb52b77d7ca37040 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.491981:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.491982:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.492094:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109573.492210:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.492216:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca37047 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.492226:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18fa:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.492230:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.492234:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca37047 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.492243:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca37047 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.492252:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca37047 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.492260:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca37047 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.492277:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109573.492340:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.492345:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca37047 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.492359:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.492362:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca37047 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.492370:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca37047 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.492382:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca37047 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.492390:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca37047 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.492410:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.492412:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.492414:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109573.492689:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.492696:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca3704e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.492715:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f9:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.492718:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.492723:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca3704e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.492732:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca3704e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.492741:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca3704e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.492748:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca3704e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.492798:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109573.493080:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.493087:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca37055 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.493095:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f8:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.493099:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.493103:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca37055 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.493112:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca37055 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.493120:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca37055 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.493127:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca37055 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493185:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786109573.493190:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca3704e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493198:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.493202:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca3704e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493210:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca3704e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493222:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca3704e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493230:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002960332/0xdb52b77d7ca3704e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493246:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.493249:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca37055 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493256:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.493259:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca37055 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493267:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca37055 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493276:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca37055 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493283:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.493285:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.493286:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.493345:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.493350:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca37055 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.493669:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.493675:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b208c8f8/0xdb52b77d7ca3705c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.493684:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f7:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.493687:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.493692:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b208c8f8/0xdb52b77d7ca3705c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.493712:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b208c8f8/0xdb52b77d7ca3705c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.493721:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b208c8f8/0xdb52b77d7ca3705c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.493728:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b208c8f8/0xdb52b77d7ca3705c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493795:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.493800:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b208c8f8/0xdb52b77d7ca3705c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493808:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2de00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.493812:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b208c8f8/0xdb52b77d7ca3705c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493820:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b208c8f8/0xdb52b77d7ca3705c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493831:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b208c8f8/0xdb52b77d7ca3705c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.493844:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.493845:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.493847:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.493915:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.493920:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b208c8f8/0xdb52b77d7ca3705c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.494233:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.494239:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d94e8c2c/0xdb52b77d7ca37063 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.494247:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f6:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.494250:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.494254:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94e8c2c/0xdb52b77d7ca37063 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.494264:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d94e8c2c/0xdb52b77d7ca37063 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.494271:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d94e8c2c/0xdb52b77d7ca37063 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.494279:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d94e8c2c/0xdb52b77d7ca37063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.494330:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.494335:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d94e8c2c/0xdb52b77d7ca37063 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.494343:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2d200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.494346:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94e8c2c/0xdb52b77d7ca37063 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.494354:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94e8c2c/0xdb52b77d7ca37063 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.494365:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d94e8c2c/0xdb52b77d7ca37063 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.494374:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.494375:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.494377:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.494445:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.494450:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d94e8c2c/0xdb52b77d7ca37063 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.494763:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.494769:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3706a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.494782:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f5:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.494785:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.494789:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3706a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.494799:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3706a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.494806:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3706a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.494813:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3706a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.494847:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.494852:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3706a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.494860:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.494863:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3706a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.494871:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3706a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.494883:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3706a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.494890:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.494892:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.494893:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.495002:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.495007:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3706a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.495293:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.495299:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002282b298/0xdb52b77d7ca37071 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.495313:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f4:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.495316:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.495320:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002282b298/0xdb52b77d7ca37071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.495330:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002282b298/0xdb52b77d7ca37071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.495337:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002282b298/0xdb52b77d7ca37071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.495345:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002282b298/0xdb52b77d7ca37071 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.495389:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.495395:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002282b298/0xdb52b77d7ca37071 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.495402:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.495406:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002282b298/0xdb52b77d7ca37071 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.495414:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002282b298/0xdb52b77d7ca37071 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.495425:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002282b298/0xdb52b77d7ca37071 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.495448:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.495450:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.495451:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.495512:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.495516:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002282b298/0xdb52b77d7ca37071 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.495842:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.495848:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37078 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.495857:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f3:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.495860:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.495865:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.495874:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.495888:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.495895:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.495931:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.495936:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.495944:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.495948:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.495956:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37078 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.495967:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37078 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.495975:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.495977:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.495979:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.496071:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.496076:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37078 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.496382:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.496387:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca3707f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.496396:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f2:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.496399:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.496404:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca3707f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.496413:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca3707f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.496421:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca3707f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.496454:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca3707f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.496526:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.496532:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca3707f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.496539:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.496542:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca3707f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.496550:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca3707f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.496562:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca3707f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.496570:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.496571:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.496573:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.496623:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.496628:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca3707f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.496902:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.496908:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca37086 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.496917:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f1:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.496977:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.496983:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca37086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.496993:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca37086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.497001:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca37086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.497009:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca37086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.497037:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.497043:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca37086 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.497050:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.497054:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca37086 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.497061:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca37086 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.497077:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca37086 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.497085:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.497087:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.497088:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.497149:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.497154:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca37086 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.497418:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.497424:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca3708d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.497452:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f0:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.497454:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.497459:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca3708d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.497469:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca3708d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.497477:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca3708d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.497485:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca3708d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.497535:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.497540:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca3708d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.497547:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.497550:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca3708d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.497558:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca3708d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.497570:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca3708d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.497577:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.497579:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.497580:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.497645:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.497649:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca3708d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.497994:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.498000:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca37094 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.498009:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ef:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.498016:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.498020:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca37094 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.498029:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca37094 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.498037:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca37094 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.498045:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca37094 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.498069:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.498073:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca37094 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.498084:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.498088:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca37094 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.498096:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca37094 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.498107:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca37094 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.498115:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.498116:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.498118:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.498172:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.498177:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca37094 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.498464:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.498470:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca3709b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.498484:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ee:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.498487:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.498491:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca3709b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.498500:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca3709b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.498508:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca3709b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.498515:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca3709b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.498556:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.498562:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca3709b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.498569:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.498573:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca3709b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.498581:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca3709b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.498592:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca3709b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.498601:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.498603:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.498604:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.498660:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.498665:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca3709b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.498995:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.499001:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca370a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.499010:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ed:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.499013:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.499018:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca370a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.499027:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca370a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.499039:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca370a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.499046:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca370a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.499077:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.499082:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca370a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.499090:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.499094:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca370a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.499102:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca370a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.499113:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca370a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.499121:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.499123:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.499125:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.499177:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.499182:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca370a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.499461:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.499467:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca370a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.499476:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ec:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.499479:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.499484:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca370a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.499493:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca370a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.499506:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca370a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.499513:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca370a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.499546:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.499550:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca370a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.499558:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.499561:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca370a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.499570:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca370a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.499581:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca370a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.499589:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.499591:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.499593:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.499645:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.499649:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca370a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.499975:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.499981:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca370b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.499989:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18eb:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.499993:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.499997:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca370b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.500007:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca370b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.500015:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca370b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.500028:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca370b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.500112:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.500117:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca370b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.500124:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.500127:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca370b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.500135:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca370b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.500146:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca370b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.500154:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.500156:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.500158:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.500214:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.500219:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca370b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.500549:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.500554:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca370b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.500562:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ea:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.500566:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.500570:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca370b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.500579:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca370b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.500587:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca370b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.500594:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca370b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.500635:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.500640:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca370b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.500652:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.500656:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca370b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.500664:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca370b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.500676:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca370b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.500684:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.500686:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.500688:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.500748:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.500753:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca370b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.501059:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.501065:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca370be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.501074:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e9:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.501077:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.501082:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca370be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.501092:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca370be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.501099:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca370be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.501106:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca370be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.501131:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.501136:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca370be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.501143:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.501147:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca370be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.501155:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca370be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.501172:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca370be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.501179:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.501181:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.501182:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.501238:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.501243:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca370be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.501567:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.501573:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca370c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.501582:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e8:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.501585:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.501589:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca370c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.501598:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca370c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.501607:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca370c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.501614:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca370c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.501677:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.501683:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca370c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.501690:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.501694:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca370c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.501715:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca370c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.501727:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca370c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.501736:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.501737:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.501739:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.501808:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.501813:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca370c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.502146:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.502156:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca370cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.502170:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e7:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.502173:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.502178:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca370cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.502187:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca370cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.502196:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca370cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.502203:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca370cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.502233:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.502237:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca370cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.502250:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.502253:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca370cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.502262:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca370cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.502273:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca370cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.502281:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.502283:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.502285:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.502341:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.502345:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca370cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.502675:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.502680:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca370d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.502689:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e6:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.502692:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.502697:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca370d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.502717:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca370d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.502725:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca370d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.502732:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca370d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.502775:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.502780:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca370d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.502788:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.502792:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca370d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.502799:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca370d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.502811:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca370d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.502819:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.502820:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.502822:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.502880:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.502885:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca370d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.503212:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.503218:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca370da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.503227:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e5:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.503230:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.503238:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca370da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.503248:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca370da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.503261:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca370da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.503268:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca370da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.503299:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.503304:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca370da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.503312:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.503315:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca370da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.503323:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca370da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.503335:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca370da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.503343:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.503344:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.503346:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.503401:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.503406:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca370da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.503738:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.503745:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e636797/0xdb52b77d7ca370e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.503753:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e4:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.503757:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.503761:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e636797/0xdb52b77d7ca370e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.503771:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e636797/0xdb52b77d7ca370e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.503779:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e636797/0xdb52b77d7ca370e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.503792:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e636797/0xdb52b77d7ca370e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.503838:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.503843:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e636797/0xdb52b77d7ca370e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.503851:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.503855:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e636797/0xdb52b77d7ca370e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.503863:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e636797/0xdb52b77d7ca370e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.503875:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e636797/0xdb52b77d7ca370e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.503883:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.503885:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.503886:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.503989:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.503997:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e636797/0xdb52b77d7ca370e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.504265:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.504271:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086666fbe/0xdb52b77d7ca370e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.504280:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e3:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.504283:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.504287:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086666fbe/0xdb52b77d7ca370e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.504296:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086666fbe/0xdb52b77d7ca370e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.504304:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086666fbe/0xdb52b77d7ca370e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.504312:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086666fbe/0xdb52b77d7ca370e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.504350:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.504354:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086666fbe/0xdb52b77d7ca370e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.504362:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.504365:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086666fbe/0xdb52b77d7ca370e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.504373:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086666fbe/0xdb52b77d7ca370e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.504385:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086666fbe/0xdb52b77d7ca370e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.504393:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.504395:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.504397:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.504475:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.504480:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086666fbe/0xdb52b77d7ca370e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109573.504760:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109573.504766:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb57637c/0xdb52b77d7ca370ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.504774:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e2:0x0].0x0 since=8430s v=(0 0) 00010000:00010000:3.0:1786109573.504778:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109573.504782:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb57637c/0xdb52b77d7ca370ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.504792:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb57637c/0xdb52b77d7ca370ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.504800:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb57637c/0xdb52b77d7ca370ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109573.504807:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb57637c/0xdb52b77d7ca370ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.504828:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109573.504833:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb57637c/0xdb52b77d7ca370ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.504840:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6da00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109573.504843:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb57637c/0xdb52b77d7ca370ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.504851:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb57637c/0xdb52b77d7ca370ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.504862:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb57637c/0xdb52b77d7ca370ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109573.504871:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.504872:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109573.504874:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109573.504979:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109573.504984:0:179239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb57637c/0xdb52b77d7ca370ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1786109573.505694:0:179239:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:6260 00000100:00100000:3.0:1786109573.505799:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:193915:x1872862933279744:12345-0@lo:5:osp-pre-0-0.0 Request processed in 35936us (36028us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109573.505809:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23117 00000100:00100000:3.0:1786109573.505862:0:193915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:193915:1872862933279744:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1786109573.505881:0:193915:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x1901:0x0] from OST, last_created [0x280000400:0x1901:0x0]last_used is [0x280000400:0x1874:0x0] 00000100:00100000:3.0:1786109573.505991:0:193915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:193915:1872862933279872:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1786109573.506026:0:193915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109573.506049:0:193915:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a9a08e000 going to sleep for 11 seconds 00000100:00100000:3.0:1786109573.506072:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933279872 00000100:00100000:3.0:1786109573.506081:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933279872 00000100:00100000:3.0:1786109573.506123:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23118 00000100:00100000:3.0:1786109573.506132:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:193915:x1872862933279872:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1786109573.506165:0:179238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 6402 00010000:00010000:1.0:1786109573.506739:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109573.507739:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+6:193915:x1872862933279872:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1605us (1709us total) trans 38654705665 rc 0/0 00000100:00100000:3.0:1786109573.507747:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23118 00000100:00100000:1.0:1786109573.507859:0:193915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:193915:1872862933279872:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1786109573.507870:0:193915:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x1901:0x0]-[0x280000400:0x1921:0x0] 00010000:00010000:1.0:1786109573.767647:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786109574.117401:0:194935:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1786109574.413800:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933280000:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.413866:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.413910:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933280512:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.414006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.414025:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933281024:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.414045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.414062:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933281536:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.414088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.414113:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1786109574.414120:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933280128:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.414141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.414159:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933280640:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.414181:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.414196:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933281152:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.414215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.414243:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933280256:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.414263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.414281:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933280768:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.414299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.414317:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933281280:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.415674:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.415730:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1786109574.415739:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933280384:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.415780:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.415799:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933280896:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.415817:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.415833:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933281408:0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.415855:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109574.415882:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933280512 00000100:00100000:1.0:1786109574.415889:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933280512 00000100:00100000:1.0:1786109574.415940:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933281024 00000100:00100000:1.0:1786109574.415944:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933281024 00000100:00100000:1.0:1786109574.415957:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933280640 00000100:00100000:1.0:1786109574.415959:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933280640 00000100:00100000:1.0:1786109574.415974:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933281152 00000100:00100000:1.0:1786109574.415976:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933281152 00000100:00100000:1.0:1786109574.415999:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6982 00000100:00100000:1.0:1786109574.416005:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933280512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.416054:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933280512:12345-0@lo:400:kworker.0 Request processed in 48us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109574.416061:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6982 00000100:00100000:1.0:1786109574.416077:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6983 00000100:00100000:1.0:1786109574.416082:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933281024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.416104:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933281024:12345-0@lo:400:kworker.0 Request processed in 23us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109574.416110:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6983 00000100:00100000:1.0:1786109574.416121:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6984 00000100:00100000:1.0:1786109574.416126:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933280640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.416155:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933280640:12345-0@lo:400:kworker.0 Request processed in 29us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109574.416161:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6984 00000100:00100000:1.0:1786109574.416281:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6985 00000100:00100000:1.0:1786109574.416287:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933281152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109574.416315:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933281152:12345-0@lo:400:kworker.0 Request processed in 29us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109574.416321:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6985 00000100:00100000:2.0:1786109574.416494:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933280000 00000100:00100000:2.0:1786109574.416500:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933280000 00000100:00100000:2.0:1786109574.416534:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1786109574.416542:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933280000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109574.416583:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933280000:12345-0@lo:400:kworker.0 Request processed in 43us (2717us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109574.416590:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1786109574.424758:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933280384 00000100:00100000:3.0:1786109574.424773:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933280384 00000100:00100000:3.0:1786109574.424829:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933280896 00000100:00100000:3.0:1786109574.424832:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933280896 00000100:00100000:3.0:1786109574.424860:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12360 00000100:00100000:3.0:1786109574.424870:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933280384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.425756:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933280384:12345-0@lo:400:kworker.0 Request processed in 883us (9970us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109574.425768:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12360 00000100:00100000:3.0:1786109574.425797:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12361 00000100:00100000:3.0:1786109574.425809:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933280896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.425845:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933280896:12345-0@lo:400:kworker.0 Request processed in 41us (10027us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109574.425851:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12361 00000100:00100000:3.0:1786109574.425876:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933281536 00000100:00100000:3.0:1786109574.425882:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933281536 00000100:00100000:3.0:1786109574.425905:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933280128 00000100:00100000:3.0:1786109574.425908:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933280128 00000100:00100000:3.0:1786109574.425993:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933280256 00000100:00100000:3.0:1786109574.425997:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933280256 00000100:00100000:3.0:1786109574.426013:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933280768 00000100:00100000:3.0:1786109574.426015:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933280768 00000100:00100000:3.0:1786109574.426025:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933281280 00000100:00100000:3.0:1786109574.426028:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933281280 00000100:00100000:3.0:1786109574.426038:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933281408 00000100:00100000:3.0:1786109574.426040:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933281408 00000100:00100000:3.0:1786109574.426054:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1786109574.426061:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933281536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.426096:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933281536:12345-0@lo:400:kworker.0 Request processed in 36us (12007us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109574.426103:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1786109574.426115:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1786109574.426122:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933280128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.426151:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933280128:12345-0@lo:400:kworker.0 Request processed in 30us (12009us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109574.426156:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1786109574.426167:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1786109574.426173:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933280256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.426200:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933280256:12345-0@lo:400:kworker.0 Request processed in 28us (11935us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109574.426206:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1786109574.426217:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1786109574.426224:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933280768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.426250:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933280768:12345-0@lo:400:kworker.0 Request processed in 27us (11949us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109574.426255:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1786109574.426267:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1786109574.426274:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933281280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.426302:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933281280:12345-0@lo:400:kworker.0 Request processed in 30us (11962us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109574.426308:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1786109574.426320:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1786109574.426327:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933281408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.427039:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933281408:12345-0@lo:400:kworker.0 Request processed in 710us (11179us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109574.427048:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00010000:00080000:3.0:1786109574.427144:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930984ff1500 x1872862933280128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109574.427159:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933280128:0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.427173:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933280640:0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.427188:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933281152:0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.427197:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933280000:0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.427208:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933280512:0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.427218:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933281024:0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.427234:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933281536:0@lo:400:kworker.0 00000100:00080000:3.0:1786109574.427276:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109574.427311:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933280384:0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.427322:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933280896:0@lo:400:kworker.0 00010000:00080000:3.0:1786109574.427336:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930aa60a3100 x1872862933281408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109574.427682:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933281408:0@lo:400:kworker.0 00000100:00100000:3.0:1786109574.427708:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933280256:0@lo:400:kworker.0 00010000:00080000:3.0:1786109574.427720:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a89099880 x1872862933280768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109574.427728:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933280768:0@lo:400:kworker.0 00010000:00080000:3.0:1786109574.427739:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930aa60a2d80 x1872862933281280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109574.427745:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933281280:0@lo:400:kworker.0 00010000:00010000:3.0:1786109574.789898:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1786109575.034354:0:194987:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1786109575.034752:0:194987:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1786109575.813021:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1786109575.824195:0:195037:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1786109575.824425:0:195037:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1786109575.887851:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109575.887888:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922104192 00000100:00100000:0.0:1786109575.887897:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922104192 00000100:00100000:0.0:1786109575.887974:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1019 00000100:00100000:0.0:1786109575.887984:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+5:162049:x1872862922104192:12345-192.168.203.38@tcp:101:touch.0 00010000:00010000:0.0:1786109575.888003:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109575.888027:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca370f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a15e8 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.888088:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca370fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.888100:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca370fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.888114:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca370fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109575.888160:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:0.0:1786109575.888164:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109575.888196:0:187899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca370fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.888221:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca370f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15e8 expref: 7 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.888235:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca370fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15e8 expref: 6 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.888243:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a833a7100) 00010000:00010000:0.0:1786109575.888246:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109575.888249:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2400, rc 0) 00000100:00100000:0.0:1786109575.888303:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:162049:x1872862922104192:12345-192.168.203.38@tcp:101:touch.0 Request processed in 320us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109575.888310:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1019 00000100:00080000:3.0:1786109575.888470:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109575.893976:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109575.894155:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922104320 00000100:00100000:3.0:1786109575.894165:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922104320 00000100:00100000:3.0:1786109575.894224:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:3.0:1786109575.894235:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:fac74500-4523-4794-af20-dfdcdfae19c1+6:162049:x1872862922104320:12345-192.168.203.38@tcp:700:touch.0 00000100:00100000:3.0:1786109575.894315:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:fac74500-4523-4794-af20-dfdcdfae19c1+6:162049:x1872862922104320:12345-192.168.203.38@tcp:700:touch.0 Request processed in 83us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109575.894323:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:0.0:1786109575.897577:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109575.897618:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922104576 00000100:00100000:0.0:1786109575.897627:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922104576 00000100:00100000:0.0:1786109575.897701:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1020 00000100:00100000:0.0:1786109575.897713:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:162049:x1872862922104576:12345-192.168.203.38@tcp:101:touch.0 00010000:00010000:0.0:1786109575.897732:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109575.897735:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786109575.897760:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca370fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15e8 expref: 6 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.897777:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a833a7100) 00010000:00010000:0.0:1786109575.897789:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109575.897803:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37104 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a15ef expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.898575:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca3710b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.898590:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca3710b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.898601:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca3710b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.898613:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37112 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.898619:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37112 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.898625:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37112 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109575.899592:0:188678:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x1875:0x0], count =141 00000004:00080000:0.0:1786109575.899600:0:188678:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x1875:0x0]+141 in llog 00000004:00080000:0.0:1786109575.899614:0:188678:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000400:0x1902:0x0], index 0: 0 00010000:00010000:0.0:1786109575.900113:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca37119 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900127:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca37119 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900136:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca37119 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900170:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca3710b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900178:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca3710b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900185:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca3710b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900191:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109575.900194:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca3710b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900200:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca3710b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900210:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a833a7f00) 00010000:00010000:0.0:1786109575.900212:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109575.900216:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca3710b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900221:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca3710b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109575.900232:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067e5b271 reply state 00000000aba14b2e transno 339302416385 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37112 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900243:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37112 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900248:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff930a833a7400) 00010000:00010000:0.0:1786109575.900250:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109575.900253:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109575.900284:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37104 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15ef expref: 8 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900304:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca37119 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15ef expref: 7 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109575.900311:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x1:0x0].0x0 (ffff930a833a7d00) 00010000:00010000:0.0:1786109575.900314:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109575.900316:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2c00, rc 0) 00000100:00100000:0.0:1786109575.900376:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+8:162049:x1872862922104576:12345-192.168.203.38@tcp:101:touch.0 Request processed in 2667us (2808us total) trans 339302416385 rc 0/0 00000100:00100000:0.0:1786109575.900384:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1020 00000100:00100000:0.0:1786109575.904629:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109575.904663:0:187911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922104704 00000100:00100000:0.0:1786109575.904671:0:187911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922104704 00000100:00100000:0.0:1786109575.904945:0:187911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:0.0:1786109575.904956:0:187911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fac74500-4523-4794-af20-dfdcdfae19c1+5:162049:x1872862922104704:12345-192.168.203.38@tcp:900:touch.0 00000100:00100000:0.0:1786109575.905028:0:187911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fac74500-4523-4794-af20-dfdcdfae19c1+5:162049:x1872862922104704:12345-192.168.203.38@tcp:900:touch.0 Request processed in 73us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109575.905035:0:187911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00080000:3.0:1786109575.907621:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109575.909172:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109575.909881:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922104960 00000100:00100000:1.0:1786109575.909891:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922104960 00000100:00100000:1.0:1786109575.910044:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1021 00000100:00100000:1.0:1786109575.910055:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+8:162049:x1872862922104960:12345-192.168.203.38@tcp:36:touch.0 00010000:00010000:1.0:1786109575.910107:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109575.910137:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca37119 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15ef expref: 8 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109575.910156:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x1:0x0].0x0 (ffff930a833a7d00) 00010000:00010000:1.0:1786109575.910168:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109575.910226:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39e00/0xdb52b77d7ca37127 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109575.910238:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39e00/0xdb52b77d7ca37127 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109575.910246:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39e00/0xdb52b77d7ca37127 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109575.910352:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cf4d2e7 reply state 0000000066ab188e transno 339302416386 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39e00/0xdb52b77d7ca37127 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109575.910363:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39e00/0xdb52b77d7ca37127 lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109575.910370:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x1:0x0].0x0 (ffff930a83e02500) 00010000:00010000:1.0:1786109575.910373:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109575.910376:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109575.910578:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+9:162049:x1872862922104960:12345-192.168.203.38@tcp:36:touch.0 Request processed in 523us (1413us total) trans 339302416386 rc 0/0 00000100:00100000:1.0:1786109575.910585:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1021 00000100:00100000:0.0:1786109575.914659:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109575.914740:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922105088 00000100:00100000:3.0:1786109575.914750:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922105088 00000100:00100000:3.0:1786109575.914819:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1022 00000100:00100000:3.0:1786109575.914830:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+9:162049:x1872862922105088:12345-192.168.203.38@tcp:101:touch.0 00010000:00010000:3.0:1786109575.914854:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109575.914876:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6da00/0xdb52b77d7ca3712e lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a15f6 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109575.914992:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6da00/0xdb52b77d7ca3712e lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15f6 expref: 10 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109575.915008:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6da00/0xdb52b77d7ca3712e lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15f6 expref: 10 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109575.915026:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x1:0x0].0x0 (ffff930a83e02500) 00010000:00010000:3.0:1786109575.915029:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786109575.915033:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6da00, rc 0) 00000100:00100000:3.0:1786109575.915084:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+10:162049:x1872862922105088:12345-192.168.203.38@tcp:101:touch.0 Request processed in 257us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109575.915095:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1022 00000100:00100000:1.0:1786109575.940777:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933281664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109575.940847:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109575.941018:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933281664 00000100:00100000:0.0:1786109575.941025:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933281664 00000100:00100000:0.0:1786109575.941085:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5833 00000100:00100000:0.0:1786109575.941093:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933281664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109575.941119:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109575.941162:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933281664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109575.941168:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5833 00000100:00100000:0.0:1786109575.941206:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933281664:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1786109575.941288:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786109576.837083:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109576.964827:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933281792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109576.964928:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109576.965013:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933281792 00000100:00100000:1.0:1786109576.965022:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933281792 00000100:00100000:1.0:1786109576.965081:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12362 00000100:00100000:1.0:1786109576.965091:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933281792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109576.965127:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446109184 avail 1299869696 00000100:00100000:1.0:1786109576.965403:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933281792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 312us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109576.965411:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12362 00000100:00100000:3.0:1786109576.965509:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933281792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109577.476989:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933281920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109577.477074:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109577.478390:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933281920 00000100:00100000:1.0:1786109577.478398:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933281920 00000100:00100000:1.0:1786109577.478484:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5834 00000100:00100000:1.0:1786109577.478494:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933281920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109577.478521:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109577.478580:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933281920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109577.478587:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5834 00000100:00100000:2.0:1786109577.478729:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933282048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109577.478764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109577.478843:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933281920:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786109577.478989:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109577.479459:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933282048 00000100:00100000:1.0:1786109577.479464:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933282048 00000100:00100000:1.0:1786109577.479544:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12363 00000100:00100000:1.0:1786109577.479553:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933282048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109577.479582:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445683200 avail 1299443712 00000100:00100000:1.0:1786109577.479635:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933282048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109577.479641:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12363 00000100:00100000:2.0:1786109577.479826:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933282048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109577.760280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109577.760389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109577.760480:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109577.760505:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109577.760531:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109577.760562:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922105856 00000100:00100000:3.0:1786109577.760570:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922105856 00000100:00100000:3.0:1786109577.760624:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922105728 00000100:00100000:3.0:1786109577.760627:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922105728 00000100:00100000:3.0:1786109577.760644:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6986 00000100:00100000:3.0:1786109577.760655:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922105856:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109577.760733:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922105856:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109577.760741:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6986 00000100:00100000:3.0:1786109577.760757:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23119 00000100:00100000:3.0:1786109577.760762:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2401:x1872862922105728:12345-192.168.203.38@tcp:8:kworker.0 00010000:00080000:3.0:1786109577.760788:0:43911:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp t0 exp 0000000000000000 cur 8434 last 0 00000020:00000080:3.0:1786109577.760816:0:43911:0:(genops.c:1406:class_connect()) connect: client fac74500-4523-4794-af20-dfdcdfae19c1, cookie 0xdb52b77d7ca37135 00002000:00100000:3.0:1786109577.760827:0:43911:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fac74500-4523-4794-af20-dfdcdfae19c1/ffff930981e14800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786109577.760844:0:43911:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786109577.760992:0:43911:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1786109577.761020:0:43911:0:(import.c:65:import_set_state_nolock()) ffff930ab1994000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109577.761182:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922105344 00000100:00100000:0.0:1786109577.761187:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922105344 00000100:00100000:0.0:1786109577.761221:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:0.0:1786109577.761228:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922105344:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109577.761298:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922105472 00000100:00100000:1.0:1786109577.761302:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922105472 00000100:00100000:1.0:1786109577.761334:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922105600 00000100:00100000:1.0:1786109577.761337:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922105600 00000100:00100000:1.0:1786109577.761361:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 256 00000100:00100000:1.0:1786109577.761369:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+10:2404:x1872862922105472:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109577.761474:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 257 00000100:00100000:2.0:1786109577.761485:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922105600:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109577.761548:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922105728:12345-192.168.203.38@tcp:8:kworker.0 Request processed in 784us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109577.761556:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23119 00000100:00080000:3.0:1786109577.761590:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109577.761594:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786109577.761596:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109577.761817:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922105344:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 589us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109577.761825:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:1.0:1786109577.762175:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+10:2404:x1872862922105472:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 805us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109577.762183:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 256 00000100:00100000:2.0:1786109577.762275:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922105600:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 793us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109577.762282:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 257 00000100:00100000:3.0:1786109577.767270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109577.767403:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922105216 00000100:00100000:0.0:1786109577.767412:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922105216 00000100:00100000:0.0:1786109577.767593:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23120 00000100:00100000:0.0:1786109577.767604:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fac74500-4523-4794-af20-dfdcdfae19c1+6:0:x1872862922105216:12345-192.168.203.38@tcp:2:touch.0 00000100:00080000:3.0:1786109577.767841:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1786109577.770022:0:194579:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705666 is committed 00000001:00100000:2.0:1786109577.770035:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00080000:2.0:1786109577.770137:0:194579:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705665 is committed 00000100:00100000:0.0:1786109577.770521:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fac74500-4523-4794-af20-dfdcdfae19c1+5:0:x1872862922105216:12345-192.168.203.38@tcp:2:touch.0 Request processed in 2914us (3257us total) trans 38654705666 rc 0/0 00000100:00100000:0.0:1786109577.770532:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23120 00000100:00100000:3.0:1786109577.788369:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109577.823416:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922106112 00000100:00100000:0.0:1786109577.823471:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922106112 00000100:00100000:0.0:1786109577.823540:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:2.0:1786109577.823547:0:187902:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1786109577.823556:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+10:162049:x1872862922106112:12345-192.168.203.38@tcp:35:touch.0 00000100:00100000:2.0:1786109577.823561:0:187902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1786109577.824052:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+11:162049:x1872862922106112:12345-192.168.203.38@tcp:35:touch.0 Request processed in 499us (35688us total) trans 339302416387 rc 0/0 00000100:00100000:3.0:1786109577.824061:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00010000:00010000:0.0:1786109577.860646:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109577.895835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109577.896081:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922106240 00000100:00100000:1.0:1786109577.896090:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922106240 00000100:00100000:1.0:1786109577.896144:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1023 00000100:00100000:1.0:1786109577.896153:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+11:162050:x1872862922106240:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:1.0:1786109577.896174:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109577.896193:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38000/0xdb52b77d7ca3713c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a15fd expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109577.896315:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca37143 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109577.896327:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca37143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109577.896339:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca37143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109577.896381:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:1.0:1786109577.896384:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786109577.896427:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca37143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109577.896481:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38000/0xdb52b77d7ca3713c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15fd expref: 13 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109577.896498:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca37143 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15fd expref: 12 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109577.896506:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a83e02300) 00010000:00010000:1.0:1786109577.896510:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786109577.896512:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f38400, rc 0) 00000100:00100000:1.0:1786109577.896562:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+12:162050:x1872862922106240:12345-192.168.203.38@tcp:101:rm.0 Request processed in 411us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109577.896568:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1023 00000100:00100000:0.0:1786109577.899944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109577.900270:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922106368 00000100:00100000:2.0:1786109577.900280:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922106368 00000100:00100000:2.0:1786109577.900365:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1024 00000100:00100000:2.0:1786109577.900375:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+12:162050:x1872862922106368:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1786109577.900398:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109577.900424:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3714a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1604 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902304:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca37151 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902326:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca37151 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902338:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca37151 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902350:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca37158 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902357:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca37158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902362:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca37158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902502:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca3715f lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902510:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca3715f lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902518:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca3715f lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109577.902556:0:189813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x1:0x0]: returning size 0 00000004:00200000:3.0:1786109577.902561:0:189813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109577.902583:0:189813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca3715f lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902596:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca3715f lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902605:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca37151 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902610:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca37151 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902617:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca37151 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902622:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109577.902626:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca37151 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902633:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca37151 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902644:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a83e02300) 00010000:00010000:3.0:1786109577.902647:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109577.902651:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca37151 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902657:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca37151 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902728:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca37158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902736:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca37158 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902742:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca37158 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902747:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109577.902750:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca37158 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902756:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca37158 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902763:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff930a833a7400) 00010000:00010000:3.0:1786109577.902766:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109577.902768:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca37158 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902773:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca37158 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902808:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca3714a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1604 expref: 14 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902822:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca3715f lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1604 expref: 13 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109577.902829:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x1:0x0].0x0 (ffff930a83e02500) 00010000:00010000:3.0:1786109577.902831:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109577.902834:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6c800, rc 0) 00000100:00100000:3.0:1786109577.902902:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+13:162050:x1872862922106368:12345-192.168.203.38@tcp:101:rm.0 Request processed in 2528us (3390us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109577.902911:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1024 00000100:00100000:3.0:1786109577.955495:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109577.957124:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922106496 00000100:00100000:0.0:1786109577.957135:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922106496 00000100:00100000:0.0:1786109577.957217:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23121 00000100:00100000:0.0:1786109577.957227:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922106496:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1786109577.957244:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109577.957264:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba38889f/0xdb52b77d7ca37166 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1902:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a160b expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786109577.957287:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1902:0x0] initial LVB size: 0, mtime: 0x6a75de87, atime: 0x6a75de87, ctime: 0x6a75de87, blocks: 0x0 00010000:00010000:0.0:1786109577.957309:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1902:0x0].0x0 since=8434s v=(0 0) 00010000:00010000:0.0:1786109577.957314:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1902:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109577.957324:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba38889f/0xdb52b77d7ca37166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a160b expref: 6 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109577.957342:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba38889f/0xdb52b77d7ca37166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a160b expref: 6 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109577.957356:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2400, rc 0) 00000100:00100000:0.0:1786109577.957791:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922106496:12345-192.168.203.38@tcp:101:rm.0 Request processed in 564us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109577.957802:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23121 00000100:00100000:0.0:1786109577.971617:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109577.971725:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922106752 00000100:00100000:2.0:1786109577.971734:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922106752 00000100:00100000:2.0:1786109577.971838:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1025 00000100:00100000:2.0:1786109577.971849:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+13:162050:x1872862922106752:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109577.971908:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1786109577.971935:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c800/0xdb52b77d7ca3715f lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1604 expref: 13 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.971958:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6da00/0xdb52b77d7ca3712e lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15f6 expref: 12 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.971973:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x1:0x0].0x0 (ffff930a83e02500) 00010000:00010000:2.0:1786109577.971982:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca37143 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15fd expref: 11 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.971990:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a83e02300) 00010000:00010000:2.0:1786109577.971999:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109577.972020:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3716d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972031:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3716d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972040:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3716d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972051:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca37174 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972059:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca37174 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972066:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca37174 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972156:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3717b lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972164:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3717b lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972175:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3717b lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109577.972386:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x13c:0x0].2, 64 off8320 00000004:00080000:2.0:1786109577.972395:0:188678:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8434638963594ns, next at 8435638961478ns, rc = 0 00010000:00010000:2.0:1786109577.972487:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca37182 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972496:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca37182 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972503:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca37182 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972510:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca37182 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972516:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca37182 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972522:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca37182 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972545:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109577.972564:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3717b lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972569:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3717b lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972575:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3717b lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972580:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109577.972584:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3717b lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972590:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3717b lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972598:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x1:0x0].0x0 (ffff930a83e02500) 00010000:00010000:2.0:1786109577.972600:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109577.972603:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3717b lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972608:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77200/0xdb52b77d7ca3717b lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972620:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3716d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972625:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3716d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972631:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3716d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972634:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109577.972636:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3716d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972641:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3716d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972651:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ac216e400) 00010000:00010000:2.0:1786109577.972653:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109577.972655:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3716d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972659:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca3716d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109577.972683:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0bb7890 reply state 0000000029d2cff4 transno 339302416388 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca37174 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972693:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca37174 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109577.972699:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff930a833a7400) 00010000:00010000:2.0:1786109577.972702:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109577.972705:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109577.972718:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109577.972726:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca37182 lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109577.972736:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109577.972741:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca37182 lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109577.972749:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca37182 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109577.972761:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x1:0x0].0x0 (ffff930a83e02500) 00010000:00010000:1.0:1786109577.972764:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109577.972768:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca37182 lrc: 1/0,0 mode: --/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109577.972774:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca37182 lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109577.972779:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+12:162050:x1872862922106752:12345-192.168.203.38@tcp:36:rm.0 Request processed in 929us (1169us total) trans 339302416388 rc 0/0 00010000:00010000:1.0:1786109577.972790:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109577.972792:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1025 00010000:00010000:1.0:1786109577.972794:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109577.972798:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109578.500778:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109578.500805:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933282176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109578.500872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109578.500934:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933282176 00000100:00100000:2.0:1786109578.500942:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933282176 00000100:00100000:2.0:1786109578.500987:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5835 00000100:00100000:2.0:1786109578.500998:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933282176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109578.501020:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00080000:3.0:1786109578.501453:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109578.501614:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109578.501625:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933282304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109578.512027:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933282176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 11021us (11144us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109578.512054:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5835 00000100:00100000:3.0:1786109578.512528:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933282176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109578.512801:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109578.513455:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933282304 00000100:00100000:0.0:1786109578.513463:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933282304 00000100:00100000:0.0:1786109578.513988:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5836 00000100:00100000:0.0:1786109578.513999:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933282304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109578.514024:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109578.514499:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933282304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 501us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109578.514508:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5836 00000100:00100000:2.0:1786109578.514633:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705665 gen 2 00000100:00100000:2.0:1786109578.514656:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933282304:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786109578.514869:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786109578.885854:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109579.528063:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933282816:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.528139:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109579.528200:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933283328:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.528223:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109579.528246:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933283840:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.528270:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109579.528293:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1786109579.528304:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933282432:0@lo:400:kworker.0 00000100:00100000:1.0:1786109579.528305:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933282560:0@lo:400:kworker.0 00000100:00100000:1.0:1786109579.528363:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109579.528387:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933283072:0@lo:400:kworker.0 00000100:00100000:1.0:1786109579.528411:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109579.528457:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933283584:0@lo:400:kworker.0 00000100:00100000:2.0:1786109579.528467:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933282816 00000100:00100000:2.0:1786109579.528476:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933282816 00000100:00100000:1.0:1786109579.528483:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109579.528525:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933283328 00000100:00100000:2.0:1786109579.528529:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933283328 00000100:00100000:1.0:1786109579.528536:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933283840 00000100:00100000:1.0:1786109579.528542:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933283840 00000100:00100000:2.0:1786109579.528555:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12364 00000100:00100000:2.0:1786109579.528565:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933282816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109579.528626:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933282816:12345-0@lo:400:kworker.0 Request processed in 62us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109579.528633:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12364 00000100:00100000:2.0:1786109579.528650:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12365 00000100:00100000:2.0:1786109579.528656:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933283328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109579.528701:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933283328:12345-0@lo:400:kworker.0 Request processed in 45us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109579.528708:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12365 00000100:00100000:3.0:1786109579.528773:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933282688:0@lo:400:kworker.0 00000100:00100000:1.0:1786109579.528782:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933282560 00000100:00100000:1.0:1786109579.528787:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933282560 00000100:00100000:1.0:1786109579.528819:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1786109579.528823:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109579.528830:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109579.528831:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933283840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109579.528944:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933283840:12345-0@lo:400:kworker.0 Request processed in 116us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109579.528952:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1786109579.528995:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933283200:0@lo:400:kworker.0 00000100:00100000:3.0:1786109579.529018:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109579.529027:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933283712:0@lo:400:kworker.0 00000100:00100000:3.0:1786109579.529042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109579.529065:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933283200 00000100:00100000:3.0:1786109579.529069:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933283200 00000100:00100000:3.0:1786109579.529092:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933283712 00000100:00100000:3.0:1786109579.529096:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933283712 00000100:00100000:1.0:1786109579.529096:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933282688 00000100:00100000:1.0:1786109579.529102:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933282688 00000100:00100000:3.0:1786109579.529116:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1786109579.529124:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933282560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109579.529160:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933282560:12345-0@lo:400:kworker.0 Request processed in 37us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109579.529166:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1786109579.529179:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1786109579.529185:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933283200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109579.529211:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933283200:12345-0@lo:400:kworker.0 Request processed in 27us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109579.529219:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1786109579.529228:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933283712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109579.529260:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933283712:12345-0@lo:400:kworker.0 Request processed in 34us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109579.530191:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1786109579.530249:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933283200:0@lo:400:kworker.0 00000100:00100000:3.0:1786109579.530265:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933283712:0@lo:400:kworker.0 00000100:00080000:3.0:1786109579.530310:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109579.530358:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933283072 00000100:00100000:3.0:1786109579.530363:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933283072 00000100:00100000:3.0:1786109579.531247:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933283584 00000100:00100000:3.0:1786109579.531254:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933283584 00000100:00100000:3.0:1786109579.531289:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6987 00000100:00100000:3.0:1786109579.531299:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933283072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109579.531367:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933283072:12345-0@lo:400:kworker.0 Request processed in 70us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109579.531533:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109579.531579:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6987 00000100:00100000:0.0:1786109579.531586:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6988 00000100:00100000:0.0:1786109579.531597:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933283584:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786109579.531603:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109579.531634:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933282432 00000100:00100000:0.0:1786109579.531638:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933283584:12345-0@lo:400:kworker.0 Request processed in 43us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109579.531640:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933282432 00000100:00100000:0.0:1786109579.531648:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6988 00000100:00100000:3.0:1786109579.531683:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1786109579.531692:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac12d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933282432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109579.531860:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac12d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933282432:12345-0@lo:400:kworker.0 Request processed in 169us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109579.531867:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786109579.531964:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933282432:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.531974:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933282944:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.533612:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109579.533780:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933282944 00000100:00100000:3.0:1786109579.533787:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933282944 00000100:00100000:3.0:1786109579.533836:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6989 00000100:00100000:3.0:1786109579.533847:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933282944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109579.533897:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933282944:12345-0@lo:400:kworker.0 Request processed in 53us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109579.533904:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6989 00000100:00100000:0.0:1786109579.534945:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933283456:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.534997:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109579.535038:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933283968:0@lo:400:kworker.0 00000100:00100000:3.0:1786109579.535065:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933283456 00000100:00100000:0.0:1786109579.535067:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109579.535073:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933283456 00000100:00100000:0.0:1786109579.535099:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933283968 00000100:00100000:0.0:1786109579.535105:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933283968 00000100:00100000:3.0:1786109579.535121:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6990 00000100:00100000:3.0:1786109579.535130:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933283456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.535151:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1786109579.535161:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933283968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109579.535177:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933283456:12345-0@lo:400:kworker.0 Request processed in 47us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109579.535184:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6990 00000100:00100000:0.0:1786109579.535205:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933283968:12345-0@lo:400:kworker.0 Request processed in 45us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109579.535214:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:3.0:1786109579.535227:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109579.535254:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933283968:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.535267:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933282816:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.535277:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933283328:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.535290:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933283840:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.535323:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933282944:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.535333:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933283456:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.538755:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933282560:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.538774:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933283072:0@lo:400:kworker.0 00000100:00100000:0.0:1786109579.538787:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933283584:0@lo:400:kworker.0 00000100:00100000:2.0:1786109579.543755:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1786109579.543944:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1786109579.543963:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933282688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109579.544364:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933282688:12345-0@lo:400:kworker.0 Request processed in 409us (15545us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109579.544372:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1786109579.544515:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933282688:0@lo:400:kworker.0 00000100:00100000:3.0:1786109579.729754:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109579.729859:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922106880 00000100:00100000:0.0:1786109579.729868:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922106880 00000100:00100000:0.0:1786109579.729979:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1026 00000100:00100000:0.0:1786109579.729990:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+12:162077:x1872862922106880:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109579.730011:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109579.730033:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37189 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1612 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109579.730094:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca37190 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109579.730107:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca37190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109579.730120:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca37190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109579.730160:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:0.0:1786109579.730164:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109579.730195:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca37190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109579.730219:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37189 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1612 expref: 14 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109579.730237:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca37190 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1612 expref: 13 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109579.730267:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a833a7800) 00010000:00010000:0.0:1786109579.730270:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109579.730274:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3400, rc 0) 00000100:00100000:0.0:1786109579.730336:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+13:162077:x1872862922106880:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 348us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109579.730344:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1026 00000100:00080000:3.0:1786109579.730724:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109579.736367:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109579.736458:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922107008 00000100:00100000:2.0:1786109579.736468:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922107008 00000100:00100000:2.0:1786109579.736524:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1027 00000100:00100000:2.0:1786109579.736534:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+13:162077:x1872862922107008:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1786109579.736568:0:188678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445683200 avail 1299443712 00000100:00100000:2.0:1786109579.736640:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+13:162077:x1872862922107008:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 108us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109579.736648:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1027 00000100:00100000:2.0:1786109579.739094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109579.739209:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922107136 00000100:00100000:1.0:1786109579.739217:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922107136 00000100:00100000:1.0:1786109579.739328:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1028 00000100:00100000:1.0:1786109579.739340:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+5:162077:x1872862922107136:12345-192.168.203.38@tcp:41:lfs.0 00000100:00080000:3.0:1786109579.739346:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:1.0:1786109579.739374:0:187899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446109184 avail 1299869696 00000100:00100000:1.0:1786109579.739469:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+5:162077:x1872862922107136:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 132us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109579.739478:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1028 00000100:00100000:3.0:1786109579.743119:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109579.743301:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922107264 00000100:00100000:1.0:1786109579.743310:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922107264 00000100:00100000:1.0:1786109579.743453:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5837 00000100:00100000:1.0:1786109579.743465:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:162077:x1872862922107264:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109579.743496:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109579.743581:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:162077:x1872862922107264:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 118us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109579.743587:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5837 00000100:00080000:3.0:1786109579.743781:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109579.746423:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109579.746544:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922107392 00000100:00100000:1.0:1786109579.746553:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922107392 00000100:00100000:1.0:1786109579.746668:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5838 00000100:00100000:1.0:1786109579.746679:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:162077:x1872862922107392:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109579.746710:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109579.746783:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:162077:x1872862922107392:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 106us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109579.746791:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5838 00000100:00080000:3.0:1786109579.747278:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786109579.908679:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109580.948315:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109581.063019:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933284096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109581.063138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109581.063710:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933284096 00000100:00100000:2.0:1786109581.063721:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933284096 00000100:00100000:2.0:1786109581.063800:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5839 00000100:00100000:2.0:1786109581.063813:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933284096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109581.063841:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109581.066192:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933284096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2369us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109581.066208:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5839 00000100:00080000:2.0:1786109581.066259:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109581.066946:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933284096:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1786109581.077510:0:193896:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 339302416388 is committed 00000004:00080000:2.0:1786109581.077524:0:193896:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1786109581.077590:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37112 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077604:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37112 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077612:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37112 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077619:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109581.077623:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37112 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077631:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37112 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077658:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff930a833a7400) 00010000:00010000:3.0:1786109581.077661:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109581.077666:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37112 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077672:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37112 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077691:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39e00/0xdb52b77d7ca37127 lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077698:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39e00/0xdb52b77d7ca37127 lrc: 2/0,0 mode: TXN/TXN res: [0x200026d31:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077708:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39e00/0xdb52b77d7ca37127 lrc: 3/0,0 mode: TXN/TXN res: [0x200026d31:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077713:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109581.077715:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39e00/0xdb52b77d7ca37127 lrc: 3/0,0 mode: TXN/TXN res: [0x200026d31:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077721:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39e00/0xdb52b77d7ca37127 lrc: 4/0,0 mode: TXN/TXN res: [0x200026d31:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077729:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x1:0x0].0x0 (ffff930a83e02500) 00010000:00010000:3.0:1786109581.077732:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109581.077735:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39e00/0xdb52b77d7ca37127 lrc: 2/0,0 mode: --/TXN res: [0x200026d31:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077740:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39e00/0xdb52b77d7ca37127 lrc: 0/0,0 mode: --/TXN res: [0x200026d31:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077759:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca37174 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077766:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca37174 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077773:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca37174 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077778:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109581.077781:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca37174 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077791:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca37174 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077800:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa27b0879 (ffff930a833a7400) 00010000:00010000:3.0:1786109581.077802:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109581.077805:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca37174 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.077810:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca37174 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa27b0879 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109581.077953:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933284224:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786109581.078024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109581.078268:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933284224 00000100:00100000:1.0:1786109581.078284:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933284224 00000100:00080000:2.0:1786109581.078356:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109581.079894:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23122 00000100:00100000:1.0:1786109581.079926:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933284224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786109581.079971:0:43916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:6402 count 1 00010000:00010000:1.0:1786109581.080009:0:43916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109581.080037:0:43916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba38889f/0xdb52b77d7ca37166 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a160b expref: 5 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109581.080047:0:43916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1902:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1786109581.080052:0:43916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1902:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109581.080058:0:43916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109581.080955:0:43916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba38889f/0xdb52b77d7ca37166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a160b expref: 5 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109581.080981:0:43916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba38889f/0xdb52b77d7ca37166 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a160b expref: 5 pid: 8442 timeout: 8537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109581.081007:0:43916:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:43916:1872862933284352:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109581.081314:0:43916:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab96439c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109581.089789:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109581.091354:0:43916:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:43916:1872862933284352:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109581.091386:0:43916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109581.091731:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922107520 00000100:00100000:3.0:1786109581.091744:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922107520 00010000:00010000:3.0:1786109581.091831:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba38889f/0xdb52b77d7ca37166 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a160b expref: 6 pid: 8442 timeout: 8537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109581.092047:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12642 00000100:00100000:3.0:1786109581.092062:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922107520:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109581.092081:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109581.092088:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba38889f/0xdb52b77d7ca37166 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1902:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a160b expref: 6 pid: 8442 timeout: 8537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.092104:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba38889f/0xdb52b77d7ca37166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1902:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a160b expref: 6 pid: 8442 timeout: 8537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.092135:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba38889f/0xdb52b77d7ca37166 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1902:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a160b expref: 6 pid: 8442 timeout: 8537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.092160:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1902:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109581.092166:0:6513:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1902:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109581.092173:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.092185:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786109581.092269:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786109581.092646:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109581.092758:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922107520:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 699us (2983us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109581.092768:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12642 00010000:00010000:1.0:1786109581.098170:0:43916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109581.098190:0:43916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109581.098204:0:43916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109581.098212:0:43916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109581.098245:0:43916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109581.098276:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109581.098291:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.098306:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109581.098313:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.098327:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109581.098496:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933284224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18582us (20467us total) trans 38654705667 rc 0/0 00000100:00100000:1.0:1786109581.098507:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23122 00010000:00010000:3.0:1786109581.098541:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.098559:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eccb6d90/0xdb52b77d7ca37197 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1902:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109581.098593:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109581.098595:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109581.098598:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786109581.098751:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930aa5c55180/2, rc 0, transno 38654705667 00000100:00100000:2.0:1786109581.098762:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933284224:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1786109581.956593:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109582.084835:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933284480:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109582.084910:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109582.085154:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933284480 00000100:00100000:2.0:1786109582.085162:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933284480 00000100:00100000:2.0:1786109582.085212:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12366 00000100:00100000:2.0:1786109582.085221:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933284480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109582.085252:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1786109582.085306:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933284480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109582.085312:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12366 00000100:00100000:0.0:1786109582.085482:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933284480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109582.598882:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933284608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109582.598950:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109582.599322:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933284736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109582.599368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109582.599525:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933284736 00000100:00100000:3.0:1786109582.599533:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933284736 00000100:00100000:3.0:1786109582.599588:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12367 00000100:00100000:3.0:1786109582.599598:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933284736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786109582.599632:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445683200 avail 1299443712 00000100:00100000:3.0:1786109582.599688:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933284736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109582.599695:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12367 00000100:00100000:2.0:1786109582.600265:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933284736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109582.600413:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933284608 00000100:00100000:0.0:1786109582.600418:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933284608 00000100:00100000:0.0:1786109582.600521:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5840 00000100:00100000:0.0:1786109582.600530:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933284608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109582.600559:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109582.600610:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933284608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109582.600617:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5840 00000100:00100000:3.0:1786109582.601883:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933284608:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1786109582.602407:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109582.866777:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109582.867084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109582.867108:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109582.867128:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109582.867179:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109582.867205:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922107648 00000100:00100000:3.0:1786109582.867213:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922107648 00000100:00100000:3.0:1786109582.867257:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:3.0:1786109582.867267:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac12db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922107648:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109582.867325:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac12db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922107648:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 61us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109582.867332:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:3.0:1786109582.867358:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922107904 00000100:00100000:3.0:1786109582.867361:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922107904 00000100:00100000:3.0:1786109582.868063:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922107776 00000100:00100000:3.0:1786109582.868068:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922107776 00000100:00100000:3.0:1786109582.868094:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 264 00000100:00100000:3.0:1786109582.868103:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922107904:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109582.868135:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922107904:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109582.868141:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 264 00000100:00100000:3.0:1786109582.868152:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 265 00000100:00100000:3.0:1786109582.868158:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922107776:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109582.868176:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922107776:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 19us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109582.868182:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 265 00000100:00100000:3.0:1786109582.868196:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922108160 00000100:00100000:3.0:1786109582.868199:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922108160 00000100:00100000:3.0:1786109582.868221:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922108032 00000100:00100000:3.0:1786109582.868223:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922108032 00000100:00100000:3.0:1786109582.868237:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6991 00000100:00100000:3.0:1786109582.868243:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922108160:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109582.868262:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922108160:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 20us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109582.868269:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6991 00000100:00100000:3.0:1786109582.868277:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6992 00000100:00100000:3.0:1786109582.868283:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922108032:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109582.868297:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922108032:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 15us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109582.868303:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6992 00000100:00080000:3.0:1786109582.868527:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109582.868532:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786109582.868534:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1786109582.980658:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109583.620687:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109583.620708:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933284864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109583.620773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109583.620929:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933284864 00000100:00100000:0.0:1786109583.620937:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933284864 00000100:00080000:3.0:1786109583.621033:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109583.621069:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5841 00000100:00100000:0.0:1786109583.621078:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933284864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109583.621104:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109583.621157:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933284864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109583.621166:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5841 00000100:00100000:3.0:1786109583.621227:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933284864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109583.621849:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933284992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109583.621893:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109583.622109:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933284992 00000100:00100000:1.0:1786109583.622116:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933284992 00000100:00100000:1.0:1786109583.622224:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5842 00000100:00100000:1.0:1786109583.622233:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933284992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786109583.622249:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109583.622289:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933284992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109583.622295:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5842 00000100:00080000:3.0:1786109583.622339:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109583.622372:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933284992:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786109584.041804:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109584.646220:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933285504:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.646319:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109584.646560:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933286016:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.646590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109584.646622:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786109584.646641:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933285120:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.646673:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109584.646712:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933285632:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.646739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109584.646773:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933285376:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.646800:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109584.646821:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933285888:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.646841:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109584.647654:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786109584.647665:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933285248:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.647716:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109584.647739:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933285760:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.647766:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109584.647815:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933285504 00000100:00100000:1.0:1786109584.647826:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933285504 00000100:00100000:3.0:1786109584.648761:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933286272:0@lo:400:kworker.0 00000100:00100000:3.0:1786109584.648812:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109584.648842:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109584.648858:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933286400:0@lo:400:kworker.0 00000100:00100000:3.0:1786109584.648881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109584.648911:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933285632 00000100:00100000:3.0:1786109584.648917:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933285632 00000100:00100000:3.0:1786109584.648969:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933285760 00000100:00100000:3.0:1786109584.648971:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933285760 00000100:00100000:3.0:1786109584.648996:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933286272 00000100:00100000:3.0:1786109584.648998:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933286272 00000100:00100000:3.0:1786109584.649018:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6993 00000100:00100000:3.0:1786109584.649026:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933285632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109584.649076:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933285632:12345-0@lo:400:kworker.0 Request processed in 50us (2336us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109584.649082:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6993 00000100:00100000:3.0:1786109584.649099:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6994 00000100:00100000:1.0:1786109584.650383:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933286016 00000100:00100000:1.0:1786109584.650394:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933286016 00000100:00100000:3.0:1786109584.650468:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933285760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.651455:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12368 00000100:00100000:1.0:1786109584.651475:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933285504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.651540:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933285504:12345-0@lo:400:kworker.0 Request processed in 73us (5221us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109584.651547:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12368 00000100:00100000:1.0:1786109584.651573:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12369 00000100:00100000:1.0:1786109584.651580:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933286016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.651604:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933286016:12345-0@lo:400:kworker.0 Request processed in 25us (5015us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109584.651610:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12369 00000100:00100000:1.0:1786109584.651646:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933285120 00000100:00100000:1.0:1786109584.651655:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933285120 00000100:00100000:1.0:1786109584.651694:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1786109584.651700:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac12d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933285120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.651731:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac12d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933285120:12345-0@lo:400:kworker.0 Request processed in 32us (5057us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109584.651737:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1786109584.651772:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933285376 00000100:00100000:1.0:1786109584.651776:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933285376 00000100:00100000:1.0:1786109584.651809:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933285888 00000100:00100000:1.0:1786109584.651814:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933285888 00000100:00100000:1.0:1786109584.651827:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933285248 00000100:00100000:1.0:1786109584.651830:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933285248 00000100:00100000:1.0:1786109584.651842:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933286400 00000100:00100000:1.0:1786109584.651844:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933286400 00000100:00100000:1.0:1786109584.651857:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1786109584.651862:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933285376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.651894:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933285376:12345-0@lo:400:kworker.0 Request processed in 32us (5093us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109584.651900:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1786109584.651912:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1786109584.651917:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933285888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.651943:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933285888:12345-0@lo:400:kworker.0 Request processed in 26us (5101us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109584.651948:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1786109584.651959:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1786109584.651965:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933285248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.651990:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933285248:12345-0@lo:400:kworker.0 Request processed in 26us (4273us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109584.651995:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1786109584.652007:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1786109584.652012:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933286400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652046:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933286400:12345-0@lo:400:kworker.0 Request processed in 34us (3164us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109584.652052:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1786109584.652091:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933286528:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652135:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109584.652185:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933285120:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652204:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933285632:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652218:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933285504:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652229:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933286016:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652259:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786109584.652267:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933286144:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109584.652314:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933286656:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652336:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109584.652371:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933285248:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652385:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933285760:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652396:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933285376:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652408:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933285888:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652473:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933286528 00000100:00100000:1.0:1786109584.652477:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933286528 00000100:00100000:1.0:1786109584.652501:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933286656 00000100:00100000:1.0:1786109584.652504:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933286656 00000100:00100000:1.0:1786109584.652518:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1786109584.652524:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933286528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652560:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933286528:12345-0@lo:400:kworker.0 Request processed in 36us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109584.652566:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1786109584.652578:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1786109584.652584:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933286656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.652611:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933286656:12345-0@lo:400:kworker.0 Request processed in 27us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109584.652616:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1786109584.654634:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933286144 00000100:00100000:0.0:1786109584.654651:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933286144 00000100:00100000:1.0:1786109584.655243:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933286400:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.655330:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933286656:0@lo:400:kworker.0 00000100:00100000:1.0:1786109584.655345:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933286528:0@lo:400:kworker.0 00000100:00100000:3.0:1786109584.655831:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933285760:12345-0@lo:400:kworker.0 Request processed in 1437us (2775us total) trans 0 rc 0/0 00000100:00080000:1.0:1786109584.656080:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786109584.656088:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109584.656092:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109584.656488:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6995 00000100:00100000:0.0:1786109584.663655:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6996 00000100:00100000:0.0:1786109584.663683:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933286144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109584.663818:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933286144:12345-0@lo:400:kworker.0 Request processed in 148us (11523us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109584.663826:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6996 00000100:00100000:2.0:1786109584.664825:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933286272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109584.664928:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933286272:12345-0@lo:400:kworker.0 Request processed in 8426us (16115us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109584.664940:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6995 00000100:00100000:0.0:1786109584.666352:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933286144:0@lo:400:kworker.0 00000100:00100000:3.0:1786109584.671612:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6994 00000100:00100000:1.0:1786109584.673081:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933286272:0@lo:400:kworker.0 00010000:00010000:2.0:1786109585.106473:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109586.116690:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109586.212950:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933286784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109586.213029:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109586.213170:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933286784 00000100:00100000:0.0:1786109586.213179:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933286784 00000100:00080000:1.0:1786109586.213292:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109586.213326:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5843 00000100:00100000:1.0:1786109586.213338:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933286784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109586.213368:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109586.213575:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933286784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 236us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109586.213584:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5843 00000100:00100000:2.0:1786109586.213697:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933286784:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1786109587.140789:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109587.214168:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933286912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109587.214235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109587.214517:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933286912 00000100:00100000:1.0:1786109587.214525:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933286912 00000100:00100000:1.0:1786109587.214568:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12370 00000100:00100000:1.0:1786109587.214577:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933286912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109587.214622:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446109184 avail 1299869696 00000100:00100000:1.0:1786109587.214673:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933286912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109587.214684:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12370 00000100:00100000:1.0:1786109587.214726:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933286912:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1786109587.224156:0:194579:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705667 is committed 00000001:02000400:0.0:1786109587.445631:0:195234:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80a: DNE: create remote dir, drop update rep from MDT0, fail MDT0 ========================================================== 09:33:05 (1786109585) 00000100:00100000:3.0:1786109587.514554:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109587.515070:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922108288 00000100:00100000:1.0:1786109587.515080:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922108288 00000100:00100000:1.0:1786109587.515151:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1029 00000100:00100000:1.0:1786109587.515161:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:162680:x1872862922108288:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109587.515179:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109587.515197:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38000/0xdb52b77d7ca3719e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1619 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.515252:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca371a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.515265:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca371a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.515278:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca371a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.515292:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39000/0xdb52b77d7ca371ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.515299:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39000/0xdb52b77d7ca371ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.515311:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39000/0xdb52b77d7ca371ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786109587.515410:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786109587.536649:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca371a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536668:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca371a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536677:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca371a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536685:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109587.536690:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca371a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536702:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca371a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536725:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a833a7800) 00010000:00010000:1.0:1786109587.536728:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109587.536735:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca371a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536742:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38400/0xdb52b77d7ca371a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536757:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39000/0xdb52b77d7ca371ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536763:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39000/0xdb52b77d7ca371ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536770:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39000/0xdb52b77d7ca371ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536775:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109587.536779:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39000/0xdb52b77d7ca371ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536785:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39000/0xdb52b77d7ca371ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536801:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff930a83e02200) 00010000:00010000:1.0:1786109587.536804:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109587.536807:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39000/0xdb52b77d7ca371ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536812:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39000/0xdb52b77d7ca371ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536863:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38000/0xdb52b77d7ca3719e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1619 expref: 7 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536872:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a833a7800) 00010000:00010000:1.0:1786109587.536874:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109587.536877:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38000/0xdb52b77d7ca3719e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1619 expref: 7 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109587.536886:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f38000, rc 0) 00000100:00100000:1.0:1786109587.536953:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:162680:x1872862922108288:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 21793us (22405us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109587.536964:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1029 00000100:00100000:0.0:1786109587.552938:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109587.553000:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922108544 00000100:00100000:2.0:1786109587.553009:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922108544 00000100:00100000:2.0:1786109587.553064:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1030 00000100:00100000:2.0:1786109587.553074:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:162680:x1872862922108544:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:2.0:1786109587.553211:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109587.553237:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca37190 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1612 expref: 6 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.553255:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a833a7800) 00010000:00010000:2.0:1786109587.553267:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109587.553334:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca371b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.553347:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca371b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.553357:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca371b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.553367:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca371ba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.553373:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca371ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.553380:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca371ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555105:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555123:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555133:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109587.555150:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc240b1b reply state 000000001b92da75 transno 339302416389 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555161:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555168:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930a90bbee00) 00010000:00010000:2.0:1786109587.555172:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109587.555175:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1786109587.555181:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1786109587.555188:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca371b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555196:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca371b3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555204:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca371b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555210:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109587.555214:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca371b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555221:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca371b3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555232:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a90bbe600) 00010000:00010000:2.0:1786109587.555234:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109587.555238:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca371b3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555245:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd77e00/0xdb52b77d7ca371b3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109587.555268:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc240b1b reply state 000000001b92da75 transno 339302416389 ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca371ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555277:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca371ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109587.555283:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff930a90bbea00) 00010000:00010000:2.0:1786109587.555286:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109587.555288:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1786109587.555452:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:162680:x1872862922108544:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 2355us (2500us total) trans 339302416389 rc 0/0 00000100:00100000:2.0:1786109587.555462:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1030 00000100:00100000:3.0:1786109587.716627:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109587.716648:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933287040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109587.716708:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109587.716774:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933287040 00000100:00100000:3.0:1786109587.716781:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933287040 00000100:00100000:3.0:1786109587.716839:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5844 00000100:00100000:3.0:1786109587.716849:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933287040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109587.716875:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109587.716914:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933287040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109587.716921:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5844 00000100:00080000:3.0:1786109587.716939:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109587.716969:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933287040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109587.718581:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109587.718596:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933287168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109587.718747:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109587.718840:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933287168 00000100:00100000:3.0:1786109587.718847:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933287168 00000100:00100000:3.0:1786109587.718896:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12371 00000100:00100000:3.0:1786109587.718905:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933287168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786109587.718932:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445679104 avail 1299439616 00000100:00100000:3.0:1786109587.718981:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933287168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109587.718988:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12371 00000100:00100000:0.0:1786109587.719076:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933287168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109588.007614:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109588.007716:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109588.007748:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922108800 00000100:00100000:2.0:1786109588.007757:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922108800 00000100:00100000:1.0:1786109588.007818:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109588.007868:0:179241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922109056 00000100:00100000:0.0:1786109588.007872:0:179241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922109056 00000100:00100000:2.0:1786109588.008009:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 272 00000100:00100000:0.0:1786109588.008084:0:179241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6997 00000100:00100000:0.0:1786109588.008094:0:179241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922109056:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:3.0:1786109588.008173:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109588.008177:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109588.008234:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922108800:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109588.008319:0:179241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922109056:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 226us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109588.008327:0:179241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6997 00000100:00100000:1.0:1786109588.008782:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109588.008849:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922108672 00000100:00100000:1.0:1786109588.008854:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922108672 00000100:00100000:1.0:1786109588.008899:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:1.0:1786109588.008907:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac12da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922108672:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109588.008943:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac12da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922108672:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109588.008948:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:2.0:1786109588.009104:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922108800:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 873us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109588.009111:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 272 00000100:00100000:0.0:1786109588.009164:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922108928 00000100:00100000:0.0:1786109588.009169:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922108928 00000100:00100000:0.0:1786109588.009252:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6998 00000100:00100000:0.0:1786109588.009259:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922108928:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109588.009290:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922108928:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 32us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109588.009295:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6998 00000100:00080000:3.0:1786109588.009671:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786109588.168810:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109588.168954:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109588.169039:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922109184 00000100:00100000:3.0:1786109588.169049:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922109184 00000100:00100000:3.0:1786109588.169113:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1031 00000100:00100000:3.0:1786109588.169124:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:162689:x1872862922109184:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109588.169149:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109588.169172:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca371c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1620 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.169238:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca371cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.169251:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca371cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.169262:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca371cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109588.169309:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:3.0:1786109588.169313:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109588.169335:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca371cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.169362:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca371c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1620 expref: 9 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.169379:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca371cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1620 expref: 8 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.169388:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ac0b06800) 00010000:00010000:3.0:1786109588.169391:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109588.169394:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d200, rc 0) 00000100:00100000:3.0:1786109588.169474:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:162689:x1872862922109184:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 352us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109588.169481:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1031 00000100:00100000:0.0:1786109588.203665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109588.206679:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922109312 00000100:00100000:3.0:1786109588.206693:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922109312 00000100:00100000:3.0:1786109588.206760:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1032 00000100:00100000:3.0:1786109588.206773:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+8:162689:x1872862922109312:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109588.206794:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109588.206812:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca371d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1627 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.206868:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca371dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.206886:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca371dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.206896:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca371dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.206906:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca371e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.206913:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca371e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.206919:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca371e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.206997:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca371eb lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207004:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca371eb lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207011:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca371eb lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109588.207038:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1786109588.207041:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109588.207057:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca371eb lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207068:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca371dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207079:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca371dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207086:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca371dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207091:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109588.207095:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca371dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207102:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca371dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207112:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ac0b06800) 00010000:00010000:3.0:1786109588.207114:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109588.207118:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca371dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207124:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca371dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207133:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca371e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207139:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca371e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207145:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca371e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207150:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6de00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109588.207153:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca371e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207159:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca371e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207165:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff930a90bbea00) 00010000:00010000:3.0:1786109588.207167:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109588.207170:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca371e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207175:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6de00/0xdb52b77d7ca371e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207195:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca371d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1627 expref: 10 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207205:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca371eb lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1627 expref: 9 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.207212:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930a90bbee00) 00010000:00010000:3.0:1786109588.207214:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786109588.207216:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6ce00, rc 0) 00000100:00100000:3.0:1786109588.207269:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+9:162689:x1872862922109312:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 500us (3611us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109588.207276:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1032 00000100:00100000:1.0:1786109588.223290:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109588.223469:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922109440 00000100:00100000:2.0:1786109588.223479:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922109440 00000100:00100000:2.0:1786109588.223528:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1033 00000100:00100000:2.0:1786109588.223537:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+9:162689:x1872862922109440:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109588.223558:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109588.223577:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ca00/0xdb52b77d7ca371f2 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a162e expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223730:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca371f9 lrc: 3/1,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223742:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca371f9 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223751:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca371f9 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223763:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166de00/0xdb52b77d7ca37200 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223769:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166de00/0xdb52b77d7ca37200 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223775:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166de00/0xdb52b77d7ca37200 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223806:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca371f9 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223813:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca371f9 lrc: 2/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223819:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca371f9 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223825:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166ce00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109588.223829:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca371f9 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223838:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca371f9 lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223849:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930a90bbee00) 00010000:00010000:2.0:1786109588.223852:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109588.223857:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca371f9 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223864:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca371f9 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223874:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166de00/0xdb52b77d7ca37200 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223880:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166de00/0xdb52b77d7ca37200 lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223885:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166de00/0xdb52b77d7ca37200 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223890:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166de00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109588.223893:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166de00/0xdb52b77d7ca37200 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223899:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166de00/0xdb52b77d7ca37200 lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223906:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0xf7117594 (ffff930a90bbe400) 00010000:00010000:2.0:1786109588.223909:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109588.223911:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166de00/0xdb52b77d7ca37200 lrc: 2/0,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223917:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166de00/0xdb52b77d7ca37200 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223951:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ca00/0xdb52b77d7ca371f2 lrc: 1/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a162e expref: 10 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223961:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930a90bbee00) 00010000:00010000:2.0:1786109588.223963:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109588.223967:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ca00/0xdb52b77d7ca371f2 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a162e expref: 10 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.223975:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a8166ca00, rc 0) 00000100:00100000:2.0:1786109588.224047:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+9:162689:x1872862922109440:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 510us (762us total) trans 0 rc 301/301 00000100:00100000:2.0:1786109588.224055:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1033 00000100:00100000:3.0:1786109588.234646:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109588.234795:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922109568 00000100:00100000:0.0:1786109588.234805:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922109568 00000100:00100000:0.0:1786109588.234887:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1034 00000100:00100000:0.0:1786109588.234898:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+9:162689:x1872862922109568:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109588.234917:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109588.234937:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37207 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1635 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235002:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3720e lrc: 3/1,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235016:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3720e lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235026:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3720e lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235039:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37215 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235046:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37215 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235052:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37215 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235093:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3720e lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235101:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3720e lrc: 2/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235107:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3720e lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235113:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109588.235116:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3720e lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235123:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3720e lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235134:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930a90bbee00) 00010000:00010000:0.0:1786109588.235136:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109588.235141:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3720e lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235146:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3720e lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235160:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37215 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235166:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37215 lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235172:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37215 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235177:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109588.235179:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37215 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235185:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37215 lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235193:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0xf7117594 (ffff930a833a7600) 00010000:00010000:0.0:1786109588.235195:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109588.235198:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37215 lrc: 2/0,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235204:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37215 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235240:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37207 lrc: 1/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1635 expref: 10 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235251:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930a90bbee00) 00010000:00010000:0.0:1786109588.235253:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109588.235257:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37207 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1635 expref: 10 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.235266:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2600, rc 0) 00000100:00100000:0.0:1786109588.235330:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+9:162689:x1872862922109568:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 433us (691us total) trans 0 rc 301/301 00000100:00100000:0.0:1786109588.235337:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1034 00000100:00100000:1.0:1786109588.250898:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109588.252629:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922109696 00000100:00100000:0.0:1786109588.252643:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922109696 00000100:00100000:0.0:1786109588.252707:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1035 00000100:00100000:0.0:1786109588.252716:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+9:162689:x1872862922109696:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109588.252737:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109588.252756:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3721c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a163c expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.252818:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37223 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.252831:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37223 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.252842:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37223 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109588.252887:0:189813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1786109588.252890:0:189813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109588.252906:0:189813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37223 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.252930:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3721c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a163c expref: 11 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.252947:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37223 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a163c expref: 10 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.252955:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930a90bbee00) 00010000:00010000:0.0:1786109588.252958:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109588.252962:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2000, rc 0) 00000100:00100000:0.0:1786109588.253014:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+10:162689:x1872862922109696:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 299us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109588.253022:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1035 00000100:00100000:3.0:1786109588.287074:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109588.287170:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922109952 00000100:00100000:0.0:1786109588.287180:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922109952 00000100:00100000:0.0:1786109588.287237:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1036 00000100:00100000:0.0:1786109588.287247:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+10:162689:x1872862922109952:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109588.287268:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109588.287288:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3722a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1643 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109588.287485:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1786109588.287651:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3722a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1643 expref: 12 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.287666:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ac0b06800) 00010000:00010000:0.0:1786109588.287670:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786109588.287674:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3722a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1643 expref: 12 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.287693:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2600, rc 0) 00000100:00100000:0.0:1786109588.287746:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+11:162689:x1872862922109952:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 500us (682us total) trans 339302416390 rc 301/301 00000100:00100000:0.0:1786109588.287754:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1036 00000100:00100000:3.0:1786109588.292132:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109588.292221:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922110080 00000100:00100000:0.0:1786109588.292232:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922110080 00000100:00100000:0.0:1786109588.292285:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1786109588.292296:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fac74500-4523-4794-af20-dfdcdfae19c1+5:162689:x1872862922110080:12345-192.168.203.38@tcp:700:lfs.0 00000100:00100000:0.0:1786109588.292511:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fac74500-4523-4794-af20-dfdcdfae19c1+5:162689:x1872862922110080:12345-192.168.203.38@tcp:700:lfs.0 Request processed in 215us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109588.292518:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1786109588.294805:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109588.294883:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922110336 00000100:00100000:3.0:1786109588.294901:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922110336 00000100:00100000:3.0:1786109588.294966:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1037 00000100:00100000:3.0:1786109588.294977:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+5:162689:x1872862922110336:12345-192.168.203.38@tcp:36:lfs.0 00000100:00100000:3.0:1786109588.295103:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933287296:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786109588.295152:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109588.295199:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aa0e899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109588.295218:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933287296 00000100:00100000:3.0:1786109588.295222:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933287296 00000100:00100000:3.0:1786109588.295255:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12372 00000100:00100000:3.0:1786109588.295263:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187899:x1872862933287296:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786109588.295325:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187899:x1872862933287296:12345-0@lo:1000:mdt00_000.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109588.295333:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12372 00000100:00100000:3.0:1786109588.295564:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933287296:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786109588.295634:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933287424:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786109588.295659:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109588.295896:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109588.296760:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933287424 00000100:00100000:0.0:1786109588.296767:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933287424 00000100:00100000:0.0:1786109588.296806:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12373 00000100:00100000:0.0:1786109588.296815:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187899:x1872862933287424:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.296948:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187899:x1872862933287424:12345-0@lo:1000:mdt00_000.0 Request processed in 134us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109588.296956:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12373 00000100:00100000:3.0:1786109588.297002:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933287424:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786109588.297049:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933287552:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786109588.297075:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109588.297188:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502f840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109588.297229:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933287552 00000100:00100000:0.0:1786109588.297233:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933287552 00000100:00100000:0.0:1786109588.297448:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12374 00000100:00100000:0.0:1786109588.297457:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187899:x1872862933287552:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.297538:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187899:x1872862933287552:12345-0@lo:1000:mdt00_000.0 Request processed in 82us (462us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786109588.297545:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12374 00000100:00100000:2.0:1786109588.297594:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933287552:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1786109588.297658:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.297669:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.297771:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109588.297787:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933287680:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1786109588.297811:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109588.298015:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab29e6540 going to sleep for 11 seconds 00000100:00100000:3.0:1786109588.299656:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933287680 00000100:00100000:3.0:1786109588.299667:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933287680 00000100:00100000:3.0:1786109588.299722:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12375 00000100:00100000:3.0:1786109588.299732:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187899:x1872862933287680:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786109588.299752:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109588.299772:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3723f lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37238 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.299796:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 2/0,1 mode: TXN/TXN res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.299807:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37223 lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a163c expref: 10 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.299816:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3723f lrc: 5/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37238 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.299857:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37223 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a163c expref: 10 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.299872:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37223 lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a163c expref: 10 pid: 189813 timeout: 8544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109588.299886:0:8452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8452:1872862933287808:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109588.299966:0:8452:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1786109588.300008:0:8452:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1786109588.300038:0:8452:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109588.304066:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109588.304095:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922110464 00000100:00100000:3.0:1786109588.304104:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922110464 00010000:00010000:3.0:1786109588.304143:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37223 lrc: 5/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a163c expref: 11 pid: 189813 timeout: 8544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109588.304181:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12643 00000100:00100000:3.0:1786109588.304192:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fac74500-4523-4794-af20-dfdcdfae19c1+11:2403:x1872862922110464:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109588.304206:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109588.304212:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37223 lrc: 5/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a163c expref: 11 pid: 189813 timeout: 8544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.304224:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37223 lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a163c expref: 11 pid: 189813 timeout: 8544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.304244:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930a90bbee00) 00010000:00010000:3.0:1786109588.304249:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3723f lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37238 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.304258:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109588.304304:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fac74500-4523-4794-af20-dfdcdfae19c1+11:2403:x1872862922110464:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 114us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109588.304311:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12643 00010000:00010000:3.0:1786109588.307198:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca37223 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a163c expref: 10 pid: 189813 timeout: 8544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109588.307223:0:8452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8452:1872862933287808:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109588.307258:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3723f lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37238 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.307272:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930a90bbee00) 00010000:00010000:3.0:1786109588.307274:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109588.307278:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3723f lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37238 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.307288:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d400, rc 0) 00000001:00080000:0.0:1786109588.308025:0:193896:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 339302416390 is committed 00010000:00010000:0.0:1786109588.308054:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca371ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308063:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca371ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308071:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca371ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308077:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109588.308081:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca371ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308089:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca371ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308103:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff930a90bbea00) 00010000:00010000:0.0:1786109588.308106:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109588.308110:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca371ba lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308115:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76400/0xdb52b77d7ca371ba lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308134:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308140:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308151:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308155:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109588.308158:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308164:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308170:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930a90bbee00) 00010000:00010000:0.0:1786109588.308173:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109588.308177:0:3632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3723f lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37238 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308187:0:3632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3723f lrc: 2/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca37238 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308195:0:3632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3723f lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca37238 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.308230:0:3632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3723f lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37238 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109588.308244:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3632:1872862933287936:0@lo:105: 00000100:00100000:0.0:1786109588.308280:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109588.308323:0:3632:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2780 going to sleep for 11 seconds 00000100:00100000:3.0:1786109588.308932:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:187899:x1872862933287680:12345-0@lo:101:mdt00_000.0 Request processed in 9201us (11118us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109588.308942:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12375 00000100:00100000:3.0:1786109588.308979:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933287936 00000100:00100000:3.0:1786109588.308985:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933287936 00000100:00100000:3.0:1786109588.309024:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5264 00000100:00100000:3.0:1786109588.309032:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3632:x1872862933287936:12345-0@lo:105: 00010000:00010000:3.0:1786109588.309044:0:6509:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 4/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3723f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.309054:0:6509:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 4/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3723f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.309062:0:6509:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 4/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3723f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.309071:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca3723f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.309077:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 5/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca3723f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.309087:0:6509:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 5/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca3723f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.309102:0:6509:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930a8166de00) 00000100:00100000:3.0:1786109588.309143:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3632:x1872862933287936:12345-0@lo:105: Request processed in 111us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109588.309149:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5264 00000100:00100000:3.0:1786109588.309195:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933287680:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786109588.309209:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3723f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109588.309228:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x2:0x0] 00010000:00010000:3.0:1786109588.309259:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.309266:0:187899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.309275:0:187899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109588.309289:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288064:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1786109588.309318:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109588.309465:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3632:1872862933287936:0@lo:105: 00010000:00010000:0.0:1786109588.309479:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 2/0,0 mode: --/TXN res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109588.309485:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93098cd76000/0xdb52b77d7ca371c1 lrc: 0/0,0 mode: --/TXN res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109588.309617:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109588.309632:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933288064 00000100:00100000:3.0:1786109588.309636:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933288064 00000100:00100000:3.0:1786109588.310456:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12376 00000100:00100000:3.0:1786109588.310469:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:187899:x1872862933288064:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786109588.310489:0:177399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109588.310507:0:177399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca3724d lrc: 2/0,0 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37246 expref: -99 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.310529:0:177399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca3724d lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37246 expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.310542:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca3724d lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37246 expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.310550:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0xf7117594 (ffff930ac0b06c00) 00010000:00010000:3.0:1786109588.310552:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109588.310555:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6c600, rc 0) 00000100:00100000:3.0:1786109588.310617:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288064:12345-0@lo:101:mdt00_000.0 Request processed in 152us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109588.310624:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12376 00000100:00100000:2.0:1786109588.310696:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288064:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786109588.310709:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3724d expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.310720:0:187899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3724d expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109588.310740:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x2:0x0] 00000100:00100000:2.0:1786109588.310777:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288192:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786109588.310808:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109588.312761:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab29e6600 going to sleep for 11 seconds 00000100:00100000:0.0:1786109588.312887:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933288192 00000100:00100000:0.0:1786109588.312895:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933288192 00000100:00100000:0.0:1786109588.312956:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12377 00000100:00100000:0.0:1786109588.312966:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.313074:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288192:12345-0@lo:1000:mdt00_000.0 Request processed in 108us (2264us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109588.313081:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12377 00000100:00100000:0.0:1786109588.313121:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288192:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.313182:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288320:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.313212:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109588.313227:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109588.313237:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933288320 00000100:00100000:0.0:1786109588.313241:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933288320 00000100:00100000:0.0:1786109588.313256:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12378 00000100:00100000:0.0:1786109588.313261:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288320:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.313320:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288320:12345-0@lo:1000:mdt00_000.0 Request processed in 57us (106us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786109588.313326:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12378 00000100:00100000:0.0:1786109588.313464:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288320:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.313531:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288448:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.313558:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109588.313696:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109588.313730:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933288448 00000100:00100000:3.0:1786109588.313734:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933288448 00000100:00100000:3.0:1786109588.313761:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12379 00000100:00100000:3.0:1786109588.313768:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab5397c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786109588.313820:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab5397c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288448:12345-0@lo:1000:mdt00_000.0 Request processed in 52us (260us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786109588.313838:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12379 00000100:00100000:0.0:1786109588.314287:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288448:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.314409:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288576:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.316989:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109588.318507:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109588.325709:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933288576 00000100:00100000:1.0:1786109588.325722:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933288576 00000100:00100000:0.0:1786109588.326216:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12380 00000100:00100000:0.0:1786109588.326227:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.327009:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288576:12345-0@lo:1000:mdt00_000.0 Request processed in 782us (10024us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109588.327018:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12380 00000100:00100000:0.0:1786109588.327063:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288576:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.327135:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288704:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.327170:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109588.327203:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109588.327250:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933288704 00000100:00100000:2.0:1786109588.327255:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933288704 00000100:00100000:0.0:1786109588.328001:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12381 00000100:00100000:0.0:1786109588.328012:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288704:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.328591:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288704:12345-0@lo:1000:mdt00_000.0 Request processed in 581us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109588.328609:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12381 00000100:00100000:3.0:1786109588.329044:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288704:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786109588.329111:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288832:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786109588.329146:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109588.329177:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109588.329225:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933288832 00000100:00100000:0.0:1786109588.329231:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933288832 00000100:00100000:0.0:1786109588.329273:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12382 00000100:00100000:0.0:1786109588.329281:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288832:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786109588.329414:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288832:12345-0@lo:1000:mdt00_000.0 Request processed in 133us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109588.329420:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12382 00000100:00100000:3.0:1786109588.329932:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288832:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786109588.330042:0:187899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288960:0@lo:700:mdt00_000.0 00000100:00100000:3.0:1786109588.330071:0:187899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109588.330096:0:187899:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098502ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109588.330148:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933288960 00000100:00100000:0.0:1786109588.330152:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933288960 00000100:00100000:0.0:1786109588.330189:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786109588.330196:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288960:12345-0@lo:700:mdt00_000.0 00000100:00100000:0.0:1786109588.330241:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+8:187899:x1872862933288960:12345-0@lo:700:mdt00_000.0 Request processed in 45us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109588.330248:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786109588.330315:0:187899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:187899:1872862933288960:0@lo:700:mdt00_000.0 00000040:00080000:3.0:1786109588.330506:0:187899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109588.330523:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].11, 64 off33472 00000004:00080000:3.0:1786109588.330529:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff93098502ff00 with version 5 00000040:00080000:3.0:1786109588.330574:0:187899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109588.330584:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].12, 64 off33536 00000004:00080000:3.0:1786109588.330588:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930987d340c0 with version 6 00000004:00080000:0.0:1786109588.330916:0:187918:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930986abf840 version 5 rpc_version 5 00000020:00100000:0.0:1786109588.330939:0:187918:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109588.330947:0:187918:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098e35b100 x1872862933289216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109588.330961:0:187918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933289216:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109588.330992:0:187918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109588.331011:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 11 seconds 00000100:00100000:0.0:1786109588.331026:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933289216 00000100:00100000:0.0:1786109588.331029:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933289216 00000100:00100000:0.0:1786109588.331058:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12383 00000100:00100000:0.0:1786109588.331065:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187918:x1872862933289216:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:3.0:1786109588.334235:0:187899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109588.334277:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].6, 64 off33152 00000040:00080000:3.0:1786109588.334648:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002efa:0x1:0x0].1, 1096 off33864 00000040:00080000:3.0:1786109588.334757:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026d32:0x1:0x0].1, 1240 off34008 00000004:00080000:3.0:1786109588.334765:0:187899:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930aa0e89240 with version 7 00000001:00080000:0.0:1786109588.341003:0:193896:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 339302416391 is committed 00010000:02000000:0.0:1786109588.341058:0:8451:0:(ldlm_lib.c:3345:target_send_reply_msg()) *** cfs_fail_loc=1701, val=2147483648*** 00010000:00020000:0.0:1786109588.348622:0:8451:0:(ldlm_lib.c:3346:target_send_reply_msg()) @@@ dropping reply req@ffff93098e358700 x1872862933289216/t339302416391(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:59/0 lens 1312/4320 e 0 to 0 dl 1786109599 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109588.367585:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187918:x1872862933289216:12345-0@lo:1000:osp_up0-1.0 Request processed in 36511us (36582us total) trans 339302416391 rc 0/0 00000100:00100000:0.0:1786109588.367611:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12383 00000100:00100000:3.0:1786109588.740784:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933289344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109588.740863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109588.740920:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933289344 00000100:00100000:3.0:1786109588.740927:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933289344 00000100:00100000:3.0:1786109588.740983:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5845 00000100:00100000:3.0:1786109588.740994:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933289344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786109588.741021:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109588.741063:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933289344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109588.741071:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5845 00000100:00080000:3.0:1786109588.741090:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109588.741118:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705667 gen 2 00000004:00080000:3.0:1786109588.741123:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930aa5c55180, transno 38654705667 00000100:00100000:3.0:1786109588.741140:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933289344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109588.741353:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933289472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109588.741382:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109588.741472:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933289472 00000100:00100000:1.0:1786109588.741476:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933289472 00000100:00100000:1.0:1786109588.741505:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5846 00000100:00100000:1.0:1786109588.741511:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933289472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109588.741521:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109588.741553:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933289472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109588.741559:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5846 00000100:00080000:3.0:1786109588.741682:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109588.741706:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933289472:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1786109588.818253:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804571 is committed 00000100:00100000:3.0:1786109588.863007:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109588.863258:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922110592 00000100:00100000:0.0:1786109588.863268:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922110592 00000100:00100000:0.0:1786109588.863328:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1038 00000100:00100000:0.0:1786109588.863338:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:162698:x1872862922110592:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:0.0:1786109588.864308:0:187901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445679104 avail 1299439616 00000100:00100000:0.0:1786109588.865032:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:162698:x1872862922110592:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 1690us (2030us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109588.865042:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1038 00000100:00100000:0.0:1786109588.872289:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109588.872383:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922110720 00000100:00100000:2.0:1786109588.872393:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922110720 00000100:00100000:2.0:1786109588.872468:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1039 00000100:00100000:2.0:1786109588.872478:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:162698:x1872862922110720:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1786109588.872515:0:187900:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00000100:00100000:2.0:1786109588.872646:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:162698:x1872862922110720:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 169us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109588.872655:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1039 00000100:00100000:3.0:1786109588.878117:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109588.881862:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922110848 00000100:00100000:0.0:1786109588.881877:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922110848 00000100:00100000:0.0:1786109588.883297:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5847 00000100:00100000:0.0:1786109588.883313:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:162698:x1872862922110848:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:0.0:1786109588.883338:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109588.883426:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:162698:x1872862922110848:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 117us (5318us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109588.883449:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5847 00000100:00100000:1.0:1786109588.891910:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109588.891999:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922110976 00000100:00100000:1.0:1786109588.892007:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922110976 00000100:00100000:1.0:1786109588.892195:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5848 00000100:00100000:1.0:1786109588.892210:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:162698:x1872862922110976:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109588.892236:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109588.892298:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:162698:x1872862922110976:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 91us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109588.892305:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5848 00000100:00100000:3.0:1786109588.928700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109588.928793:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922111232 00000100:00100000:2.0:1786109588.928803:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922111232 00000100:00100000:2.0:1786109588.928858:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1040 00000100:00100000:2.0:1786109588.928868:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+7:162705:x1872862922111232:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00010000:2.0:1786109588.928988:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109588.929017:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d200/0xdb52b77d7ca371cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1620 expref: 7 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.929033:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ac0b06800) 00010000:00010000:2.0:1786109588.929043:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109588.930002:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca37254 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930019:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca37254 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930031:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca37254 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930044:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d000/0xdb52b77d7ca3725b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930051:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d000/0xdb52b77d7ca3725b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930057:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d000/0xdb52b77d7ca3725b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930655:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca37254 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930664:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca37254 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930671:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca37254 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930679:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166d600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109588.930683:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca37254 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930690:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca37254 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930702:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93098c4ae800) 00010000:00010000:2.0:1786109588.930705:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109588.930709:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca37254 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930715:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca37254 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109588.930796:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000788ed8bf reply state 0000000045e8e08b transno 339302416392 ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d000/0xdb52b77d7ca3725b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930807:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d000/0xdb52b77d7ca3725b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.930814:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff93098c4aec00) 00010000:00010000:2.0:1786109588.930816:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109588.930829:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109588.930937:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+8:162705:x1872862922111232:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 2067us (2242us total) trans 339302416392 rc 0/0 00000100:00100000:2.0:1786109588.930946:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1040 00000100:00100000:1.0:1786109588.952583:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109588.955294:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922111360 00000100:00100000:2.0:1786109588.955307:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922111360 00000100:00100000:2.0:1786109588.955388:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1041 00000100:00100000:2.0:1786109588.955398:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+8:162708:x1872862922111360:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1786109588.955422:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109588.955457:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca37262 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a164a expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.955519:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c200/0xdb52b77d7ca37269 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.955531:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c200/0xdb52b77d7ca37269 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.955542:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c200/0xdb52b77d7ca37269 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109588.955584:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:2.0:1786109588.955588:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109588.959313:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c200/0xdb52b77d7ca37269 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.959500:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca37262 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a164a expref: 10 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.959522:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c200/0xdb52b77d7ca37269 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a164a expref: 9 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.959530:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93098c4ae800) 00010000:00010000:2.0:1786109588.959532:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109588.959535:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a8166c200, rc 0) 00000100:00100000:2.0:1786109588.960990:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+9:162708:x1872862922111360:12345-192.168.203.38@tcp:101:rm.0 Request processed in 5584us (8405us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109588.961006:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1041 00000100:00100000:2.0:1786109588.963982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109588.964084:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922111488 00000100:00100000:3.0:1786109588.964093:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922111488 00000100:00100000:3.0:1786109588.964179:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1042 00000100:00100000:3.0:1786109588.964191:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+9:162708:x1872862922111488:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1786109588.964209:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109588.964230:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca37270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1651 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964290:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca37277 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964304:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca37277 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964316:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca37277 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964330:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca3727e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964337:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca3727e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964344:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca3727e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964461:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca37285 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964484:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca37285 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964492:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca37285 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109588.964532:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x3:0x0]: returning size 0 00000004:00200000:3.0:1786109588.964535:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109588.964551:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca37285 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964562:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca37285 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964571:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca37277 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964578:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca37277 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964589:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca37277 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964608:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109588.964613:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca37277 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964622:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca37277 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964632:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93098c4ae800) 00010000:00010000:3.0:1786109588.964635:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109588.964640:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca37277 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964657:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d600/0xdb52b77d7ca37277 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964668:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca3727e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964674:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca3727e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964680:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca3727e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964685:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6dc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109588.964687:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca3727e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964696:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca3727e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964703:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff93098c4aec00) 00010000:00010000:3.0:1786109588.964705:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109588.964708:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca3727e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964715:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6dc00/0xdb52b77d7ca3727e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964740:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca37270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1651 expref: 11 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964752:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca37285 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1651 expref: 10 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109588.964758:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x3:0x0].0x0 (ffff930a91108100) 00010000:00010000:3.0:1786109588.964761:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109588.964763:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6cc00, rc 0) 00000100:00100000:3.0:1786109588.964823:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+10:162708:x1872862922111488:12345-192.168.203.38@tcp:101:rm.0 Request processed in 635us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109588.964830:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1042 00000100:00100000:1.0:1786109588.973495:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109588.973532:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922111744 00000100:00100000:2.0:1786109588.973543:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922111744 00000100:00100000:2.0:1786109588.973640:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1043 00000100:00100000:2.0:1786109588.973650:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+10:162708:x1872862922111744:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109588.973703:0:189813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786109588.973728:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6cc00/0xdb52b77d7ca37285 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1651 expref: 10 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.973760:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x3:0x0].0x0 (ffff930a91108100) 00010000:00010000:2.0:1786109588.973776:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c200/0xdb52b77d7ca37269 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a164a expref: 9 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.973785:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93098c4ae800) 00010000:00010000:2.0:1786109588.973792:0:189813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109588.973814:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca3728c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.973825:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca3728c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.973834:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca3728c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.973858:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166cc00/0xdb52b77d7ca37293 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.973870:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166cc00/0xdb52b77d7ca37293 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.973876:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166cc00/0xdb52b77d7ca37293 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.973962:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c000/0xdb52b77d7ca3729a lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.973971:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c000/0xdb52b77d7ca3729a lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.973976:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c000/0xdb52b77d7ca3729a lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974156:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca372a1 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974166:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca372a1 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974173:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca372a1 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974180:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca372a1 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974187:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca372a1 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974193:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca372a1 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974231:0:189813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109588.974248:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c000/0xdb52b77d7ca3729a lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974254:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c000/0xdb52b77d7ca3729a lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974259:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c000/0xdb52b77d7ca3729a lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974265:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166c000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109588.974269:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c000/0xdb52b77d7ca3729a lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974275:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c000/0xdb52b77d7ca3729a lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974283:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x3:0x0].0x0 (ffff93098c4aeb00) 00010000:00010000:2.0:1786109588.974286:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109588.974289:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c000/0xdb52b77d7ca3729a lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974295:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166c000/0xdb52b77d7ca3729a lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974308:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca3728c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974313:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca3728c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974320:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca3728c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974324:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166d600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109588.974326:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca3728c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974331:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca3728c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974336:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93098c4aed00) 00010000:00010000:2.0:1786109588.974338:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109588.974340:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca3728c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974345:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d600/0xdb52b77d7ca3728c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109588.974356:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e60792c reply state 00000000a1d1aafc transno 339302416393 ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166cc00/0xdb52b77d7ca37293 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974366:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166cc00/0xdb52b77d7ca37293 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109588.974371:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff93098c4aec00) 00010000:00010000:2.0:1786109588.974373:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109588.974376:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109588.974466:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+10:162708:x1872862922111744:12345-192.168.203.38@tcp:36:rm.0 Request processed in 815us (979us total) trans 339302416393 rc 0/0 00000100:00100000:2.0:1786109588.974473:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1043 00010000:00010000:1.0:1786109588.974938:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109588.974945:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca372a1 lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109588.974952:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166ce00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109588.974956:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca372a1 lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109588.974962:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca372a1 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109588.974973:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x3:0x0].0x0 (ffff93098c4aeb00) 00010000:00010000:1.0:1786109588.974975:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109588.974978:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca372a1 lrc: 1/0,0 mode: --/PW res: [0x200026d31:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109588.974984:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166ce00/0xdb52b77d7ca372a1 lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109588.974998:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109588.975000:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109588.975002:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109589.188983:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109589.790801:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933289728:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.790879:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.790910:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933290240:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.790935:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.790950:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933290752:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.790967:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.790986:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1786109589.790991:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933289600:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791013:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.791047:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933290112:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791067:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.791081:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933290624:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791098:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.791112:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933291136:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791129:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.791153:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933289856:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791178:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.791202:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933290368:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791221:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.791235:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933290880:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.791263:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1786109589.791267:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933289984:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791288:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.791305:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933290496:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.791341:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933291008:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791358:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109589.791381:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933290240 00000100:00100000:0.0:1786109589.791387:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933290240 00000100:00100000:0.0:1786109589.791451:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933290752 00000100:00100000:0.0:1786109589.791455:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933290752 00000100:00100000:0.0:1786109589.791481:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933290112 00000100:00100000:0.0:1786109589.791485:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933290112 00000100:00100000:0.0:1786109589.791501:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933290624 00000100:00100000:0.0:1786109589.791503:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933290624 00000100:00100000:0.0:1786109589.791521:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6999 00000100:00100000:0.0:1786109589.791529:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933290240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791575:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933290240:12345-0@lo:400:kworker.0 Request processed in 47us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.791582:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6999 00000100:00100000:0.0:1786109589.791608:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7000 00000100:00100000:0.0:1786109589.791614:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933290752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791640:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933290752:12345-0@lo:400:kworker.0 Request processed in 26us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.791644:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7000 00000100:00100000:0.0:1786109589.791655:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7001 00000100:00100000:0.0:1786109589.791660:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933290112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791683:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933290112:12345-0@lo:400:kworker.0 Request processed in 24us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.791688:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7001 00000100:00100000:0.0:1786109589.791697:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7002 00000100:00100000:0.0:1786109589.791702:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933290624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791726:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933290624:12345-0@lo:400:kworker.0 Request processed in 24us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.791732:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7002 00000100:00100000:0.0:1786109589.791749:0:193902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933289600 00000100:00100000:0.0:1786109589.791752:0:193902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933289600 00000100:00100000:0.0:1786109589.791778:0:193902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1786109589.791784:0:193902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac12db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933289600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.791811:0:193902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac12db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933289600:12345-0@lo:400:kworker.0 Request processed in 27us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.791817:0:193902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1786109589.791846:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933289728 00000100:00100000:0.0:1786109589.791850:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933289728 00000100:00100000:0.0:1786109589.791869:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933291136 00000100:00100000:0.0:1786109589.791871:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933291136 00000100:00100000:0.0:1786109589.791882:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933289856 00000100:00100000:0.0:1786109589.791884:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933289856 00000100:00100000:0.0:1786109589.791895:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933290368 00000100:00100000:0.0:1786109589.791897:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933290368 00000100:00100000:0.0:1786109589.791906:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933290880 00000100:00100000:0.0:1786109589.791908:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933290880 00000100:00100000:0.0:1786109589.791918:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933291008 00000100:00100000:0.0:1786109589.791920:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933291008 00000100:00100000:0.0:1786109589.791933:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1786109589.791938:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933289728:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109589.791952:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d885180 x1872862933289728/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:60/0 lens 224/224 e 0 to 0 dl 1786109600 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109589.791980:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933289728:12345-0@lo:400:kworker.0 Request processed in 41us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.791985:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1786109589.791996:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1786109589.792002:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933291136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.792027:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933291136:12345-0@lo:400:kworker.0 Request processed in 25us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.792036:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1786109589.792046:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1786109589.792051:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933289856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.792079:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933289856:12345-0@lo:400:kworker.0 Request processed in 29us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.792086:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1786109589.792096:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1786109589.792102:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933290368:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109589.792111:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a893c2d80 x1872862933290368/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:60/0 lens 224/224 e 0 to 0 dl 1786109600 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109589.792135:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933290368:12345-0@lo:400:kworker.0 Request processed in 33us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.792140:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1786109589.792151:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1786109589.792156:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933290880:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109589.792166:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a893c1f80 x1872862933290880/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:60/0 lens 224/224 e 0 to 0 dl 1786109600 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109589.792188:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933290880:12345-0@lo:400:kworker.0 Request processed in 33us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.792194:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1786109589.792204:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1786109589.792209:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933291008:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109589.792218:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c53480 x1872862933291008/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:60/0 lens 224/224 e 0 to 0 dl 1786109600 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109589.792245:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933291008:12345-0@lo:400:kworker.0 Request processed in 37us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.792250:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1786109589.792270:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933289984 00000100:00100000:0.0:1786109589.792274:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933289984 00000100:00100000:0.0:1786109589.792294:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933290496 00000100:00100000:0.0:1786109589.792296:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933290496 00000100:00100000:0.0:1786109589.792312:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12384 00000100:00100000:0.0:1786109589.792318:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933289984:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109589.792330:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c51f80 x1872862933289984/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:60/0 lens 224/224 e 0 to 0 dl 1786109600 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109589.792355:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933289984:12345-0@lo:400:kworker.0 Request processed in 38us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.792361:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12384 00000100:00100000:0.0:1786109589.792372:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12385 00000100:00100000:0.0:1786109589.792377:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933290496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.792403:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933290496:12345-0@lo:400:kworker.0 Request processed in 25us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109589.792407:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12385 00000100:00080000:0.0:1786109589.792426:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109589.792450:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109589.792454:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109589.792502:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933289984:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.792513:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933290496:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.792524:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933291008:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.792533:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933289856:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.792541:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933290368:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.792550:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933290880:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.792584:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933289600:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.792985:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933290112:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.792998:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933290624:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.793008:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933291136:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.793017:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933289728:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.793027:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933290240:0@lo:400:kworker.0 00000100:00100000:0.0:1786109589.793035:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933290752:0@lo:400:kworker.0 00010000:00010000:1.0:1786109590.216149:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109591.238441:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109591.302707:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933291264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109591.302767:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109591.302817:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933291264 00000100:00100000:2.0:1786109591.302823:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933291264 00000100:00100000:2.0:1786109591.302868:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5849 00000100:00100000:2.0:1786109591.302877:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933291264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109591.302902:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109591.302939:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933291264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109591.302945:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5849 00000100:00080000:2.0:1786109591.302963:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109591.302993:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933291264:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1786109592.261134:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109592.325303:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933291392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109592.325370:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109592.325469:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933291392 00000100:00100000:2.0:1786109592.325477:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933291392 00000100:00100000:2.0:1786109592.325528:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12386 00000100:00100000:2.0:1786109592.325538:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933291392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109592.325570:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00000100:00100000:2.0:1786109592.325751:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933291392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 214us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109592.325760:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12386 00000100:00100000:1.0:1786109592.325835:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933291392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109592.836615:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109592.836770:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933291648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109592.836784:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933291520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109592.836873:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109592.836947:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933291520 00000100:00100000:1.0:1786109592.836954:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933291520 00000100:00100000:1.0:1786109592.837005:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5850 00000100:00100000:1.0:1786109592.837014:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933291520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109592.837041:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109592.837087:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933291520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109592.837093:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5850 00000100:00080000:1.0:1786109592.837173:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109592.837208:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933291520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109592.837299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109592.837528:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933291648 00000100:00100000:1.0:1786109592.837533:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933291648 00000100:00100000:1.0:1786109592.837615:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12387 00000100:00100000:1.0:1786109592.837623:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933291648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109592.837646:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445679104 avail 1299439616 00010000:00000080:1.0:1786109592.837658:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c50000 x1872862933291648/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:63/0 lens 224/368 e 0 to 0 dl 1786109603 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109592.837778:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933291648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109592.837785:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12387 00000100:00100000:0.0:1786109592.837891:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933291648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109593.106459:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109593.106491:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109593.106514:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109593.106529:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109593.106557:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109593.106650:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922112000 00000100:00100000:3.0:1786109593.106661:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922112000 00000100:00100000:3.0:1786109593.106709:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922112128 00000100:00100000:3.0:1786109593.106712:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922112128 00000100:00100000:3.0:1786109593.106736:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 279 00000100:00100000:3.0:1786109593.106752:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+10:2404:x1872862922112000:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:3.0:1786109593.106785:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098e50ed80 x1872862922112000/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:64/0 lens 224/224 e 0 to 0 dl 1786109604 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109593.106854:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+10:2404:x1872862922112000:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 109us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109593.106861:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 279 00000100:00100000:3.0:1786109593.106877:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 280 00000100:00100000:3.0:1786109593.106885:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922112128:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109593.106908:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922112128:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109593.106913:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 280 00000100:00100000:3.0:1786109593.106929:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922112256 00000100:00100000:3.0:1786109593.106932:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922112256 00000100:00100000:3.0:1786109593.106954:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922112384 00000100:00100000:3.0:1786109593.106956:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922112384 00000100:00100000:3.0:1786109593.106973:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7003 00000100:00100000:3.0:1786109593.106979:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922112256:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109593.107003:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922112256:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109593.107008:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7003 00000100:00100000:3.0:1786109593.107018:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7004 00000100:00100000:3.0:1786109593.107024:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922112384:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109593.107044:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922112384:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 21us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109593.107050:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7004 00000100:00100000:3.0:1786109593.107068:0:193901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922111872 00000100:00100000:3.0:1786109593.107071:0:193901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922111872 00000100:00100000:3.0:1786109593.107096:0:193901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:3.0:1786109593.107101:0:193901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac12d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2404:x1872862922111872:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109593.107124:0:193901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac12d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2404:x1872862922111872:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109593.107129:0:193901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00080000:1.0:1786109593.107563:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109593.107577:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109593.107580:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109593.107582:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786109593.287906:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109593.860685:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933291776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109593.860756:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109593.860911:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933291904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109593.860938:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109593.861010:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933291776 00000100:00100000:1.0:1786109593.861018:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933291776 00000100:00100000:1.0:1786109593.861076:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933291904 00000100:00100000:1.0:1786109593.861079:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933291904 00000100:00100000:1.0:1786109593.861103:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5851 00000100:00100000:1.0:1786109593.861112:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933291776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786109593.861140:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109593.861190:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933291776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109593.861197:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5851 00000100:00100000:1.0:1786109593.861214:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5852 00000100:00100000:1.0:1786109593.861221:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933291904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109593.861230:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109593.861258:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933291904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109593.861267:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5852 00000100:00080000:0.0:1786109593.861322:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109593.861355:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933291904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109593.861387:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933291776:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1786109594.034651:0:195677:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:1.0:1786109594.308653:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786109594.373255:0:193896:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 339302416393 is committed 00010000:00010000:0.0:1786109594.373334:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d000/0xdb52b77d7ca3725b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373346:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d000/0xdb52b77d7ca3725b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373353:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d000/0xdb52b77d7ca3725b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373359:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166d000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109594.373364:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d000/0xdb52b77d7ca3725b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373371:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d000/0xdb52b77d7ca3725b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373387:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff93098c4aec00) 00010000:00010000:0.0:1786109594.373390:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109594.373396:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d000/0xdb52b77d7ca3725b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373402:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166d000/0xdb52b77d7ca3725b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373421:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166cc00/0xdb52b77d7ca37293 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373427:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166cc00/0xdb52b77d7ca37293 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373475:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166cc00/0xdb52b77d7ca37293 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373480:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166cc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109594.373483:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166cc00/0xdb52b77d7ca37293 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373489:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166cc00/0xdb52b77d7ca37293 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373501:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff93098c4aec00) 00010000:00010000:0.0:1786109594.373504:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109594.373507:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166cc00/0xdb52b77d7ca37293 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109594.373512:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930a8166cc00/0xdb52b77d7ca37293 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109594.884809:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933292160:0@lo:400:kworker.0 00000100:00100000:1.0:1786109594.884935:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933292032:0@lo:400:kworker.0 00000100:00100000:1.0:1786109594.884998:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109594.885084:0:193903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933292032 00000100:00100000:1.0:1786109594.885090:0:193903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933292032 00000100:00100000:1.0:1786109594.885131:0:193903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1786109594.885140:0:193903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985a47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933292032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109594.885189:0:193903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985a47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933292032:12345-0@lo:400:kworker.0 Request processed in 49us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109594.885196:0:193903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1786109594.885256:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933292032:0@lo:400:kworker.0 00000100:00100000:0.0:1786109594.885318:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109594.885348:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109594.885354:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933292288:0@lo:400:kworker.0 00000100:00100000:0.0:1786109594.885377:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109594.885406:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933292160 00000100:00100000:0.0:1786109594.885410:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933292160 00000100:00100000:0.0:1786109594.885473:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933292288 00000100:00100000:0.0:1786109594.885477:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933292288 00000100:00100000:0.0:1786109594.885497:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1786109594.885505:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933292160:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109594.885520:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c51880 x1872862933292160/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:65/0 lens 224/224 e 0 to 0 dl 1786109605 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109594.885554:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933292160:12345-0@lo:400:kworker.0 Request processed in 49us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109594.885573:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1786109594.885588:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1786109594.885594:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933292288:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786109594.885595:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109594.885600:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109594.885623:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933292288:12345-0@lo:400:kworker.0 Request processed in 29us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109594.885629:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1786109594.885662:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933292288:0@lo:400:kworker.0 00000100:00100000:0.0:1786109594.885672:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933292160:0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.886381:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933292416:0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.886420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109594.886532:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933292928:0@lo:400:kworker.0 00000100:00100000:0.0:1786109594.886532:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933292800:0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.886568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109594.886569:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109594.886589:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933293312:0@lo:400:kworker.0 00000100:00100000:3.0:1786109594.886609:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933292800 00000100:00100000:3.0:1786109594.886614:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933292800 00000100:00100000:3.0:1786109594.886650:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1786109594.886659:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933292800:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109594.886673:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c50e00 x1872862933292800/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:65/0 lens 224/224 e 0 to 0 dl 1786109605 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109594.886705:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933292800:12345-0@lo:400:kworker.0 Request processed in 49us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109594.886711:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1786109594.886845:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933293440:0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.886869:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109594.886889:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1786109594.886894:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933292544:0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.886919:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109594.886937:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933293056:0@lo:400:kworker.0 00000100:00100000:0.0:1786109594.886947:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109594.886954:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109594.886967:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933293568:0@lo:400:kworker.0 00000100:00100000:0.0:1786109594.886976:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933292800:0@lo:400:kworker.0 00000100:00100000:0.0:1786109594.886985:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786109594.886986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109594.886990:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933292672:0@lo:400:kworker.0 00000100:00100000:0.0:1786109594.887023:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109594.887032:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933292416 00000100:00100000:1.0:1786109594.887036:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933292416 00000100:00100000:0.0:1786109594.887047:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933293184:0@lo:400:kworker.0 00000100:00100000:0.0:1786109594.887066:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109594.887090:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933292544 00000100:00100000:0.0:1786109594.887090:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933293056 00000100:00100000:2.0:1786109594.887094:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933292544 00000100:00100000:0.0:1786109594.887094:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933293056 00000100:00100000:0.0:1786109594.887117:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933292672 00000100:00100000:0.0:1786109594.887120:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933292672 00000100:00100000:2.0:1786109594.887121:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933293184 00000100:00100000:2.0:1786109594.887123:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933293184 00000100:00100000:2.0:1786109594.887148:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7005 00000100:00100000:2.0:1786109594.887155:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933293056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.887193:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933293056:12345-0@lo:400:kworker.0 Request processed in 39us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109594.887199:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7005 00000100:00100000:2.0:1786109594.887210:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7006 00000100:00100000:2.0:1786109594.887216:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933292544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.887242:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933292544:12345-0@lo:400:kworker.0 Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109594.887248:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7006 00000100:00100000:2.0:1786109594.887259:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7007 00000100:00100000:2.0:1786109594.887266:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933293184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.887297:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933293184:12345-0@lo:400:kworker.0 Request processed in 31us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109594.887303:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7007 00000100:00100000:2.0:1786109594.887314:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7008 00000100:00100000:2.0:1786109594.887319:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933292672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.887345:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933292672:12345-0@lo:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109594.887349:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7008 00000100:00100000:3.0:1786109594.887383:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933292928 00000100:00100000:3.0:1786109594.887387:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933292928 00000100:00100000:3.0:1786109594.887415:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12388 00000100:00100000:3.0:1786109594.887422:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933292416:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109594.887457:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1783100 x1872862933292416/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:65/0 lens 224/224 e 0 to 0 dl 1786109605 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109594.887486:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933292416:12345-0@lo:400:kworker.0 Request processed in 65us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109594.887492:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12388 00000100:00100000:3.0:1786109594.887505:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12389 00000100:00100000:3.0:1786109594.887512:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933292928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109594.887541:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933292928:12345-0@lo:400:kworker.0 Request processed in 30us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109594.887547:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12389 00000100:00100000:3.0:1786109594.887582:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933293440 00000100:00100000:3.0:1786109594.887585:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933293440 00000100:00100000:0.0:1786109594.887593:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933293312 00000100:00100000:0.0:1786109594.887596:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933293312 00000100:00100000:3.0:1786109594.887602:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933293568 00000100:00100000:3.0:1786109594.887604:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933293568 00000100:00100000:3.0:1786109594.887619:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1786109594.887624:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933293440:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109594.887636:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1780a80 x1872862933293440/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:65/0 lens 224/224 e 0 to 0 dl 1786109605 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109594.887663:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933293440:12345-0@lo:400:kworker.0 Request processed in 39us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109594.887669:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1786109594.887681:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1786109594.887689:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933293568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109594.887714:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933293568:12345-0@lo:400:kworker.0 Request processed in 28us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109594.887721:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1786109594.887731:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1786109594.887743:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933293312:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109594.887753:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c53800 x1872862933293312/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:65/0 lens 224/224 e 0 to 0 dl 1786109605 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109594.887779:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933293312:12345-0@lo:400:kworker.0 Request processed in 43us (832us total) trans 0 rc 0/0 00000100:00080000:0.0:1786109594.887831:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109594.887835:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109594.887837:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933292544:0@lo:400:kworker.0 00000100:00080000:0.0:1786109594.887837:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109594.887846:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933293056:0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.887855:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933293568:0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.887864:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933292416:0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.887872:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933292928:0@lo:400:kworker.0 00000100:00100000:2.0:1786109594.887880:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933293440:0@lo:400:kworker.0 00000100:00100000:3.0:1786109594.888035:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1786109594.888044:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933292672:0@lo:400:kworker.0 00000100:00100000:0.0:1786109594.888054:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933293184:0@lo:400:kworker.0 00000100:00100000:0.0:1786109594.888064:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933293312:0@lo:400:kworker.0 00010000:00010000:0.0:1786109595.333548:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1786109596.033351:0:195774:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1786109596.033459:0:195774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.033479:0:195774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.033487:0:195774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.033494:0:195774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.033520:0:195774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1786109596.033526:0:195774:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1786109596.033577:0:195774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786109596.033583:0:195774:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1786109596.033590:0:195774:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1786109596.033623:0:195774:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1786109596.033715:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109596.033724:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109596.033733:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c400 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:2.0:1786109596.033737:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109596.033747:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109596.033760:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109596.033767:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1786109596.033770:0:10402:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1786109596.033773:0:10402:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1786109596.033805:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109596.033812:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786109596.033855:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109596.033863:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c400/0xdb52b77d7ca36d84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36d8b expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109596.033877:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109596.033879:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109596.033880:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109596.033925:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109596.033953:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933293824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109596.034045:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109596.034216:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933293696:0@lo:39:umount.0 00000100:00100000:0.0:1786109596.034255:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109596.034394:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933293696 00000100:00100000:1.0:1786109596.034403:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933293696 00000100:00100000:1.0:1786109596.034490:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1786109596.034503:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872862933293696:12345-0@lo:39:umount.0 00000020:00000080:1.0:1786109596.034537:0:187901:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36e56 00000100:00080000:1.0:1786109596.034568:0:187901:0:(import.c:65:import_set_state_nolock()) ffff930a87b2b000 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1786109596.034614:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c52a00 x1872862933293696/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:106/0 lens 224/224 e 0 to 0 dl 1786109646 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109596.034663:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1872862933293696:12345-0@lo:39:umount.0 Request processed in 162us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109596.034671:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000020:00000080:1.0:1786109596.034682:0:187901:0:(genops.c:906:class_export_put()) final put ffff930a87b29000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1786109596.034772:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786109596.034784:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b29000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1786109596.034852:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a87b2b000 for lustre-MDT0000 00000100:00080000:0.0:1786109596.034971:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1786109596.034995:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933293696:0@lo:39:umount.0 00000100:00080000:1.0:1786109596.035063:0:195774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786109596.035067:0:195774:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1786109596.035071:0:195774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1786109596.036150:0:195774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.036175:0:195774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.036183:0:195774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.036190:0:195774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.036293:0:195774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109596.036301:0:195774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.036309:0:195774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.036315:0:195774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.036323:0:195774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109596.036461:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933293824 00000100:00100000:2.0:1786109596.036473:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933293824 00000100:00100000:2.0:1786109596.036602:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4518 00000100:00100000:2.0:1786109596.036614:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933293824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109596.036631:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109596.036653:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2d800/0xdb52b77d7ca36d8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36d84 expref: 24 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109596.036672:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109596.036758:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3649:x1872862933293824:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (2712us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109596.036766:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4518 00010000:00010000:3.0:1786109596.036834:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109596.036842:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.036850:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2ce00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109596.036855:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.036864:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109596.036871:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109596.036878:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786109596.036881:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1786109596.036910:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.036917:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109596.036937:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.036944:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0b2ce00/0xdb52b77d7ca36cc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36cc7 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.036960:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109596.036964:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.036969:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a600 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109596.036972:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.036978:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109596.036985:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109596.036990:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1786109596.036993:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1786109596.037004:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.037011:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109596.037027:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.037034:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109596.037035:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109596.037037:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109596.037062:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109596.037080:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933294080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109596.037125:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786109596.037179:0:195774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786109596.037185:0:195774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930aa628a600/0xdb52b77d7ca36ff3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36ffa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109596.037196:0:195774:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1786109596.037205:0:195774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.037213:0:195774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.037220:0:195774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.037227:0:195774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.037239:0:195774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109596.037244:0:195774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.037250:0:195774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.037257:0:195774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.037263:0:195774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.037275:0:195774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1786109596.037278:0:195774:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1786109596.037284:0:195774:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1786109596.037328:0:195774:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1786109596.037333:0:195774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1786109596.037340:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1786109596.037349:0:195774:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000004:00000080:1.0:1786109596.039310:0:195774:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:1.0:1786109596.039893:0:195774:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1786109596.039904:0:195774:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff93098e517800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786109596.039914:0:195774:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930a9788b000 fac74500-4523-4794-af20-dfdcdfae19c1 192.168.203.38@tcp 5 (0 0 1) 0 0 0 0: 0000000000000000 339302416393 stale:0 00000020:00080000:1.0:1786109596.039920:0:195774:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930a87b2a800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786109596.039924:0:195774:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930a87b2d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786109596.039929:0:195774:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930ab198d000 lustre-MDT0001-mdtlov_UUID 0@lo 7 (0 0 2) 0 0 0 0: 0000000000000000 339302416391 stale:0 00000020:00080000:1.0:1786109596.039934:0:195774:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff930ab99d3380) has exports, disconnecting them 00000020:00080000:1.0:1786109596.039939:0:195774:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93098e517800), last request at 1786109594 00000020:00000080:1.0:1786109596.039947:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36fd0 00000100:00080000:1.0:1786109596.039959:0:195774:0:(import.c:65:import_set_state_nolock()) ffff93098e512800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1786109596.039990:0:195774:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93098e517800): rc 0 00000020:00000080:1.0:1786109596.039993:0:195774:0:(genops.c:906:class_export_put()) final put ffff93098e517800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1786109596.040006:0:195774:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.38@tcp (ffff930a9788b000), last request at 1786109593 00000020:00000080:1.0:1786109596.040014:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36f59 00000020:00010000:1.0:1786109596.040031:0:195774:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930a9788b000: total 1 00000100:00080000:1.0:1786109596.040035:0:195774:0:(import.c:65:import_set_state_nolock()) ffff930a9788e000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1786109596.040059:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e517800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1786109596.040120:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098e512800 for lustre-MDT0000 00000020:00080000:1.0:1786109596.040169:0:195774:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.38@tcp (ffff930a9788b000): rc 0 00000020:00080000:1.0:1786109596.040173:0:195774:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930a87b2a800), last request at 1786109562 00000020:00000080:1.0:1786109596.040176:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36e4f 00000100:00080000:1.0:1786109596.040180:0:195774:0:(import.c:65:import_set_state_nolock()) ffff930a87b28800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1786109596.040186:0:195774:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930a87b2a800): rc 0 00000020:00000080:1.0:1786109596.040188:0:195774:0:(genops.c:906:class_export_put()) final put ffff930a87b2a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1786109596.040195:0:195774:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930a87b2d000), last request at 1786109594 00000020:00000080:1.0:1786109596.040199:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36e48 00000100:00080000:1.0:1786109596.040207:0:195774:0:(import.c:65:import_set_state_nolock()) ffff930a87b2b800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1786109596.040216:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b2a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1786109596.040242:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a87b28800 for lustre-MDT0000 00000020:00080000:1.0:1786109596.040262:0:195774:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930a87b2d000): rc 0 00000020:00000080:1.0:1786109596.040264:0:195774:0:(genops.c:906:class_export_put()) final put ffff930a87b2d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1786109596.040272:0:195774:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930ab198d000), last request at 1786109556 00000020:00000080:1.0:1786109596.040276:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36cff 00000020:00010000:1.0:1786109596.040284:0:195774:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930ab198d000: total 1 00000100:00080000:1.0:1786109596.040288:0:195774:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1786109596.040296:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b2d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1786109596.040316:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a87b2b800 for lustre-MDT0000 00000020:00080000:1.0:1786109596.040326:0:195774:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab198d000): rc 0 00000004:00000080:1.0:1786109596.040332:0:195774:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa66f07eebae0 00000100:00080000:1.0:1786109596.040354:0:195774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1786109596.040359:0:195774:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1786109596.041424:0:195774:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1786109596.041489:0:195774:0:(import.c:65:import_set_state_nolock()) ffff930981dba800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1786109596.041731:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109596.041755:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933293952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109596.041849:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109596.042010:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933294080 00000100:00100000:0.0:1786109596.042022:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933294080 00000100:00100000:0.0:1786109596.042098:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4519 00000100:00100000:0.0:1786109596.042108:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3647:x1872862933294080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109596.042126:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109596.042152:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd77a00/0xdb52b77d7ca36ffa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36ff3 expref: 23 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109596.042172:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109596.042215:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3647:x1872862933294080:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (5089us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109596.042226:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4519 00000020:00010000:0.0:1786109596.042253:0:6514:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930a9788b000: total 0 00010000:00010000:0.0:1786109596.042312:0:6514:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930a9788b000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1786109596.042347:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6ce00/0xdb52b77d7ca371eb lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1627 expref: 2 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109596.042361:0:6514:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930a9788b000, canceled 1 locks, left on hash table 0. 00000100:00100000:2.0:1786109596.044980:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933293824:0@lo:103:ldlm_bl.0 00000020:00010000:2.0:1786109596.045251:0:10402:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930ab198d000: total 0 00010000:00010000:2.0:1786109596.045257:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00010000:2.0:1786109596.045261:0:10402:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930ab198d000: total 0 00010000:00010000:2.0:1786109596.045270:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109596.045282:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2cc00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:2.0:1786109596.045287:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109596.045299:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109596.045307:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109596.045314:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1786109596.045317:0:10402:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1786109596.045320:0:10402:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1786109596.045371:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109596.045378:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786109596.045398:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109596.045404:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0b2cc00/0xdb52b77d7ca36d76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36d7d expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1786109596.045419:0:10402:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930ab198d000: total 0 00010000:00010000:2.0:1786109596.045510:0:10402:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930ab198d000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1786109596.045560:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d400/0xdb52b77d7ca3723f lrc: 0/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37238 expref: 3 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109596.045592:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca3724d lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37246 expref: 2 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109596.045608:0:10402:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930ab198d000, canceled 2 locks, left on hash table 0. 00000100:00100000:3.0:1786109596.047724:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933293952 00000100:00100000:3.0:1786109596.047742:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933293952 00000100:00100000:3.0:1786109596.047905:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4520 00000100:00100000:3.0:1786109596.047919:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3648:x1872862933293952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109596.047937:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109596.047957:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd76800/0xdb52b77d7ca36cc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36cc0 expref: 22 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.047976:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109596.048044:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3648:x1872862933293952:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (6193us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109596.048051:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4520 00000100:00100000:3.0:1786109596.048102:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933293952:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109596.048133:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109596.048141:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.048151:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac0b2c600 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109596.048155:0:29734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.048165:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109596.048172:0:29734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109596.048180:0:29734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1786109596.048183:0:29734:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1786109596.048188:0:29734:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1786109596.048218:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.048225:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109596.048246:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.048254:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c600/0xdb52b77d7ca36cb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca36cb9 expref: -99 pid: 193895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.048267:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109596.048269:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109596.048271:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109596.048278:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109596.048292:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933294464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109596.048338:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786109596.048371:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109596.048382:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933294464 00000100:00100000:3.0:1786109596.048386:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933294464 00000100:00100000:3.0:1786109596.048416:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4521 00000100:00100000:3.0:1786109596.048423:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3649:x1872862933294464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109596.048453:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109596.048464:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd77800/0xdb52b77d7ca36cb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36cb2 expref: 21 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.048474:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109596.048503:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:3649:x1872862933294464:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109596.048510:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4521 00000100:00100000:3.0:1786109596.048535:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933294464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109596.048578:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933294080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109596.048593:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933294336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109596.048617:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109596.048637:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933294336 00000100:00100000:3.0:1786109596.048641:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933294336 00000100:00100000:3.0:1786109596.048665:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4522 00000100:00100000:3.0:1786109596.048672:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:3647:x1872862933294336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109596.048680:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109596.048689:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2dc00/0xdb52b77d7ca36d7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36d76 expref: 20 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.048697:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109596.048721:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3647:x1872862933294336:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109596.048727:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4522 00000100:00100000:3.0:1786109596.048752:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933294336:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1786109596.055030:0:195774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1786109596.055042:0:195774:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705667 gen 3 00000004:00080000:3.0:1786109596.055067:0:195774:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1786109596.055153:0:195774:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1786109596.055199:0:195774:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1786109596.055216:0:195774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1786109596.055220:0:195774:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975825 gen 3 00000004:00080000:3.0:1786109596.055230:0:195774:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1786109596.055306:0:195774:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1786109596.055317:0:195774:0:(import.c:65:import_set_state_nolock()) ffff930a8a47c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1786109596.055369:0:195774:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff930ab99d3380) has no exports 00000100:00100000:1.0:1786109596.060542:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933294208:0@lo:39:umount.0 00000100:00100000:1.0:1786109596.060660:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109596.060713:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933294592:0@lo:9:umount.0 00000100:00100000:1.0:1786109596.060741:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1786109596.060929:0:195774:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff930ab99d3380) has no exports 00000100:00100000:1.0:1786109596.061877:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933294720:0@lo:9:umount.0 00000100:00100000:1.0:1786109596.061954:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109596.062038:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933294208 00000100:00100000:1.0:1786109596.062049:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933294208 00000100:00100000:1.0:1786109596.062112:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12390 00000100:00100000:1.0:1786109596.062124:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933294208:12345-0@lo:39:umount.0 00000020:00000080:1.0:1786109596.062164:0:177399:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36d3e 00000100:00080000:1.0:1786109596.062175:0:177399:0:(import.c:65:import_set_state_nolock()) ffff93098e160000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786109596.062202:0:177399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 6, last_transno is 25769804571 00000100:00100000:1.0:1786109596.062380:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3645:x1872862933294208:12345-0@lo:39:umount.0 Request processed in 257us (1720us total) trans 25769804572 rc 0/0 00000100:00100000:1.0:1786109596.062389:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12390 00000100:00100000:1.0:1786109596.062417:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933294592 00000100:00100000:1.0:1786109596.062422:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933294592 00000100:00100000:1.0:1786109596.062485:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933294720 00000100:00100000:1.0:1786109596.062488:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933294720 00000100:00100000:1.0:1786109596.062513:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23123 00000100:00100000:1.0:1786109596.062520:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933294592:12345-0@lo:9:umount.0 00000020:00000080:1.0:1786109596.062537:0:17009:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36f9f 00000100:00080000:1.0:1786109596.062564:0:17009:0:(import.c:65:import_set_state_nolock()) ffff930ab28f6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786109596.062616:0:17009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705667 00000100:00100000:1.0:1786109596.062722:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3645:x1872862933294592:12345-0@lo:9:umount.0 Request processed in 203us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109596.062729:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23123 00000100:00100000:1.0:1786109596.062743:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23124 00000100:00100000:1.0:1786109596.062750:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933294720:12345-0@lo:9:umount.0 00000020:00000080:1.0:1786109596.062761:0:17009:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36d61 00000100:00080000:1.0:1786109596.062768:0:17009:0:(import.c:65:import_set_state_nolock()) ffff930ab9961000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786109596.064916:0:17009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975825 00000100:00100000:1.0:1786109596.065160:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3645:x1872862933294720:12345-0@lo:9:umount.0 Request processed in 2404us (3201us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109596.065174:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23124 00010000:00010000:1.0:1786109596.065230:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786109596.065281:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981dba800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1786109596.065291:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933294208:0@lo:39:umount.0 00000100:00080000:1.0:1786109596.065306:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1786109596.065333:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1786109596.065335:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786109596.065338:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933294592:0@lo:9:umount.0 00000100:00080000:1.0:1786109596.065348:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1786109596.065357:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1786109596.065358:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1786109596.065361:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933294720:0@lo:9:umount.0 00000100:00080000:1.0:1786109596.065392:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109596.065398:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786109596.065470:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786109596.132291:0:6514:0:(genops.c:906:class_export_put()) final put ffff930a9788b000/fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:1.0:1786109596.132952:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a9788b000/fac74500-4523-4794-af20-dfdcdfae19c1 for lustre-MDT0000 00010000:00010000:0.0:1786109596.134276:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109596.134284:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109596.134287:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786109596.134567:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a9788e000 for lustre-MDT0000 00000020:00000080:2.0:1786109596.141300:0:10402:0:(genops.c:906:class_export_put()) final put ffff930ab198d000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1786109596.141381:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109596.141385:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786109596.141583:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab198d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1786109596.141657:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab8da4800 for lustre-MDT0000 00010000:00010000:2.0:1786109596.141900:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786109596.174317:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36d14 00000020:00000080:3.0:1786109596.174333:0:195774:0:(genops.c:906:class_export_put()) final put ffff93098e166000/lustre-QMT0000_UUID 00000020:01000000:3.0:1786109596.174705:0:195774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1786109596.174843:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e166000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1786109596.204617:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109596.204640:0:195774:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1786109596.204647:0:195774:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff930984eacd40) has no exports 00000020:00000080:1.0:1786109596.205068:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36d0d 00000020:00000080:1.0:1786109596.205080:0:195774:0:(genops.c:906:class_export_put()) final put ffff93098e2bd800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786109596.205224:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e2bd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1786109596.205364:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109596.205374:0:195774:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1786109596.205379:0:195774:0:(genops.c:906:class_export_put()) final put ffff93098e2be000/lustre-QMT0000_UUID 00000020:00000080:1.0:1786109596.205381:0:195774:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e2be000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1786109596.205390:0:195774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1786109596.224514:0:195774:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ac0f1fde0 - data ffff930abf8feaf8/ffff930ac0d5b800 00000020:01000000:1.0:1786109596.225154:0:195774:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ac0f1fd20 - data ffff930aa412bbd0/ffff930ab2ce4400 00000100:00080000:3.0:1786109596.263484:0:195774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1786109596.263492:0:195774:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1786109596.263507:0:195774:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff930986551c00 x1872862933294208/t25769804572(25769804572) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109606 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109596.263536:0:195774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1786109596.265418:0:195774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1786109596.265424:0:195774:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705667 gen 4 00000004:00080000:3.0:1786109596.265468:0:195774:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109596.265470:0:195774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1786109596.265775:0:193914:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1786109596.265781:0:193914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x13c:0x0] index 2 count 1 00000040:00080000:0.0:1786109596.265791:0:193914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 79 count 2 00000100:00080000:3.0:1786109596.266538:0:195774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1786109596.266542:0:195774:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975825 gen 4 00000004:00080000:3.0:1786109596.266564:0:195774:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109596.266566:0:195774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1786109596.266792:0:193916:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1786109596.266795:0:193916:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x13e:0x0] index 1 count 1 00000040:00080000:1.0:1786109596.266803:0:193916:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 79 count 2 00000020:00000080:3.0:1786109596.269361:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36cd5 00000020:00000080:3.0:1786109596.269372:0:195774:0:(genops.c:906:class_export_put()) final put ffff930981db8800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1786109596.269993:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36cea 00000020:00000080:3.0:1786109596.269999:0:195774:0:(genops.c:906:class_export_put()) final put ffff930ab1988000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1786109596.270004:0:195774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1786109596.270009:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109596.270019:0:195774:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1786109596.270023:0:195774:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff930ab99d0000) has no exports 00000004:01000000:3.0:1786109596.270558:0:195774:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1786109596.270567:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36d5a 00000020:00000080:3.0:1786109596.270573:0:195774:0:(genops.c:906:class_export_put()) final put ffff930985f20000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1786109596.270578:0:195774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1786109596.270582:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109596.270588:0:195774:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786109596.270591:0:195774:0:(genops.c:1579:class_disconnect_exports()) OBD device 19 (ffff93098272b380) has no exports 00000020:00000080:3.0:1786109596.270596:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36d53 00000020:00000080:3.0:1786109596.270599:0:195774:0:(genops.c:906:class_export_put()) final put ffff930ab7c41000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1786109596.270919:0:195774:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1786109596.270923:0:195774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1786109596.270927:0:195774:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975825 gen 5 00000004:00080000:3.0:1786109596.270934:0:195774:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109596.270936:0:195774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786109596.270967:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109596.270973:0:195774:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109596.270978:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36d45 00000020:00000080:3.0:1786109596.270982:0:195774:0:(genops.c:906:class_export_put()) final put ffff930ab7c42800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1786109596.270985:0:195774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1786109596.270988:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109596.270992:0:195774:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786109596.270994:0:195774:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9309827299c0) has no exports 00000020:00000080:3.0:1786109596.270997:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36d37 00000020:00000080:3.0:1786109596.271000:0:195774:0:(genops.c:906:class_export_put()) final put ffff930ab7c43000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1786109596.271508:0:195774:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1786109596.271511:0:195774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1786109596.271513:0:195774:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705667 gen 5 00000004:00080000:3.0:1786109596.271516:0:195774:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109596.271518:0:195774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786109596.271543:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109596.271560:0:195774:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1786109596.271572:0:195774:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1786109596.271576:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36d29 00000020:00000080:3.0:1786109596.271581:0:195774:0:(genops.c:906:class_export_put()) final put ffff93098e2bb000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1786109596.271584:0:195774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1786109596.271589:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109596.271593:0:195774:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786109596.271596:0:195774:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff930984ea8000) has no exports 00000020:00000080:3.0:1786109596.271600:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36d22 00000020:00000080:3.0:1786109596.271602:0:195774:0:(genops.c:906:class_export_put()) final put ffff930981dbc000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786109596.272223:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930981db8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786109596.272236:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab1988000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1786109596.272240:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930985f20000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1786109596.272245:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab7c41000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786109596.272249:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a8a47c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1786109596.272255:0:192991:0:(genops.c:906:class_export_put()) final put ffff930ab7c45000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786109596.272257:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab7c45000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1786109596.272262:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109596.272337:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab7c42800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1786109596.272341:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab7c43000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786109596.272345:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab7c42000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1786109596.272349:0:192991:0:(genops.c:906:class_export_put()) final put ffff93098e2bf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786109596.272351:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e2bf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1786109596.272354:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109596.272380:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e2bb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1786109596.272384:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930981dbc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1786109596.288026:0:195774:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1786109596.288034:0:195774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1786109596.288039:0:195774:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1786109596.288056:0:195774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786109596.288255:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109596.288267:0:195774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109596.288293:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109596.288296:0:195774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109596.288301:0:195774:0:(genops.c:906:class_export_put()) final put ffff930a88c1d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786109596.288305:0:195774:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88c1d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1786109596.288315:0:195774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109596.288421:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36cf1 00000020:00000080:3.0:1786109596.288487:0:195774:0:(genops.c:906:class_export_put()) final put ffff930ab1989800/lustre-MDD0000_UUID 00000020:00000080:0.0:1786109596.292599:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930981dba800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1786109596.292618:0:192991:0:(genops.c:906:class_export_put()) final put ffff93098e2bc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786109596.292622:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e2bc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1786109596.292635:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1786109596.292876:0:195774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1786109596.292882:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109596.292894:0:195774:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1786109596.292899:0:195774:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff930984ea99c0) has no exports 00000020:00000080:3.0:1786109596.292938:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109596.292945:0:195774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1786109596.292957:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36cf8 00000020:00000080:3.0:1786109596.292964:0:195774:0:(genops.c:906:class_export_put()) final put ffff930ab198e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786109596.293384:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab1989800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1786109596.293389:0:192991:0:(genops.c:906:class_export_put()) final put ffff930a88c1a800/lustre-MDD0000_UUID 00000020:00000080:0.0:1786109596.293391:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88c1a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1786109596.293395:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1786109596.293707:0:195774:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930ab29d1000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1786109596.293713:0:195774:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab29d1000 3 00000020:01000004:3.0:1786109596.293716:0:195774:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff930ab29d1000 from lustre-MDT0000 00000020:00000080:3.0:1786109596.293735:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109596.293742:0:195774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1786109596.293744:0:195774:0:(genops.c:906:class_export_put()) final put ffff930981db9800/lustre-MDT0000_UUID 00000020:00000080:3.0:1786109596.293746:0:195774:0:(genops.c:865:class_export_destroy()) destroying export ffff930981db9800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1786109596.293753:0:195774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1786109596.293803:0:195774:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1786109596.293807:0:195774:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1786109596.293811:0:195774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1786109596.293813:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109596.293817:0:195774:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1786109596.293825:0:195774:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff93098650a000 4929093a-da1f-45c7-90e6-dcd2fb5a5df4 192.168.203.38@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786109596.293831:0:195774:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff930a88c1d800 aeab97cc-8463-4daa-a678-1bb2ad93cc69 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786109596.293836:0:195774:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff930ab99d4d40) has exports, disconnecting them 00000020:00080000:3.0:1786109596.293841:0:195774:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.38@tcp (ffff93098650a000), last request at 1786109562 00000020:00000080:3.0:1786109596.293861:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36e41 00000020:00010000:3.0:1786109596.293866:0:195774:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93098650a000: total 1 00000100:00080000:3.0:1786109596.293870:0:195774:0:(import.c:65:import_set_state_nolock()) ffff93098650d000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1786109596.293890:0:195774:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.38@tcp (ffff93098650a000): rc 0 00000020:00080000:3.0:1786109596.293893:0:195774:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff930a88c1d800), last request at 1786109556 00000020:00000080:3.0:1786109596.293935:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36c9d 00000020:00010000:3.0:1786109596.293938:0:195774:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930a88c1d800: total 1 00000100:00080000:3.0:1786109596.293941:0:195774:0:(import.c:65:import_set_state_nolock()) ffff930a88c18800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1786109596.293948:0:195774:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930a88c1d800): rc 0 00000020:00080000:3.0:1786109596.293952:0:195774:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff930ab99d4d40) has no exports 00000100:00100000:3.0:1786109596.293995:0:193902:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff930982ce7c00:193902] 1 exiting: rc = 0 00000020:00010000:1.0:1786109596.294241:0:29734:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93098650a000: total 1 00010000:00010000:1.0:1786109596.294278:0:29734:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93098650a000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1786109596.294307:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930aa628a800/0xdb52b77d7ca3700f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15e1 expref: 5 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.294324:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930aa628ae00/0xdb52b77d7ca36e5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1571 expref: 4 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.294336:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac1f39800/0xdb52b77d7ca36f52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a15b0 expref: 3 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.294348:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac1f39200/0xdb52b77d7ca36e64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1578 expref: 2 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109596.294357:0:29734:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93098650a000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1786109596.294373:0:29734:0:(genops.c:906:class_export_put()) final put ffff93098650a000/4929093a-da1f-45c7-90e6-dcd2fb5a5df4 00000100:00100000:3.0:1786109596.294726:0:193901:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff930ab8fe0e00:193901] 0 exiting: rc = 1 00000100:00100000:3.0:1786109596.294786:0:193903:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff930ac0b5aa00:193903] 2 exiting: rc = 0 00000020:00010000:3.0:1786109596.294823:0:6515:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930a88c1d800: total 2 00010000:00010000:3.0:1786109596.294852:0:6515:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930a88c1d800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1786109596.294872:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd77400/0xdb52b77d7ca36de6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36ddf expref: 14 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.294892:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2da00/0xdb52b77d7ca36df4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36ded expref: 13 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.294902:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac1f38600/0xdb52b77d7ca36f83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36f7c expref: 12 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.294912:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd76200/0xdb52b77d7ca36e10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36e09 expref: 11 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.294922:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2d600/0xdb52b77d7ca36e02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36dfb expref: 10 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.294931:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c2a00/0xdb52b77d7ca36fad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36fa6 expref: 9 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.294939:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac0b2ca00/0xdb52b77d7ca36dbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36db5 expref: 8 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.294949:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd76e00/0xdb52b77d7ca36fbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36fb4 expref: 7 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.294958:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd76a00/0xdb52b77d7ca36e1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36e17 expref: 6 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.294969:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c2200/0xdb52b77d7ca37008 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37001 expref: 5 pid: 193901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.294979:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd77600/0xdb52b77d7ca36e2c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36e25 expref: 4 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.294995:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930aa628b400/0xdb52b77d7ca36e3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36e33 expref: 3 pid: 193902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.295005:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93098cd77000/0xdb52b77d7ca36dd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca36dd1 expref: 2 pid: 193903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109596.295014:0:6515:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930a88c1d800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1786109596.295027:0:6515:0:(genops.c:906:class_export_put()) final put ffff930a88c1d800/aeab97cc-8463-4daa-a678-1bb2ad93cc69 00000020:00000080:0.0:1786109596.295200:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab198e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1786109596.295260:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109596.295263:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109596.295265:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786109596.295298:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098650a000/4929093a-da1f-45c7-90e6-dcd2fb5a5df4 for MGS 00000020:00000080:0.0:1786109596.295329:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098650d000 for MGS 00000100:00100000:0.0:1786109596.295659:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295668:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295674:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295679:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295685:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295691:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295697:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295703:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295709:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295714:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295720:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295725:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295730:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295735:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295741:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295746:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295751:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295757:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295761:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295767:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295773:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295778:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295784:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295790:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295795:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295800:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295805:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295810:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295815:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295819:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295825:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295830:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295835:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295840:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295845:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295850:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295854:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295859:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295865:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295870:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295875:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295880:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295886:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295891:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295897:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295903:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295909:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295914:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295920:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295925:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295930:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295936:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295942:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295947:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295952:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295958:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295964:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295969:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295974:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295979:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295984:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.295990:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.296260:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109596.296266:0:195774:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1786109596.297031:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109596.297033:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109596.297035:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786109596.297175:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88c1d800/aeab97cc-8463-4daa-a678-1bb2ad93cc69 for MGS 00000020:00000080:1.0:1786109596.297226:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a88c18800 for MGS 00000020:01000000:3.0:1786109596.297298:0:195774:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930aa66bf600 - data ffff930abf8eee58/ffff930ac1439800 00000020:01000000:3.0:1786109596.297405:0:195774:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930a97940de0 - data ffff930abf9781b0/ffff930ac104cc00 00000020:00000080:3.0:1786109596.297845:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36c96 00000020:00000080:3.0:1786109596.297852:0:195774:0:(genops.c:906:class_export_put()) final put ffff930a88c1f000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1786109596.297865:0:195774:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930ab29d1000 from MGS, refs=2 00000020:01000004:3.0:1786109596.297868:0:195774:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab29d1000 2 00000020:01000004:3.0:1786109596.297871:0:195774:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff930ab29d1000 from MGS 00000020:00000080:3.0:1786109596.297891:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109596.297897:0:195774:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1786109596.297900:0:195774:0:(genops.c:906:class_export_put()) final put ffff930a89250000/MGS 00000020:00000080:3.0:1786109596.297901:0:195774:0:(genops.c:865:class_export_destroy()) destroying export ffff930a89250000/MGS for MGS 00000020:01000000:3.0:1786109596.297906:0:195774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1786109596.297976:0:195774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1786109596.297980:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109596.297988:0:195774:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1786109596.297994:0:195774:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff930985f21800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786109596.297999:0:195774:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff930982728000) has exports, disconnecting them 00000020:00080000:3.0:1786109596.298003:0:195774:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff930985f21800), last request at 1786109556 00000020:00000080:3.0:1786109596.298008:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36d99 00000020:00080000:3.0:1786109596.298017:0:195774:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930985f21800): rc 0 00000020:00000080:3.0:1786109596.298020:0:195774:0:(genops.c:906:class_export_put()) final put ffff930985f21800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1786109596.298202:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88c1f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786109596.298209:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930985f21800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1786109596.304495:0:195774:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1786109596.304506:0:195774:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109596.304510:0:195774:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1786109596.304518:0:195774:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786109596.304750:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109596.304762:0:195774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1786109596.304769:0:195774:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab29d1000 1 00000020:00000080:0.0:1786109596.304775:0:195774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36c88 00000020:00000080:0.0:1786109596.304783:0:195774:0:(genops.c:906:class_export_put()) final put ffff930aa6614800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1786109596.304788:0:195774:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1786109596.304792:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109596.304796:0:195774:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786109596.304799:0:195774:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff930ab99d19c0) has no exports 00000020:00000080:1.0:1786109596.307157:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930985f23800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1786109596.307179:0:192991:0:(genops.c:906:class_export_put()) final put ffff930985f27000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1786109596.307182:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930985f27000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1786109596.307188:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1786109596.307262:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930aa6614800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1786109596.340985:0:195774:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109596.340998:0:195774:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1786109596.341004:0:195774:0:(genops.c:906:class_export_put()) final put ffff930a89256800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1786109596.341009:0:195774:0:(genops.c:865:class_export_destroy()) destroying export ffff930a89256800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1786109596.341022:0:195774:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1786109596.341130:0:195774:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff930a89252800 00000020:02000400:1.0:1786109596.341192:0:195774:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1786109596.361583:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109596.422738:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933294848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109596.423374:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109596.423505:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933294848 00000100:00100000:1.0:1786109596.423514:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933294848 00000100:00100000:1.0:1786109596.423607:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5853 00000100:00100000:1.0:1786109596.423619:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933294848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109596.423658:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00080000:2.0:1786109596.423757:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109596.423849:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933294848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 232us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109596.423858:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5853 00000100:00100000:3.0:1786109596.423940:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933294848:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1786109597.380635:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109597.956891:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933294976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109597.956960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109597.957898:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933294976 00000100:00100000:0.0:1786109597.957908:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933294976 00000100:00100000:0.0:1786109597.957963:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12391 00000100:00100000:0.0:1786109597.957970:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1872862933294976:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1786109597.957978:0:8452:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1786109597.958022:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1872862933294976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (1061us total) trans 0 rc -107/-107 00000100:00100000:0.0:1786109597.958028:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12391 00000100:02020000:3.0:1786109597.958648:0:3646:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1786109597.975570:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1786109597.975582:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1786109597.975588:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1786109598.009997:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109598.010016:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8418 00000100:00080000:3.0:1786109598.010028:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109598.010129:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c52300 x1872862933295104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109598.010222:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933295104:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1786109598.010285:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109598.011889:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933295104 00000100:00100000:3.0:1786109598.011907:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933295104 00000100:00100000:3.0:1786109598.011973:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12392 00000100:00100000:3.0:1786109598.011985:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933295104:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1786109598.012015:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109598.045898:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933295104:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 33903us (35600us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109598.045917:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12392 00000100:00080000:1.0:1786109598.045929:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109598.045938:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109598.045944:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933295104:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1786109598.246546:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109598.246601:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109598.246665:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922112640 00000100:00100000:2.0:1786109598.246682:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922112640 00000400:00000100:1.0:1786109598.246715:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922112512 offset 0 length 224: 4 00000100:00100000:2.0:1786109598.246755:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1045 00000100:00100000:2.0:1786109598.246766:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2405:x1872862922112640:12345-192.168.203.38@tcp:400:kworker.0 00000020:00080000:2.0:1786109598.246776:0:189813:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.38@tcp 00000100:00100000:2.0:1786109598.246848:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2405:x1872862922112640:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 82us (330us total) trans 0 rc -107/-107 00000100:00100000:2.0:1786109598.246855:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1045 00000100:00100000:0.0:1786109598.248065:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922112896 00000100:00100000:0.0:1786109598.248080:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922112896 00000100:00100000:1.0:1786109598.248274:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00080000:2.0:1786109598.248276:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109598.248340:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109598.248653:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922112768 00000100:00100000:1.0:1786109598.248659:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922112768 00000100:00100000:1.0:1786109598.248711:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 287 00000100:00100000:1.0:1786109598.248724:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922112768:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109598.248873:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922113024 00000100:00100000:0.0:1786109598.248878:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922113024 00000100:00100000:0.0:1786109598.248920:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7009 00000100:00100000:0.0:1786109598.248929:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922112896:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109598.249090:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922112768:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 368us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109598.249100:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 287 00000100:00100000:1.0:1786109598.249134:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7010 00000100:00100000:1.0:1786109598.249145:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922113024:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:2.0:1786109598.249185:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109598.249191:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922113024:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 49us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109598.249198:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7010 00000100:00080000:2.0:1786109598.249510:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109598.251274:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922112896:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 2332us (4658us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109598.251290:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7009 00000100:00100000:1.0:1786109598.297057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109598.297158:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922113152 00000100:00100000:3.0:1786109598.297168:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922113152 00000100:00100000:2.0:1786109598.298557:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1046 00000100:00100000:2.0:1786109598.298569:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922113152:12345-192.168.203.38@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1786109598.298598:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109598.298732:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922113152:12345-192.168.203.38@tcp:38:ptlrpcd_01_01.0 Request processed in 163us (1684us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109598.298741:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1046 00010000:00010000:1.0:1786109598.405638:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109598.980757:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933295232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109598.980971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109598.981711:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933295232 00000100:00100000:1.0:1786109598.981727:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933295232 00000100:00100000:1.0:1786109598.981832:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5854 00000100:00100000:1.0:1786109598.981846:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933295232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109598.981894:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00080000:2.0:1786109598.981942:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109598.981994:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933295232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109598.982006:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5854 00000100:00100000:2.0:1786109598.982055:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933295232:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1786109599.430488:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109599.493396:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 1 seconds 00000100:00100000:3.0:1786109600.005624:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933295360:0@lo:400:kworker.0 00000100:00100000:0.0:1786109600.005657:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933295488:0@lo:400:kworker.0 00000400:00000100:3.0:1786109600.005705:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933295360 offset 0 length 224: 4 00000100:00080000:2.0:1786109600.005799:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109600.005806:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109600.005810:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109600.005816:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8454 00000100:00080000:2.0:1786109600.005822:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109600.005830:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109600.005898:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109600.005949:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933295616:0@lo:400:kworker.0 00000100:00100000:1.0:1786109600.005986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109600.006011:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933295488 00000100:00100000:3.0:1786109600.006022:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933295488 00000100:00100000:1.0:1786109600.006046:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933295616 00000100:00100000:1.0:1786109600.006052:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933295616 00000100:00100000:3.0:1786109600.006071:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1786109600.006082:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1872862933295488:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1786109600.006093:0:187901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109600.006110:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1786109600.006120:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933295616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109600.006139:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1872862933295488:12345-0@lo:400:kworker.0 Request processed in 56us (240us total) trans 0 rc -107/-107 00000100:00100000:3.0:1786109600.006147:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00080000:3.0:1786109600.006195:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109600.006382:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0cedc00 x1872862933295744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109600.006627:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933295872:0@lo:400:kworker.0 00000100:00100000:3.0:1786109600.006952:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933295744:0@lo:38:kworker.0 00000100:00080000:0.0:1786109600.007253:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1786109600.007259:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1786109600.007263:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1786109600.007269:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109600.007273:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8418 00000100:00080000:0.0:1786109600.007279:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109600.007304:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c52300 x1872862933296512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109600.007318:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933295488:0@lo:400:kworker.0 00000100:00100000:0.0:1786109600.007343:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933296128:0@lo:400:kworker.0 00000100:00100000:2.0:1786109600.007949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109600.007995:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933296384:0@lo:400:kworker.0 00000100:00100000:2.0:1786109600.008029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109600.008057:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109600.008064:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933296256:0@lo:400:kworker.0 00000100:00100000:2.0:1786109600.008089:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109600.008134:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933296000:0@lo:400:kworker.0 00000100:00100000:2.0:1786109600.008162:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109600.008219:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933295872 00000100:00100000:2.0:1786109600.008227:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933295872 00000100:00100000:2.0:1786109600.008287:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933296000 00000100:00100000:2.0:1786109600.008290:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933296000 00000100:00100000:2.0:1786109600.008320:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7011 00000100:00100000:2.0:1786109600.008331:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933295872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109600.009669:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933295872:12345-0@lo:400:kworker.0 Request processed in 1332us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109600.009683:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7011 00000100:00100000:2.0:1786109600.009724:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7012 00000100:00100000:2.0:1786109600.009741:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933296000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109600.013786:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933296000:12345-0@lo:400:kworker.0 Request processed in 4037us (5607us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109600.013806:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7012 00000100:00080000:2.0:1786109600.013877:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109600.013885:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109600.013943:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933295872:0@lo:400:kworker.0 00000100:00100000:2.0:1786109600.013988:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933296384 00000100:00100000:2.0:1786109600.013996:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933296384 00000100:00100000:2.0:1786109600.014066:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933296256 00000100:00100000:2.0:1786109600.014070:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933296256 00000100:00100000:2.0:1786109600.014085:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1786109600.014095:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933296384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109600.014183:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933296384:12345-0@lo:400:kworker.0 Request processed in 89us (6153us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109600.014191:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1786109600.014204:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:2.0:1786109600.014209:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1872862933296256:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1786109600.014216:0:187901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1786109600.014247:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1872862933296256:12345-0@lo:400:kworker.0 Request processed in 36us (6157us total) trans 0 rc -107/-107 00000100:00100000:2.0:1786109600.014252:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00080000:2.0:1786109600.014269:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109600.014288:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1786109600.014294:0:3647:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1786109600.014298:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1786109600.014305:0:3647:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109600.014310:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8424 00000100:00080000:2.0:1786109600.014316:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109600.014350:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0cec380 x1872862933296640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109600.014369:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933296256:0@lo:400:kworker.0 00000100:00100000:2.0:1786109600.014387:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933296384:0@lo:400:kworker.0 00000100:00100000:2.0:1786109600.014423:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933296000:0@lo:400:kworker.0 00000100:00100000:2.0:1786109600.014560:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933295616:0@lo:400:kworker.0 00000100:00100000:3.0:1786109600.017619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109600.017707:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933296512:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1786109600.017762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109600.017799:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933296640:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1786109600.017825:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109600.017880:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933296512 00000100:00100000:3.0:1786109600.017890:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933296512 00000100:00100000:3.0:1786109600.017929:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933296640 00000100:00100000:3.0:1786109600.017932:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933296640 00000100:00100000:3.0:1786109600.017947:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1786109600.017955:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933296512:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1786109600.017981:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109600.018029:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933296512:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 73us (265us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109600.018036:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1786109600.018054:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1786109600.018058:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933296640:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1786109600.018067:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109600.018092:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933296640:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 32us (266us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109600.018097:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00080000:3.0:1786109600.018142:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109600.018148:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109600.018152:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933296512:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1786109600.018162:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109600.018165:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109600.018168:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933296640:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1786109600.018839:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109600.018875:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933296128 00000100:00100000:3.0:1786109600.018881:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933296128 00000100:00100000:3.0:1786109600.018911:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:3.0:1786109600.018918:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1872862933296128:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1786109600.018925:0:187901:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109600.018957:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933295616:12345-0@lo:400:kworker.0 Request processed in 12837us (12967us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109600.018967:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1786109600.018993:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933295744 00000100:00100000:2.0:1786109600.018998:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933295744 00000100:00100000:2.0:1786109600.019036:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12393 00000100:00100000:2.0:1786109600.019043:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933295744:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109600.019060:0:8452:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109600.019747:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1872862933296128:12345-0@lo:400:kworker.0 Request processed in 822us (905us total) trans 0 rc -107/-107 00000100:00080000:0.0:1786109600.020003:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1786109600.020010:0:3649:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1786109600.020014:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1786109600.020020:0:3649:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109600.020025:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8418 00000100:00080000:0.0:1786109600.020034:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109600.020074:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c52300 x1872862933296768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109600.020115:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933296128:0@lo:400:kworker.0 00000100:00100000:1.0:1786109600.020996:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933296768:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1786109600.021079:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109600.021532:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:3.0:1786109600.021566:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933296768 00000100:00100000:3.0:1786109600.021576:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933296768 00000100:00100000:3.0:1786109600.021620:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:3.0:1786109600.021628:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933296768:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1786109600.021656:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109600.021716:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933296768:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 86us (635us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109600.021722:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00080000:1.0:1786109600.022247:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109600.022254:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109600.022258:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933296768:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1786109600.022642:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933295744:12345-0@lo:38:kworker.0 Request processed in 3594us (5032us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109600.022653:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12393 00000100:00080000:1.0:1786109600.022722:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109600.022727:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109600.022731:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933295744:0@lo:38:kworker.0 00010000:00010000:0.0:1786109600.453033:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109600.516642:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 1 seconds 00010000:00010000:2.0:1786109601.485853:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109601.540847:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933296896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109601.540970:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109601.541066:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 1 seconds 00000100:00100000:1.0:1786109601.541188:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933296896 00000100:00100000:1.0:1786109601.541199:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933296896 00000100:00100000:1.0:1786109601.541276:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5855 00000100:00100000:1.0:1786109601.541287:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933296896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109601.541322:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109601.541385:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933296896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109601.541393:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5855 00000100:00100000:3.0:1786109601.541474:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933296896:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1786109602.057425:0:187891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1786109602.057461:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804572 is committed 00000020:00000080:0.0:1786109602.057466:0:187891:0:(genops.c:906:class_export_put()) final put ffff93098e164000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1786109602.057659:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786109602.057664:0:9518:0:(genops.c:906:class_export_put()) final put ffff930ab9965800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1786109602.057757:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786109602.057761:0:194579:0:(genops.c:906:class_export_put()) final put ffff93098e510800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786109602.057892:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e164000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1786109602.057979:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab9965800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1786109602.057995:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098e160000 for lustre-MDT0001 00000020:00000080:2.0:1786109602.057999:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab9961000 for lustre-OST0001 00000020:00000080:2.0:1786109602.058091:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e510800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1786109602.058111:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab28f6800 for lustre-OST0000 00010000:00010000:1.0:1786109602.501019:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109602.564749:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 1 seconds 00000100:00100000:2.0:1786109603.381625:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109603.382248:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922113536 00000100:00100000:1.0:1786109603.382258:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922113536 00000100:00080000:3.0:1786109603.382397:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109603.382420:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000400:00000100:2.0:1786109603.382477:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922113280 offset 0 length 224: 4 00000100:00100000:2.0:1786109603.382496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109603.382568:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922113408 00000100:00100000:1.0:1786109603.382572:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922113408 00000100:00100000:1.0:1786109603.382593:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 290 00000100:00100000:1.0:1786109603.382604:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922113536:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109603.382756:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1053 00000100:00100000:0.0:1786109603.382763:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1872862922113408:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:0.0:1786109603.382783:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109603.382868:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922113536:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 265us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109603.383094:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 290 00000100:00100000:0.0:1786109603.383125:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1872862922113408:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 361us (1457us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109603.383131:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1053 00000100:00100000:0.0:1786109603.383149:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922113664 00000100:00100000:0.0:1786109603.383152:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922113664 00000100:00100000:0.0:1786109603.383183:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7013 00000100:00100000:0.0:1786109603.383189:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922113664:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109603.383219:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922113664:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109603.383225:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7013 00000100:00080000:0.0:1786109603.383238:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109603.383322:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109603.383406:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922113792 00000100:00100000:2.0:1786109603.383409:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922113792 00000100:00100000:2.0:1786109603.383453:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7014 00000100:00100000:2.0:1786109603.383461:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922113792:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109603.388534:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922113792:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 5063us (5201us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109603.388550:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7014 00000100:00080000:1.0:1786109603.388924:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786109603.524590:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109603.588515:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 1 seconds 00000100:00100000:3.0:1786109604.142113:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109604.142135:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933297024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109604.142200:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109604.142332:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933297024 00000100:00100000:2.0:1786109604.142341:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933297024 00000100:00100000:2.0:1786109604.142404:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5856 00000100:00100000:2.0:1786109604.142414:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933297024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109604.142463:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00080000:1.0:1786109604.142580:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109604.142683:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933297024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 271us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109604.142690:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5856 00000100:00100000:3.0:1786109604.142747:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933297024:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1786109604.548733:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1786109604.612584:0:187918:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109588/real 1786109588] req@ffff93098e35b100 x1872862933289216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 1 dl 1786109604 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109604.612620:0:187918:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff930a89101800 already not connected (conn 31, was 29): DISCONN 00000100:00100000:0.0:1786109604.612626:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:2.0:1786109605.124796:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933297152:0@lo:400:kworker.0 00000400:00000100:2.0:1786109605.124847:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933297152 offset 0 length 224: 4 00000100:00080000:1.0:1786109605.124952:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109605.124957:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109605.124961:0:192991:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109605.124966:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8456 00000100:00080000:1.0:1786109605.124971:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1786109605.124978:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109605.125002:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89099500 x1872862933297280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109605.125234:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933297280:0@lo:38:kworker.0 00000100:00100000:0.0:1786109605.125275:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786109605.125342:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109605.125347:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109605.125348:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109605.125352:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8456 00000100:00080000:1.0:1786109605.125355:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1786109605.125359:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109605.125375:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89098e00 x1872862933297536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109605.125414:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109605.125417:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109605.125419:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109605.125422:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8456 00000100:00080000:1.0:1786109605.125425:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1786109605.125453:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109605.125467:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a8909a300 x1872862933297920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109605.125475:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109605.125478:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109605.125479:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109605.125483:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8456 00000100:00080000:1.0:1786109605.125485:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1786109605.125531:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933297280 00000100:00100000:2.0:1786109605.125539:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933297280 00000100:00100000:2.0:1786109605.125574:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1786109605.125580:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933297280:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109605.125597:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109605.125635:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933297280:12345-0@lo:38:kworker.0 Request processed in 53us (360us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109605.125641:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1786109605.125681:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933297664:0@lo:400:kworker.0 00000100:00100000:2.0:1786109605.125709:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109605.125729:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109605.125735:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933297792:0@lo:400:kworker.0 00000100:00100000:2.0:1786109605.125755:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109605.125778:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933297536:0@lo:38:kworker.0 00000100:00100000:2.0:1786109605.125801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109605.125816:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933297920:0@lo:38:kworker.0 00000100:00100000:2.0:1786109605.125835:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109605.125897:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933297920 00000100:00100000:0.0:1786109605.125901:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933297920 00000100:00100000:0.0:1786109605.125923:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1786109605.125927:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933297920:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109605.125937:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109605.125964:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933297920:12345-0@lo:38:kworker.0 Request processed in 35us (127us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109605.125970:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1786109605.125990:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109605.125996:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933297408:0@lo:400:kworker.0 00000100:00100000:0.0:1786109605.126019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109605.126042:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933297408 00000100:00100000:0.0:1786109605.126046:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933297408 00000100:00100000:0.0:1786109605.126078:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1786109605.126084:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933297408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109605.126124:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933297408:12345-0@lo:400:kworker.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109605.126130:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1786109605.126158:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933297408:0@lo:400:kworker.0 00000100:00080000:1.0:1786109605.126205:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109605.126221:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89098a80 x1872862933298048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109605.126264:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109605.126332:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933297664 00000100:00100000:3.0:1786109605.126337:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933297664 00000100:00100000:3.0:1786109605.126371:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933297792 00000100:00100000:3.0:1786109605.126374:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933297792 00000100:00100000:3.0:1786109605.126403:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7015 00000100:00100000:3.0:1786109605.126411:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933297664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109605.126481:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933297664:12345-0@lo:400:kworker.0 Request processed in 71us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109605.126499:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7015 00000100:00100000:3.0:1786109605.126513:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7016 00000100:00100000:3.0:1786109605.126519:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933297792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109605.126549:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933297792:12345-0@lo:400:kworker.0 Request processed in 30us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109605.126556:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7016 00000100:00100000:3.0:1786109605.126575:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109605.126583:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933298176:0@lo:400:kworker.0 00000100:00100000:3.0:1786109605.126607:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109605.126632:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933298176 00000100:00100000:3.0:1786109605.126636:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933298176 00000100:00100000:3.0:1786109605.126660:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1786109605.126668:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933298176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109605.126701:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933298176:12345-0@lo:400:kworker.0 Request processed in 34us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109605.126706:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1786109605.126728:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933298176:0@lo:400:kworker.0 00000100:00080000:3.0:1786109605.126742:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109605.126745:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109605.126754:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933297536 00000100:00100000:3.0:1786109605.126757:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933297536 00000100:00100000:3.0:1786109605.126775:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12394 00000100:00100000:3.0:1786109605.126779:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933297536:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109605.126790:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109605.126817:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933297536:12345-0@lo:38:kworker.0 Request processed in 35us (1014us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109605.126823:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12394 00000100:00100000:3.0:1786109605.126863:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933297792:0@lo:400:kworker.0 00000100:00100000:3.0:1786109605.126873:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933297664:0@lo:400:kworker.0 00000100:00080000:2.0:1786109605.126939:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109605.126944:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109605.126947:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933297280:0@lo:38:kworker.0 00000100:00100000:2.0:1786109605.126963:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933298048:0@lo:38:kworker.0 00000100:00100000:2.0:1786109605.126990:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109605.127025:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109605.127029:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109605.127032:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933297536:0@lo:38:kworker.0 00000100:00080000:2.0:1786109605.127041:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109605.127044:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109605.127046:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933297920:0@lo:38:kworker.0 00000100:00100000:3.0:1786109605.127192:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933298048 00000100:00100000:3.0:1786109605.127197:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933298048 00000100:00100000:3.0:1786109605.127260:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1786109605.127265:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933298048:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109605.127276:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109605.127318:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933298048:12345-0@lo:38:kworker.0 Request processed in 52us (327us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109605.127325:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00080000:2.0:1786109605.127377:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109605.127381:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109605.127384:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933298048:0@lo:38:kworker.0 00010000:00010000:2.0:1786109605.573289:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109605.640281:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00010000:00010000:1.0:1786109606.596719:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109606.660562:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:0.0:1786109606.660702:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933298304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109606.660771:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109606.660830:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933298304 00000100:00100000:1.0:1786109606.660838:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933298304 00000100:00100000:2.0:1786109606.660894:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5857 00000100:00100000:2.0:1786109606.660906:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933298304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109606.660937:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109606.661026:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933298304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109606.661070:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933298304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109606.661197:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5857 00010000:00010000:3.0:1786109607.620671:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109607.684844:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000400:00000100:2.0:1786109608.464776:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922113920 offset 0 length 224: 4 00000100:00100000:0.0:1786109608.469974:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109608.470069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109608.470176:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109608.470216:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109608.470254:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922114432 00000100:00100000:0.0:1786109608.470263:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922114432 00000100:00100000:0.0:1786109608.470320:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922114304 00000100:00100000:0.0:1786109608.470323:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922114304 00000100:00100000:0.0:1786109608.470349:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7017 00000100:00100000:0.0:1786109608.470360:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922114432:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109608.470524:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7018 00000100:00100000:2.0:1786109608.470534:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922114304:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109608.470585:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922114304:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 53us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109608.470593:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7018 00000100:00080000:2.0:1786109608.470638:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109608.470643:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109608.471079:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922114176 00000100:00100000:1.0:1786109608.471085:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922114176 00000100:00100000:1.0:1786109608.471124:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922114048 00000100:00100000:1.0:1786109608.471127:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922114048 00000100:00100000:1.0:1786109608.471143:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 293 00000100:00100000:1.0:1786109608.471151:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2403:x1872862922114176:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109608.471194:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1057 00000100:00100000:0.0:1786109608.471204:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922114432:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 842us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109608.471216:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7017 00000100:00100000:3.0:1786109608.471225:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922114048:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:3.0:1786109608.471260:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109608.471290:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2403:x1872862922114176:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 135us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109608.471300:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 293 00000100:00080000:1.0:1786109608.471330:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109608.471337:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922114048:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 124us (1262us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109608.471348:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1057 00010000:00010000:0.0:1786109608.645525:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109608.708602:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:3.0:1786109609.222139:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109609.222156:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933298432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109609.222219:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109609.222289:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933298432 00000100:00100000:3.0:1786109609.222297:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933298432 00000100:00100000:3.0:1786109609.222351:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5858 00000100:00100000:3.0:1786109609.222360:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933298432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109609.222389:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109609.222449:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933298432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109609.222456:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5858 00000100:00080000:3.0:1786109609.222487:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109609.222519:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933298432:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1786109609.670418:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109609.736895:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:3.0:1786109610.245603:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933298560:0@lo:400:kworker.0 00000400:00000100:3.0:1786109610.245885:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933298560 offset 0 length 224: 4 00000100:00080000:0.0:1786109610.246149:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109610.246155:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109610.246158:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109610.246163:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8461 00000100:00080000:0.0:1786109610.246168:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109610.246175:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109610.246200:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9928000 x1872862933298688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109610.246231:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109610.246234:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109610.246236:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109610.246239:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8461 00000100:00080000:0.0:1786109610.246242:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1786109610.246245:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109610.246257:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098e35aa00 x1872862933298944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109610.246322:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933299200:0@lo:400:kworker.0 00000100:00100000:2.0:1786109610.246362:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109610.246399:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933298688:0@lo:38:kworker.0 00000100:00100000:2.0:1786109610.246423:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109610.246470:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933298944:0@lo:38:kworker.0 00000100:00100000:2.0:1786109610.246490:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109610.246522:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933298944 00000100:00100000:2.0:1786109610.246529:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933298944 00000100:00100000:2.0:1786109610.246560:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12395 00000100:00100000:2.0:1786109610.246568:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933298944:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109610.246588:0:8452:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109610.246630:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933298944:12345-0@lo:38:kworker.0 Request processed in 61us (137us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109610.246636:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12395 00000100:00080000:2.0:1786109610.246674:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109610.246679:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109610.246683:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933298944:0@lo:38:kworker.0 00000100:00100000:3.0:1786109610.246886:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933299200 00000100:00100000:3.0:1786109610.246891:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933299200 00000100:00100000:1.0:1786109610.247104:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933298688 00000100:00100000:1.0:1786109610.247109:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933298688 00000100:00100000:1.0:1786109610.247135:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1786109610.247140:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933298688:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109610.247152:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109610.247194:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933298688:12345-0@lo:38:kworker.0 Request processed in 54us (770us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109610.247200:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00080000:1.0:1786109610.247233:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109610.247237:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109610.247240:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933298688:0@lo:38:kworker.0 00000100:00100000:3.0:1786109610.247569:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7019 00000100:00100000:3.0:1786109610.247579:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933299200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109610.247627:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933299200:12345-0@lo:400:kworker.0 Request processed in 51us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109610.247633:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7019 00000100:00100000:3.0:1786109610.247653:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933299072:0@lo:400:kworker.0 00000100:00100000:3.0:1786109610.247694:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109610.247717:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109610.247723:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933298816:0@lo:400:kworker.0 00000100:00100000:3.0:1786109610.247745:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109610.247773:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933299072 00000100:00100000:3.0:1786109610.247777:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933299072 00000100:00100000:3.0:1786109610.247798:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7020 00000100:00100000:3.0:1786109610.247804:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933299072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109610.247837:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933299072:12345-0@lo:400:kworker.0 Request processed in 32us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109610.247843:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7020 00000100:00100000:3.0:1786109610.247873:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933299200:0@lo:400:kworker.0 00000100:00100000:3.0:1786109610.247894:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933299072:0@lo:400:kworker.0 00000100:00100000:1.0:1786109610.248095:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933298816 00000100:00100000:1.0:1786109610.248099:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933298816 00000100:00100000:1.0:1786109610.248182:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1786109610.248191:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933298816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109610.248233:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933298816:12345-0@lo:400:kworker.0 Request processed in 44us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109610.248239:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:2.0:1786109610.248295:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109610.248300:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109610.248424:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933298816:0@lo:400:kworker.0 00000100:00080000:0.0:1786109610.248863:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109610.248868:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109610.248872:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109610.248877:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8461 00000100:00080000:0.0:1786109610.248881:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109610.248886:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109610.248913:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098d887800 x1872862933299328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109610.250885:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109610.250893:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109610.250896:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109610.250903:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8461 00000100:00080000:0.0:1786109610.250908:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109610.250914:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109610.250955:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098d886a00 x1872862933299456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109610.251002:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933299584:0@lo:400:kworker.0 00000100:00100000:2.0:1786109610.251062:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109610.251853:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933299584 00000100:00100000:1.0:1786109610.251862:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933299584 00000100:00100000:1.0:1786109610.251943:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933299328:0@lo:38:kworker.0 00000100:00100000:1.0:1786109610.251984:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109610.252023:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933299456:0@lo:38:kworker.0 00000100:00100000:1.0:1786109610.252047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109610.252082:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933299328 00000100:00100000:1.0:1786109610.252085:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933299328 00000100:00100000:1.0:1786109610.252110:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933299456 00000100:00100000:1.0:1786109610.252113:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933299456 00000100:00100000:1.0:1786109610.252124:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1786109610.252131:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933299328:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109610.252151:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109610.252190:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933299328:12345-0@lo:38:kworker.0 Request processed in 58us (206us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109610.252196:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1786109610.252210:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1786109610.252213:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933299456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109610.252222:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109610.252244:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933299456:12345-0@lo:38:kworker.0 Request processed in 29us (197us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109610.252250:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00080000:1.0:1786109610.252281:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109610.252286:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109610.252290:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933299328:0@lo:38:kworker.0 00000100:00080000:1.0:1786109610.252299:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109610.252303:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109610.252305:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933299456:0@lo:38:kworker.0 00000100:00100000:3.0:1786109610.252505:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1786109610.252514:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933299584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109610.252562:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933299584:12345-0@lo:400:kworker.0 Request processed in 49us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109610.252568:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1786109610.252601:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933299584:0@lo:400:kworker.0 00000100:00080000:2.0:1786109610.252748:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1786109610.694741:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109610.756502:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00010000:00010000:3.0:1786109611.717498:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109611.783287:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109611.783324:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933299712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109611.783408:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109611.783561:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933299712 00000100:00100000:3.0:1786109611.783572:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933299712 00000100:00100000:3.0:1786109611.783626:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5859 00000100:00100000:3.0:1786109611.783636:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933299712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109611.784056:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580416 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109611.784118:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933299712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 481us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109611.784126:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5859 00000100:00100000:3.0:1786109611.784416:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933299712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109611.785070:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00010000:00010000:0.0:1786109612.740723:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109612.820918:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:0.0:1786109613.594241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000400:00000100:0.0:1786109613.594290:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922114560 offset 0 length 520: 4 00000100:00100000:0.0:1786109613.594311:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109613.594340:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109613.594373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109613.594406:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922114944 00000100:00100000:0.0:1786109613.594417:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922114944 00000100:00100000:0.0:1786109613.594526:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23125 00000100:00100000:0.0:1786109613.594540:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fac74500-4523-4794-af20-dfdcdfae19c1+5:2401:x1872862922114944:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:0.0:1786109613.594731:0:40692:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37135 00000100:00080000:0.0:1786109613.594746:0:40692:0:(import.c:65:import_set_state_nolock()) ffff930ab1994000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786109613.594802:0:40692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705667 00000100:00100000:0.0:1786109613.595011:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fac74500-4523-4794-af20-dfdcdfae19c1+2:2401:x1872862922114944:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 474us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109613.595020:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23125 00000100:00100000:0.0:1786109613.595040:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922115072 00000100:00100000:0.0:1786109613.595043:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922115072 00000100:00100000:0.0:1786109613.595071:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23126 00000100:00100000:0.0:1786109613.595077:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fac74500-4523-4794-af20-dfdcdfae19c1+5:2401:x1872862922115072:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:0.0:1786109613.595091:0:40692:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36f67 00000100:00080000:0.0:1786109613.595097:0:40692:0:(import.c:65:import_set_state_nolock()) ffff930a97ceb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786109613.595119:0:40692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975825 00000100:00100000:0.0:1786109613.595267:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fac74500-4523-4794-af20-dfdcdfae19c1+2:2401:x1872862922115072:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 188us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109613.595274:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23126 00010000:00010000:0.0:1786109613.595333:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109613.595506:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109613.596804:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922114816 00000100:00100000:3.0:1786109613.596817:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922114816 00000100:00100000:3.0:1786109613.596883:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922114688 00000100:00100000:3.0:1786109613.596886:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922114688 00000100:00100000:3.0:1786109613.596914:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 296 00000100:00100000:3.0:1786109613.596927:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922114816:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109613.597012:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922114816:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 88us (2786us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109613.597025:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 296 00000100:00100000:3.0:1786109613.597046:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1061 00000100:00100000:3.0:1786109613.597051:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922114688:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:3.0:1786109613.597078:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109613.597105:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922114688:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 53us (2793us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109613.597112:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1061 00000100:00080000:3.0:1786109613.597132:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109613.597758:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109613.597763:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786109613.765557:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109613.830588:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:0.0:1786109614.340828:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933299840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109614.340899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109614.341057:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933299840 00000100:00100000:1.0:1786109614.341066:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933299840 00000100:00100000:1.0:1786109614.341127:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5860 00000100:00100000:1.0:1786109614.341136:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933299840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109614.341165:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923472384 avail 3691950080 00000100:00080000:2.0:1786109614.341243:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109614.341566:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933299840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 430us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109614.341574:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5860 00000100:00100000:0.0:1786109614.341650:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933299840:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1786109614.788696:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109614.853762:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00080000:0.0:1786109615.364709:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109615.364719:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109615.364724:0:192991:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109615.364736:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8466 00000100:00080000:0.0:1786109615.364743:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1786109615.364752:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109615.364780:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac17bd880 x1872862933300096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109615.364806:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109615.364809:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109615.364811:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109615.364815:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8466 00000100:00080000:0.0:1786109615.364817:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109615.364821:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109615.364834:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac17bc700 x1872862933300352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109615.365033:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933299968:0@lo:400:kworker.0 00000400:00000100:3.0:1786109615.365101:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933299968 offset 0 length 224: 4 00000100:00100000:3.0:1786109615.365245:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109615.365252:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933300224:0@lo:400:kworker.0 00000100:00100000:3.0:1786109615.365293:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109615.365339:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933300224 00000100:00100000:3.0:1786109615.365348:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933300224 00000100:00100000:3.0:1786109615.365414:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1786109615.365469:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933300224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109615.365530:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933300224:12345-0@lo:400:kworker.0 Request processed in 65us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109615.365538:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:3.0:1786109615.365563:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109615.365598:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933300224:0@lo:400:kworker.0 00000100:00100000:1.0:1786109615.365757:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933300096:0@lo:38:kworker.0 00000100:00100000:1.0:1786109615.365791:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109615.365821:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933300352:0@lo:38:kworker.0 00000100:00100000:1.0:1786109615.365844:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109615.365938:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933300352 00000100:00100000:1.0:1786109615.365943:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933300352 00000100:00100000:1.0:1786109615.365968:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12396 00000100:00100000:1.0:1786109615.365974:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933300352:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109615.365997:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109615.366030:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933300352:12345-0@lo:38:kworker.0 Request processed in 55us (185us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109615.366036:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12396 00000100:00080000:1.0:1786109615.366064:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109615.366068:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109615.366072:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933300352:0@lo:38:kworker.0 00000100:00080000:0.0:1786109615.366146:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109615.366151:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109615.366153:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109615.366223:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8466 00000100:00080000:0.0:1786109615.366227:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1786109615.366232:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109615.366251:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac17bca80 x1872862933300736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109615.366273:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109615.366277:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109615.366279:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109615.366282:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8466 00000100:00080000:0.0:1786109615.366285:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1786109615.366288:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109615.366300:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1f52a00 x1872862933300864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109615.366350:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786109615.366358:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933300992:0@lo:400:kworker.0 00000100:00100000:0.0:1786109615.366386:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109615.366417:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933300480:0@lo:400:kworker.0 00000100:00100000:0.0:1786109615.366476:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109615.366496:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109615.366500:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933300608:0@lo:400:kworker.0 00000100:00100000:0.0:1786109615.366518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109615.366545:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933300096 00000100:00100000:0.0:1786109615.366549:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933300096 00000100:00100000:0.0:1786109615.366572:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933300992 00000100:00100000:0.0:1786109615.366574:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933300992 00000100:00100000:0.0:1786109615.366604:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1786109615.366611:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933300992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109615.366928:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933300992:12345-0@lo:400:kworker.0 Request processed in 316us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109615.366935:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1786109615.366950:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1786109615.366954:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933300096:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109615.366968:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109615.366993:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933300096:12345-0@lo:38:kworker.0 Request processed in 38us (1202us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109615.366999:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1786109615.367025:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933300480 00000100:00100000:0.0:1786109615.367029:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933300480 00000100:00100000:0.0:1786109615.367055:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933300608 00000100:00100000:0.0:1786109615.367057:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933300608 00000100:00100000:0.0:1786109615.367076:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7021 00000100:00100000:0.0:1786109615.367081:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933300480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109615.367112:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933300480:12345-0@lo:400:kworker.0 Request processed in 32us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109615.367119:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7021 00000100:00100000:0.0:1786109615.367128:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7022 00000100:00100000:0.0:1786109615.367133:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933300608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109615.367153:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933300608:12345-0@lo:400:kworker.0 Request processed in 20us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109615.367243:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933300736:0@lo:38:kworker.0 00000100:00100000:1.0:1786109615.367271:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109615.367291:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933300864:0@lo:38:kworker.0 00000100:00100000:1.0:1786109615.367307:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786109615.367330:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109615.367334:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109615.367338:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933300096:0@lo:38:kworker.0 00000100:00100000:1.0:1786109615.367366:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933300736 00000100:00100000:1.0:1786109615.367369:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933300736 00000100:00100000:1.0:1786109615.367382:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933300864 00000100:00100000:1.0:1786109615.367385:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933300864 00000100:00100000:1.0:1786109615.367395:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1786109615.367401:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933300736:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109615.367411:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109615.367476:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933300736:12345-0@lo:38:kworker.0 Request processed in 74us (203us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109615.367482:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1786109615.367496:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1786109615.367500:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933300864:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109615.367509:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109615.367531:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933300864:12345-0@lo:38:kworker.0 Request processed in 29us (222us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109615.367537:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00080000:1.0:1786109615.367564:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109615.367568:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109615.367571:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933300736:0@lo:38:kworker.0 00000100:00080000:1.0:1786109615.367580:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109615.367583:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109615.367586:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933300864:0@lo:38:kworker.0 00000100:00080000:3.0:1786109615.367962:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109615.367969:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109615.368030:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7022 00000100:00100000:0.0:1786109615.368072:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933300992:0@lo:400:kworker.0 00000100:00100000:0.0:1786109615.368112:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933300608:0@lo:400:kworker.0 00000100:00100000:0.0:1786109615.368126:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933300480:0@lo:400:kworker.0 00010000:00010000:3.0:1786109615.812757:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109615.877540:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00000400:3.0:1786109616.388748:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109600/real 1786109600] req@ffff930ac1780380 x1872862933295360/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109616.388788:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff930ac1780380 x1872862933295360/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786109616.388798:0:3648:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1786109616.388803:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1786109616.388807:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.138@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1786109616.388809:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1786109616.388813:0:3648:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930ac1780380 x1872862933295360/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109616.388822:0:3648:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930a8909aa00 x1872862933297152/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109621 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109616.389797:0:3648:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930ab9929500 x1872862933298560/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109626 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109616.389821:0:3648:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930ac17bc000 x1872862933299968/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109631 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1786109616.389831:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1786109616.389834:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1786109616.389835:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1786109616.389838:0:3648:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1786109616.389875:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933299968:0@lo:400:kworker.0 00000100:00100000:3.0:1786109616.389881:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933295360:0@lo:400:kworker.0 00000100:00080000:3.0:1786109616.389918:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109616.389924:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1786109616.389927:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109616.389933:0:171804:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8413 00000100:00080000:3.0:1786109616.389941:0:171804:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109616.389970:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a3800 x1872862933301120/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109616.389991:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109616.389994:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109616.389996:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109616.389999:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8472 00000100:00080000:3.0:1786109616.390002:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109616.390005:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109616.390018:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a1500 x1872862933301248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109616.390038:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109616.390042:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109616.390043:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109616.390046:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8472 00000100:00080000:3.0:1786109616.390049:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109616.390052:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109616.390061:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1780380 x1872862933301504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109616.390089:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109616.390093:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109616.390095:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109616.390098:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8472 00000100:00080000:3.0:1786109616.390101:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109616.390104:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109616.390115:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a97fa9f80 x1872862933301888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109616.390123:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109616.390126:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786109616.390128:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109616.390131:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8472 00000100:00080000:3.0:1786109616.390133:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109616.390136:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109616.390146:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a97fabb80 x1872862933302016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109616.390180:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933301120:0@lo:250:kworker.0 00000400:00000100:3.0:1786109616.390234:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933301120 offset 0 length 520: 4 00000100:00100000:3.0:1786109616.390288:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933301248:0@lo:38:kworker.0 00000100:00100000:3.0:1786109616.390326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109616.390349:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933301504:0@lo:38:kworker.0 00000100:00100000:3.0:1786109616.390375:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109616.390394:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933301888:0@lo:38:kworker.0 00000100:00100000:2.0:1786109616.390479:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933301376:0@lo:400:kworker.0 00000100:00100000:3.0:1786109616.391545:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109616.391955:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933302016:0@lo:38:kworker.0 00000100:00100000:3.0:1786109616.391993:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109616.392038:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933302144:0@lo:400:kworker.0 00000100:00100000:3.0:1786109616.392066:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109616.392101:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97faaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933301760:0@lo:400:kworker.0 00000100:00100000:3.0:1786109616.392132:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109616.392156:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109616.392163:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97faa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933301632:0@lo:400:kworker.0 00000100:00100000:3.0:1786109616.392186:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109616.392221:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933301248 00000100:00100000:3.0:1786109616.392230:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933301248 00000100:00100000:3.0:1786109616.392262:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933301888 00000100:00100000:3.0:1786109616.392265:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933301888 00000100:00100000:3.0:1786109616.392274:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933302016 00000100:00100000:3.0:1786109616.392276:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933302016 00000100:00100000:3.0:1786109616.392283:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933302144 00000100:00100000:3.0:1786109616.392285:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933302144 00000100:00100000:3.0:1786109616.392312:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1786109616.392322:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933302144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109616.392385:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933302144:12345-0@lo:400:kworker.0 Request processed in 64us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109616.392393:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1786109616.392427:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1786109616.392456:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933301248:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109616.392479:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109616.392516:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933301248:12345-0@lo:38:kworker.0 Request processed in 59us (2190us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109616.392523:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1786109616.392536:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1786109616.392540:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933301888:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109616.392549:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109616.392573:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933301888:12345-0@lo:38:kworker.0 Request processed in 31us (1034us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109616.392578:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1786109616.392589:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1786109616.392594:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933302016:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109616.392602:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109616.392626:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933302016:12345-0@lo:38:kworker.0 Request processed in 31us (633us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109616.392631:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1786109616.392746:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109616.392779:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933298560:0@lo:400:kworker.0 00000100:00100000:3.0:1786109616.392845:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933301376 00000100:00100000:3.0:1786109616.392849:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933301376 00000100:00100000:3.0:1786109616.392867:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1786109616.392873:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933301376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109616.392955:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933301376:12345-0@lo:400:kworker.0 Request processed in 81us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109616.392963:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1786109616.392984:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933301504 00000100:00100000:3.0:1786109616.392989:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933301504 00000100:00100000:3.0:1786109616.393014:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12397 00000100:00100000:3.0:1786109616.393019:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933301504:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109616.393031:0:8452:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109616.393060:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933301504:12345-0@lo:38:kworker.0 Request processed in 39us (2683us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109616.393066:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12397 00000100:00100000:3.0:1786109616.393097:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933301760 00000100:00100000:3.0:1786109616.393101:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933301760 00000100:00100000:3.0:1786109616.393129:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933301632 00000100:00100000:3.0:1786109616.393132:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933301632 00000100:00100000:3.0:1786109616.393164:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7023 00000100:00100000:3.0:1786109616.393170:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933301760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109616.393210:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933301760:12345-0@lo:400:kworker.0 Request processed in 40us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109616.393217:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7023 00000100:00100000:3.0:1786109616.393229:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7024 00000100:00100000:3.0:1786109616.393235:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933301632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109616.393263:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933301632:12345-0@lo:400:kworker.0 Request processed in 29us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109616.393269:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7024 00000100:00100000:3.0:1786109616.393308:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933302144:0@lo:400:kworker.0 00000100:00080000:3.0:1786109616.393338:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109616.393344:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109616.393347:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933301248:0@lo:38:kworker.0 00000100:00080000:3.0:1786109616.393358:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109616.393361:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109616.393365:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933301504:0@lo:38:kworker.0 00000100:00080000:3.0:1786109616.393374:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109616.393377:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109616.393380:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933301888:0@lo:38:kworker.0 00000100:00080000:3.0:1786109616.393389:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109616.393393:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109616.393396:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933302016:0@lo:38:kworker.0 00000100:00080000:3.0:1786109616.393462:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109616.393486:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97faa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933301632:0@lo:400:kworker.0 00000100:00100000:3.0:1786109616.393497:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97faaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933301760:0@lo:400:kworker.0 00000100:00100000:0.0:1786109616.397791:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933297152:0@lo:400:kworker.0 00000100:00100000:2.0:1786109616.398907:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933301376:0@lo:400:kworker.0 00010000:00010000:3.0:1786109616.841038:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109616.900772:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109616.900916:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933302272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109616.901012:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109616.901130:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:3.0:1786109616.901174:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933302272 00000100:00100000:3.0:1786109616.901185:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933302272 00000100:00100000:3.0:1786109616.901348:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5861 00000100:00100000:3.0:1786109616.901361:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933302272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109616.901401:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142656 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109616.901521:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933302272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 162us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109616.901528:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5861 00000100:00100000:1.0:1786109616.901612:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933302272:0@lo:13:osp-pre-1-1.0 00000020:01000004:1.0:1786109617.137709:0:196391:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1786109617.137717:0:196391:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1786109617.137719:0:196391:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1786109617.137848:0:196391:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff930ab282d000 00000020:01000004:1.0:1786109617.137868:0:196391:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1786109617.137886:0:196391:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1786109617.137903:0:196391:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff930985210000) 00000020:00000080:1.0:1786109617.137924:0:196391:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1786109617.202830:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1786109617.203459:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.204577:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1786109617.204875:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1786109617.205248:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1786109617.205489:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1786109617.205820:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1786109617.206082:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1786109617.206281:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1786109617.206591:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1786109617.206885:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1786109617.207130:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1786109617.207370:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1786109617.207712:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1786109617.212708:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1786109617.213757:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.213967:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.214237:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.214563:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.214842:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.215037:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.215222:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.215503:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.215736:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.215950:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.216172:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.216378:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.216758:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.216995:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.217170:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.217348:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.217603:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.217854:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.218064:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.218304:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.218562:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.218774:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.219036:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.219258:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.219571:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.219856:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.220109:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.220343:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.220719:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.220983:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.221197:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1786109617.221423:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1786109617.223343:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1786109617.223904:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1786109617.224116:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1786109617.224573:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1786109617.225039:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1786109617.225261:0:196391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:2.0:1786109617.226090:0:196391:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1786109617.226363:0:196391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1786109617.226374:0:196391:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786109617.226390:0:196391:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca372af 00000020:01000004:2.0:1786109617.226401:0:196391:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1786109617.226546:0:196391:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1786109617.226554:0:196391:0:(tgt_mount.c:101:server_register_mount()) register mount ffff930ab282d000 from MGS 00000020:01000004:2.0:1786109617.226559:0:196391:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1786109617.226570:0:196391:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff930982480000) 00000020:00000080:2.0:1786109617.226585:0:196391:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1786109617.226677:0:196391:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930ab282d000 from MGS, refs=2 00080000:01000000:2.0:1786109617.226684:0:196391:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1786109617.226689:0:196391:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca372bd 00010000:00010000:2.0:1786109617.226823:0:196391:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1786109617.231297:0:196391:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1786109617.234285:0:196395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1786109617.234335:0:196391:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1786109617.234404:0:196391:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1786109617.238031:0:196391:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1786109617.238383:0:196391:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786109617.238604:0:196391:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1786109617.238612:0:196391:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1786109617.239741:0:196391:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1786109617.239753:0:196391:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1786109617.240195:0:196391:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1786109617.240203:0:196391:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1786109617.240831:0:196391:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1786109617.240862:0:196391:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1786109617.240865:0:196391:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1786109617.240869:0:196391:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1786109617.240875:0:196391:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff930a8a640000 already not connected (conn 13800, was 0): CONNECTING 00000100:00100000:3.0:1786109617.240883:0:196391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00010000:00010000:3.0:1786109617.860698:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109617.925128:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:0.0:1786109618.725283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109618.725383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109618.725704:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922115328 00000100:00100000:3.0:1786109618.725718:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922115328 00000100:00100000:3.0:1786109618.725809:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922115200 00000100:00100000:3.0:1786109618.725813:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922115200 00000100:00100000:3.0:1786109618.725837:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 301 00000100:00100000:3.0:1786109618.725849:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922115328:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109618.725946:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922115328:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 99us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109618.725954:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 301 00000100:00100000:3.0:1786109618.725973:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1068 00000100:00100000:3.0:1786109618.725978:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922115200:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:3.0:1786109618.726002:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109618.726031:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922115200:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 51us (648us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109618.726038:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1068 00000100:00080000:0.0:1786109618.726457:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1786109618.884787:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109618.948653:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:2.0:1786109619.460834:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109619.460862:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933302400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109619.460958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109619.461851:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933302400 00000100:00100000:3.0:1786109619.461864:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933302400 00000100:00100000:3.0:1786109619.461956:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5862 00000100:00080000:1.0:1786109619.462028:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109619.462067:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933302400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109619.462342:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923472384 avail 3691950080 00000001:00100000:1.0:1786109619.462697:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:1.0:1786109619.462704:0:9518:0:(genops.c:906:class_export_put()) final put ffff930a97cec000/fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:0.0:1786109619.462917:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a97cec000/fac74500-4523-4794-af20-dfdcdfae19c1 for lustre-OST0001 00000100:00100000:3.0:1786109619.462945:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933302400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 975us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109619.462956:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5862 00000020:00000080:0.0:1786109619.463049:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a97ceb000 for lustre-OST0001 00000100:00100000:2.0:1786109619.463625:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933302400:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1786109619.463957:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:3.0:1786109619.463963:0:194579:0:(genops.c:906:class_export_put()) final put ffff930981e14800/fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:0.0:1786109619.465347:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930981e14800/fac74500-4523-4794-af20-dfdcdfae19c1 for lustre-OST0000 00000020:00000080:0.0:1786109619.465427:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab1994000 for lustre-OST0000 00010000:00010000:0.0:1786109619.909014:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109619.972643:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:2.0:1786109621.074277:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00010000:00010000:0.0:1786109621.074468:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109621.515015:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109621.515025:0:171804:0:(pinger.c:247:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1786109621.515029:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109621.515033:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109621.515037:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109621.515046:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8473 00000100:00080000:2.0:1786109621.515051:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1786109621.515059:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109621.515099:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098e358a80 x1872862933302528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109621.515228:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933302528:0@lo:38:kworker.0 00000100:00100000:3.0:1786109621.515296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109621.515526:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109621.515530:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109621.515532:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109621.515536:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8473 00000100:00080000:2.0:1786109621.515539:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1786109621.515543:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109621.515556:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098ba4ea00 x1872862933302784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109621.515617:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933302656:0@lo:400:kworker.0 00000100:00100000:1.0:1786109621.515649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109621.515700:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933302528 00000100:00100000:1.0:1786109621.515707:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933302528 00000100:00100000:1.0:1786109621.515738:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933302656 00000100:00100000:1.0:1786109621.515741:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933302656 00000100:00100000:1.0:1786109621.515785:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1786109621.515796:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933302656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109621.515847:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933302656:12345-0@lo:400:kworker.0 Request processed in 54us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109621.515855:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1786109621.515876:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:1.0:1786109621.515881:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933302528:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109621.515899:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109621.515970:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933302784:0@lo:38:kworker.0 00000100:00100000:3.0:1786109621.516007:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109621.516056:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109621.516093:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109621.516097:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109621.516100:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1786109621.516103:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933302656:0@lo:400:kworker.0 00000100:00080000:2.0:1786109621.516106:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8473 00000100:00080000:2.0:1786109621.516112:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1786109621.516117:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109621.516131:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098ba4dc00 x1872862933303168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109621.516134:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933303040:0@lo:400:kworker.0 00000100:00100000:0.0:1786109621.516167:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109621.516190:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786109621.516196:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933302912:0@lo:400:kworker.0 00000100:00100000:0.0:1786109621.516217:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109621.516245:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933303040 00000100:00100000:0.0:1786109621.516249:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933303040 00000100:00100000:0.0:1786109621.516280:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933302912 00000100:00100000:0.0:1786109621.516283:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933302912 00000100:00080000:2.0:1786109621.516304:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1786109621.516305:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7025 00000100:00080000:2.0:1786109621.516311:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109621.516314:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1786109621.516318:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933303040:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786109621.516321:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8473 00000100:00080000:2.0:1786109621.516326:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1786109621.516331:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109621.516347:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098ba4f100 x1872862933303296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109621.516393:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933303040:12345-0@lo:400:kworker.0 Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109621.516400:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7025 00000100:00100000:0.0:1786109621.516415:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7026 00000100:00100000:0.0:1786109621.516421:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933302912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109621.516468:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933302912:12345-0@lo:400:kworker.0 Request processed in 47us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109621.516475:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7026 00000100:00080000:0.0:1786109621.516495:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109621.516498:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109621.516510:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933303424:0@lo:400:kworker.0 00000100:00100000:0.0:1786109621.516538:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109621.516576:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933303424 00000100:00100000:0.0:1786109621.516577:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933302912:0@lo:400:kworker.0 00000100:00100000:2.0:1786109621.516583:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933303424 00000100:00100000:0.0:1786109621.516591:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933303040:0@lo:400:kworker.0 00000100:00080000:0.0:1786109621.516609:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109621.516627:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1786109621.516635:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933303424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109621.516667:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933303424:12345-0@lo:400:kworker.0 Request processed in 33us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109621.516701:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933302528:12345-0@lo:38:kworker.0 Request processed in 816us (1403us total) trans 0 rc -19/-19 00000100:00080000:3.0:1786109621.516752:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109621.516757:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109621.516760:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933302528:0@lo:38:kworker.0 00000100:00100000:3.0:1786109621.516797:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933303168:0@lo:38:kworker.0 00000100:00100000:3.0:1786109621.516822:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109621.516840:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933303296:0@lo:38:kworker.0 00000100:00100000:3.0:1786109621.516863:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109621.516904:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933302784 00000100:00100000:3.0:1786109621.516908:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933302784 00000100:00100000:3.0:1786109621.516932:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12398 00000100:00100000:3.0:1786109621.516937:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933302784:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109621.516950:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109621.516985:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933302784:12345-0@lo:38:kworker.0 Request processed in 46us (978us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109621.516992:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12398 00000100:00080000:3.0:1786109621.517020:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109621.517024:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109621.517027:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933302784:0@lo:38:kworker.0 00000100:00100000:3.0:1786109621.517053:0:188678:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:3.0:1786109621.517061:0:188678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:2.0:1786109621.517541:0:187900:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1786109621.517551:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933303168 00000100:00100000:2.0:1786109621.517555:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933303168 00000100:00100000:2.0:1786109621.517568:0:187900:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1786109621.517572:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933303296 00000100:00100000:2.0:1786109621.517574:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933303296 00000100:00100000:2.0:1786109621.517583:0:187900:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1786109621.517588:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1786109621.517595:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933303168:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109621.517608:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109621.517653:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933303168:12345-0@lo:38:kworker.0 Request processed in 56us (829us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109621.517660:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1786109621.517674:0:187900:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1786109621.517681:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1786109621.517685:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933303296:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109621.517695:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109621.517724:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933303296:12345-0@lo:38:kworker.0 Request processed in 37us (860us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109621.517730:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00080000:2.0:1786109621.517770:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109621.517774:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109621.517777:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933303168:0@lo:38:kworker.0 00000100:00080000:2.0:1786109621.517785:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109621.517788:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109621.517791:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933303296:0@lo:38:kworker.0 00000100:00100000:2.0:1786109621.517852:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933303424:0@lo:400:kworker.0 00000100:00100000:0.0:1786109621.518325:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1786109621.518705:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00010000:00010000:3.0:1786109622.020608:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109622.020781:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933303552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109622.020849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109622.020951:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933303552 00000100:00100000:3.0:1786109622.020959:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933303552 00000100:00100000:3.0:1786109622.021014:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5863 00000100:00100000:3.0:1786109622.021023:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933303552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109622.021054:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142656 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109622.021103:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933303552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109622.021110:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5863 00000100:00100000:0.0:1786109622.021189:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933303552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109622.084568:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00010000:00010000:0.0:1786109623.046480:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109623.142921:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:0.0:1786109623.957992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109623.958035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109623.958069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109623.958107:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922115456 00000100:00100000:0.0:1786109623.958115:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922115456 00000100:00100000:2.0:1786109623.958128:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922115584 00000100:00100000:2.0:1786109623.958143:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922115584 00000100:00100000:0.0:1786109623.958160:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1072 00000100:00100000:0.0:1786109623.958169:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922115456:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:0.0:1786109623.958191:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109623.958257:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922115456:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 87us (274us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109623.958265:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1072 00000100:00100000:2.0:1786109623.958330:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 304 00000100:00100000:2.0:1786109623.958347:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2405:x1872862922115584:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:0.0:1786109623.958351:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109623.958483:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922115712 00000100:00100000:3.0:1786109623.958491:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922115712 00000100:00100000:2.0:1786109623.958521:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2405:x1872862922115584:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 180us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109623.958535:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 304 00000100:00100000:3.0:1786109623.958543:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:3.0:1786109623.958552:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1872862922115712:12345-192.168.203.38@tcp:250:kworker.0 00010000:00080000:3.0:1786109623.958574:0:196397:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 4929093a-da1f-45c7-90e6-dcd2fb5a5df4@192.168.203.38@tcp t0 exp 0000000000000000 cur 8480 last 0 00000020:00000080:3.0:1786109623.958602:0:196397:0:(genops.c:1406:class_connect()) connect: client 4929093a-da1f-45c7-90e6-dcd2fb5a5df4, cookie 0xdb52b77d7ca372c4 00000100:00080000:2.0:1786109623.975526:0:196397:0:(import.c:65:import_set_state_nolock()) ffff930983755800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109623.975739:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+5:2401:x1872862922115712:12345-192.168.203.38@tcp:250:kworker.0 Request processed in 17184us (17700us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109623.975757:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00010000:00010000:0.0:1786109624.076056:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109624.196607:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:1.0:1786109624.581169:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933303680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109624.581243:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109624.581450:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933303680 00000100:00100000:3.0:1786109624.581458:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933303680 00000100:00100000:3.0:1786109624.581522:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5864 00000100:00100000:3.0:1786109624.581532:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933303680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109624.581561:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109624.581605:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933303680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109624.581612:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5864 00000100:00100000:1.0:1786109624.582841:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933303680:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1786109624.582920:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786109625.092770:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109625.222074:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:0.0:1786109625.829538:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109625.829651:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922115840 00000100:00100000:1.0:1786109625.829660:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922115840 00000100:00100000:1.0:1786109625.829725:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:1.0:1786109625.829736:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+5:161855:x1872862922115840:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109625.829752:0:196399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109625.829773:0:196399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac1f38e00/0xdb52b77d7ca372cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1658 expref: -99 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109625.829798:0:196399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac1f38e00/0xdb52b77d7ca372cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1658 expref: 6 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109625.829808:0:196399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac1f38e00/0xdb52b77d7ca372cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1658 expref: 6 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109625.829816:0:196399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f38e00, rc 0) 00000100:00100000:1.0:1786109625.829992:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+6:161855:x1872862922115840:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 256us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109625.829999:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:0.0:1786109625.832423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109625.832633:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922115968 00000100:00100000:2.0:1786109625.832641:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922115968 00000100:00100000:2.0:1786109625.832693:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1786109625.832704:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+6:161855:x1872862922115968:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 00000100:00100000:2.0:1786109625.832891:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+6:161855:x1872862922115968:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 Request processed in 187us (473us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786109625.832899:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1786109625.834900:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109625.835017:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922116096 00000100:00100000:1.0:1786109625.835025:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922116096 00000100:00100000:1.0:1786109625.835110:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:1.0:1786109625.835121:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+6:161855:x1872862922116096:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109625.835137:0:196399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109625.835205:0:196399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac1f38200/0xdb52b77d7ca372d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a165f expref: -99 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109625.835231:0:196399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac1f38200/0xdb52b77d7ca372d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a165f expref: 7 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109625.835242:0:196399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac1f38200/0xdb52b77d7ca372d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a165f expref: 7 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109625.835251:0:196399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f38200, rc 0) 00000100:00100000:1.0:1786109625.835311:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+7:161855:x1872862922116096:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 192us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109625.835319:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1786109625.837516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109625.837647:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922116224 00000100:00100000:2.0:1786109625.837657:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922116224 00000100:00100000:2.0:1786109625.837709:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:2.0:1786109625.837720:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+7:161855:x1872862922116224:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1786109625.838411:0:196402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1786109625.838523:0:196397:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 329 20000000:01000000:1.0:1786109625.845299:0:196403:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1786109625.845308:0:196403:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1786109625.845311:0:196403:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1786109625.845314:0:196403:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1786109625.845541:0:196403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1786109625.845840:0:196397:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1786109625.845952:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161855:x1872862922116224:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 8229us (8439us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109625.845964:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:0.0:1786109625.848130:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109625.848219:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922116352 00000100:00100000:1.0:1786109625.848227:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922116352 00000100:00100000:1.0:1786109625.848318:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1786109625.848329:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161855:x1872862922116352:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109625.848584:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161855:x1872862922116352:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 247us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109625.848593:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1786109625.852603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109625.852872:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922116480 00000100:00100000:2.0:1786109625.852882:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922116480 00000100:00100000:2.0:1786109625.852975:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1786109625.852986:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161855:x1872862922116480:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109625.853001:0:196397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109625.853021:0:196397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930a8166c200/0xdb52b77d7ca372d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1666 expref: -99 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109625.853049:0:196397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a8166c200/0xdb52b77d7ca372d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1666 expref: 9 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109625.853060:0:196397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930a8166c200/0xdb52b77d7ca372d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1666 expref: 9 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109625.853069:0:196397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a8166c200, rc 0) 00000100:00100000:2.0:1786109625.853133:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922116480:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 148us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109625.853141:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:0.0:1786109625.855644:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109625.855842:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922116608 00000100:00100000:1.0:1786109625.855850:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922116608 00000100:00100000:1.0:1786109625.855940:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1786109625.855950:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922116608:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109625.856146:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922116608:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 197us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109625.856154:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:0.0:1786109625.858791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109625.858899:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922116736 00000100:00100000:2.0:1786109625.858908:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922116736 00000100:00100000:2.0:1786109625.858993:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1786109625.859004:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922116736:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109625.859154:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922116736:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 151us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109625.859161:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1786109625.864034:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109625.864134:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922116864 00000100:00100000:1.0:1786109625.864145:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922116864 00000100:00100000:1.0:1786109625.864239:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:1.0:1786109625.864250:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922116864:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109625.864265:0:196399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109625.864283:0:196399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac1f38400/0xdb52b77d7ca372e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a166d expref: -99 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109625.864311:0:196399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac1f38400/0xdb52b77d7ca372e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a166d expref: 10 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109625.864322:0:196399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac1f38400/0xdb52b77d7ca372e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a166d expref: 10 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109625.864331:0:196399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f38400, rc 0) 00000100:00100000:1.0:1786109625.864406:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922116864:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 158us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109625.864413:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1786109625.867502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109625.867682:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922116992 00000100:00100000:2.0:1786109625.867691:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922116992 00000100:00100000:2.0:1786109625.867781:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1786109625.867791:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922116992:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109625.867910:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922116992:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 120us (416us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786109625.867918:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00010000:00010000:1.0:1786109626.195798:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109626.244557:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:2.0:1786109626.629099:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109616/real 1786109616] req@ffff930aa60a3800 x1872862933301120/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786109626 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109626.629134:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff930aa60a3800 x1872862933301120/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786109626 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109626.629149:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109626.629158:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1786109626.629169:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933301120:0@lo:250:kworker.0 00000100:00080000:1.0:1786109626.629457:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109626.629463:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1786109626.629465:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109626.629470:0:192991:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8473 00000100:00080000:1.0:1786109626.629475:0:192991:0:(import.c:589:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1786109626.629480:0:192991:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109626.629511:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a8909b100 x1872862933303808/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109626.629541:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109626.629545:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109626.629546:0:192991:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109626.629550:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8478 00000100:00080000:1.0:1786109626.629552:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109626.629556:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109626.629572:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89099c00 x1872862933303936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109626.629601:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109626.629605:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109626.629606:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109626.629610:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8478 00000100:00080000:1.0:1786109626.629613:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1786109626.629617:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109626.629632:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89098000 x1872862933304192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109626.629655:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109626.629658:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109626.629660:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109626.629663:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8478 00000100:00080000:1.0:1786109626.629665:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109626.629668:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109626.629676:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac17bed80 x1872862933304576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109626.629684:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109626.629686:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109626.629688:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109626.629691:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8478 00000100:00080000:1.0:1786109626.629693:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109626.629695:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109626.630323:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933304064:0@lo:400:kworker.0 00000100:00100000:2.0:1786109626.630397:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109626.630541:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933304064 00000100:00100000:2.0:1786109626.630549:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933304064 00000100:00100000:2.0:1786109626.630601:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1786109626.630612:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933304064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109626.630665:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933304064:12345-0@lo:400:kworker.0 Request processed in 55us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109626.630672:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1786109626.631563:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac17bc000 x1872862933304704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109626.631622:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933304832:0@lo:400:kworker.0 00000100:00100000:0.0:1786109626.632047:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933304320:0@lo:400:kworker.0 00000100:00100000:2.0:1786109626.632135:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933304064:0@lo:400:kworker.0 00000100:00080000:2.0:1786109626.632175:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00020000:2.0:1786109626.632188:0:3645:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff930a8909b100 x1872862933303808/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109626.635846:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.636524:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933304832 00000100:00100000:1.0:1786109626.636533:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933304832 00000100:00100000:1.0:1786109626.636593:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1786109626.636603:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933304832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109626.636668:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933304832:12345-0@lo:400:kworker.0 Request processed in 66us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.636674:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1786109626.637112:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933304832:0@lo:400:kworker.0 00000100:00100000:1.0:1786109626.637173:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933304448:0@lo:400:kworker.0 00000100:00100000:1.0:1786109626.637210:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109626.642076:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1786109626.642341:0:196391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1786109626.642369:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930aa628aa00/0xdb52b77d7ca36e25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36e2c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642387:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930aa628aa00/0xdb52b77d7ca36e25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36e2c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642393:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1786109626.642406:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642415:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930aa628aa00/0xdb52b77d7ca36e25 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36e2c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.642469:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff93098cd76600/0xdb52b77d7ca36db5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36dbc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642477:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff93098cd76600/0xdb52b77d7ca36db5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36dbc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642483:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109626.642486:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642490:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff93098cd76600/0xdb52b77d7ca36db5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36dbc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.642499:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d000/0xdb52b77d7ca36dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36dd8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642506:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d000/0xdb52b77d7ca36dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36dd8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642511:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109626.642514:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642518:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d000/0xdb52b77d7ca36dd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36dd8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.642532:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca36dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36e02 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642538:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca36dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36e02 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642544:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109626.642547:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642550:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff93098cd76c00/0xdb52b77d7ca36dfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36e02 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.642559:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d400/0xdb52b77d7ca36e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36e10 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642566:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d400/0xdb52b77d7ca36e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36e10 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642571:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109626.642574:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642577:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0b2d400/0xdb52b77d7ca36e09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36e10 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.642585:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36e3a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642591:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36e3a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642597:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109626.642601:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642604:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c200/0xdb52b77d7ca36e33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36e3a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.642613:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930aa628be00/0xdb52b77d7ca36f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36f83 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642620:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930aa628be00/0xdb52b77d7ca36f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36f83 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642626:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109626.642629:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642632:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930aa628be00/0xdb52b77d7ca36f7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36f83 expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.642641:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac1f38c00/0xdb52b77d7ca36fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36fbb expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642648:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac1f38c00/0xdb52b77d7ca36fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36fbb expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642653:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109626.642656:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642659:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac1f38c00/0xdb52b77d7ca36fb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36fbb expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.642673:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930aa628b800/0xdb52b77d7ca37001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca37008 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642680:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930aa628b800/0xdb52b77d7ca37001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca37008 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642690:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109626.642693:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642696:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930aa628b800/0xdb52b77d7ca37001 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca37008 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.642708:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c000/0xdb52b77d7ca36ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36de6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642715:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c000/0xdb52b77d7ca36ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36de6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642720:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109626.642723:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642727:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac0b2c000/0xdb52b77d7ca36ddf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36de6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.642738:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff93098cd77c00/0xdb52b77d7ca36ded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36df4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642745:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff93098cd77c00/0xdb52b77d7ca36ded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36df4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642750:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786109626.642753:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642756:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff93098cd77c00/0xdb52b77d7ca36ded lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36df4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.642765:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac1f39600/0xdb52b77d7ca36e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36e1e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642775:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac1f39600/0xdb52b77d7ca36e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36e1e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642781:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786109626.642784:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642788:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac1f39600/0xdb52b77d7ca36e17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36e1e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.642796:0:196391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca36fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca36fad expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.642802:0:196391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca36fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca36fad expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.642807:0:196391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786109626.642810:0:196391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1786109626.642813:0:196391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca36fa6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca36fad expref: -99 pid: 194578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109626.646695:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933304448 00000100:00100000:1.0:1786109626.653039:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933304448 00000100:00100000:1.0:1786109626.653114:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933304320 00000100:00100000:1.0:1786109626.653117:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933304320 00000100:00100000:1.0:1786109626.653150:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7027 00000100:00100000:1.0:1786109626.653161:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933304448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109626.653319:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933304448:12345-0@lo:400:kworker.0 Request processed in 160us (16108us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.653326:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7027 00000100:00100000:1.0:1786109626.653341:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7028 00000100:00100000:1.0:1786109626.653359:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933304320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109626.656813:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933304320:12345-0@lo:400:kworker.0 Request processed in 3455us (14733us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.656827:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7028 00000100:00100000:1.0:1786109626.656970:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933304448:0@lo:400:kworker.0 00000100:00100000:1.0:1786109626.657104:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933304320:0@lo:400:kworker.0 00000100:00080000:1.0:1786109626.657141:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109626.657146:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109626.657149:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109626.720210:0:196391:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff930a8a640000 already not connected (conn 13801, was 0): CONNECTING 00000100:00080000:2.0:1786109626.720210:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109626.720328:0:196391:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109626.720337:0:196391:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8483 00000100:00080000:2.0:1786109626.720352:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00080000:3.0:1786109626.720353:0:196391:0:(import.c:589:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1786109626.720360:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:0:1872862933303808:0@lo:250:kworker.0 00000100:00080000:3.0:1786109626.720364:0:196391:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00080000:1.0:1786109626.720385:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1786109626.720404:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933303936:0@lo:38:kworker.0 00000100:00100000:2.0:1786109626.720516:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786109626.721450:0:192991:0:(pinger.c:247:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1786109626.721468:0:196391:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa66e8a80 x1872862933304960/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109626.721486:0:196391:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1786109626.721547:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933303936 00000100:00100000:3.0:1786109626.721555:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933303936 00000100:00100000:3.0:1786109626.721612:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1786109626.721620:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933303936:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109626.721756:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109626.721854:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933303936:12345-0@lo:38:kworker.0 Request processed in 232us (1337us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109626.721863:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00080000:2.0:1786109626.721874:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109626.721882:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109626.721886:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933303936:0@lo:38:kworker.0 00000100:00100000:2.0:1786109626.721895:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933304192:0@lo:38:kworker.0 00000100:00100000:2.0:1786109626.721928:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109626.721969:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933304576:0@lo:38:kworker.0 00000100:00100000:2.0:1786109626.721994:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109626.722021:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933304704:0@lo:38:kworker.0 00000100:00100000:2.0:1786109626.722043:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109626.722086:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933304960:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1786109626.722091:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933304576 00000100:00100000:1.0:1786109626.722097:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933304576 00000100:00100000:2.0:1786109626.722111:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.722121:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933304704 00000100:00100000:1.0:1786109626.722125:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933304704 00000100:00100000:1.0:1786109626.722148:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1786109626.722154:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933304576:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109626.722166:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109626.722198:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933304576:12345-0@lo:38:kworker.0 Request processed in 43us (203us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109626.722204:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1786109626.722217:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1786109626.722221:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933304704:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109626.722230:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109626.722255:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933304704:12345-0@lo:38:kworker.0 Request processed in 33us (211us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109626.722260:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1786109626.722285:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933304960 00000100:00100000:1.0:1786109626.722288:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933304960 00000100:00100000:1.0:1786109626.722305:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786109626.722310:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3645:x1872862933304960:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1786109626.722326:0:196399:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from aeab97cc-8463-4daa-a678-1bb2ad93cc69@0@lo t0 exp 0000000000000000 cur 8483 last 0 00000020:00000080:1.0:1786109626.722374:0:196399:0:(genops.c:1406:class_connect()) connect: client aeab97cc-8463-4daa-a678-1bb2ad93cc69, cookie 0xdb52b77d7ca372e7 00000100:00080000:1.0:1786109626.722525:0:196399:0:(import.c:65:import_set_state_nolock()) ffff930ab29d1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786109626.722565:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+5:3645:x1872862933304960:12345-0@lo:250:mount.lustre.0 Request processed in 254us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.722573:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786109626.724735:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933304192 00000100:00100000:3.0:1786109626.724748:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933304192 00000100:00100000:3.0:1786109626.724788:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12399 00000100:00100000:3.0:1786109626.724796:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933304192:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109626.724820:0:8452:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109626.724889:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933304192:12345-0@lo:38:kworker.0 Request processed in 92us (2960us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109626.724896:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12399 00000100:00100000:2.0:1786109626.725111:0:3645:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.138@tcp: committing for last_committed 0 gen 80 00000100:00080000:2.0:1786109626.725122:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.138@tcp: connect to target with instance 0 00000100:00080000:2.0:1786109626.725130:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1786109626.725136:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1786109626.725140:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1786109626.725143:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1786109626.725164:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1786109626.725173:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933304960:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1786109626.725192:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109626.725197:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109626.725200:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933304192:0@lo:38:kworker.0 00000100:00080000:3.0:1786109626.725304:0:196391:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1786109626.725315:0:196391:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1786109626.725358:0:196391:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1786109626.725364:0:196391:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1786109626.725484:0:196391:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000000:1.0:1786109626.725928:0:192991:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.138@tcp 10000000:01000000:1.0:1786109626.725943:0:192991:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1786109626.725946:0:192991:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1786109626.725948:0:192991:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786109626.725949:0:192991:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109626.725951:0:192991:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109626.725952:0:192991:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109626.725953:0:192991:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109626.725955:0:192991:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786109626.725956:0:192991:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109626.725958:0:192991:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1786109626.725998:0:192991:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1786109626.726004:0:192991:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1786109626.726006:0:192991:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000100:00080000:2.0:1786109626.726008:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000020:01000004:1.0:1786109626.726008:0:192991:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1786109626.726010:0:192991:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109626.726013:0:192991:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109626.726016:0:192991:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00080000:2.0:1786109626.726017:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000020:01000004:1.0:1786109626.726018:0:192991:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109626.726021:0:192991:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786109626.726023:0:192991:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:2.0:1786109626.726025:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933304576:0@lo:38:kworker.0 00000020:01000004:1.0:1786109626.726025:0:192991:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:2.0:1786109626.726046:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000020:01000000:1.0:1786109626.726048:0:192991:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00080000:2.0:1786109626.726053:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 10000000:01000000:1.0:1786109626.726057:0:192991:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000100:00100000:2.0:1786109626.726058:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933304704:0@lo:38:kworker.0 00000020:01000004:1.0:1786109626.726062:0:192991:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1786109626.726066:0:192991:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786109626.726067:0:192991:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109626.726069:0:192991:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109626.726071:0:192991:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109626.726072:0:192991:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109626.726073:0:192991:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786109626.726075:0:192991:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109626.726076:0:192991:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1786109626.726089:0:192991:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1786109626.726115:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109626.726121:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933305344:0@lo:253:kworker.0 00000100:00100000:2.0:1786109626.726127:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933305088:0@lo:253:kworker.0 00000100:00100000:1.0:1786109626.726177:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.726223:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109626.726230:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933305216:0@lo:253:kworker.0 00000100:00100000:1.0:1786109626.726259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.726298:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933305344 00000100:00100000:1.0:1786109626.726304:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933305344 00000100:00100000:1.0:1786109626.726335:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933305216 00000100:00100000:1.0:1786109626.726338:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933305216 00000100:00100000:1.0:1786109626.726364:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786109626.726373:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+6:3647:x1872862933305344:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1786109626.726400:0:196397:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000020:01000004:3.0:1786109626.726402:0:196391:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1786109626.726407:0:196391:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1786109626.726409:0:196391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786109626.726410:0:196391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109626.726411:0:196391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109626.726413:0:196391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 20000000:01000000:1.0:1786109626.726414:0:196397:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:3.0:1786109626.726415:0:196391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109626.726417:0:196391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786109626.726419:0:196391:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786109626.726421:0:196391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109626.726423:0:196391:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786109626.726425:0:196391:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1786109626.726428:0:196391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786109626.726429:0:196391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000100:00100000:1.0:1786109626.726532:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786109626.726541:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+6:3647:x1872862933305216:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1786109626.726558:0:196399:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1786109626.727314:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109626.727381:0:196398:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1786109626.727390:0:196398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000020:01000004:3.0:1786109626.727458:0:196391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109626.727460:0:196391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109626.727461:0:196391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109626.727462:0:196391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109626.727463:0:196391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786109626.727465:0:196391:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786109626.727466:0:196391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109626.727467:0:196391:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786109626.727485:0:196391:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1786109626.727498:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933305472:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1786109626.728162:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.728193:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109626.728718:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933305088 00000100:00100000:1.0:1786109626.728726:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933305088 00000100:00100000:1.0:1786109626.728761:0:196398:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1786109626.728767:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933305472 00000100:00100000:1.0:1786109626.728770:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933305472 00000100:00100000:2.0:1786109626.730186:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786109626.730204:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:3648:x1872862933305088:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1786109626.730858:0:196404:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1786109626.739445:0:196399:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1786109626.739618:0:196397:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786109626.739635:0:196397:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1786109626.740296:0:196402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1786109626.740302:0:196402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1786109626.741421:0:196402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109626.741458:0:196402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ac1f38e00/0xdb52b77d7ca372cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1658 expref: 9 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109626.741472:0:196402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.743322:0:196402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ac1f38e00/0xdb52b77d7ca372cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1658 expref: 9 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.743797:0:196402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ac1f38e00/0xdb52b77d7ca372cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1658 expref: 9 pid: 196399 timeout: 8583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109626.743835:0:196402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196402:1872862933305600:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109626.743957:0:196402:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098661aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109626.747411:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:3647:x1872862933305344:12345-0@lo:253:kworker.0 Request processed in 21030us (21224us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109626.747426:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786109626.747514:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786109626.747527:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:196391:x1872862933305472:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1786109626.748095:0:196397:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1786109626.748098:0:196397:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1786109626.748101:0:196397:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1786109626.748107:0:196397:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:1.0:1786109626.748406:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1786109626.748413:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786109626.748415:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109626.748417:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109626.748418:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109626.748419:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109626.748421:0:3647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786109626.748423:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109626.748424:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1786109626.748466:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933305344:0@lo:253:kworker.0 00000100:00100000:3.0:1786109626.751780:0:196402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196402:1872862933305600:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109626.751809:0:196402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109626.751964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109626.752152:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922117120 00000100:00100000:3.0:1786109626.752161:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922117120 00010000:00010000:3.0:1786109626.752203:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ac1f38e00/0xdb52b77d7ca372cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1658 expref: 10 pid: 196399 timeout: 8583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109626.752235:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12644 00000100:00100000:3.0:1786109626.752245:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922117120:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109626.752259:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109626.752266:0:177416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930ac1f38e00/0xdb52b77d7ca372cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1658 expref: 10 pid: 196399 timeout: 8583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.752278:0:177416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ac1f38e00/0xdb52b77d7ca372cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1658 expref: 10 pid: 196399 timeout: 8583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.752296:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac1f38e00/0xdb52b77d7ca372cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1658 expref: 10 pid: 196399 timeout: 8583 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786109626.752303:0:196404:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1786109626.752316:0:177416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.752325:0:177416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1786109626.752338:0:177416:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012037295s 00010000:00010000:3.0:1786109626.752342:0:177416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.752366:0:177416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.752372:0:177416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.752379:0:177416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.752384:0:177416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109626.752389:0:177416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.752396:0:177416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.752411:0:177416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.752421:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109626.752461:0:196402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.752471:0:196402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.752489:0:196402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c3800/0xdb52b77d7ca372ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109626.752502:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:2402:x1872862922117120:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 257us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109626.752511:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12644 20000000:01000000:1.0:1786109626.753303:0:196399:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1786109626.753323:0:196399:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1786109626.754061:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:196391:x1872862933305472:12345-0@lo:253:mount.lustre.0 Request processed in 6534us (26518us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109626.754077:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786109626.754159:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933305472:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1786109626.754174:0:196391:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1786109626.754177:0:196391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786109626.754179:0:196391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786109626.754180:0:196391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109626.754182:0:196391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109626.754183:0:196391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109626.754184:0:196391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109626.754186:0:196391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786109626.754187:0:196391:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786109626.754189:0:196391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109626.754190:0:196391:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1786109626.754220:0:196391:0:(tgt_mount.c:101:server_register_mount()) register mount ffff930ab282d000 from lustre-MDT0000 10000000:01000000:3.0:1786109626.754251:0:196391:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1786109626.754254:0:196391:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1786109626.754265:0:196391:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff930ab282d000 10000000:01000000:3.0:1786109626.754270:0:196391:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1786109626.754275:0:196391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff930ab282d000 10000000:01000000:3.0:1786109626.754278:0:196391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1786109626.754282:0:196391:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff930ab282d000 from 1 10000000:01000000:3.0:1786109626.754284:0:196391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1786109626.754315:0:196391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.754329:0:196391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.754338:0:196391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109626.754366:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933305728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786109626.754397:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.754461:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f9c0 going to sleep for 11 seconds 20000000:01000000:2.0:1786109626.754630:0:196402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1786109626.754634:0:196402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786109626.754647:0:196402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca372fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.754660:0:196402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca372fc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786109626.754669:0:196402:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012037295s 00010000:00010000:2.0:1786109626.754673:0:196402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca372fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.754680:0:196402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca372fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.754687:0:196402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca372fc lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.754704:0:196402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca372fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.754711:0:196402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166d000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109626.754715:0:196402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca372fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.754721:0:196402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca372fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.754731:0:196402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca372fc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.754738:0:196402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca372fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.754744:0:196402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca372fc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109626.755027:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933305728 00000100:00100000:1.0:1786109626.755034:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933305728 00000100:00100000:1.0:1786109626.755066:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786109626.755074:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:196391:x1872862933305728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109626.755087:0:196398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109626.755099:0:196398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac1f38000/0xdb52b77d7ca37303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca372f5 expref: -99 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.755116:0:196398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac1f38000/0xdb52b77d7ca37303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca372f5 expref: 8 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.755126:0:196398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac1f38000/0xdb52b77d7ca37303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca372f5 expref: 8 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.755133:0:196398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f38000, rc 0) 00000100:00100000:0.0:1786109626.756730:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933305728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109626.756751:0:196391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109626.756761:0:196391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109626.756779:0:196391:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1786109626.756792:0:196391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109626.756800:0:196391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109626.756807:0:196391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1786109626.756811:0:196391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786109626.756817:0:196391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff930ab282d000 10000000:01000000:0.0:1786109626.756819:0:196391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1786109626.756822:0:196391:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1786109626.756825:0:196391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786109626.756850:0:196391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109626.756858:0:196391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109626.756866:0:196391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109626.757621:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:196391:x1872862933305728:12345-0@lo:101:mount.lustre.0 Request processed in 2543us (3219us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.757630:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1786109626.758454:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933305856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109626.758715:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109626.758761:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab91a3180 going to sleep for 11 seconds 00000100:00100000:1.0:1786109626.758970:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933305856 00000100:00100000:1.0:1786109626.758977:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933305856 00000100:00100000:1.0:1786109626.759028:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786109626.759038:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:196391:x1872862933305856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109626.759054:0:196397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109626.759071:0:196397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac1f39e00/0xdb52b77d7ca37311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3730a expref: -99 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.759096:0:196397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac1f39e00/0xdb52b77d7ca37311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3730a expref: 9 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.759106:0:196397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac1f39e00/0xdb52b77d7ca37311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3730a expref: 9 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.759114:0:196397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f39e00, rc 0) 00000100:00100000:1.0:1786109626.759163:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:196391:x1872862933305856:12345-0@lo:101:mount.lustre.0 Request processed in 126us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.759170:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786109626.761056:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933305856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786109626.761084:0:196391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.761096:0:196391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109626.761310:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933305984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109626.761372:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.761628:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109626.761790:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933305984 00000100:00100000:1.0:1786109626.761797:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933305984 00000100:00100000:1.0:1786109626.762036:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786109626.762047:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:196391:x1872862933305984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109626.762522:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196391:x1872862933305984:12345-0@lo:501:mount.lustre.0 Request processed in 475us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.762531:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786109626.762982:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933305984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109626.763024:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933306112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109626.763077:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.763327:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109626.763386:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933306112 00000100:00100000:1.0:1786109626.763391:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933306112 00000100:00100000:1.0:1786109626.763417:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786109626.763425:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196391:x1872862933306112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109626.765377:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196391:x1872862933306112:12345-0@lo:503:mount.lustre.0 Request processed in 1945us (2293us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.765393:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786109626.765682:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933306112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109626.768365:0:196405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196405:1872862933306240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109626.768466:0:196405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.768830:0:196405:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f180 going to sleep for 11 seconds 20000000:01000000:3.0:1786109626.769549:0:196404:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786109626.769564:0:196404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1786109626.770031:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:3648:x1872862933305088:12345-0@lo:253:kworker.0 Request processed in 39830us (42715us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109626.770042:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786109626.770075:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933306240 00000100:00100000:3.0:1786109626.770082:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933306240 00000100:00100000:1.0:1786109626.770371:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:3647:x1872862933305216:12345-0@lo:253:kworker.0 Request processed in 43830us (44109us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.770380:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786109626.770406:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786109626.770415:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:196405:x1872862933306240:12345-0@lo:502:llog_process_th.0 00000020:01000004:2.0:1786109626.770598:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1786109626.770601:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786109626.770603:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109626.770604:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109626.770605:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109626.770607:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109626.770608:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786109626.770611:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109626.770612:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1786109626.770616:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933305088:0@lo:253:kworker.0 20000000:01000000:2.0:1786109626.770642:0:196402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1786109626.770647:0:196402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786109626.770668:0:196402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca37318 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.770684:0:196402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca37318 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786109626.770694:0:196402:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012037295s 00010000:00010000:2.0:1786109626.770699:0:196402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca37318 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.770707:0:196402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca37318 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.770714:0:196402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca37318 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.770721:0:196402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca37318 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.770727:0:196402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166d000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109626.770731:0:196402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca37318 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.770739:0:196402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca37318 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.770752:0:196402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca37318 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.770760:0:196402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca37318 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.770767:0:196402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166d000/0xdb52b77d7ca37318 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786109626.771767:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1786109626.771772:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1786109626.771773:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109626.771774:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109626.771775:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109626.771777:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109626.771779:0:3647:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786109626.771780:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109626.771781:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1786109626.771785:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933305216:0@lo:253:kworker.0 00000100:00100000:1.0:1786109626.773832:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:196405:x1872862933306240:12345-0@lo:502:llog_process_th.0 Request processed in 3410us (5358us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.773845:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786109626.773977:0:196405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196405:1872862933306240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786109626.774012:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109626.774023:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109626.774027:0:196405:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1786109626.774032:0:196405:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1786109626.774036:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786109626.774051:0:196405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9309824819c0) 00000020:00000080:2.0:1786109626.774076:0:196405:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1786109626.774083:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1786109626.774173:0:196405:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1786109626.774180:0:196405:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca37326 00000020:00000080:2.0:1786109626.774420:0:196405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1786109626.774425:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109626.774447:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109626.774449:0:196405:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1786109626.774453:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109626.774457:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109626.774458:0:196405:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1786109626.774462:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786109626.774469:0:196405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff930ac11b0000) 00000020:00000080:2.0:1786109626.774492:0:196405:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1786109626.774498:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1786109626.774500:0:196405:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1786109626.774503:0:196405:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1786109626.774509:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1786109626.774565:0:196405:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930ab282d000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1786109626.774589:0:196405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9309835d0000) 00000020:00000080:2.0:1786109626.774600:0:196405:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1786109626.774657:0:196405:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1786109626.774664:0:196405:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca3733b 00000020:00000080:2.0:1786109626.774764:0:196405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1786109626.774771:0:196405:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1786109626.774776:0:196405:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdb52b77d7ca37342 00080000:01000000:2.0:1786109626.774781:0:196405:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1786109626.774785:0:196405:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca37349 00010000:00010000:2.0:1786109626.852182:0:196405:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1786109626.852396:0:196405:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: fac74500-4523-4794-af20-dfdcdfae19c1 idx: 0 lr: 0 srv lr: 339302416384 lx: 0 gen 24 00000001:00080000:2.0:1786109626.852458:0:196405:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 326417514497 srv lr: 339302416384 lx: 0 gen 23 00000001:00000004:2.0:1786109626.852496:0:196405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 80, last_transno is 339302416384 00000001:00080000:2.0:1786109626.852785:0:196405:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1786109626.852840:0:196405:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930a97cf1180: xid 1872862932692352, transno 326417514497, client gen 23, slot idx 0 00000001:00080000:2.0:1786109626.852852:0:196405:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930a90577e40: xid 1872862922108544, transno 339302416389, client gen 24, slot idx 1 00000001:00080000:2.0:1786109626.852859:0:196405:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ab9689600: xid 1872862922109952, transno 339302416390, client gen 24, slot idx 2 00000001:00080000:2.0:1786109626.852864:0:196405:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ab9689840: xid 1872862933289216, transno 339302416391, client gen 23, slot idx 3 00000001:00080000:2.0:1786109626.852868:0:196405:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ab9689180: xid 1872862932692096, transno 322122568361, client gen 23, slot idx 4 00000001:00080000:2.0:1786109626.852873:0:196405:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ab9689300: xid 1872862932691584, transno 322122568360, client gen 23, slot idx 5 00000020:00000080:2.0:1786109626.853629:0:196405:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9309835d3380) 00000020:00000080:2.0:1786109626.853651:0:196405:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1786109626.853853:0:196405:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1786109626.853861:0:196405:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca37365 00000020:00000080:2.0:1786109626.854519:0:196405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1786109626.858136:0:196405:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdb52b77d7ca3736c 00000020:00000080:0.0:1786109626.860808:0:196405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1786109626.860821:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109626.860828:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.860830:0:196405:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1786109626.860834:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1786109626.860837:0:196405:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1786109626.860839:0:196405:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786109626.860840:0:196405:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786109626.860842:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1786109626.860844:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.860846:0:196405:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1786109626.860848:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786109626.860853:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.860855:0:196405:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1786109626.860860:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1786109626.860991:0:196405:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1786109626.861014:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109626.861018:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.861020:0:196405:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1786109626.861023:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786109626.861027:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.861029:0:196405:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1786109626.861032:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1786109626.861037:0:196405:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:0.0:1786109626.861064:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786109626.861080:0:196405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff930a97cbcd40) 00000020:00000080:0.0:1786109626.861101:0:196405:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1786109626.861107:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1786109626.861162:0:196405:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1786109626.861168:0:196405:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1786109626.861174:0:196405:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca3737a 00010000:00080000:0.0:1786109626.861275:0:196405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930985f23800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1786109626.863089:0:196405:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1786109626.873342:0:196405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109626.873370:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1786109626.873415:0:196405:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1786109626.873721:0:196405:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca37381 00000100:00080000:0.0:1786109626.873733:0:196405:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786109626.873739:0:196405:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930985f23800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109626.873776:0:196405:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1f52a00 x1872862933306368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109626.873960:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933306368:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786109626.874030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.874123:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933306368 00000100:00100000:3.0:1786109626.874130:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933306368 00000100:00100000:3.0:1786109626.874168:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12400 00000100:00100000:3.0:1786109626.874176:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933306368:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1786109626.874199:0:177399:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8483 last 0 00000020:00000080:3.0:1786109626.874307:0:177399:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca37388 00000004:00100000:3.0:1786109626.874323:0:177399:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1786109626.874448:0:177399:0:(import.c:65:import_set_state_nolock()) ffff930aa0713000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1786109626.874598:0:196405:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1786109626.874945:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109626.874952:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.874954:0:196405:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1786109626.874959:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1786109626.874962:0:196405:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1786109626.874964:0:196405:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786109626.874965:0:196405:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786109626.874968:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1786109626.874970:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.874972:0:196405:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1786109626.874975:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786109626.874980:0:196405:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1786109626.874984:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.874985:0:196405:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1786109626.874988:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1786109626.874992:0:196405:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:0.0:1786109626.875015:0:196405:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1786109626.875019:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786109626.875033:0:196405:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff930a97cb99c0) 00000020:00000080:0.0:1786109626.875052:0:196405:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1786109626.875058:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1786109626.875125:0:196405:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1786109626.875131:0:196405:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:0.0:1786109626.875137:0:196405:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca37396 00010000:00080000:0.0:1786109626.875165:0:196405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930a8a715800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1786109626.875384:0:196405:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:0.0:1786109626.876474:0:196405:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1786109626.876679:0:196405:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1786109626.877127:0:196405:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 78, last_idx 79 00000040:00080000:0.0:1786109626.878137:0:196405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786109626.878168:0:196405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].80, 64 off13312 00000040:00080000:0.0:1786109626.878409:0:196405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x140:0x0].1, 64 off8256 00000020:00000080:0.0:1786109626.881377:0:196405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109626.881392:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1786109626.881452:0:196405:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1786109626.881485:0:196405:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca3739d 00000100:00080000:0.0:1786109626.881496:0:196405:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786109626.881501:0:196405:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff930a8a715800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109626.881537:0:196405:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7c57480 x1872862933306496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109626.881554:0:196405:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1786109626.881889:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109626.881894:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.881896:0:196405:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1786109626.881899:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1786109626.881902:0:196405:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1786109626.881904:0:196405:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786109626.881906:0:196405:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1786109626.881907:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1786109626.881910:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.881912:0:196405:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1786109626.881914:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786109626.881919:0:196405:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1786109626.881922:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.881923:0:196405:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1786109626.881926:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1786109626.881930:0:196405:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:0.0:1786109626.881956:0:196405:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1786109626.881960:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786109626.881971:0:196405:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff930a97cbb380) 00000020:00000080:0.0:1786109626.881987:0:196405:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type osp with refcount 2 00000020:00000080:0.0:1786109626.881991:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1786109626.882049:0:196405:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1786109626.882055:0:196405:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:0.0:1786109626.882061:0:196405:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca373ab 00010000:00080000:0.0:1786109626.882089:0:196405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930a8a711000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.138@tcp at head 00000040:00080000:1.0:1786109626.882408:0:196411:0:(llog.c:805:llog_process_thread()) index: 79, lh_last_idx: 80 synced_idx: 0 lgh_last_idx: 80 00000040:00080000:1.0:1786109626.882413:0:196411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13c:0x0] at index 79 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1786109626.882816:0:196411:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 79, last_idx 80 00000040:00080000:1.0:1786109626.882842:0:196411:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x13c:0x0] at index 79 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1786109626.883038:0:196411:0:(llog.c:805:llog_process_thread()) index: 80, lh_last_idx: 80 synced_idx: 80 lgh_last_idx: 80 00000040:00080000:1.0:1786109626.883042:0:196411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x140:0x0] at index 80 of catalog [0x1:0x2:0x0] 00010000:00010000:0.0:1786109626.883188:0:196405:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:3.0:1786109626.883367:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933306368:12345-0@lo:38:llog_process_th.0 Request processed in 9187us (9333us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109626.883380:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12400 00000040:01000000:0.0:1786109626.883811:0:196405:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1786109626.883826:0:196405:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1786109626.884170:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786109626.884181:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 6 00000100:00080000:2.0:1786109626.884187:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1786109626.884193:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1786109626.884196:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1786109626.884315:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933306368:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786109626.884353:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933306496:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1786109626.884411:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1786109626.885108:0:196405:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 78, last_idx 79 00000040:00080000:0.0:1786109626.885843:0:196405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786109626.885873:0:196405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].80, 64 off13312 00000040:00080000:0.0:1786109626.886081:0:196405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x142:0x0].1, 64 off8256 00000100:00100000:3.0:1786109626.886591:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933306496 00000100:00100000:3.0:1786109626.886601:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933306496 00000100:00100000:3.0:1786109626.886643:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23127 00000100:00100000:3.0:1786109626.886651:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1872862933306496:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1786109626.886683:0:9990:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8483 last 0 00000020:00000080:3.0:1786109626.886748:0:9990:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca373b2 00002000:00100000:3.0:1786109626.886763:0:9990:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff930ac09cf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1786109626.886768:0:9990:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1786109626.886771:0:9990:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1786109626.887314:0:9990:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1786109626.887340:0:9990:0:(import.c:65:import_set_state_nolock()) ffff930ac09cd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786109626.887794:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933306496:12345-0@lo:8:llog_process_th.0 Request processed in 1141us (3380us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109626.887804:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23127 00000040:00080000:0.0:1786109626.888999:0:196413:0:(llog.c:805:llog_process_thread()) index: 79, lh_last_idx: 80 synced_idx: 0 lgh_last_idx: 80 00000040:00080000:0.0:1786109626.889007:0:196413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x13e:0x0] at index 79 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1786109626.889176:0:196413:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 79, last_idx 80 00000040:00080000:0.0:1786109626.889203:0:196413:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x13e:0x0] at index 79 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1786109626.889462:0:196413:0:(llog.c:805:llog_process_thread()) index: 80, lh_last_idx: 80 synced_idx: 80 lgh_last_idx: 80 00000040:00080000:0.0:1786109626.889466:0:196413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x142:0x0] at index 80 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1786109626.889981:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933306624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109626.890054:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1786109626.890417:0:196405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109626.890690:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1786109626.890803:0:196405:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1786109626.890825:0:196405:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca373b9 00000100:00080000:0.0:1786109626.890834:0:196405:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786109626.890839:0:196405:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff930a8a711000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109626.890864:0:196405:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7c54e00 x1872862933306752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109626.890998:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933306624 00000100:00100000:1.0:1786109626.891005:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933306624 00000100:00100000:1.0:1786109626.891051:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12401 00000100:00100000:1.0:1786109626.891061:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933306624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109626.891093:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00000100:00100000:1.0:1786109626.891151:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933306624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.891158:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12401 00000100:00080000:0.0:1786109626.891273:0:196405:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1786109626.891337:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109626.891342:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.891354:0:196405:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1786109626.891358:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786109626.891363:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.891364:0:196405:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786109626.891367:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786109626.891369:0:196405:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1786109626.891373:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109626.891375:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.891376:0:196405:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1786109626.891379:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786109626.891381:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109626.891382:0:196405:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1786109626.891386:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1786109626.891414:0:196405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196405:1872862933306880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109626.891501:0:196405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109626.891531:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933306880 00000100:00100000:0.0:1786109626.891535:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933306880 00000100:00100000:0.0:1786109626.891560:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786109626.891771:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933306624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109626.892094:0:196405:0:(client.c:2702:ptlrpc_set_wait()) set ffff930986044d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109626.892287:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:196405:x1872862933306880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109626.892988:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:196405:x1872862933306880:12345-0@lo:502:llog_process_th.0 Request processed in 1418us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109626.892998:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786109626.893319:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786109626.893329:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 9 00000100:00080000:2.0:1786109626.893338:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1786109626.893353:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1786109626.893357:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a715800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1786109626.893384:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1786109626.893553:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933306496:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1786109626.893611:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933306752:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1786109626.893659:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109626.893706:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933306752 00000100:00100000:2.0:1786109626.893712:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933306752 00000100:00100000:2.0:1786109626.893741:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23128 00000100:00100000:2.0:1786109626.893748:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3645:x1872862933306752:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1786109626.893776:0:151898:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8483 last 0 00000020:00000080:2.0:1786109626.893802:0:151898:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca373c0 00002000:00100000:2.0:1786109626.893815:0:151898:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff930ab199f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1786109626.893820:0:151898:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1786109626.893823:0:151898:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1786109626.894071:0:151898:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786109626.894099:0:151898:0:(import.c:65:import_set_state_nolock()) ffff930a905fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109626.894142:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933306752:12345-0@lo:8:llog_process_th.0 Request processed in 392us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109626.894148:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23128 00000100:00100000:2.0:1786109626.894200:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786109626.894218:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1786109626.894223:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1786109626.894226:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1786109626.894229:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a711000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1786109626.894238:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1786109626.894242:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933306752:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1786109626.894587:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109626.894598:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933307008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109626.894635:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109626.894668:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933307008 00000100:00100000:0.0:1786109626.894673:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933307008 00000100:00100000:0.0:1786109626.894830:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5865 00000100:00100000:0.0:1786109626.894839:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933307008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109626.894862:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109626.894976:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933307008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109626.894983:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5865 00000100:00080000:0.0:1786109626.895001:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109626.895031:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933307008:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1786109626.895053:0:196413:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1786109626.895113:0:196413:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8483561681690ns, next at 0ns, rc = 0 00080000:00080000:0.0:1786109626.895119:0:196413:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1786109626.895277:0:196411:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1786109626.895312:0:196411:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8483561880551ns, next at 0ns, rc = 0 00080000:00080000:3.0:1786109626.895317:0:196411:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1786109626.895382:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933307136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109626.895415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.895490:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933307136 00000100:00100000:3.0:1786109626.895495:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933307136 00000100:00100000:3.0:1786109626.895529:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5866 00000100:00100000:3.0:1786109626.895536:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933307136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109626.895554:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142656 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109626.895602:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933307136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109626.895609:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5866 00000100:00100000:3.0:1786109626.895644:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933307136:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786109626.895907:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1786109626.898175:0:196392:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1786109626.898201:0:196392:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1786109626.898812:0:196405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196405:1872862933306880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786109626.898859:0:196405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109626.898868:0:196405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109626.898870:0:196405:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1786109626.898951:0:196405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1786109626.899138:0:196391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1786109626.899159:0:196391:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1786109626.899181:0:196391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.899192:0:196391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.899201:0:196391:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930ab282d000 from 1 10000000:01000000:3.0:1786109626.899204:0:196391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786109626.899251:0:196391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.899259:0:196391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.899269:0:196391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109626.899289:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933307264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786109626.899359:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.899405:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109626.899839:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933307264 00000100:00100000:0.0:1786109626.899846:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933307264 00000100:00100000:0.0:1786109626.900006:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786109626.900018:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:196391:x1872862933307264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109626.900032:0:196397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109626.900047:0:196397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca373ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca373c7 expref: -99 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109626.900070:0:196397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca373ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca373c7 expref: 9 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109626.900082:0:196397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca373ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca373c7 expref: 9 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109626.900090:0:196397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3600, rc 0) 00000100:00100000:0.0:1786109626.900142:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:196391:x1872862933307264:12345-0@lo:101:mount.lustre.0 Request processed in 126us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109626.900149:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786109626.900274:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933307264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786109626.900288:0:196391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca373ce expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.900297:0:196391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca373ce expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109626.901091:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933307392:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1786109626.901139:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.901656:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109626.901815:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933307392 00000100:00100000:1.0:1786109626.901823:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933307392 00000100:00100000:1.0:1786109626.901861:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786109626.901870:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:196391:x1872862933307392:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1786109626.901965:0:196399:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1786109626.901985:0:196399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1786109626.901990:0:196399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1786109626.901993:0:196399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1786109626.901995:0:196399:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 332 00000100:00100000:1.0:1786109626.902092:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:196391:x1872862933307392:12345-0@lo:256:mount.lustre.0 Request processed in 222us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.902101:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786109626.902157:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933307392:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1786109626.903167:0:196391:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786109626.903185:0:196391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca373ce expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.903202:0:196391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca373ce expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109626.903668:0:196391:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930ab282d000 from 1 10000000:01000000:1.0:1786109626.903671:0:196391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786109626.903855:0:196391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.903864:0:196391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.903940:0:196391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109626.903963:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933307520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109626.904013:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.904060:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab2e9b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109626.904112:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933307520 00000100:00100000:2.0:1786109626.904118:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933307520 00000100:00100000:2.0:1786109626.904164:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786109626.904175:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:196391:x1872862933307520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109626.904187:0:196399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109626.904199:0:196399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930a8166c000/0xdb52b77d7ca373dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca373d5 expref: -99 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.904231:0:196399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a8166c000/0xdb52b77d7ca373dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca373d5 expref: 10 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.904242:0:196399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930a8166c000/0xdb52b77d7ca373dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca373d5 expref: 10 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.904251:0:196399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a8166c000, rc 0) 00000100:00100000:2.0:1786109626.904298:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196391:x1872862933307520:12345-0@lo:101:mount.lustre.0 Request processed in 125us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109626.904304:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786109626.904516:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933307520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109626.904528:0:196391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.904537:0:196391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109626.904603:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933307648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109626.904628:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.904653:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab2e9b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109626.904862:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933307648 00000100:00100000:2.0:1786109626.904866:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933307648 00000100:00100000:2.0:1786109626.904970:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786109626.904979:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196391:x1872862933307648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109626.905095:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196391:x1872862933307648:12345-0@lo:501:mount.lustre.0 Request processed in 116us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109626.905102:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786109626.905204:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933307648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109626.905298:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933307776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109626.905353:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.905386:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab2e9b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109626.905463:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933307776 00000100:00100000:2.0:1786109626.905467:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933307776 00000100:00100000:2.0:1786109626.905652:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786109626.905660:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196391:x1872862933307776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109626.905859:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196391:x1872862933307776:12345-0@lo:503:mount.lustre.0 Request processed in 200us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109626.905867:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786109626.906035:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933307776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109626.906459:0:196415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196415:1872862933307904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109626.906511:0:196415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.906545:0:196415:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97916180 going to sleep for 11 seconds 00000100:00100000:2.0:1786109626.906723:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933307904 00000100:00100000:2.0:1786109626.906728:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933307904 00000100:00100000:2.0:1786109626.906762:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786109626.906770:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196415:x1872862933307904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786109626.907423:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196415:x1872862933307904:12345-0@lo:502:llog_process_th.0 Request processed in 652us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109626.907451:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786109626.907612:0:196415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196415:1872862933307904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786109626.907640:0:196415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109626.907649:0:196415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109626.907652:0:196415:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1786109626.907660:0:196415:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff930ab282d000 00000020:00000080:3.0:1786109626.907663:0:196415:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1786109626.907671:0:196415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109626.907674:0:196415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109626.907675:0:196415:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1786109626.907678:0:196415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109626.907680:0:196415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109626.907681:0:196415:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1786109626.907685:0:196415:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff930ab282d000 00000020:00000080:3.0:1786109626.907687:0:196415:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1786109626.907894:0:196415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196415:1872862933308032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109626.907938:0:196415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.907972:0:196415:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97916180 going to sleep for 11 seconds 00000100:00100000:1.0:1786109626.908114:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933308032 00000100:00100000:1.0:1786109626.908120:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933308032 00000100:00100000:1.0:1786109626.908152:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786109626.908161:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196415:x1872862933308032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109626.908266:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196415:x1872862933308032:12345-0@lo:502:llog_process_th.0 Request processed in 104us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.908273:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786109626.908313:0:196415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196415:1872862933308032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786109626.908334:0:196415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109626.908339:0:196415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109626.908340:0:196415:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1786109626.908355:0:196415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1786109626.908420:0:196391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1786109626.908458:0:196391:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786109626.908488:0:196391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.908500:0:196391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109626.908551:0:196391:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1786109626.908555:0:196391:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff930ab282d000 10000000:01000000:1.0:1786109626.908558:0:196391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff930ab282d000 10000000:01000000:1.0:1786109626.908562:0:196391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786109626.908812:0:196391:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930ab282d000 from 1 10000000:01000000:1.0:1786109626.908816:0:196391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786109626.908842:0:196391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.908850:0:196391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.908860:0:196391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109626.908946:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933308160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109626.908982:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.908999:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109626.909133:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933308160 00000100:00100000:3.0:1786109626.909138:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933308160 00000100:00100000:3.0:1786109626.909169:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786109626.909177:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:196391:x1872862933308160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786109626.909187:0:196404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109626.909200:0:196404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6ca00/0xdb52b77d7ca373ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca373e3 expref: -99 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.909293:0:196404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6ca00/0xdb52b77d7ca373ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca373e3 expref: 11 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.909304:0:196404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6ca00/0xdb52b77d7ca373ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca373e3 expref: 11 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.909313:0:196404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6ca00, rc 0) 00000100:00100000:3.0:1786109626.909361:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196391:x1872862933308160:12345-0@lo:101:mount.lustre.0 Request processed in 185us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109626.909368:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786109626.911815:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933308160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109626.911840:0:196391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109626.911852:0:196391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109626.912008:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933308288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109626.912063:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.912107:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109626.912178:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933308288 00000100:00100000:3.0:1786109626.912185:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933308288 00000100:00100000:3.0:1786109626.912298:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786109626.912309:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196391:x1872862933308288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109626.912486:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196391:x1872862933308288:12345-0@lo:501:mount.lustre.0 Request processed in 169us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109626.912494:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786109626.912773:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933308288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109626.912805:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933308416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109626.912848:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.912870:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109626.913029:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933308416 00000100:00100000:3.0:1786109626.913033:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933308416 00000100:00100000:3.0:1786109626.913062:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786109626.913069:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196391:x1872862933308416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109626.913146:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196391:x1872862933308416:12345-0@lo:503:mount.lustre.0 Request processed in 77us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109626.913154:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786109626.913781:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933308416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109626.922830:0:196417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196417:1872862933308544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109626.923152:0:196417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109626.923305:0:196417:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a88d87300 going to sleep for 11 seconds 00000100:00100000:3.0:1786109626.923358:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933308544 00000100:00100000:3.0:1786109626.923366:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933308544 00000100:00100000:3.0:1786109626.923413:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786109626.923423:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196417:x1872862933308544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109626.924138:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196417:x1872862933308544:12345-0@lo:502:llog_process_th.0 Request processed in 714us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109626.924147:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786109626.924294:0:196417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196417:1872862933308544:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1786109626.924378:0:196417:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1786109626.924393:0:196417:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff930a97cb8000) 00000020:00000080:0.0:1786109626.924418:0:196417:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1786109626.924989:0:196417:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930ab282d000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1786109626.924994:0:196417:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930ab282d000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1786109626.924996:0:196417:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab282d000 4 00010000:00080000:0.0:1786109626.925027:0:196417:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930ab2ab9000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1786109626.928655:0:196417:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1786109626.929026:0:196417:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1786109626.929074:0:196417:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786109626.929087:0:196417:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdb52b77d7ca373f8 00000100:00080000:0.0:1786109626.929098:0:196417:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786109626.929103:0:196417:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff930ab2ab9000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109626.929137:0:196417:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7c54700 x1872862933308672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109626.929163:0:196417:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1786109626.931381:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933308672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786109626.932009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.937023:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933308672 00000100:00100000:1.0:1786109626.937038:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933308672 00000100:00100000:1.0:1786109626.937089:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1786109626.937098:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933308672:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786109626.939805:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786109626.939818:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab2ab9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109626.939825:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1786109626.939829:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933308672:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1786109626.940293:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933308672:12345-0@lo:38:llog_process_th.0 Request processed in 3192us (8282us total) trans 0 rc -11/-11 00000100:00100000:1.0:1786109626.940305:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1786109626.950337:0:196417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196417:1872862933308800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109626.950445:0:196417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.950551:0:196417:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a88d87300 going to sleep for 11 seconds 00000100:00100000:1.0:1786109626.950584:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933308800 00000100:00100000:1.0:1786109626.950659:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933308800 00000100:00100000:1.0:1786109626.950713:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786109626.950722:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196417:x1872862933308800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109626.950830:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196417:x1872862933308800:12345-0@lo:502:llog_process_th.0 Request processed in 109us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109626.950838:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786109626.951001:0:196417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196417:1872862933308800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109626.951038:0:196417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196417:1872862933308928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109626.951066:0:196417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109626.951087:0:196417:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109626.952177:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933308928 00000100:00100000:0.0:1786109626.952186:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933308928 00000100:00100000:0.0:1786109626.952326:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1786109626.952336:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196417:x1872862933308928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109626.952512:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196417:x1872862933308928:12345-0@lo:502:llog_process_th.0 Request processed in 176us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109626.952520:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786109626.952662:0:196417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196417:1872862933308928:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1786109626.952688:0:196417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1786109626.953081:0:196391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1786109626.953106:0:196391:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786109626.953127:0:196391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.953138:0:196391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1786109626.953194:0:196391:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1786109626.953196:0:196391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109626.953198:0:196391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109626.953199:0:196391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109626.953200:0:196391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109626.953201:0:196391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109626.953203:0:196391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109626.953204:0:196391:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109626.953310:0:196391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109626.953312:0:196391:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786109626.953316:0:196391:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1786109626.953319:0:196391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786109626.953320:0:196391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109626.953321:0:196391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109626.953322:0:196391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109626.953324:0:196391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109626.953325:0:196391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109626.953326:0:196391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109626.953327:0:196391:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109626.953328:0:196391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109626.953329:0:196391:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786109626.953359:0:196391:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1786109626.953375:0:196391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933309056:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786109626.953460:0:196391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109626.953932:0:196391:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a7d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109626.954117:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933309056 00000100:00100000:3.0:1786109626.954125:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933309056 00000100:00100000:3.0:1786109626.954172:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786109626.954182:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196391:x1872862933309056:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1786109626.954413:0:196398:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1786109626.954534:0:196398:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1786109626.962860:0:196398:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786109626.963022:0:196398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1786109626.963280:0:196402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1786109626.963285:0:196402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786109626.963306:0:196402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.963324:0:196402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca373ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca373c7 expref: 11 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.963333:0:196402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.963384:0:196402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca373ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca373c7 expref: 11 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.963400:0:196402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca373ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb52b77d7ca373c7 expref: 11 pid: 196397 timeout: 8583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109626.963415:0:196402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196402:1872862933309184:0@lo:104: 00000100:00100000:2.0:1786109626.963512:0:196402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.963852:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933309184 00000100:00100000:3.0:1786109626.963860:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933309184 00000100:00100000:3.0:1786109626.963980:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5265 00000100:00100000:3.0:1786109626.963992:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:196402:x1872862933309184:12345-0@lo:104: 00010000:00010000:3.0:1786109626.964006:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca373ce expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964059:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786109626.964066:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:196402:x1872862933309184:12345-0@lo:104: Request processed in 77us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109626.964073:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5265 00010000:00010000:3.0:1786109626.964098:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109626.964104:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca373ce expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964117:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c200 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109626.964120:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb52b77d7ca373ce expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964129:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca373ce expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109626.964136:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca373ce expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109626.964142:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109626.964173:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca373ce expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964180:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109626.964197:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca373ce expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964205:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c200/0xdb52b77d7ca373c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca373ce expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964294:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109626.964296:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109626.964298:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109626.964312:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933309312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109626.964358:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109626.964404:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933309312 00000100:00100000:3.0:1786109626.964408:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933309312 00010000:00010000:3.0:1786109626.964424:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca373ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca373c7 expref: 12 pid: 196397 timeout: 8583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109626.964465:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12645 00000100:00100000:3.0:1786109626.964472:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a90736850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:3647:x1872862933309312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109626.964554:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109626.964560:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca373ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca373c7 expref: 12 pid: 196397 timeout: 8583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964580:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca373ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb52b77d7ca373c7 expref: 12 pid: 196397 timeout: 8583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964607:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964615:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1786109626.964629:0:6512:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012037295s 00010000:00010000:3.0:1786109626.964633:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964640:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964647:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964653:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964659:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166d600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109626.964664:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964671:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964679:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109626.964689:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109626.964911:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a90736850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:3647:x1872862933309312:12345-0@lo:103:ldlm_bl.0 Request processed in 438us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109626.964919:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12645 00000100:00100000:3.0:1786109626.964990:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933309312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109626.965052:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:196391:x1872862933309056:12345-0@lo:253:mount.lustre.0 Request processed in 10871us (11590us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109626.965061:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786109626.965185:0:196402:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a7d4f00 going to sleep for 11 seconds 00010000:00010000:2.0:1786109626.965212:0:196402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca373ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca373c7 expref: 10 pid: 196397 timeout: 8583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109626.965226:0:196402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196402:1872862933309184:0@lo:104: 00010000:00010000:2.0:1786109626.965240:0:196402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.965248:0:196402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.965255:0:196402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109626.965261:0:196402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca373ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109626.965297:0:196391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:196391:1872862933309056:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1786109626.965307:0:196391:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1786109626.965310:0:196391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786109626.965312:0:196391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109626.965313:0:196391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109626.965315:0:196391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109626.965316:0:196391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109626.965317:0:196391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109626.965319:0:196391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109626.965320:0:196391:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109626.965322:0:196391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109626.965323:0:196391:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1786109626.965337:0:196391:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1786109626.995780:0:196391:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 322122568692 00000040:01000000:0.0:1786109626.997005:0:196391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1786109626.998077:0:196424:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1786109627.004459:0:196391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:3.0:1786109627.006464:0:196423:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 322122568692 00000020:00080000:3.0:1786109627.006473:0:196423:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 322122568692 00000100:00100000:0.0:1786109627.007453:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109627.007501:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922117248 00000100:00100000:0.0:1786109627.007521:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922117248 00000100:00100000:0.0:1786109627.009771:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:0.0:1786109627.009791:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922117248:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109627.009812:0:196404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109627.009834:0:196404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c2e00/0xdb52b77d7ca37406 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1674 expref: -99 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109627.009865:0:196404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c2e00/0xdb52b77d7ca37406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1674 expref: 10 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109627.009888:0:196404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c2e00/0xdb52b77d7ca37406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1674 expref: 10 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109627.009898:0:196404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2e00, rc 0) 00000100:00100000:0.0:1786109627.009958:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922117248:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 175us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109627.009966:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:1.0:1786109627.011384:0:196425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196425:1872862933309440:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109627.011471:0:196425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109627.011735:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933309440 00000100:00100000:1.0:1786109627.011742:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933309440 00000100:00100000:1.0:1786109627.011789:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12402 00000100:00100000:1.0:1786109627.011798:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196425:x1872862933309440:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109627.011886:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196425:x1872862933309440:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 78us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109627.011894:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12402 00000100:00100000:1.0:1786109627.011920:0:196425:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a59eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109627.011946:0:196425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196425:1872862933309440:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1786109627.011977:0:196425:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1786109627.012006:0:196425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196425:1872862933309568:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109627.012037:0:196425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109627.012058:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933309568 00000100:00100000:1.0:1786109627.012061:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933309568 00000100:00100000:1.0:1786109627.012670:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12403 00000100:00100000:1.0:1786109627.012680:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196425:x1872862933309568:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109627.012858:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196425:x1872862933309568:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 180us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109627.012866:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12403 00000100:00100000:1.0:1786109627.012957:0:196425:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a59ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109627.012976:0:196425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196425:1872862933309568:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109627.013042:0:196425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196425:1872862933309696:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109627.013069:0:196425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109627.013171:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933309696 00000100:00100000:1.0:1786109627.013176:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933309696 00000100:00100000:1.0:1786109627.013203:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12404 00000100:00100000:1.0:1786109627.013284:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196425:x1872862933309696:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109627.013339:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196425:x1872862933309696:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 58us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109627.013357:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12404 00000100:00100000:1.0:1786109627.013377:0:196425:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a59ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109627.013391:0:196425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196425:1872862933309696:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109627.013486:0:196425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196425:1872862933309824:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109627.013742:0:196425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109627.013766:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933309824 00000100:00100000:1.0:1786109627.013770:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933309824 00000100:00100000:1.0:1786109627.013795:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12405 00000100:00100000:1.0:1786109627.013802:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196425:x1872862933309824:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1786109627.014322:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:196425:x1872862933309824:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 519us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109627.014329:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12405 00000100:00100000:1.0:1786109627.014364:0:196425:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a59e300 going to sleep for 11 seconds 00000100:00100000:1.0:1786109627.014380:0:196425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:196425:1872862933309824:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1786109627.019007:0:196425:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1786109627.019292:0:196425:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1786109627.027281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109627.028041:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922117376 00000100:00100000:3.0:1786109627.028051:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922117376 00000100:00100000:3.0:1786109627.028931:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:3.0:1786109627.028949:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922117376:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1786109627.028978:0:196399:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1786109627.029002:0:196399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786109627.029007:0:196399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1786109627.029010:0:196399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1786109627.029013:0:196399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1786109627.029017:0:196399:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 333 00000040:01000000:2.0:1786109627.046537:0:196391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1786109627.046594:0:196391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1786109627.047413:0:196391:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1786109627.047426:0:196391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1786109627.047546:0:196391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109627.057330:0:196391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1786109627.062385:0:196391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1786109627.062501:0:196391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1786109627.064008:0:196391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1786109627.070462:0:196391:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x83:0x0] (8/32) registered 00010000:00080000:3.0:1786109627.078803:0:196391:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 339302416391 00010000:00080000:3.0:1786109627.080110:0:196426:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 196426 00010000:02000000:3.0:1786109627.080283:0:196426:0:(ldlm_lib.c:2336:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:1.0:1786109627.080721:0:196391:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1786109627.080739:0:196391:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1786109627.080763:0:196391:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1786109627.080796:0:196391:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1786109627.085667:0:196391:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1786109627.087424:0:196391:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:3.0:1786109627.107179:0:196426:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1786109627.107188:0:196426:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1786109627.287019:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933309952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109627.287113:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109627.287852:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933309952 00000100:00100000:0.0:1786109627.287860:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933309952 00000100:00100000:0.0:1786109627.287988:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5867 00000100:00100000:0.0:1786109627.287998:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933309952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109627.288024:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 142656 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109627.295676:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933309952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7671us (8554us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109627.295689:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5867 00000100:00100000:0.0:1786109627.295724:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:3.0:1786109627.296288:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933309952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109627.298663:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922117376:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 Request processed in 269712us (272227us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109627.298676:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000040:00080000:1.0:1786109627.300800:0:196424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1786109627.300959:0:196424:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1786109627.300965:0:196424:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1786109627.301470:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1786109627.328023:0:196426:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1786109627.328101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109627.329196:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922117504 00000100:00100000:3.0:1786109627.329208:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922117504 00000100:00100000:3.0:1786109627.329248:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1077 00000100:00100000:3.0:1786109627.329258:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1872862922117504:12345-192.168.203.38@tcp:38:ll_cfg_requeue.0 00010000:00080000:3.0:1786109627.329290:0:196401:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'fac74500-4523-4794-af20-dfdcdfae19c1' at ffff930a90aa2800, cookie 0xdb52b77d7ca37350 00010000:00080000:3.0:1786109627.329296:0:196401:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp recovering/t339302416390 exp ffff930a90aa2800 cur 8483 last 1786109626 00010000:02000400:3.0:1786109627.329305:0:196401:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1786109627.352745:0:196401:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 69 seconds 00000004:00100000:3.0:1786109627.358675:0:196401:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1786109627.358826:0:196401:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786109627.359402:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922117504:12345-192.168.203.38@tcp:38:ll_cfg_requeue.0 Request processed in 30141us (31301us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109627.359415:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1077 00000100:00100000:1.0:1786109627.369332:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109627.369389:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922109952 00000100:00100000:1.0:1786109627.369398:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922109952 00000100:00100000:1.0:1786109627.369467:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1078 00000100:00100000:1.0:1786109627.369479:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922109952:12345-192.168.203.38@tcp:101:lfs.0 00010000:00080000:1.0:1786109627.369498:0:189813:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 339302416392, current: 339302416390, replaying 00010000:00010000:1.0:1786109627.369508:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109627.369531:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3740d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1643 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109627.373316:0:189813:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3734us 00000004:00200000:1.0:1786109627.442548:0:189813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x2:0x0]: returning size 4096 00000004:00080000:1.0:1786109627.443027:0:189813:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x200026d31:0x2:0x0], cookie = 0xdb52b77d7ca37231 00000004:00080000:1.0:1786109627.443032:0:189813:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xdb52b77d7ca37231 in new mfd 00010000:00010000:1.0:1786109627.443237:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3740d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1643 expref: 8 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109627.443255:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab9367e00) 00010000:00010000:1.0:1786109627.443259:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786109627.443264:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3740d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1643 expref: 8 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109627.443284:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f38c00, rc 0) 00000100:00100000:1.0:1786109627.443361:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+7:2401:x1872862922109952:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 73884us (74039us total) trans 339302416390 rc 301/301 00000100:00100000:1.0:1786109627.443371:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1078 00000100:00100000:3.0:1786109627.463249:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109627.463303:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922111232 00000100:00100000:3.0:1786109627.463312:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922111232 00000100:00100000:3.0:1786109627.463368:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1079 00000100:00100000:3.0:1786109627.463379:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+7:2401:x1872862922111232:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00080000:3.0:1786109627.463400:0:188678:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 339302416392, current: 339302416392, replaying 00000100:00100000:3.0:1786109627.463412:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+7:2401:x1872862922111232:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 36us (174us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109627.463418:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1079 00010000:00080000:3.0:1786109627.463460:0:196426:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:3.0:1786109628.100543:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786109628.100552:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930ab282d000 from 333 10000000:01000000:3.0:1786109628.100557:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786109628.100599:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.100610:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.100622:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109628.100646:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.100706:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.100800:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109628.103737:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933310080 00000100:00100000:1.0:1786109628.103751:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933310080 00000100:00100000:1.0:1786109628.103859:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786109628.103869:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:6524:x1872862933310080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109628.103885:0:196404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109628.103903:0:196404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac1f38a00/0xdb52b77d7ca37422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3741b expref: -99 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.103929:0:196404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac1f38a00/0xdb52b77d7ca37422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3741b expref: 11 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.103945:0:196404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac1f38a00/0xdb52b77d7ca37422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3741b expref: 11 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.103954:0:196404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f38a00, rc 0) 00000100:00100000:1.0:1786109628.104039:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933310080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (3333us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109628.104046:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1786109628.104127:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109628.104147:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.104157:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109628.104221:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.104258:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.105412:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109628.106099:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933310208 00000100:00100000:2.0:1786109628.106108:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933310208 00000100:00100000:3.0:1786109628.106222:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786109628.106230:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933310208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1786109628.106251:0:196397:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1786109628.106265:0:196397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786109628.106269:0:196397:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 333 00000100:00100000:3.0:1786109628.106382:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933310208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.106389:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786109628.106453:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1786109628.106507:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786109628.106516:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.106525:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109628.106536:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786109628.106538:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930a88c18000 from 52 10000000:01000000:3.0:1786109628.106540:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786109628.106567:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c400/0xdb52b77d7ca37429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.106574:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c400/0xdb52b77d7ca37429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.106583:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c400/0xdb52b77d7ca37429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109628.106599:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.106630:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.106645:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.106657:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933310336 00000100:00100000:3.0:1786109628.106659:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933310336 00000100:00100000:3.0:1786109628.106677:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786109628.106683:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933310336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109628.106691:0:196397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109628.106702:0:196397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6d800/0xdb52b77d7ca37430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37429 expref: -99 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.106725:0:196397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6d800/0xdb52b77d7ca37430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37429 expref: 12 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.106733:0:196397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6d800/0xdb52b77d7ca37430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37429 expref: 12 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.106746:0:196397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d800, rc 0) 00000100:00100000:3.0:1786109628.106772:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933310336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.106778:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786109628.106806:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109628.106818:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c400/0xdb52b77d7ca37429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37430 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.106825:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c400/0xdb52b77d7ca37429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37430 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109628.106876:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.106900:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.106913:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.106923:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933310464 00000100:00100000:3.0:1786109628.106926:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933310464 00000100:00100000:3.0:1786109628.106942:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786109628.106949:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933310464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.107055:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933310464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.107061:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786109628.107085:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.107113:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.107151:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.107165:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.107175:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933310592 00000100:00100000:3.0:1786109628.107178:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933310592 00000100:00100000:3.0:1786109628.107194:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786109628.107199:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933310592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.107274:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933310592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.107281:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786109628.107318:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109628.115176:0:196467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1786109628.115384:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1786109628.115415:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786109628.115426:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c400/0xdb52b77d7ca37429 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37430 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.115572:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c400/0xdb52b77d7ca37429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37430 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109628.115582:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1786109628.115585:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1786109628.115587:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1786109628.115627:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c000/0xdb52b77d7ca37437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.115635:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c000/0xdb52b77d7ca37437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.115647:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c000/0xdb52b77d7ca37437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109628.115671:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.115732:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.115819:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109628.116879:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933310720 00000100:00100000:0.0:1786109628.116889:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933310720 00000100:00100000:3.0:1786109628.122096:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1786109628.122114:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933310720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109628.122132:0:196397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109628.122152:0:196397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6c200/0xdb52b77d7ca3743e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37437 expref: -99 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.122179:0:196397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6c200/0xdb52b77d7ca3743e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37437 expref: 13 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.122189:0:196397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6c200/0xdb52b77d7ca3743e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37437 expref: 13 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.122199:0:196397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6c200, rc 0) 00000100:00100000:3.0:1786109628.122269:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933310720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (6536us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.122276:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1786109628.124003:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109628.124027:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c000/0xdb52b77d7ca37437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3743e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.124038:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c000/0xdb52b77d7ca37437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3743e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109628.124120:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.124172:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109628.124222:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109628.124240:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933310848 00000100:00100000:2.0:1786109628.124245:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933310848 00000100:00100000:2.0:1786109628.124287:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786109628.124296:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933310848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.126684:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933310848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2379us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.126697:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1786109628.126765:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.126820:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.126866:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.126889:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.126906:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933310976 00000100:00100000:3.0:1786109628.126912:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933310976 00000100:00100000:3.0:1786109628.126948:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786109628.126956:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933310976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.127794:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933310976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 834us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.127803:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786109628.127883:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933310976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786109628.134020:0:196472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1786109628.134088:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1786109628.134110:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1786109628.134121:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c000/0xdb52b77d7ca37437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3743e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.134133:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c000/0xdb52b77d7ca37437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3743e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109628.134142:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786109628.134145:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930a88c18000 from 7 10000000:01000000:2.0:1786109628.134147:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786109628.134184:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930a8166ca00/0xdb52b77d7ca37445 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.134192:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930a8166ca00/0xdb52b77d7ca37445 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.134203:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930a8166ca00/0xdb52b77d7ca37445 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109628.134226:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.134288:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109628.134532:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.134583:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933311104 00000100:00100000:3.0:1786109628.134591:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933311104 00000100:00100000:3.0:1786109628.134633:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786109628.134641:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933311104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109628.134654:0:196398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109628.134667:0:196398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6ce00/0xdb52b77d7ca3744c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37445 expref: -99 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.134688:0:196398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6ce00/0xdb52b77d7ca3744c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37445 expref: 14 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.134699:0:196398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6ce00/0xdb52b77d7ca3744c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37445 expref: 14 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.134706:0:196398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6ce00, rc 0) 00000100:00100000:3.0:1786109628.134741:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933311104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.134747:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786109628.134874:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109628.134889:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930a8166ca00/0xdb52b77d7ca37445 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3744c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.134897:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930a8166ca00/0xdb52b77d7ca37445 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3744c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109628.134946:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.134971:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109628.134997:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.135105:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933311232 00000100:00100000:3.0:1786109628.135109:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933311232 00000100:00100000:3.0:1786109628.135141:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786109628.135148:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933311232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.135245:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933311232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.135252:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786109628.135281:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.135307:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.135364:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.135378:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.135389:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933311360 00000100:00100000:3.0:1786109628.135392:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933311360 00000100:00100000:3.0:1786109628.135412:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786109628.135418:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933311360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.135515:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933311360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.135521:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786109628.135570:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786109628.136196:0:196473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1786109628.136248:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1786109628.136266:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786109628.136273:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930a8166ca00/0xdb52b77d7ca37445 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3744c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.136281:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930a8166ca00/0xdb52b77d7ca37445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3744c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109628.136289:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786109628.136291:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930a92e3e800 from 52 10000000:01000000:3.0:1786109628.136294:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786109628.136313:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.136321:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.136329:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109628.136613:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.136651:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.137111:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2e840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109628.137159:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933311488 00000100:00100000:2.0:1786109628.137165:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933311488 00000100:00100000:2.0:1786109628.137206:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786109628.137215:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933311488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109628.137228:0:196397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109628.137241:0:196397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930a8166ce00/0xdb52b77d7ca3745a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37453 expref: -99 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.137262:0:196397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a8166ce00/0xdb52b77d7ca3745a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37453 expref: 15 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.137272:0:196397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930a8166ce00/0xdb52b77d7ca3745a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37453 expref: 15 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.137280:0:196397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a8166ce00, rc 0) 00000100:00100000:2.0:1786109628.137334:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933311488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109628.137352:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786109628.137645:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109628.137661:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.137670:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109628.137730:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109628.137762:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109628.137794:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac123a780 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.137838:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933311616 00000100:00100000:3.0:1786109628.137842:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933311616 00000100:00100000:3.0:1786109628.138383:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786109628.138392:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933311616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.138556:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933311616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.138575:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1786109628.138648:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109628.138682:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109628.138724:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109628.139073:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109628.139134:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933311744 00000100:00100000:2.0:1786109628.139140:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933311744 00000100:00100000:2.0:1786109628.139181:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786109628.139189:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933311744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.139274:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933311744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109628.139282:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786109628.139381:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786109628.140012:0:196474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1786109628.140068:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1786109628.140089:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786109628.140097:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.140107:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109628.140116:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1786109628.140118:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930a92e3e800 from 330 10000000:01000000:0.0:1786109628.140121:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786109628.140148:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.140156:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.140164:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109628.140180:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109628.140216:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109628.140236:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109628.140251:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933311872 00000100:00100000:0.0:1786109628.140254:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933311872 00000100:00100000:0.0:1786109628.140281:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786109628.140289:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933311872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109628.140298:0:196404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109628.140308:0:196404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c2a00/0xdb52b77d7ca37468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37461 expref: -99 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.140327:0:196404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c2a00/0xdb52b77d7ca37468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37461 expref: 16 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.140425:0:196404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c2a00/0xdb52b77d7ca37468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37461 expref: 16 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.140454:0:196404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2a00, rc 0) 00000100:00100000:0.0:1786109628.140487:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933311872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109628.140494:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786109628.140531:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933311872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109628.140543:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.140552:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109628.140666:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1786109628.140695:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109628.140709:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109628.140719:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933312000 00000100:00100000:0.0:1786109628.140723:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933312000 00000100:00100000:0.0:1786109628.140744:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786109628.140750:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933312000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786109628.140763:0:196404:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786109628.140780:0:196404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786109628.140783:0:196404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1786109628.140786:0:196404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1786109628.140789:0:196404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1786109628.140791:0:196404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 333 00000100:00100000:0.0:1786109628.140870:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933312000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109628.140877:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786109628.140907:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1786109628.140975:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786109628.140980:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.140988:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109628.140995:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1786109628.140996:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1786109628.140999:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1786109628.141014:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.141020:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.141027:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109628.141038:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109628.141061:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109628.141073:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109628.141084:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933312128 00000100:00100000:0.0:1786109628.141087:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933312128 00000100:00100000:0.0:1786109628.141106:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786109628.141111:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933312128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109628.141118:0:196404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109628.141126:0:196404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca37476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3746f expref: -99 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.141141:0:196404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca37476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3746f expref: 17 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.141148:0:196404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca37476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3746f expref: 17 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.141154:0:196404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3600, rc 0) 00000100:00100000:0.0:1786109628.141180:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933312128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109628.141186:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786109628.141215:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109628.141224:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.141232:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109628.141276:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109628.141300:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109628.141313:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109628.141323:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933312256 00000100:00100000:0.0:1786109628.141326:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933312256 00000100:00100000:0.0:1786109628.142288:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786109628.142299:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933312256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109628.143692:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933312256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1390us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109628.143702:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1786109628.143912:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.143962:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.144008:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109628.144109:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6180 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.147521:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933312384 00000100:00100000:3.0:1786109628.147535:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933312384 00000100:00100000:3.0:1786109628.148475:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786109628.148489:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933312384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.149318:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933312384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 829us (5304us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.149328:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786109628.149472:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109628.151398:0:196477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1786109628.152281:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1786109628.152311:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1786109628.152322:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.152333:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109628.152353:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1786109628.152356:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff930a92e3e800 from 1 10000000:01000000:0.0:1786109628.152359:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1786109628.152396:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.152404:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.152414:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109628.152462:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109628.152773:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109628.152826:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109628.152905:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933312512 00000100:00100000:1.0:1786109628.152912:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933312512 00000100:00100000:1.0:1786109628.152961:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786109628.152971:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933312512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109628.152984:0:196397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109628.152998:0:196397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac1f39800/0xdb52b77d7ca37484 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3747d expref: -99 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.153022:0:196397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac1f39800/0xdb52b77d7ca37484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3747d expref: 18 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.153033:0:196397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac1f39800/0xdb52b77d7ca37484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3747d expref: 18 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.153041:0:196397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f39800, rc 0) 00000100:00100000:1.0:1786109628.153094:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933312512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109628.153101:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786109628.153180:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109628.153195:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.153204:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109628.153221:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1786109628.153225:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.153232:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109628.153239:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786109628.153241:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930a92e3e800 from 7 10000000:01000000:0.0:1786109628.153243:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786109628.153258:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.153265:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.153276:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109628.153289:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109628.153316:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109628.153361:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a901c9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109628.154528:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933312640 00000100:00100000:1.0:1786109628.154538:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933312640 00000100:00100000:1.0:1786109628.154640:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786109628.154651:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933312640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109628.154665:0:196398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109628.154680:0:196398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac1f39200/0xdb52b77d7ca37492 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3748b expref: -99 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.154699:0:196398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac1f39200/0xdb52b77d7ca37492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3748b expref: 19 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.154709:0:196398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac1f39200/0xdb52b77d7ca37492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3748b expref: 19 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.154716:0:196398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f39200, rc 0) 00000100:00100000:1.0:1786109628.154769:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933312640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109628.154775:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786109628.154822:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109628.154836:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.154845:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109628.154908:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109628.154936:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109628.154970:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098469f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109628.154983:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933312768 00000100:00100000:1.0:1786109628.154987:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933312768 00000100:00100000:1.0:1786109628.155009:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786109628.155015:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933312768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109628.155110:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933312768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109628.155117:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786109628.155146:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109628.155170:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109628.155209:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109628.155223:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098469f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109628.155236:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933312896 00000100:00100000:1.0:1786109628.155239:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933312896 00000100:00100000:1.0:1786109628.155260:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1786109628.155267:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933312896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109628.156674:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933312896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1401us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109628.156684:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1786109628.158631:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933312896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786109628.159572:0:196479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1786109628.160124:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1786109628.160147:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786109628.160157:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.160169:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109628.160184:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786109628.160186:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930aa6612000 from 52 10000000:01000000:1.0:1786109628.160189:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786109628.160223:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f38600/0xdb52b77d7ca37499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.160231:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac1f38600/0xdb52b77d7ca37499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.160241:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac1f38600/0xdb52b77d7ca37499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109628.160263:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109628.160320:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109628.160469:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a88d87d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109628.160532:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933313024 00000100:00100000:2.0:1786109628.160539:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933313024 00000100:00100000:2.0:1786109628.160638:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1786109628.160648:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933313024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109628.160662:0:196398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109628.160675:0:196398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca374a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37499 expref: -99 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.160697:0:196398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca374a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37499 expref: 20 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.160706:0:196398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca374a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37499 expref: 20 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.160714:0:196398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a8166d600, rc 0) 00000100:00100000:2.0:1786109628.160762:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933313024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109628.160769:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1786109628.160843:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109628.160855:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac1f38600/0xdb52b77d7ca37499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374a0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109628.160863:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac1f38600/0xdb52b77d7ca37499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca374a0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109628.160909:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109628.160931:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109628.160964:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a88d87d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109628.161004:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933313152 00000100:00100000:2.0:1786109628.161008:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933313152 00000100:00100000:2.0:1786109628.161040:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786109628.161047:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933313152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.161156:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933313152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109628.161162:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786109628.161191:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.161217:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.161260:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109628.161275:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6240 going to sleep for 11 seconds 00000100:00100000:2.0:1786109628.161286:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933313280 00000100:00100000:2.0:1786109628.161290:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933313280 00000100:00100000:2.0:1786109628.161310:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786109628.161316:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933313280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.161760:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933313280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 442us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109628.161768:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786109628.163350:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109628.164830:0:196481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1786109628.168669:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1786109628.168703:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786109628.168714:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f38600/0xdb52b77d7ca37499 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374a0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.168727:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac1f38600/0xdb52b77d7ca37499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374a0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109628.169732:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1786109628.169739:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1786109628.169743:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1786109628.169781:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d400/0xdb52b77d7ca374a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.169791:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d400/0xdb52b77d7ca374a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.169802:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d400/0xdb52b77d7ca374a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109628.169825:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.169889:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.169925:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933313408 00000100:00100000:3.0:1786109628.169932:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933313408 00000100:00100000:3.0:1786109628.169974:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786109628.169983:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933313408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109628.169997:0:196404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109628.170010:0:196404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6cc00/0xdb52b77d7ca374ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca374a7 expref: -99 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.170031:0:196404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6cc00/0xdb52b77d7ca374ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca374a7 expref: 21 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.170047:0:196404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6cc00/0xdb52b77d7ca374ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca374a7 expref: 21 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.170055:0:196404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6cc00, rc 0) 00000100:00100000:3.0:1786109628.170086:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933313408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.170092:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786109628.170142:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2e840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.170161:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109628.170174:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d400/0xdb52b77d7ca374a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374ae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.170184:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d400/0xdb52b77d7ca374a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca374ae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109628.170236:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.170261:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.170282:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933313536 00000100:00100000:3.0:1786109628.170286:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933313536 00000100:00100000:3.0:1786109628.170309:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786109628.170316:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933313536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.170765:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933313536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 449us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.170772:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786109628.170797:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2e840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.170808:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.170837:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.170880:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.170906:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109628.171879:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933313664 00000100:00100000:2.0:1786109628.171887:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933313664 00000100:00100000:2.0:1786109628.171932:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786109628.171943:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933313664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.172691:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933313664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 747us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109628.172699:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786109628.172784:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786109628.174705:0:196483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1786109628.174778:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1786109628.174802:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1786109628.174813:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d400/0xdb52b77d7ca374a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374ae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.174825:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d400/0xdb52b77d7ca374a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374ae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109628.174835:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786109628.174837:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930aa6612000 from 7 10000000:01000000:2.0:1786109628.174840:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786109628.174876:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930a8166cc00/0xdb52b77d7ca374b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.174884:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930a8166cc00/0xdb52b77d7ca374b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.174895:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930a8166cc00/0xdb52b77d7ca374b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109628.174917:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.174974:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109628.175002:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.175300:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933313792 00000100:00100000:3.0:1786109628.175307:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933313792 00000100:00100000:3.0:1786109628.175366:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786109628.176547:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933313792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109628.176615:0:196397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109628.176632:0:196397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6d200/0xdb52b77d7ca374bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca374b5 expref: -99 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.176657:0:196397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6d200/0xdb52b77d7ca374bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca374b5 expref: 22 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.176667:0:196397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6d200/0xdb52b77d7ca374bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca374b5 expref: 22 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.176675:0:196397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d200, rc 0) 00000100:00100000:3.0:1786109628.176737:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933313792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1363us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.176744:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786109628.176808:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109628.176824:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930a8166cc00/0xdb52b77d7ca374b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374bc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.176834:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930a8166cc00/0xdb52b77d7ca374b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca374bc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109628.176905:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.176932:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.176949:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8e2f780 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.176964:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933313920 00000100:00100000:3.0:1786109628.176968:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933313920 00000100:00100000:3.0:1786109628.176995:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786109628.177002:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933313920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.177095:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933313920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.177101:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786109628.177132:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933313920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.177159:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933314048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.177198:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.177212:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8e2f780 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.177222:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933314048 00000100:00100000:3.0:1786109628.177225:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933314048 00000100:00100000:3.0:1786109628.177245:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1786109628.177250:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933314048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.177328:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933314048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109628.177348:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1786109628.179790:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933314048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786109628.181009:0:196486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1786109628.181166:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1786109628.181188:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786109628.181199:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930a8166cc00/0xdb52b77d7ca374b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374bc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.181209:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930a8166cc00/0xdb52b77d7ca374b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374bc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109628.181219:0:6524:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1786109628.181222:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff930a8a73cd40 from 1 10000000:01000000:3.0:1786109628.181224:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1786109628.181259:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6da00/0xdb52b77d7ca374c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.181267:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab8f6da00/0xdb52b77d7ca374c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109628.181278:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab8f6da00/0xdb52b77d7ca374c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109628.181299:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933314176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.181371:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109628.182535:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a905180 going to sleep for 11 seconds 00000100:00100000:2.0:1786109628.182681:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933314176 00000100:00100000:2.0:1786109628.182688:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933314176 00000100:00100000:2.0:1786109628.182745:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1786109628.182755:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933314176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109628.182769:0:196398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109628.182786:0:196398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930a8166c800/0xdb52b77d7ca374ca lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca374c3 expref: -99 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.182814:0:196398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a8166c800/0xdb52b77d7ca374ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca374c3 expref: 23 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.182825:0:196398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930a8166c800/0xdb52b77d7ca374ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca374c3 expref: 23 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.182833:0:196398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a8166c800, rc 0) 00000100:00100000:2.0:1786109628.182889:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933314176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109628.182895:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1786109628.182943:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933314176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109628.182958:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab8f6da00/0xdb52b77d7ca374c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374ca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.182967:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6da00/0xdb52b77d7ca374c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca374ca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109628.182989:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1786109628.182994:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6da00/0xdb52b77d7ca374c3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374ca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.183002:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab8f6da00/0xdb52b77d7ca374c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374ca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109628.183010:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1786109628.183013:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff930a8a73cd40 from 1 10000000:01000000:2.0:1786109628.183015:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786109628.183038:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.183046:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.183054:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109628.183071:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933314304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.183101:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109628.183117:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6240 going to sleep for 11 seconds 00000100:00100000:2.0:1786109628.183131:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933314304 00000100:00100000:2.0:1786109628.183134:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933314304 00000100:00100000:2.0:1786109628.183159:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1786109628.183166:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933314304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109628.183172:0:196404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109628.183181:0:196404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9453600/0xdb52b77d7ca374d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca374d1 expref: -99 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.183196:0:196404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9453600/0xdb52b77d7ca374d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca374d1 expref: 24 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.183204:0:196404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9453600/0xdb52b77d7ca374d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca374d1 expref: 24 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.183211:0:196404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9453600, rc 0) 00000100:00100000:2.0:1786109628.183241:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933314304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109628.183246:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1786109628.183279:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933314304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109628.183290:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374d8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.183298:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca374d8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109628.184776:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933314432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109628.184830:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109628.184915:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6240 going to sleep for 11 seconds 00000100:00100000:3.0:1786109628.189578:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933314432 00000100:00100000:3.0:1786109628.189593:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933314432 00000100:00100000:3.0:1786109628.189660:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786109628.189672:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933314432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109628.189798:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933314432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (4967us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786109628.189806:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786109628.194194:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933314432:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1786109628.194239:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1786109628.194250:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374d8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109628.194261:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374d8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109628.359528:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109628.365210:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:00100000:0.0:1786109629.380513:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00010000:00010000:0.0:1786109629.388822:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109629.520524:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109629.520580:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109629.520616:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922117760 00000100:00100000:2.0:1786109629.520624:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922117760 00000100:00100000:2.0:1786109629.520669:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 307 00000100:00100000:2.0:1786109629.520678:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922117760:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109629.520744:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922117760:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 67us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109629.520751:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 307 00000100:00100000:2.0:1786109629.520776:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922117632 00000100:00100000:2.0:1786109629.520779:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922117632 00000100:00100000:2.0:1786109629.520799:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:2.0:1786109629.520805:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922117632:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109629.520826:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922117632:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 21us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109629.520832:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:2.0:1786109629.701933:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933314560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109629.702004:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109629.702101:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933314560 00000100:00100000:3.0:1786109629.702109:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933314560 00000100:00100000:3.0:1786109629.702176:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5868 00000100:00100000:3.0:1786109629.702188:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933314560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109629.702219:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109629.702261:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933314560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109629.702269:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5868 00000100:00080000:2.0:1786109629.702335:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109629.702373:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933314560:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1786109630.404531:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109630.404826:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00000100:02000400:3.0:1786109631.240272:0:176321:0:(service.c:2875:ptlrpc_watchdog_fire()) mdt00_000: service thread pid 187899 was inactive for 42.945 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: 00000100:00100000:1.0:1786109631.428501:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 0 seconds 00010000:00010000:1.0:1786109631.428791:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786109632.244405:0:196679:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1786109632.261009:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933314688:0@lo:400:kworker.0 00000100:00100000:1.0:1786109632.261085:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109632.261194:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933314688 00000100:00100000:2.0:1786109632.261202:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933314688 00000100:00100000:2.0:1786109632.261252:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786109632.261261:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933314688:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1786109632.261333:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109632.261338:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109632.261342:0:192991:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109632.261347:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8483 00000100:00080000:0.0:1786109632.261351:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1786109632.261356:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109632.261377:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7c56300 x1872862933314816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109632.261552:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933314688:12345-0@lo:400:kworker.0 Request processed in 291us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109632.261560:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1786109632.261641:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933314688:0@lo:400:kworker.0 00000100:00100000:1.0:1786109632.261656:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109632.261663:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933314944:0@lo:400:kworker.0 00000100:00100000:1.0:1786109632.261691:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109632.261880:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933314944 00000100:00100000:2.0:1786109632.261885:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933314944 00000100:00100000:2.0:1786109632.261923:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1786109632.261931:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933314944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109632.261971:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933314944:12345-0@lo:400:kworker.0 Request processed in 41us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109632.261977:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1786109632.262090:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933314944:0@lo:400:kworker.0 00000001:00100000:1.0:1786109632.262697:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:0.0:1786109632.262877:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109632.262882:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109632.262884:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109632.262889:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8483 00000100:00080000:0.0:1786109632.262892:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109632.262897:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109632.262921:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7c57100 x1872862933315072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109632.262981:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933315200:0@lo:400:kworker.0 00000100:00100000:1.0:1786109632.263021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109632.263126:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933315200 00000100:00100000:2.0:1786109632.263132:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933315200 00000100:00100000:2.0:1786109632.263174:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7029 00000100:00100000:2.0:1786109632.263184:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933315200:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1786109632.263247:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109632.263251:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109632.263253:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109632.263257:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8483 00000100:00080000:0.0:1786109632.263260:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1786109632.263264:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da4000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109632.263279:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7c54380 x1872862933315456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109632.263288:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109632.263291:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109632.263293:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109632.263296:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8483 00000100:00080000:0.0:1786109632.263298:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1786109632.263301:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109632.263329:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7c55f80 x1872862933315584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109632.263367:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1786109632.263370:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109632.263372:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930ab2ab9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109632.263376:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff930ab2ab9000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109632.263390:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7c54700 x1872862933316224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109632.263419:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933314816:0@lo:38:kworker.0 00000100:00100000:0.0:1786109632.263470:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109632.263491:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933315072:0@lo:38:kworker.0 00000100:00100000:0.0:1786109632.263513:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109632.263531:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933315456:0@lo:38:kworker.0 00000100:00100000:0.0:1786109632.263569:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109632.263586:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933315584:0@lo:38:kworker.0 00000100:00100000:0.0:1786109632.263607:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109632.263622:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933316224:0@lo:38:kworker.0 00000100:00100000:0.0:1786109632.263643:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109632.263670:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933314816 00000100:00100000:0.0:1786109632.263674:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933314816 00000100:00100000:0.0:1786109632.263693:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933315456 00000100:00100000:0.0:1786109632.263695:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933315456 00000100:00100000:0.0:1786109632.263703:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933315584 00000100:00100000:0.0:1786109632.263704:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933315584 00000100:00100000:0.0:1786109632.263710:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933316224 00000100:00100000:0.0:1786109632.263712:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933316224 00000100:00100000:0.0:1786109632.263720:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1786109632.263725:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3645:x1872862933314816:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109632.263748:0:196401:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8488 last 0 00000020:00000080:0.0:1786109632.263783:0:196401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdb52b77d7ca374df 00000004:00100000:0.0:1786109632.263796:0:196401:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109632.263916:0:196401:0:(import.c:65:import_set_state_nolock()) ffff930ab9960800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109632.263959:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872862933314816:12345-0@lo:38:kworker.0 Request processed in 232us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109632.263966:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1786109632.263982:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1786109632.263986:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3645:x1872862933315456:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109632.264001:0:196401:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8488 last 0 00000020:00000080:0.0:1786109632.264024:0:196401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdb52b77d7ca374e6 00000004:00100000:0.0:1786109632.264032:0:196401:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109632.264047:0:196401:0:(import.c:65:import_set_state_nolock()) ffff930ab9961000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109632.264074:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872862933315456:12345-0@lo:38:kworker.0 Request processed in 87us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109632.264080:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1786109632.264093:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1786109632.264097:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3645:x1872862933315584:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109632.264110:0:196401:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8488 last 0 00000020:00000080:0.0:1786109632.264134:0:196401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdb52b77d7ca374ed 00000004:00100000:0.0:1786109632.264140:0:196401:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109632.264155:0:196401:0:(import.c:65:import_set_state_nolock()) ffff930ab9965000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109632.264183:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872862933315584:12345-0@lo:38:kworker.0 Request processed in 84us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109632.264189:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1786109632.264201:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1786109632.264205:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3645:x1872862933316224:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109632.264218:0:196401:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8488 last 0 00000020:00000080:0.0:1786109632.264239:0:196401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdb52b77d7ca374f4 00000004:00100000:0.0:1786109632.264245:0:196401:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109632.264259:0:196401:0:(import.c:65:import_set_state_nolock()) ffff930ab9960000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109632.264288:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872862933316224:12345-0@lo:38:kworker.0 Request processed in 81us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109632.264293:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1786109632.264373:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933315200:12345-0@lo:400:kworker.0 Request processed in 1188us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109632.264381:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7029 00000100:00100000:2.0:1786109632.264405:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933315328:0@lo:400:kworker.0 00000100:00100000:2.0:1786109632.264446:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109632.264471:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933316096:0@lo:400:kworker.0 00000100:00100000:2.0:1786109632.264492:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109632.264513:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109632.264519:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933315968:0@lo:400:kworker.0 00000100:00100000:2.0:1786109632.264538:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109632.264560:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109632.264571:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933315328 00000100:00100000:2.0:1786109632.264575:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933315328 00000100:00100000:2.0:1786109632.264601:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933316096 00000100:00100000:2.0:1786109632.264604:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933316096 00000100:00100000:2.0:1786109632.264618:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933315968 00000100:00100000:2.0:1786109632.264620:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933315968 00000100:00100000:2.0:1786109632.264637:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7030 00000100:00100000:2.0:1786109632.264643:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933315328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109632.264677:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933315328:12345-0@lo:400:kworker.0 Request processed in 35us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109632.264683:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7030 00000100:00100000:2.0:1786109632.264694:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7031 00000100:00100000:2.0:1786109632.264700:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933316096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109632.264730:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933316096:12345-0@lo:400:kworker.0 Request processed in 31us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109632.264734:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7031 00000100:00100000:2.0:1786109632.264744:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7032 00000100:00100000:2.0:1786109632.264749:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933315968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109632.264773:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933315968:12345-0@lo:400:kworker.0 Request processed in 24us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109632.264778:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7032 00000100:00080000:2.0:1786109632.264807:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109632.264809:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109632.264846:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933315968:0@lo:400:kworker.0 00000100:00100000:2.0:1786109632.264857:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933315328:0@lo:400:kworker.0 00000100:00100000:2.0:1786109632.264866:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933316096:0@lo:400:kworker.0 00010000:00080000:0.0:1786109632.265024:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ab7c56300 x1872862933314816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109632.265037:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 80 00000100:00080000:0.0:1786109632.265913:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff930ab7c56300 x1872862933314816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109632.265923:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109632.265928:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109632.265931:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1786109632.266023:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933315200:0@lo:400:kworker.0 00000100:00100000:1.0:1786109632.266059:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933315840:0@lo:400:kworker.0 00000100:00100000:1.0:1786109632.266109:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109632.266203:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109632.266209:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933315712:0@lo:400:kworker.0 00000100:00100000:1.0:1786109632.266235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109632.266292:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933315072 00000100:00100000:2.0:1786109632.266299:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933315072 00000100:00100000:2.0:1786109632.266338:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933315840 00000100:00100000:2.0:1786109632.266342:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933315840 00000100:00100000:2.0:1786109632.266368:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12406 00000100:00100000:2.0:1786109632.266375:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933315072:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1786109632.266400:0:177399:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff930a90aa1800, cookie 0xdb52b77d7ca37357 00010000:00080000:2.0:1786109632.266405:0:177399:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff930a90aa1800 cur 8488 last 1786109626 00000004:00100000:2.0:1786109632.266423:0:177399:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786109632.266465:0:177399:0:(import.c:65:import_set_state_nolock()) ffff930ac0c88000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109632.266516:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933315072:12345-0@lo:38:kworker.0 Request processed in 140us (3001us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109632.266525:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12406 00000100:00100000:2.0:1786109632.266540:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12407 00000100:00100000:2.0:1786109632.266546:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933315840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109632.266582:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933315840:12345-0@lo:400:kworker.0 Request processed in 36us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109632.266589:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12407 00010000:00080000:2.0:1786109632.266606:0:196426:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1786109632.266611:0:196426:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 339302416392 00000020:00080000:2.0:1786109632.266616:0:196426:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109632.266619:0:196426:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 339302416392, next_transno: 339302416392 00010000:00080000:2.0:1786109632.266622:0:196426:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (339302416392) 00000020:00080000:2.0:1786109632.266624:0:196426:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109632.266632:0:196426:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922111232 t339302416392 from 192.168.203.38@tcp req@ffff930aa66eaa00 x1872862922111232/t0(339302416392) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:98/0 lens 528/0 e 0 to 0 dl 1786109638 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1786109632.267193:0:196426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca374fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267210:0:196426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca374fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267223:0:196426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca374fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267236:0:196426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452600/0xdb52b77d7ca37502 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267243:0:196426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452600/0xdb52b77d7ca37502 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267253:0:196426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452600/0xdb52b77d7ca37502 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267701:0:196426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca374fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267710:0:196426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca374fb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267717:0:196426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca374fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267723:0:196426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109632.267727:0:196426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca374fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267735:0:196426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca374fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267748:0:196426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0f7e300) 00010000:00010000:2.0:1786109632.267751:0:196426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109632.267756:0:196426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca374fb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267762:0:196426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca374fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109632.267778:0:196426:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000743d99bb reply state 00000000f3a20d40 transno 339302416392 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452600/0xdb52b77d7ca37502 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267789:0:196426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452600/0xdb52b77d7ca37502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.267796:0:196426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930aa0f7ee00) 00010000:00010000:2.0:1786109632.267798:0:196426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109632.267801:0:196426:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1786109632.267893:0:196426:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1786109632.267913:0:196426:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109632.267916:0:196426:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 339302416393 00000020:00080000:2.0:1786109632.267919:0:196426:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109632.267921:0:196426:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 339302416393 00000100:00100000:1.0:1786109632.270267:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933315712 00000100:00100000:1.0:1786109632.270278:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933315712 00000100:00100000:1.0:1786109632.270343:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1786109632.270355:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933315712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109632.270455:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933315712:12345-0@lo:400:kworker.0 Request processed in 103us (4219us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109632.270465:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1786109632.270526:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933315712:0@lo:400:kworker.0 00000001:00080000:2.0:1786109632.270700:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 339302416392 is committed 00010000:00010000:2.0:1786109632.270732:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452600/0xdb52b77d7ca37502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.270743:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452600/0xdb52b77d7ca37502 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.270751:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452600/0xdb52b77d7ca37502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.270758:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109632.270763:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452600/0xdb52b77d7ca37502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.270770:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452600/0xdb52b77d7ca37502 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.270784:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930aa0f7ee00) 00010000:00010000:2.0:1786109632.270788:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109632.270792:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452600/0xdb52b77d7ca37502 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.270803:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452600/0xdb52b77d7ca37502 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109632.272385:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933315840:0@lo:400:kworker.0 00000100:00100000:1.0:1786109632.272468:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109632.272479:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933316352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109632.272545:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109632.272603:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933316352 00000100:00100000:1.0:1786109632.272610:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933316352 00000100:00100000:1.0:1786109632.272647:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12408 00000100:00100000:1.0:1786109632.272655:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933316352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109632.272689:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00000100:00100000:1.0:1786109632.272729:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933316352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109632.272736:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12408 00000100:00100000:1.0:1786109632.272766:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933316352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109632.275024:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109632.276500:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922111744 00000100:00100000:2.0:1786109632.276511:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922111744 00000100:00100000:2.0:1786109632.276566:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1084 00000100:00100000:2.0:1786109632.276576:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+7:2401:x1872862922111744:12345-192.168.203.38@tcp:36:rm.0 00010000:00080000:2.0:1786109632.276596:0:189813:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 339302416393, current: 339302416393, replaying 00000100:00100000:2.0:1786109632.276610:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+7:2401:x1872862922111744:12345-192.168.203.38@tcp:36:rm.0 Request processed in 37us (1593us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109632.276618:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1084 00000020:00080000:2.0:1786109632.276650:0:196426:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109632.276654:0:196426:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 339302416393, next_transno: 339302416393 00010000:00080000:2.0:1786109632.276658:0:196426:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (339302416393) 00000020:00080000:2.0:1786109632.276660:0:196426:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109632.276669:0:196426:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922111744 t339302416393 from 192.168.203.38@tcp req@ffff930aa66ea300 x1872862922111744/t0(339302416393) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:103/0 lens 512/0 e 0 to 0 dl 1786109643 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1786109632.276749:0:196426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453200/0xdb52b77d7ca37509 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.276765:0:196426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453200/0xdb52b77d7ca37509 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.276777:0:196426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453200/0xdb52b77d7ca37509 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.276790:0:196426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37510 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.276798:0:196426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37510 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.276805:0:196426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37510 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.276894:0:196426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37517 lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.276903:0:196426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37517 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.276910:0:196426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37517 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277140:0:196426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37517 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277148:0:196426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37517 lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277155:0:196426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37517 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277161:0:196426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109632.277165:0:196426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37517 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277173:0:196426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37517 lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277185:0:196426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x3:0x0].0x0 (ffff930ac216e600) 00010000:00010000:2.0:1786109632.277188:0:196426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109632.277193:0:196426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37517 lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277199:0:196426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37517 lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277220:0:196426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453200/0xdb52b77d7ca37509 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277227:0:196426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453200/0xdb52b77d7ca37509 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277232:0:196426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453200/0xdb52b77d7ca37509 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277237:0:196426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109632.277240:0:196426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453200/0xdb52b77d7ca37509 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277245:0:196426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453200/0xdb52b77d7ca37509 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277252:0:196426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ac216e400) 00010000:00010000:2.0:1786109632.277255:0:196426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109632.277257:0:196426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453200/0xdb52b77d7ca37509 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277263:0:196426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453200/0xdb52b77d7ca37509 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109632.277274:0:196426:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027a34b65 reply state 000000004a05835e transno 339302416393 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37510 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277290:0:196426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37510 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.277297:0:196426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ac216ee00) 00010000:00010000:2.0:1786109632.277300:0:196426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109632.277303:0:196426:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1786109632.285772:0:196426:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1786109632.286118:0:196426:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109632.286124:0:196426:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 339302416394 00000020:00080000:2.0:1786109632.286128:0:196426:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109632.286130:0:196426:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 339302416394 00000001:00100000:1.0:1786109632.290843:0:187891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1786109632.290946:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1786109632.291930:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109632.292024:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922117888 00000100:00100000:1.0:1786109632.292035:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922117888 00000100:00100000:1.0:1786109632.292166:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 310 00000100:00100000:1.0:1786109632.292176:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:2401:x1872862922117888:12345-192.168.203.38@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1786109632.292200:0:187901:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff93098ba4fb80 x1872862922117888/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:103/0 lens 224/0 e 0 to 0 dl 1786109643 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109632.292217:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:2401:x1872862922117888:12345-192.168.203.38@tcp:400:ldlm_lock_repla.0 Request processed in 42us (294us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109632.292227:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 310 00000020:00080000:2.0:1786109632.292648:0:196426:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109632.292653:0:196426:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 339302416394 00000100:00100000:0.0:1786109632.295174:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933314816:0@lo:38:kworker.0 00000100:00100000:0.0:1786109632.299894:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 339302416391 gen 2 00000100:00080000:0.0:1786109632.299913:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 80 00000100:00080000:0.0:1786109632.299925:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1786109632.299931:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1786109632.299933:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 339302416391 gen 2 00000100:00080000:0.0:1786109632.299936:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a89101800 from lustre-MDT0000_UUID committed 339302416391 last 0 00000100:00080000:0.0:1786109632.299939:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1786109632.300136:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933315072:0@lo:38:kworker.0 00010000:00080000:0.0:1786109632.300160:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ab7c54380 x1872862933315456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109632.300173:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 80 00010000:00080000:1.0:1786109632.302520:0:196681:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1786109632.302527:0:196681:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1786109632.302660:0:196681:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:1.0:1786109632.303326:0:196681:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 3/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3723f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1786109632.303347:0:196681:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00010000:00010000:1.0:1786109632.303357:0:196681:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3724d expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1786109632.303365:0:196681:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 2(512) 00000100:00080000:0.0:1786109632.303786:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff930ab7c54380 x1872862933315456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109632.303797:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109632.303803:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109632.303806:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109632.303811:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933315456:0@lo:38:kworker.0 00010000:00080000:0.0:1786109632.303846:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ab7c55f80 x1872862933315584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109632.303860:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 80 00000100:00080000:0.0:1786109632.305346:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff930ab7c55f80 x1872862933315584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109647 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109632.305359:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109632.305363:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109632.305366:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109632.305636:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933315584:0@lo:38:kworker.0 00010000:00080000:0.0:1786109632.305666:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ab7c54700 x1872862933316224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109632.305680:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 80 00000100:00080000:0.0:1786109632.305687:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1786109632.305691:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786109632.305693:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab2ab9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786109632.305697:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933316224:0@lo:38:kworker.0 00000100:00100000:0.0:1786109632.305742:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933316480:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1786109632.305803:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109632.305883:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933316608:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1786109632.305905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109632.306157:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933316480 00000100:00100000:1.0:1786109632.306164:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933316480 00000100:00100000:1.0:1786109632.306209:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933316608 00000100:00100000:1.0:1786109632.306212:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933316608 00000100:00100000:1.0:1786109632.306234:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12409 00000100:00100000:1.0:1786109632.306242:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1872862933316480:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:1.0:1786109632.306266:0:179257:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9309854f8700 x1872862933316480/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:103/0 lens 328/0 e 0 to 0 dl 1786109643 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109632.306284:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1872862933316480:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 43us (482us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109632.306290:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12409 00000100:00100000:1.0:1786109632.306299:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12410 00000100:00100000:1.0:1786109632.306305:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1872862933316608:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:1.0:1786109632.306324:0:179257:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9309854f9180 x1872862933316608/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:103/0 lens 328/0 e 0 to 0 dl 1786109643 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109632.306332:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1872862933316608:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 29us (427us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109632.306338:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12410 00000020:00080000:1.0:1786109632.306355:0:196426:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109632.306358:0:196426:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 339302416394 00010000:00080000:1.0:1786109632.306361:0:196426:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1786109632.306364:0:196426:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109632.309156:0:196426:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1786109632.309164:0:196426:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1786109632.309178:0:196426:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff9309854f8700 x1872862933316480/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:103/0 lens 328/0 e 0 to 0 dl 1786109643 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1786109632.309205:0:196426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109632.309237:0:196426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39400/0xdb52b77d7ca3751e lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37238 expref: -99 pid: 196426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.309263:0:196426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39400/0xdb52b77d7ca3751e lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37238 expref: 8 pid: 196426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.309280:0:196426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39400/0xdb52b77d7ca3751e lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37238 expref: 8 pid: 196426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.309288:0:196426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f39400, rc 0) 00010000:00080000:1.0:1786109632.309469:0:196426:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1786109632.309480:0:196426:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1786109632.309483:0:196426:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1786109632.309488:0:196426:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff9309854f9180 x1872862933316608/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:103/0 lens 328/0 e 0 to 0 dl 1786109643 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1786109632.309611:0:196426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109632.309624:0:196426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37525 lrc: 2/0,0 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37246 expref: -99 pid: 196426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.309638:0:196426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37525 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37246 expref: 8 pid: 196426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.309648:0:196426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37525 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37246 expref: 8 pid: 196426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.309656:0:196426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f38800, rc 0) 00010000:00080000:1.0:1786109632.309679:0:196426:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1786109632.309685:0:196426:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00010000:2.0:1786109632.309784:0:3645:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 3/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3751e expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109632.309796:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933316480:0@lo:101:ldlm_lock_repla.0 00010000:00010000:2.0:1786109632.309806:0:3645:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37525 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786109632.309813:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1786109632.309836:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933316608:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1786109632.309857:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933316736:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1786109632.309890:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109632.310243:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933316736 00000100:00100000:3.0:1786109632.310250:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933316736 00000100:00100000:1.0:1786109632.310337:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12411 00000100:00100000:1.0:1786109632.310348:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3645:x1872862933316736:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1786109632.310361:0:179257:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ab7c55f80 x1872862933316736/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:103/0 lens 224/0 e 0 to 0 dl 1786109643 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109632.311805:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3645:x1872862933316736:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1454us (1908us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109632.311817:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12411 00010000:00080000:1.0:1786109632.311845:0:196426:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1786109632.311944:0:196426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 80, last_transno is 343597383680 00000001:00100000:3.0:1786109632.316780:0:196392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1786109632.316790:0:196392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00080000:3.0:1786109632.316813:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 339302416393 is committed 00000001:00080000:3.0:1786109632.316852:0:196426:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1786109632.316888:0:196426:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1786109632.316903:0:196426:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.203.38@tcp: req@ffff93098ba4fb80 x1872862922117888/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:103/0 lens 224/0 e 0 to 0 dl 1786109643 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1786109632.316989:0:196426:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff930ab7c55f80 x1872862933316736/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:103/0 lens 224/0 e 0 to 0 dl 1786109643 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1786109632.317139:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37510 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.317150:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37510 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.317158:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37510 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.317165:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109632.317169:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37510 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.317178:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37510 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.317197:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ac216ee00) 00010000:00010000:0.0:1786109632.317200:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109632.317205:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37510 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.317211:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37510 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:02000000:3.0:1786109632.317887:0:196426:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1786109632.320608:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1786109632.320625:0:3645:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff930ab7c54700 x1872862933316736/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109648 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109632.320637:0:3645:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff930ab7c54700 x1872862933316736/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109648 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109632.320651:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109632.320670:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1786109632.320676:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000edc4d172): req@ffff93098e35b100 x1872862933289216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 1 dl 1786109604 ref 2 fl Rpc:XQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109632.320694:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000015c5cfb9): req@ffff9309851f2680 x1872862933294976/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109613 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109632.320705:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933316736:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1786109632.320784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109632.320816:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109632.320824:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933316864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109632.320847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109632.320880:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933294976 00000100:00100000:1.0:1786109632.320886:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933294976 00000100:00100000:1.0:1786109632.320924:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933316864 00000100:00100000:1.0:1786109632.320928:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933316864 00000100:00100000:1.0:1786109632.320944:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12412 00000100:00100000:1.0:1786109632.320951:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933294976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109632.320981:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445679104 avail 1299439616 00000100:00100000:1.0:1786109632.321019:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933294976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109632.321026:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12412 00000100:00100000:1.0:1786109632.321053:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12413 00000100:00100000:1.0:1786109632.321059:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933316864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109632.321070:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445679104 avail 1299439616 00000100:00100000:1.0:1786109632.321094:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933316864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 35us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109632.321099:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12413 00000100:00100000:0.0:1786109632.321133:0:187918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109632.321151:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0ec2900 going to sleep for 11 seconds 00000100:00100000:0.0:1786109632.321163:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933289216 00000100:00100000:0.0:1786109632.321167:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933289216 00000100:00100000:0.0:1786109632.321186:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12414 00000100:00100000:0.0:1786109632.321192:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187918:x1872862933289216:12345-0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1786109632.321213:0:177399:0:(tgt_handler.c:3156:tgt_check_resent()) @@@ reconstruct resent RPC req@ffff9309854faa00 x1872862933289216/t339302416391(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:103/0 lens 1312/4320 e 0 to 0 dl 1786109643 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00080000:0.0:1786109632.321249:0:177399:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff930a97878208 index 0: rc = 0 00000020:00080000:0.0:1786109632.321258:0:177399:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff930a97878208 index 1: rc = 0 00000020:00080000:0.0:1786109632.321262:0:177399:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff930a97878208 index 2: rc = 0 00000020:00080000:0.0:1786109632.321265:0:177399:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff930a97878208 index 3: rc = 0 00000020:00080000:0.0:1786109632.321268:0:177399:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff930a97878208 index 4: rc = 0 00000020:00080000:0.0:1786109632.321271:0:177399:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff930a97878208 index 5: rc = 0 00000020:00080000:0.0:1786109632.321273:0:177399:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff930a97878208 index 6: rc = 0 00000100:00100000:0.0:1786109632.321304:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187918:x1872862933289216:12345-0@lo:1000:osp_up0-1.0 Request processed in 112us (171us total) trans 339302416391 rc 0/0 00000100:00100000:0.0:1786109632.321323:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12414 00000004:00080000:0.0:1786109632.321348:0:187918:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 339302416391 committed transno 339302416391 00000100:00100000:0.0:1786109632.321363:0:187918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933289216:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1786109632.321471:0:187918:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930986abf840 version 6 rpc_version 6 00000020:00100000:0.0:1786109632.321489:0:187918:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109632.321579:0:187918:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9309854f8380 x1872862933317120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109632.321596:0:187918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933317120:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109632.321622:0:187918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109632.321637:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109632.321648:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933317120 00000100:00100000:0.0:1786109632.321651:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933317120 00000100:00100000:0.0:1786109632.321668:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12415 00000100:00100000:0.0:1786109632.321673:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187918:x1872862933317120:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1786109632.335235:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383681 is committed 00000100:00100000:2.0:1786109632.336261:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187918:x1872862933317120:12345-0@lo:1000:osp_up0-1.0 Request processed in 14582us (14632us total) trans 343597383681 rc 0/0 00000100:00100000:2.0:1786109632.336275:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12415 00000004:00080000:2.0:1786109632.336345:0:187918:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 343597383681 committed transno 343597383681 00000100:00100000:2.0:1786109632.336350:0:187918:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383681 gen 2 00000100:00100000:2.0:1786109632.336367:0:187918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933317120:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786109632.336820:0:187918:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930986abf840 version 7 rpc_version 7 00000020:00100000:2.0:1786109632.336852:0:187918:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109632.336860:0:187918:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab7c54380 x1872862933317376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109632.336880:0:187918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933317376:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109632.336923:0:187918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109632.336948:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109632.336965:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933317376 00000100:00100000:2.0:1786109632.336971:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933317376 00000100:00100000:2.0:1786109632.337007:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12416 00000100:00100000:2.0:1786109632.337014:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187918:x1872862933317376:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786109632.341695:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933316864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109632.341758:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933294976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109632.343738:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187918:x1872862933317376:12345-0@lo:1000:osp_up0-1.0 Request processed in 6715us (6806us total) trans 343597383682 rc 0/0 00000100:00100000:2.0:1786109632.343753:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12416 00000100:00100000:0.0:1786109632.346299:0:187918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933317376:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1786109632.346582:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3752c lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.346598:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3752c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.346611:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3752c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109632.346628:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3878b73 reply state 000000003b330253 transno 25769804571 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3752c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.346639:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3752c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.346647:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930ab9367d00) 00010000:00010000:1.0:1786109632.346650:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109632.346653:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1786109632.346659:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x1:0x0]: returning size 4096 00000004:00080000:1.0:1786109632.346668:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x2:0x0] 00010000:00010000:1.0:1786109632.346677:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3751e expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.346686:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3751e expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.346694:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3751e expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.346711:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786109632.346714:0:187899:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x2:0x0] 00010000:00010000:1.0:1786109632.346719:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37525 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.346727:0:187899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37525 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1786109632.346796:0:187899:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1786109632.346809:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:162689:x1872862922110336:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 44051833us (44052010us total) trans 25769804571 rc 0/0 00000100:00100000:1.0:1786109632.346817:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1037 00000100:02000400:1.0:1786109632.346832:0:187899:0:(service.c:2915:ptlrpc_watchdog_update()) mdt00_000: service thread pid 187899 completed after 44.051s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources). 00010000:00010000:2.0:1786109632.348333:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3752c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.348347:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3752c lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.348359:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3752c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.348365:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109632.348380:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3752c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.348388:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3752c lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.348404:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930ab9367d00) 00010000:00010000:2.0:1786109632.348407:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109632.348412:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3752c lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.348418:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca3752c lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109632.355070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109632.355121:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922118144 00000100:00100000:2.0:1786109632.355130:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922118144 00000100:00100000:2.0:1786109632.355190:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1786109632.355202:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab92e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:162689:x1872862922118144:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1786109632.355470:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab92e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:162689:x1872862922118144:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 269us (407us total) trans 343597383683 rc 0/0 00000100:00100000:2.0:1786109632.355478:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00010000:00010000:0.0:1786109632.364800:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109632.364814:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 2/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3751e expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.364827:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166de00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109632.364834:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca3751e expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109632.364844:0:29734:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca3751e expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.364890:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3751e expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.364902:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109632.364935:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 1/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3751e expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.364943:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930a8166de00/0xdb52b77d7ca37238 lrc: 0/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3751e expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.364968:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.364969:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.364971:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109632.369414:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933317504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109632.369761:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109632.372196:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933317504 00000100:00100000:1.0:1786109632.372208:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933317504 00000100:00100000:1.0:1786109632.372269:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4523 00000100:00100000:1.0:1786109632.372279:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933317504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109632.372295:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109632.372327:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f39400/0xdb52b77d7ca3751e lrc: 0/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37238 expref: 9 pid: 196426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.372343:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930ab9367e00) 00010000:00010000:1.0:1786109632.372352:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109632.372894:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933317504:12345-0@lo:103:ldlm_bl.0 Request processed in 614us (3131us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109632.372901:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4523 00000100:00100000:2.0:1786109632.373504:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933317504:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1786109632.373752:0:196426:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa66f08707e10 00100000:10000000:3.0:1786109632.373762:0:196426:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1786109632.374640:0:196414:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x1882:0x0] 00000004:00080000:2.0:1786109632.374701:0:196412:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x1902:0x0] 00000100:00100000:2.0:1786109632.374727:0:196412:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c57b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:196412:1872862933317760:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1786109632.374864:0:196412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109632.374896:0:196412:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1000 going to sleep for 11 seconds 00000100:00100000:1.0:1786109632.374922:0:196414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:196414:1872862933317632:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1786109632.374964:0:196414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109632.374993:0:196414:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9689300 going to sleep for 11 seconds 00000100:00100000:2.0:1786109632.375037:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933317760 00000100:00100000:2.0:1786109632.375043:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933317760 00000100:00100000:2.0:1786109632.375083:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933317632 00000100:00100000:2.0:1786109632.375086:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933317632 00000100:00100000:2.0:1786109632.375108:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23129 00000100:00100000:2.0:1786109632.375116:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:196412:x1872862933317760:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1786109632.375145:0:43912:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6433 -> diff = -31 00002000:02000040:2.0:1786109632.375150:0:43912:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6403 to 0x280000400:6433) 00000100:00100000:0.0:1786109632.376320:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23130 00000100:00100000:0.0:1786109632.376335:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:196414:x1872862933317632:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1786109632.376357:0:8442:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6369 -> diff = -95 00002000:02000040:0.0:1786109632.376362:0:8442:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6275 to 0x2c0000401:6369) 00002000:00010000:3.0:1786109632.404265:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1921:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.404277:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca37533 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1921:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.404294:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1921:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.404299:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1921:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.404305:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca37533 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.404337:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca37533 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.404346:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca37533 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.404354:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca37533 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.404938:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.404955:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.404961:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca37533 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.404971:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.404975:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca37533 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.404989:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca37533 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405005:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca37533 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405011:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010372269/0xdb52b77d7ca37533 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1921:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405028:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.405031:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.405032:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.405613:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1920:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.405619:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca3753a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1920:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405629:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1920:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.405633:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1920:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.405637:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca3753a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405647:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca3753a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405656:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca3753a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405663:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca3753a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405678:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.405686:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.405690:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca3753a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405698:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.405701:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca3753a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405708:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca3753a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405719:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca3753a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405725:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b9c2c49/0xdb52b77d7ca3753a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1920:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405737:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.405738:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.405740:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.405787:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x191f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.405793:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca37541 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x191f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405801:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x191f:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.405804:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x191f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.405808:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca37541 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.405816:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca37541 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.406201:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca37541 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.406207:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca37541 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.406226:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.406234:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.406238:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca37541 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.406244:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.406247:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca37541 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.406254:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca37541 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x191f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.406264:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca37541 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x191f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.406270:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000612d90c3/0xdb52b77d7ca37541 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x191f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.406282:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.406284:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.406285:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.406342:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x191e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.406348:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca37548 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x191e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.406355:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x191e:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.406358:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x191e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.406362:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca37548 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407048:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca37548 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407060:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca37548 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407066:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca37548 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407084:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109632.407204:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x191d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.407209:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca3754f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x191d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407217:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x191d:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.407220:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x191d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.407225:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca3754f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407232:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca3754f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407240:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca3754f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407247:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca3754f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407267:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786109632.407321:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x191c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.407325:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca37556 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x191c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407334:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x191c:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.407337:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x191c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.407341:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca37556 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407350:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca37556 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407356:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca37556 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407363:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca37556 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407593:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1786109632.407602:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109632.407607:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca37548 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407615:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109632.407618:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109632.407620:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca37548 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.407623:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca3754f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407627:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca37548 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x191e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.407631:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109632.407634:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca3754f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407640:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca37548 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x191e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.407641:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca3754f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x191d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407653:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b9c835/0xdb52b77d7ca37548 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x191e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.407653:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca3754f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x191d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.407661:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000484acae4/0xdb52b77d7ca3754f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x191d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407667:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.407670:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca37556 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.407672:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109632.407674:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.407676:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.407679:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca37556 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407686:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca37556 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x191c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407696:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca37556 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x191c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407703:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f052b7ba/0xdb52b77d7ca37556 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x191c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407713:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.407715:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.407717:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.407764:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x191b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.407769:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca3755d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x191b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407776:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x191b:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.407779:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x191b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.407783:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca3755d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407791:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca3755d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407804:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca3755d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407811:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca3755d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407825:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.407832:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.407835:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca3755d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407842:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.407845:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca3755d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407853:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca3755d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x191b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407868:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca3755d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x191b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407876:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000163cea76/0xdb52b77d7ca3755d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x191b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.407888:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.407890:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.407891:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.408202:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x191a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.408208:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca37564 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x191a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408216:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x191a:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.408220:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x191a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.408224:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca37564 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408233:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca37564 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408241:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca37564 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x191a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408249:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca37564 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408259:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109632.408296:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1919:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.408301:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca3756b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1919:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408320:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1919:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.408323:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1919:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.408327:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca3756b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408336:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca3756b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408343:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca3756b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408351:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca3756b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408365:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1786109632.408574:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109632.408580:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca37564 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408587:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.408592:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca37564 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x191a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408600:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca37564 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x191a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408611:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca37564 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x191a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408618:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ee3602a/0xdb52b77d7ca37564 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x191a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408629:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.408632:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca3756b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408639:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.408641:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca3756b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408648:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca3756b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408657:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca3756b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408664:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce653669/0xdb52b77d7ca3756b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1919:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408675:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.408677:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.408679:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.408721:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1918:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.408727:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca37572 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1918:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408735:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1918:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.408738:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1918:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.408742:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca37572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408750:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca37572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408758:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca37572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408765:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca37572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408778:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.408784:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.408787:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca37572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408798:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.408801:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca37572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408808:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca37572 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408818:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca37572 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408926:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036f1619f/0xdb52b77d7ca37572 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1918:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408937:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.408939:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.408940:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.408983:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1917:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.408989:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca37579 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1917:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.408996:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1917:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.409000:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1917:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.409003:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca37579 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409012:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca37579 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409020:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca37579 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409027:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca37579 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409039:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.409045:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.409048:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca37579 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409054:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.409057:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca37579 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409063:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca37579 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409073:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca37579 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409080:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abc8de12/0xdb52b77d7ca37579 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1917:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409091:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.409092:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.409094:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.409207:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1916:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.409212:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca37580 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1916:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409221:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1916:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.409224:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1916:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.409228:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca37580 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409236:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca37580 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409244:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca37580 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409251:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca37580 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409264:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.409270:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.409274:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca37580 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409281:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.409284:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca37580 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409297:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca37580 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409320:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca37580 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409328:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd2d0465/0xdb52b77d7ca37580 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1916:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409340:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.409341:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.409343:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.409597:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1915:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.409602:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca37587 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1915:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409610:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1915:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.409613:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1915:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.409617:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca37587 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409624:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca37587 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409631:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca37587 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409638:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca37587 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409651:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.409657:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.409661:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca37587 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409668:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.409671:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca37587 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409678:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca37587 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409688:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca37587 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409696:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001adf53e8/0xdb52b77d7ca37587 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1915:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409708:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.409710:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.409712:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.409753:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1914:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.409758:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3758e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1914:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409765:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1914:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.409768:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1914:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.409772:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3758e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409781:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3758e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409788:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3758e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409795:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3758e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409808:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.409814:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.409818:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3758e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409825:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd76400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.409829:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3758e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409836:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3758e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409846:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3758e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409853:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f40f04fd/0xdb52b77d7ca3758e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1914:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409866:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.409868:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.409869:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.409910:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1913:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.409915:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37595 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1913:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409923:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1913:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.409926:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1913:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.409930:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37595 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409938:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37595 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409946:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37595 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409953:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37595 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409965:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.409971:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.409975:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37595 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409981:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.409983:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37595 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.409991:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37595 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410001:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37595 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410008:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6e8d02d/0xdb52b77d7ca37595 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1913:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410021:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.410022:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.410024:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.410062:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1912:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.410067:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca3759c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1912:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410075:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1912:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.410078:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1912:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.410083:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca3759c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410091:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca3759c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410097:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca3759c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410105:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca3759c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410117:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.410123:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.410126:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca3759c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410209:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93098cd77200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.410213:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca3759c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410220:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca3759c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410231:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca3759c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410243:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079dd8af5/0xdb52b77d7ca3759c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1912:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410257:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.410259:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.410261:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.410301:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1911:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.410320:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca375a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1911:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410328:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1911:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.410331:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1911:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.410335:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca375a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410343:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca375a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410351:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca375a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410358:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca375a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410382:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.410390:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.410393:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca375a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410401:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.410404:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca375a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410411:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca375a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410421:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca375a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410630:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd7dca6/0xdb52b77d7ca375a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1911:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410646:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.410648:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.410649:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.410692:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1910:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.410697:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca375aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1910:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410705:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1910:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.410708:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1910:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.410712:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca375aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410725:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca375aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410732:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca375aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410738:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca375aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410750:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.410756:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.410760:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca375aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410765:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.410769:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca375aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410776:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca375aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410785:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca375aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410791:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f334b2/0xdb52b77d7ca375aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1910:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410803:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.410805:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.410806:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.410846:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x190f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.410851:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca375b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x190f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410859:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x190f:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.410861:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x190f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.410866:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca375b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410874:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca375b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410882:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca375b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410889:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca375b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410901:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.410906:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.410910:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca375b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410922:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.410926:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca375b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410933:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca375b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x190f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410943:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca375b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x190f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410950:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a5510d8/0xdb52b77d7ca375b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x190f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.410961:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.410963:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.410965:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.411003:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x190e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.411009:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca375b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x190e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411016:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x190e:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.411020:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x190e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.411024:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca375b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411033:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca375b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411042:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca375b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411049:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca375b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411061:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.411066:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.411070:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca375b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411076:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.411078:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca375b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411085:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca375b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x190e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411094:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca375b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x190e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411101:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d80ff1d/0xdb52b77d7ca375b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x190e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411114:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.411116:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.411118:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.411237:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x190d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.411242:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca375bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x190d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411250:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x190d:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.411254:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x190d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.411258:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca375bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411266:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca375bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411273:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca375bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411280:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca375bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411291:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.411296:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.411299:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca375bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411304:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.411320:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca375bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411330:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca375bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x190d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411339:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca375bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x190d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411345:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f72eb19/0xdb52b77d7ca375bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x190d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411355:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.411356:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.411357:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.411578:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x190c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.411583:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca375c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x190c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411590:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x190c:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.411592:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x190c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.411596:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca375c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411603:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca375c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411609:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca375c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411615:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca375c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411626:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.411632:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.411635:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca375c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411642:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.411645:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca375c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411653:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca375c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x190c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411662:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca375c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x190c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411669:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000396e1c1d/0xdb52b77d7ca375c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x190c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411680:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.411682:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.411684:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.411774:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x190b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.411780:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca375cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x190b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411788:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x190b:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.411791:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x190b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.411794:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca375cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411804:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca375cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411812:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca375cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411819:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca375cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411830:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.411835:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.411838:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca375cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411845:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.411848:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca375cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411856:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca375cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x190b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411866:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca375cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x190b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411873:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca375cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x190b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411885:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.411887:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.411888:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.411925:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x190a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.411930:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca375d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x190a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411937:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x190a:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.411940:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x190a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.411944:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca375d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411953:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca375d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411961:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca375d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x190a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411968:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca375d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411982:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.411988:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.411992:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca375d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.411998:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.412001:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca375d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x190a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412007:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca375d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x190a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412017:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca375d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x190a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412024:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1390/0xdb52b77d7ca375d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x190a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412036:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.412037:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.412039:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.412077:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1909:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.412082:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca375db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1909:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412089:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1909:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.412092:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1909:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.412096:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca375db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412104:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca375db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412112:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca375db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412119:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca375db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412208:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.412215:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.412219:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca375db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412228:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.412232:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca375db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412239:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca375db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412249:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca375db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412358:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a76386f/0xdb52b77d7ca375db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1909:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412574:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.412576:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.412578:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.412626:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1908:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.412632:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca375e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1908:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412640:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1908:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.412643:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1908:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.412647:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca375e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412656:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca375e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412664:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca375e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412671:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca375e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412684:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.412691:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.412695:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca375e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412701:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.412705:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca375e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412711:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca375e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412721:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca375e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412727:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc42eb40/0xdb52b77d7ca375e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1908:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.412739:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.412741:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.412743:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.413015:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1907:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.413021:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca375e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1907:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413029:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1907:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.413032:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1907:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.413037:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca375e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413050:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca375e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413057:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca375e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413063:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca375e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413076:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.413083:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.413086:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca375e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413093:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.413096:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca375e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413103:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca375e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413113:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca375e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413120:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca375e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1907:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413208:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.413210:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.413212:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.413254:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1906:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.413259:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca375f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1906:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413267:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1906:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.413270:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1906:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.413275:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca375f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413284:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca375f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413291:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca375f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413297:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca375f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413319:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109632.413326:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109632.413329:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca375f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413339:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.413340:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.413343:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca375f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413344:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.413351:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca375f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413360:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca375f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413367:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073d05bcd/0xdb52b77d7ca375f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1906:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413503:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.413590:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.413592:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.413594:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.413638:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1905:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.413644:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca375f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1905:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413652:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1905:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.413655:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1905:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.413659:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca375f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413668:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca375f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413676:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca375f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413682:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca375f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413706:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109632.413724:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109632.413730:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca375f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413737:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07800 already unused, calling callback (ffffffffc0e7cfd0) 00002000:00010000:3.0:1786109632.413741:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1904:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109632.413741:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca375f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413746:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca375fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1904:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413749:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca375f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413753:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1904:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.413756:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1904:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.413761:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca375fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413761:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca375f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413769:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4770689/0xdb52b77d7ca375f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1905:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413771:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca375fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413779:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca375fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413785:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109632.413786:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.413787:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca375fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413788:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.413814:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109632.413827:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109632.413831:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca375fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413838:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109632.413841:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca375fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413848:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca375fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109632.413849:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1903:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.413854:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37605 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1903:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413858:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca375fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413861:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1903:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.413865:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1903:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109632.413865:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b27a60/0xdb52b77d7ca375fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1904:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413869:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413877:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413878:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109632.413879:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109632.413881:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.413885:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37605 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413893:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.413912:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1786109632.413937:0:43912:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:6402 00010000:00010000:1.0:1786109632.413939:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109632.413942:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413953:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109632.413956:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37605 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413962:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37605 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413971:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37605 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413976:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047599f64/0xdb52b77d7ca37605 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1903:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.413988:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109632.413989:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109632.413991:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109632.414034:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:196412:x1872862933317760:12345-0@lo:5:osp-pre-0-0.0 Request processed in 38914us (39248us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109632.414042:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23129 00000100:00100000:1.0:1786109632.414174:0:196412:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c57b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:196412:1872862933317760:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1786109632.414188:0:196412:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x1921:0x0] from OST, last_created [0x280000400:0x1921:0x0]last_used is [0x280000400:0x1902:0x0] 00000100:00100000:1.0:1786109632.414266:0:196412:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:196412:1872862933318016:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1786109632.414301:0:196412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109632.414332:0:196412:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9689180 going to sleep for 11 seconds 00000100:00100000:1.0:1786109632.414343:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109632.414353:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933317888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109632.414378:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109632.414468:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933318016 00000100:00100000:3.0:1786109632.414475:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933318016 00000100:00100000:3.0:1786109632.414511:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23131 00000100:00100000:3.0:1786109632.414519:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:196412:x1872862933318016:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1786109632.415353:0:179242:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 6434 00000100:00100000:0.0:1786109632.415844:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933317888 00000100:00100000:0.0:1786109632.415851:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933317888 00000100:00100000:0.0:1786109632.415893:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5869 00000100:00100000:0.0:1786109632.415902:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933317888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109632.415918:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109632.415981:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933317888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109632.415987:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5869 00000100:00100000:0.0:1786109632.416031:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933317888:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1786109632.416066:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109632.416074:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca3760c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416088:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e1:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:0.0:1786109632.416092:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109632.416098:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca3760c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416112:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca3760c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416122:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca3760c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416211:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca3760c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416228:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1786109632.416290:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109632.416295:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca37613 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416304:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e0:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:0.0:1786109632.416319:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109632.416324:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca37613 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416333:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca37613 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416341:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca37613 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416348:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca37613 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416363:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1786109632.416600:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109632.416606:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca3760c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416614:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109632.416618:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca3760c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416628:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca3760c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416644:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca3760c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416653:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0aa7a4e/0xdb52b77d7ca3760c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416671:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109632.416675:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca37613 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416683:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109632.416686:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca37613 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416693:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca37613 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416704:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca37613 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416711:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f1aedcf/0xdb52b77d7ca37613 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416724:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.416726:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.416728:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1786109632.416781:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109632.416787:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca3761a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416795:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18df:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:0.0:1786109632.416797:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109632.416801:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca3761a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416815:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca3761a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416822:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca3761a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416828:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca3761a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416840:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109632.416847:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109632.416851:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca3761a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416858:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109632.416861:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca3761a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416869:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca3761a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109632.416871:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:196412:x1872862933318016:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2352us (2568us total) trans 38654705668 rc 0/0 00000100:00100000:3.0:1786109632.416878:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23131 00010000:00010000:0.0:1786109632.416879:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca3761a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416886:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000410741a9/0xdb52b77d7ca3761a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416898:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.416900:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.416902:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.416934:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1786109632.416939:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109632.416943:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca37621 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416951:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18de:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:0.0:1786109632.416954:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109632.416958:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca37621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416966:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca37621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109632.416973:0:196412:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:196412:1872862933318016:0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1786109632.416973:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca37621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.416980:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca37621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109632.416985:0:196412:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x1921:0x0]-[0x280000400:0x1941:0x0] 00010000:00010000:0.0:1786109632.416993:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109632.416999:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109632.417003:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca37621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417014:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109632.417017:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca37621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417024:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca37621 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417034:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca37621 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417040:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069eea867/0xdb52b77d7ca37621 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417052:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.417054:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.417055:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1786109632.417092:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109632.417098:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca37628 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417104:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18dd:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:0.0:1786109632.417107:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109632.417111:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca37628 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417120:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca37628 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417203:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca37628 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417214:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca37628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417224:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1786109632.417263:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109632.417268:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca3762f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417275:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18dc:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:0.0:1786109632.417278:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109632.417282:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca3762f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417290:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca3762f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417297:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca3762f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417304:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca3762f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417334:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1786109632.417341:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109632.417345:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca37628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417351:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109632.417355:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca37628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417362:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca37628 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417809:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca37628 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417819:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca37628 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417833:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109632.417836:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca3762f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417843:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109632.417846:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca3762f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417859:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca3762f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417869:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca3762f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417876:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca3762f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.417887:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.417888:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.417891:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.418126:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109632.419289:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.419297:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37636 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419319:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18db:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.419322:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.419328:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419339:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419348:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419363:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419382:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109632.419392:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109632.419396:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419403:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.419407:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419415:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419428:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37636 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419453:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37636 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419467:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.419468:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.419470:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109632.419511:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.419516:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352071d3/0xdb52b77d7ca3763d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419524:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18da:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.419527:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.419543:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000352071d3/0xdb52b77d7ca3763d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419552:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000352071d3/0xdb52b77d7ca3763d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419560:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352071d3/0xdb52b77d7ca3763d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419567:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000352071d3/0xdb52b77d7ca3763d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419586:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109632.419621:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.419625:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca37644 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419635:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d9:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.419638:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.419642:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca37644 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419655:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca37644 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419662:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca37644 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419668:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca37644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419679:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786109632.419707:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.419712:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca3764b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419719:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d8:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.419721:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.419725:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca3764b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419736:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca3764b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419743:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca3764b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419754:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca3764b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419765:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1786109632.419771:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786109632.419775:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000352071d3/0xdb52b77d7ca3763d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419781:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.419784:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000352071d3/0xdb52b77d7ca3763d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419791:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000352071d3/0xdb52b77d7ca3763d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419799:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000352071d3/0xdb52b77d7ca3763d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419806:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000352071d3/0xdb52b77d7ca3763d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419816:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786109632.419819:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca37644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419829:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.419832:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca37644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419839:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca37644 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419846:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca37644 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419851:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca37644 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419859:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109632.419861:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca3764b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419866:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.419869:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca3764b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419875:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca3764b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419882:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca3764b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419889:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca3764b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419898:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.419899:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.419900:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109632.419929:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.419933:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401b1c8/0xdb52b77d7ca37652 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419939:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d7:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.419942:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.419945:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401b1c8/0xdb52b77d7ca37652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419953:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401b1c8/0xdb52b77d7ca37652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419959:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401b1c8/0xdb52b77d7ca37652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419966:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401b1c8/0xdb52b77d7ca37652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419975:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109632.419980:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109632.419983:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401b1c8/0xdb52b77d7ca37652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419989:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.419992:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401b1c8/0xdb52b77d7ca37652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.419998:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401b1c8/0xdb52b77d7ca37652 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420006:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401b1c8/0xdb52b77d7ca37652 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420012:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401b1c8/0xdb52b77d7ca37652 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420021:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.420023:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.420024:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109632.420052:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.420056:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e25eb66/0xdb52b77d7ca37659 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420063:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d6:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.420066:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.420069:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e25eb66/0xdb52b77d7ca37659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420082:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e25eb66/0xdb52b77d7ca37659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420088:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e25eb66/0xdb52b77d7ca37659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420094:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e25eb66/0xdb52b77d7ca37659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420103:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109632.420108:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109632.420111:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e25eb66/0xdb52b77d7ca37659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420117:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.420119:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e25eb66/0xdb52b77d7ca37659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420125:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e25eb66/0xdb52b77d7ca37659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420134:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e25eb66/0xdb52b77d7ca37659 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420140:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e25eb66/0xdb52b77d7ca37659 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420151:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.420153:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.420155:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109632.420192:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.420197:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37660 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420272:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d5:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.420275:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.420279:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420287:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420294:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420300:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420320:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109632.420326:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109632.420329:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420340:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.420343:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420350:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420362:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37660 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420369:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37660 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420381:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.420382:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.420384:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109632.420422:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.420427:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca37667 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420452:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d4:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.420455:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.420459:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca37667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420468:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca37667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420476:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca37667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420483:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca37667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420496:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109632.420502:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109632.420506:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca37667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420512:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.420514:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca37667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420521:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca37667 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420616:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca37667 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.420624:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca37667 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421215:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.421218:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.421220:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109632.421614:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.421621:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca3766e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421630:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d3:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.421633:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.421637:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca3766e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421646:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca3766e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421653:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca3766e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421660:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca3766e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421674:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109632.421683:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109632.421686:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca3766e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421692:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.421696:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca3766e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421708:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca3766e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421717:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca3766e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421723:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca3766e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421734:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.421735:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.421737:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109632.421770:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.421775:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca37675 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421782:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d2:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.421784:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.421788:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca37675 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421796:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca37675 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421802:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca37675 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421809:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca37675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421819:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109632.421823:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109632.421827:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca37675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421832:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.421835:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca37675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421842:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca37675 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421850:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca37675 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421856:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca37675 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421866:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.421867:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.421869:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109632.421895:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.421900:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3767c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421907:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d1:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.421909:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.421913:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3767c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421921:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3767c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421928:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3767c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421935:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3767c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421944:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109632.421949:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109632.421951:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3767c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421957:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.421959:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3767c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421966:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3767c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421975:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3767c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421981:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3767c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.421991:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.421992:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.421994:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109632.422020:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.422025:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca37683 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422032:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d0:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.422034:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.422038:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca37683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422046:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca37683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422052:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca37683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422060:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca37683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422070:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109632.422075:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109632.422078:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca37683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422084:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.422087:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca37683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422093:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca37683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422101:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca37683 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422107:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca37683 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422116:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.422117:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.422118:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109632.422148:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.422152:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6dd1d31/0xdb52b77d7ca3768a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422159:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18cf:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.422163:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.422167:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6dd1d31/0xdb52b77d7ca3768a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422176:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6dd1d31/0xdb52b77d7ca3768a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422183:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6dd1d31/0xdb52b77d7ca3768a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422191:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6dd1d31/0xdb52b77d7ca3768a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.422300:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.422334:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.422719:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109632.422761:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.422766:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37691 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422774:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ce:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.422776:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.422780:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422788:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422795:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422801:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422814:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786109632.422843:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.422847:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37698 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422855:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18cd:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.422857:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.422861:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422868:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422875:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422882:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422892:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1786109632.422923:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.422928:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939494ee/0xdb52b77d7ca3769f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422937:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18cc:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.422939:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.422943:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000939494ee/0xdb52b77d7ca3769f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422952:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000939494ee/0xdb52b77d7ca3769f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422959:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939494ee/0xdb52b77d7ca3769f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422965:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000939494ee/0xdb52b77d7ca3769f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.422975:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1786109632.422985:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1786109632.422990:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6dd1d31/0xdb52b77d7ca3768a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.422998:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109632.423001:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6dd1d31/0xdb52b77d7ca3768a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423009:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6dd1d31/0xdb52b77d7ca3768a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786109632.423010:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.423015:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000369ed86/0xdb52b77d7ca376a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423021:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18cb:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:1.0:1786109632.423021:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6dd1d31/0xdb52b77d7ca3768a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423024:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.423029:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000369ed86/0xdb52b77d7ca376a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423029:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6dd1d31/0xdb52b77d7ca3768a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423038:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000369ed86/0xdb52b77d7ca376a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423043:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786109632.423047:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000369ed86/0xdb52b77d7ca376a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423047:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423055:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000369ed86/0xdb52b77d7ca376a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423055:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109632.423058:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423063:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1786109632.423066:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37691 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423080:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37691 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423087:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37691 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786109632.423092:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.423095:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919b973f/0xdb52b77d7ca376ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423097:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786109632.423100:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423103:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ca:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.423106:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109632.423107:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.423110:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000919b973f/0xdb52b77d7ca376ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423111:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423119:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37698 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423120:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000919b973f/0xdb52b77d7ca376ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423128:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37698 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423136:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37698 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423147:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786109632.423150:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000939494ee/0xdb52b77d7ca3769f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423157:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bd000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109632.423159:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000939494ee/0xdb52b77d7ca3769f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423166:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000939494ee/0xdb52b77d7ca3769f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423175:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000939494ee/0xdb52b77d7ca3769f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423183:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000939494ee/0xdb52b77d7ca3769f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423194:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109632.423197:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000369ed86/0xdb52b77d7ca376a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423203:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bd600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109632.423206:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000369ed86/0xdb52b77d7ca376a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.423207:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.423212:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109632.423214:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000369ed86/0xdb52b77d7ca376a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.423215:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109632.423223:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000369ed86/0xdb52b77d7ca376a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423232:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000369ed86/0xdb52b77d7ca376a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423235:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919b973f/0xdb52b77d7ca376ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423242:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.423243:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000919b973f/0xdb52b77d7ca376ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109632.423243:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109632.423245:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.423290:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109632.423344:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.423349:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011d64c65/0xdb52b77d7ca376b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423356:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c9:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.423359:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.423363:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011d64c65/0xdb52b77d7ca376b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423575:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011d64c65/0xdb52b77d7ca376b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423584:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011d64c65/0xdb52b77d7ca376b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423591:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011d64c65/0xdb52b77d7ca376b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.423641:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109632.423646:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000919b973f/0xdb52b77d7ca376ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.423652:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bc400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109632.423655:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000919b973f/0xdb52b77d7ca376ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.423662:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000919b973f/0xdb52b77d7ca376ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.423673:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000919b973f/0xdb52b77d7ca376ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.423679:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000919b973f/0xdb52b77d7ca376ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.423691:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109632.423693:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011d64c65/0xdb52b77d7ca376b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.423699:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bde00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109632.423702:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011d64c65/0xdb52b77d7ca376b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.423709:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011d64c65/0xdb52b77d7ca376b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.423717:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011d64c65/0xdb52b77d7ca376b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.423724:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.423725:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.423727:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.423785:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1786109632.423789:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011d64c65/0xdb52b77d7ca376b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786109632.423837:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.423842:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098cbbcda/0xdb52b77d7ca376bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423849:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c8:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.423975:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.423980:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098cbbcda/0xdb52b77d7ca376bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423991:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098cbbcda/0xdb52b77d7ca376bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.423999:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098cbbcda/0xdb52b77d7ca376bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.424006:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098cbbcda/0xdb52b77d7ca376bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.424029:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109632.424033:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098cbbcda/0xdb52b77d7ca376bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.424040:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bc000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109632.424044:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098cbbcda/0xdb52b77d7ca376bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.424051:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098cbbcda/0xdb52b77d7ca376bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.424062:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098cbbcda/0xdb52b77d7ca376bb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.424069:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.424070:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.424072:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.424191:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1786109632.424197:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098cbbcda/0xdb52b77d7ca376bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786109632.424247:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109632.424251:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd387d6/0xdb52b77d7ca376c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.424258:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c7:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:2.0:1786109632.424261:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109632.424265:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd387d6/0xdb52b77d7ca376c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.424274:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cd387d6/0xdb52b77d7ca376c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.424281:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd387d6/0xdb52b77d7ca376c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.424288:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cd387d6/0xdb52b77d7ca376c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.424318:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109632.424324:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cd387d6/0xdb52b77d7ca376c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.424330:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bd200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109632.424333:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd387d6/0xdb52b77d7ca376c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.424341:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd387d6/0xdb52b77d7ca376c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.424351:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cd387d6/0xdb52b77d7ca376c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.424359:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.424361:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.424362:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.425237:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1786109632.425245:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd387d6/0xdb52b77d7ca376c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.425697:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.425774:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.425780:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca376c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.425789:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c6:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.425793:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.425797:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca376c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.425808:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca376c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.425816:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca376c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.425830:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca376c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.425859:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109632.425896:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.425901:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca376d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.425910:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c5:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.425913:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.425917:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca376d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.425926:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca376d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.425934:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca376d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.425941:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca376d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.425961:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786109632.425996:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.426000:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca376d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426008:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c4:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.426011:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.426015:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca376d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426023:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca376d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426029:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca376d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426035:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca376d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426047:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1786109632.426083:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.426088:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca376de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426095:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c3:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.426098:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.426101:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca376de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426110:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca376de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426118:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca376de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426125:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca376de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426137:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1786109632.426144:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786109632.426148:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca376c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426155:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.426159:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca376c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426167:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca376c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426180:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca376c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426187:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca376c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.426198:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109632.426200:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109632.426204:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca376d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.426204:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca376d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426211:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109632.426212:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109632.426215:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca376d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.426215:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca376d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426223:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca376d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.426224:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca376d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426233:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca376d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.426234:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca376d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426241:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca376d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.426241:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca376d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426251:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109632.426252:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.426254:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca376de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.426254:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109632.426256:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.426260:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109632.426261:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.426263:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca376de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426270:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca376de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426285:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca376de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426293:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca376de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426303:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.426305:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109632.426319:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109632.426361:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109632.426367:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca376e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426375:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c2:0x0].0x0 since=8489s v=(0 0) 00010000:00010000:3.0:1786109632.426378:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109632.426382:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca376e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426390:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca376e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426398:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca376e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426406:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca376e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109632.426424:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109632.426500:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109632.426506:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca376e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.426513:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109632.426516:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca376e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.426523:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca376e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109632.426618:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.426828:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca376e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.426837:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca376e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109632.426848:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.426850:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109632.426852:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1786109632.427273:0:8442:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6274 00000100:00100000:3.0:1786109632.427416:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:196414:x1872862933317632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 51083us (52449us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109632.427426:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23130 00000100:00100000:1.0:1786109632.427807:0:196414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:196414:1872862933317632:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1786109632.427820:0:196414:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x18e1:0x0] from OST, last_created [0x2c0000401:0x18e1:0x0]last_used is [0x2c0000401:0x1882:0x0] 00000100:00100000:1.0:1786109632.427890:0:196414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:196414:1872862933318272:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1786109632.427920:0:196414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109632.427940:0:196414:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9689300 going to sleep for 11 seconds 00000100:00100000:1.0:1786109632.427952:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109632.427962:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933318144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109632.427985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109632.428012:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933318272 00000100:00100000:1.0:1786109632.428017:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933318272 00000100:00100000:1.0:1786109632.428050:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23132 00000100:00100000:1.0:1786109632.428058:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:196414:x1872862933318272:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1786109632.428092:0:43920:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6370 00000100:00100000:1.0:1786109632.429935:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:196414:x1872862933318272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1872us (2010us total) trans 4294975826 rc 0/0 00000100:00100000:1.0:1786109632.429945:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23132 00000100:00100000:1.0:1786109632.429975:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933318144 00000100:00100000:1.0:1786109632.429982:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933318144 00000100:00100000:1.0:1786109632.430011:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5870 00000100:00100000:1.0:1786109632.430018:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933318144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109632.430036:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141760 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109632.430066:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933318144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109632.430072:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5870 00000100:00100000:1.0:1786109632.430115:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933318144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109632.430179:0:196414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:196414:1872862933318272:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1786109632.430190:0:196414:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x18e1:0x0]-[0x2c0000401:0x1901:0x0] 00010000:00010000:1.0:1786109632.460603:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109632.462835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109632.462887:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109632.463748:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922118272 00000100:00100000:3.0:1786109632.463758:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922118272 00000100:00100000:3.0:1786109632.463869:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:3.0:1786109632.463881:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922118272:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109632.463944:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922118272:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 65us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109632.463952:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:1.0:1786109632.464589:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922118400 00000100:00100000:1.0:1786109632.464597:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922118400 00000100:00100000:1.0:1786109632.464673:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 311 00000100:00100000:1.0:1786109632.464683:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922118400:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109632.464768:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922118400:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 87us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109632.464775:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 311 00000100:00100000:1.0:1786109632.775609:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933318400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109632.775676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109632.776582:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933318400 00000100:00100000:1.0:1786109632.776593:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933318400 00000100:00100000:1.0:1786109632.776645:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5871 00000100:00100000:1.0:1786109632.776655:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933318400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109632.776679:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141760 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109632.776737:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933318400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109632.776745:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5871 00000100:00100000:1.0:1786109632.776792:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933318400:0@lo:13:osp-pre-1-1.0 00000020:00000004:1.0:1786109633.120062:0:196733:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1786109633.121114:0:196733:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1786109633.476910:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1786109633.970272:0:196783:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1786109633.970968:0:196783:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1786109634.500841:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109634.820930:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933318528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109634.821005:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109634.821189:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933318528 00000100:00100000:1.0:1786109634.821197:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933318528 00000100:00080000:2.0:1786109634.821306:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109634.821375:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5872 00000100:00100000:1.0:1786109634.821388:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933318528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109634.821418:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109634.821553:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933318528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 169us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109634.821561:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5872 00000100:00100000:0.0:1786109634.821691:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933318528:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1786109635.524702:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109636.225860:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109636.225949:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922118528 00000100:00100000:0.0:1786109636.225959:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922118528 00000100:00080000:2.0:1786109636.226065:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109636.226103:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1085 00000100:00100000:0.0:1786109636.226114:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+7:163104:x1872862922118528:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109636.226136:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109636.226155:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca376ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a167b expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109636.226211:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca376f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109636.226224:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca376f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109636.226268:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca376f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109636.226390:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:0.0:1786109636.226394:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109636.226421:0:188678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca376f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109636.226478:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca376ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a167b expref: 9 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109636.226508:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca376f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a167b expref: 8 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109636.226518:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:0.0:1786109636.226520:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109636.226523:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3400, rc 0) 00000100:00100000:0.0:1786109636.226582:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+8:163104:x1872862922118528:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 470us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109636.226589:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1085 00000100:00100000:3.0:1786109636.254925:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109636.255109:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922118656 00000100:00100000:2.0:1786109636.255118:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922118656 00000100:00100000:2.0:1786109636.255227:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1086 00000100:00100000:2.0:1786109636.255238:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+8:163104:x1872862922118656:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1786109636.255273:0:187900:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00000100:00100000:2.0:1786109636.255463:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+8:163104:x1872862922118656:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 193us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109636.255471:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1086 00000100:00100000:2.0:1786109636.261398:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109636.261631:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922118784 00000100:00100000:0.0:1786109636.261641:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922118784 00000100:00100000:0.0:1786109636.261766:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1087 00000100:00100000:0.0:1786109636.261778:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+5:163104:x1872862922118784:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:0.0:1786109636.261816:0:189813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00000100:00100000:0.0:1786109636.261934:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+5:163104:x1872862922118784:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 158us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109636.261942:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1087 00000100:00100000:0.0:1786109636.266155:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109636.266268:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922118912 00000100:00100000:3.0:1786109636.266277:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922118912 00000100:00100000:2.0:1786109636.266390:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23133 00000100:00100000:2.0:1786109636.266399:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2401:x1872862922118912:12345-192.168.203.38@tcp:8:lfs.0 00010000:00080000:2.0:1786109636.266458:0:43917:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp t0 exp 0000000000000000 cur 8492 last 0 00000020:00000080:2.0:1786109636.266490:0:43917:0:(genops.c:1406:class_connect()) connect: client fac74500-4523-4794-af20-dfdcdfae19c1, cookie 0xdb52b77d7ca376fa 00002000:00100000:2.0:1786109636.266500:0:43917:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fac74500-4523-4794-af20-dfdcdfae19c1/ffff930ac0c8b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786109636.266657:0:43917:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786109636.266724:0:43917:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786109636.266751:0:43917:0:(import.c:65:import_set_state_nolock()) ffff930ac0c89000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109636.266850:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922118912:12345-192.168.203.38@tcp:8:lfs.0 Request processed in 450us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109636.266857:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23133 00000100:00100000:3.0:1786109636.269555:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109636.269754:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922119040 00000100:00100000:1.0:1786109636.269763:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922119040 00000100:00100000:1.0:1786109636.269897:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5873 00000100:00100000:1.0:1786109636.269908:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:163104:x1872862922119040:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109636.269934:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109636.270007:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:163104:x1872862922119040:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 101us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109636.270014:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5873 00000100:00080000:2.0:1786109636.270476:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109636.272921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109636.273019:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922119168 00000100:00100000:2.0:1786109636.273028:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922119168 00000100:00100000:2.0:1786109636.273076:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23134 00000100:00100000:2.0:1786109636.273085:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:0+-99:2401:x1872862922119168:12345-192.168.203.38@tcp:8:lfs.0 00010000:00080000:2.0:1786109636.273129:0:179239:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp t0 exp 0000000000000000 cur 8492 last 0 00000020:00000080:2.0:1786109636.273161:0:179239:0:(genops.c:1406:class_connect()) connect: client fac74500-4523-4794-af20-dfdcdfae19c1, cookie 0xdb52b77d7ca37701 00002000:00100000:2.0:1786109636.273172:0:179239:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fac74500-4523-4794-af20-dfdcdfae19c1/ffff930ac0c8e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786109636.273189:0:179239:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786109636.273248:0:179239:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786109636.273276:0:179239:0:(import.c:65:import_set_state_nolock()) ffff930ab9966800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109636.273497:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922119168:12345-192.168.203.38@tcp:8:lfs.0 Request processed in 410us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109636.273505:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23134 00000100:00100000:0.0:1786109636.275951:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109636.276055:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922119296 00000100:00100000:3.0:1786109636.276064:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922119296 00000100:00100000:3.0:1786109636.276179:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5874 00000100:00100000:3.0:1786109636.276189:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:163104:x1872862922119296:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:3.0:1786109636.276211:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109636.276276:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:163104:x1872862922119296:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 88us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109636.276295:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5874 00000100:00080000:2.0:1786109636.276772:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786109636.548730:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109637.383704:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933319040:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.383793:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.383859:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933319552:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.383885:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.383903:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933320064:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.383933:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.383964:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1786109637.383970:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933318656:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.384004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.384029:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933319168:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.384051:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.384069:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933319680:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.384088:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.384103:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933320192:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.384120:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.384146:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933318784:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.384167:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.384264:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933319296:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.384303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.384322:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933319808:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.384350:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.384366:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1786109637.384371:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933318912:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.384390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.384796:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933319424:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.384825:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.384844:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933319936:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.384863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109637.384920:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933319552 00000100:00100000:0.0:1786109637.384929:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933319552 00000100:00100000:0.0:1786109637.384989:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933319680 00000100:00100000:0.0:1786109637.384993:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933319680 00000100:00100000:0.0:1786109637.385012:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933320192 00000100:00100000:0.0:1786109637.385015:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933320192 00000100:00100000:0.0:1786109637.385031:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933318784 00000100:00100000:0.0:1786109637.385034:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933318784 00000100:00100000:0.0:1786109637.385050:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933318912 00000100:00100000:0.0:1786109637.385053:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933318912 00000100:00100000:0.0:1786109637.385068:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933319424 00000100:00100000:0.0:1786109637.385071:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933319424 00000100:00100000:0.0:1786109637.385090:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1786109637.385327:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933319552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.385498:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933319552:12345-0@lo:400:kworker.0 Request processed in 78us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109637.385506:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1786109637.385534:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1786109637.385542:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933319680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.385577:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933319680:12345-0@lo:400:kworker.0 Request processed in 36us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109637.385583:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1786109637.385599:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1786109637.385605:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933320192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.385635:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933320192:12345-0@lo:400:kworker.0 Request processed in 31us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109637.385642:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1786109637.385658:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1786109637.385665:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933318784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.385701:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933318784:12345-0@lo:400:kworker.0 Request processed in 37us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109637.385711:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1786109637.385729:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1786109637.385736:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933318912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.385765:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933318912:12345-0@lo:400:kworker.0 Request processed in 31us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109637.385771:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1786109637.385787:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1786109637.385794:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933319424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.385822:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933319424:12345-0@lo:400:kworker.0 Request processed in 29us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109637.385828:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1786109637.385856:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933320064 00000100:00100000:0.0:1786109637.385861:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933320064 00000100:00100000:0.0:1786109637.385897:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933319168 00000100:00100000:0.0:1786109637.385900:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933319168 00000100:00100000:0.0:1786109637.385922:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933319296 00000100:00100000:0.0:1786109637.385925:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933319296 00000100:00100000:0.0:1786109637.385944:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933319936 00000100:00100000:0.0:1786109637.385947:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933319936 00000100:00100000:0.0:1786109637.385965:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7033 00000100:00100000:0.0:1786109637.385971:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933320064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.386007:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933320064:12345-0@lo:400:kworker.0 Request processed in 36us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109637.386013:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7033 00000100:00100000:0.0:1786109637.386025:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7034 00000100:00100000:0.0:1786109637.386031:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933319168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.386062:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933319168:12345-0@lo:400:kworker.0 Request processed in 31us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109637.386068:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7034 00000100:00100000:0.0:1786109637.386080:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7035 00000100:00100000:0.0:1786109637.386086:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933319296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.386115:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933319296:12345-0@lo:400:kworker.0 Request processed in 30us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109637.386121:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7035 00000100:00100000:0.0:1786109637.386132:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7036 00000100:00100000:0.0:1786109637.386139:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933319936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.386166:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933319936:12345-0@lo:400:kworker.0 Request processed in 27us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109637.386171:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7036 00000100:00100000:0.0:1786109637.386252:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933318912:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.386267:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933319424:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.386293:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933319936:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.386304:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933318784:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.386315:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933319296:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.386364:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933319168:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.386377:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933319680:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.386391:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933320192:0@lo:400:kworker.0 00000100:00100000:2.0:1786109637.388502:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933319040 00000100:00100000:2.0:1786109637.388524:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933319040 00000100:00100000:2.0:1786109637.388597:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933319808 00000100:00100000:2.0:1786109637.388601:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933319808 00000100:00100000:2.0:1786109637.388630:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12417 00000100:00100000:2.0:1786109637.388642:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933319040:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786109637.389376:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786109637.389385:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109637.389389:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109637.389543:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933319552:0@lo:400:kworker.0 00000100:00100000:3.0:1786109637.389683:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12418 00000100:00100000:3.0:1786109637.389696:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933319808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109637.389978:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933320448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109637.390389:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933319040:12345-0@lo:400:kworker.0 Request processed in 1747us (6592us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109637.391290:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933320064:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.391349:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933319040:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.391392:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933320320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109637.391479:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109637.391643:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12417 00000100:00100000:2.0:1786109637.391683:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933320320 00000100:00100000:2.0:1786109637.391690:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933320320 00000100:00100000:2.0:1786109637.391725:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12419 00000100:00100000:2.0:1786109637.391736:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933320320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109637.391781:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00000100:00100000:2.0:1786109637.391852:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933320320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109637.391859:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12419 00000100:00100000:2.0:1786109637.392199:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933318656 00000100:00100000:2.0:1786109637.392204:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933318656 00000100:00100000:2.0:1786109637.392235:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1786109637.392243:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933318656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.392341:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933320320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109637.392863:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933318656:12345-0@lo:400:kworker.0 Request processed in 617us (8854us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109637.392872:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1786109637.393085:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933319808:12345-0@lo:400:kworker.0 Request processed in 3390us (8730us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109637.393096:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12418 00000100:00100000:3.0:1786109637.393157:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933319808:0@lo:400:kworker.0 00000100:00100000:0.0:1786109637.393288:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933318656:0@lo:400:kworker.0 00000100:00100000:1.0:1786109637.393361:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109637.396449:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933320448 00000100:00100000:2.0:1786109637.396470:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933320448 00000100:00100000:2.0:1786109637.396543:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12420 00000100:00100000:2.0:1786109637.396556:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933320448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109637.396609:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00000100:00100000:2.0:1786109637.396724:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933320448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 169us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109637.396731:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12420 00000100:00100000:1.0:1786109637.397404:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933320448:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786109637.582695:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109637.649258:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109637.649312:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109637.649324:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922119424 00000100:00100000:3.0:1786109637.649339:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922119424 00000100:00100000:1.0:1786109637.649341:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109637.649372:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109637.649405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109637.649415:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:1.0:1786109637.649455:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922119936 00000100:00100000:1.0:1786109637.649461:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922119936 00000100:00100000:3.0:1786109637.649489:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922119424:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109637.649502:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7037 00000100:00100000:1.0:1786109637.649511:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fac74500-4523-4794-af20-dfdcdfae19c1+6:2403:x1872862922119936:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109637.649613:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922119424:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 186us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109637.649615:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fac74500-4523-4794-af20-dfdcdfae19c1+6:2403:x1872862922119936:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 103us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109637.649631:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:1.0:1786109637.649632:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7037 00000100:00100000:1.0:1786109637.649657:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922119808 00000100:00100000:1.0:1786109637.649661:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922119808 00000100:00100000:1.0:1786109637.649688:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7038 00000100:00100000:1.0:1786109637.649695:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922119808:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109637.649726:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922119808:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 31us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109637.649733:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7038 00000100:00100000:1.0:1786109637.651506:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922119680 00000100:00100000:1.0:1786109637.651520:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922119680 00000100:00100000:1.0:1786109637.651590:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922119552 00000100:00100000:1.0:1786109637.651594:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922119552 00000100:00100000:1.0:1786109637.651625:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 318 00000100:00100000:1.0:1786109637.651637:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922119680:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109637.651714:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922119680:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 79us (2403us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109637.651722:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 318 00000100:00100000:1.0:1786109637.651740:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 319 00000100:00100000:1.0:1786109637.651747:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+8:2402:x1872862922119552:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109637.651773:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+8:2402:x1872862922119552:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109637.651779:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 319 00000100:00080000:2.0:1786109637.651863:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109637.895646:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933320576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109637.895746:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109637.895825:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933320576 00000100:00100000:1.0:1786109637.895834:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933320576 00000100:00100000:1.0:1786109637.895891:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5875 00000100:00100000:1.0:1786109637.895902:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933320576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109637.895942:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109637.895995:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933320576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109637.896003:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5875 00000100:00100000:1.0:1786109637.896058:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933320576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109637.896325:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109637.896336:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933320704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109637.896370:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109637.896399:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933320704 00000100:00100000:3.0:1786109637.896403:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933320704 00000100:00100000:3.0:1786109637.896455:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5876 00000100:00100000:3.0:1786109637.896463:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933320704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786109637.896483:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109637.896521:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933320704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109637.896528:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5876 00000100:00100000:3.0:1786109637.896564:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933320704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109637.896630:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933320832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109637.896655:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109637.896684:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933320832 00000100:00100000:3.0:1786109637.896688:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933320832 00000100:00100000:3.0:1786109637.896706:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5877 00000100:00100000:3.0:1786109637.896711:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933320832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109637.896722:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109637.896749:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933320832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109637.896754:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5877 00000100:00100000:3.0:1786109637.896781:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933320832:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1786109638.409425:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00080000:2.0:1786109638.409477:0:194579:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705668 is committed 00000001:00080000:0.0:1786109638.409632:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383683 is committed 00000001:00080000:0.0:1786109638.409654:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383682 is committed 00000001:00100000:2.0:1786109638.411558:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00080000:2.0:1786109638.411573:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975826 is committed 00010000:00010000:1.0:1786109638.597886:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109639.625829:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109639.941317:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933320960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109639.941388:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109639.941821:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933320960 00000100:00100000:0.0:1786109639.941829:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933320960 00000100:00100000:0.0:1786109639.941896:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5878 00000100:00100000:0.0:1786109639.941907:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933320960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109639.941937:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00080000:2.0:1786109639.942241:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109639.943155:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933320960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1244us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109639.943165:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5878 00000100:00100000:1.0:1786109639.943245:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933320960:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1786109640.671511:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109641.732581:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786109641.960861:0:196976:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:1.0:1786109642.501375:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109642.502235:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933321472:0@lo:400:kworker.0 00000100:00100000:3.0:1786109642.502312:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109642.502366:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933321984:0@lo:400:kworker.0 00000100:00100000:3.0:1786109642.502386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109642.503802:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933321088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109642.505000:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933321344:0@lo:400:kworker.0 00000100:00100000:0.0:1786109642.506184:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933321472 00000100:00100000:0.0:1786109642.506197:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933321472 00000100:00100000:0.0:1786109642.506298:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933321984 00000100:00100000:0.0:1786109642.506302:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933321984 00000100:00100000:0.0:1786109642.506338:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1786109642.506349:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933321472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.507841:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109642.508418:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933321472:12345-0@lo:400:kworker.0 Request processed in 2067us (6102us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109642.508571:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1786109642.508607:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1786109642.508619:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933321216:0@lo:400:kworker.0 00000100:00100000:0.0:1786109642.508621:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933321984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109642.508681:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933321984:12345-0@lo:400:kworker.0 Request processed in 66us (6293us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109642.508689:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1786109642.508697:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109642.508733:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933321728:0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.508761:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109642.508782:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933322240:0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.508804:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109642.508824:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933322752:0@lo:400:kworker.0 00000100:00100000:0.0:1786109642.508850:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933322240 00000100:00100000:1.0:1786109642.508852:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109642.508859:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933322240 00000100:00100000:1.0:1786109642.508877:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1786109642.508886:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933321600:0@lo:400:kworker.0 00000100:00100000:0.0:1786109642.508892:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1786109642.508901:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933322240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.508914:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109642.508941:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933322112:0@lo:400:kworker.0 00000100:00100000:0.0:1786109642.508946:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933322240:12345-0@lo:400:kworker.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109642.508954:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1786109642.508967:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933322752 00000100:00100000:1.0:1786109642.508972:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109642.508972:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933322752 00000100:00100000:1.0:1786109642.508990:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933322624:0@lo:400:kworker.0 00000100:00100000:0.0:1786109642.508992:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933322112 00000100:00100000:0.0:1786109642.508997:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933322112 00000100:00100000:1.0:1786109642.509020:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109642.509022:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1786109642.509030:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933322752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.509061:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933322240:0@lo:400:kworker.0 00000100:00100000:0.0:1786109642.509074:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933322752:12345-0@lo:400:kworker.0 Request processed in 43us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109642.509082:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1786109642.509090:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933322752:0@lo:400:kworker.0 00000100:00100000:0.0:1786109642.509095:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1786109642.509104:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933322112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109642.509149:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933322112:12345-0@lo:400:kworker.0 Request processed in 46us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109642.509151:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933321088 00000100:00100000:1.0:1786109642.509157:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933321088 00000100:00100000:0.0:1786109642.509158:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:0.0:1786109642.509182:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109642.509186:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109642.509191:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933321600 00000100:00100000:1.0:1786109642.509195:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933321600 00000100:00100000:1.0:1786109642.509216:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12421 00000100:00100000:1.0:1786109642.509224:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9675500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3649:x1872862933321088:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109642.509251:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12422 00000100:00100000:0.0:1786109642.509262:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3649:x1872862933321600:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1786109642.509263:0:179257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00000100:00100000:1.0:1786109642.509304:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9675500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3649:x1872862933321088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109642.509311:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12421 00000100:00100000:1.0:1786109642.509330:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933321216 00000100:00100000:1.0:1786109642.509334:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933321216 00000100:00100000:1.0:1786109642.509360:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786109642.509366:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933321216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.511828:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933321216:12345-0@lo:400:kworker.0 Request processed in 2451us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109642.511837:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1872862933321600:12345-0@lo:400:kworker.0 Request processed in 2573us (2918us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109642.511846:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1786109642.511853:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12422 00000100:00100000:1.0:1786109642.511912:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933321728 00000100:00100000:1.0:1786109642.511920:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933321728 00000100:00100000:1.0:1786109642.511984:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933322624 00000100:00100000:1.0:1786109642.511987:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933322624 00000100:00100000:1.0:1786109642.512018:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7039 00000100:00100000:1.0:1786109642.512027:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933321728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.512083:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933321728:12345-0@lo:400:kworker.0 Request processed in 57us (3321us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109642.512090:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7039 00000100:00080000:0.0:1786109642.512107:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109642.512113:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109642.513281:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7040 00000100:00100000:1.0:1786109642.513301:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933322624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.513367:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933322624:12345-0@lo:400:kworker.0 Request processed in 74us (4349us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109642.513375:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7040 00000100:00100000:1.0:1786109642.513768:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383682 gen 2 00000004:00080000:1.0:1786109642.513774:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 343597383682 committed transno 343597383682 00000020:00080000:1.0:1786109642.513779:0:3649:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff930aa0e899c0 refcount 2 committed 0 result 0 batchid 21474840725 00000020:00080000:1.0:1786109642.513784:0:3649:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93098c0abc00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff930aa0e89240 00000020:00080000:1.0:1786109642.513788:0:3649:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200026d32:0x1:0x0].1 00000020:00080000:1.0:1786109642.513791:0:3649:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93098c0ab400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab2a6c800 00000020:00080000:1.0:1786109642.513794:0:3649:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002efa:0x1:0x0].1 00000100:00100000:1.0:1786109642.513857:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933321600:0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.513878:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933322112:0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.513891:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975826 gen 2 00000100:00100000:1.0:1786109642.513900:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933322624:0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.513912:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933321216:0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.513924:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933321728:0@lo:400:kworker.0 00000100:00100000:1.0:1786109642.513940:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933321088:0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1786109642.513984:0:187933:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 21474840725 committed batchid 17179869467 00000020:00080000:1.0:1786109642.514054:0:187933:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17179869467 00000100:00100000:3.0:1786109642.516111:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933321984:0@lo:400:kworker.0 00000100:00100000:3.0:1786109642.516302:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933322496:0@lo:400:kworker.0 00000100:00100000:2.0:1786109642.516353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109642.516362:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109642.516412:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933321344 00000100:00100000:0.0:1786109642.516420:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933321344 00000100:00100000:0.0:1786109642.516503:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1786109642.516511:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933321344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109642.516843:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933321344:12345-0@lo:400:kworker.0 Request processed in 331us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109642.516846:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933321344:0@lo:400:kworker.0 00000100:00100000:0.0:1786109642.516856:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1786109642.516860:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933321856:0@lo:400:kworker.0 00000100:00080000:0.0:1786109642.516885:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109642.516891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109642.516914:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933322368:0@lo:400:kworker.0 00000100:00100000:2.0:1786109642.516940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109642.516970:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933322880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109642.516991:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109642.517013:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933322368 00000100:00100000:0.0:1786109642.517018:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933322368 00000100:00100000:2.0:1786109642.517019:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933322880 00000100:00100000:2.0:1786109642.517025:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933322880 00000100:00100000:3.0:1786109642.517041:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933322496 00000100:00100000:3.0:1786109642.517047:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933322496 00000100:00100000:0.0:1786109642.517055:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12423 00000100:00100000:2.0:1786109642.517066:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12424 00000100:00100000:0.0:1786109642.517067:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933322368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109642.517078:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933322880:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109642.517090:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933321856 00000100:00100000:3.0:1786109642.517094:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933321856 00000100:00100000:0.0:1786109642.517115:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933322368:12345-0@lo:400:kworker.0 Request processed in 52us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109642.517119:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7041 00000100:00100000:0.0:1786109642.517129:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12423 00000100:00100000:3.0:1786109642.517131:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933322496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109642.517167:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933322496:12345-0@lo:400:kworker.0 Request processed in 39us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109642.517172:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7041 00000100:00100000:3.0:1786109642.517185:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7042 00000100:00100000:3.0:1786109642.517190:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933321856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109642.517217:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933321856:12345-0@lo:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109642.517222:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7042 00000100:00080000:3.0:1786109642.517254:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109642.517257:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00000024:2.0:1786109642.517746:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00000100:00100000:2.0:1786109642.517792:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933322880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 716us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109642.517800:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12424 00000100:00100000:2.0:1786109642.517842:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933322880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109642.517874:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933321856:0@lo:400:kworker.0 00000100:00100000:2.0:1786109642.517882:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933322368:0@lo:400:kworker.0 00000100:00100000:3.0:1786109642.517948:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705668 gen 2 00000100:00100000:3.0:1786109642.517964:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933322496:0@lo:400:kworker.0 00000100:00100000:3.0:1786109642.517990:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933321472:0@lo:400:kworker.0 00010000:00010000:1.0:1786109642.756782:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109642.786691:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109642.786735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109642.786778:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109642.786803:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922120064 00000100:00100000:3.0:1786109642.786813:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922120064 00000100:00100000:0.0:1786109642.786814:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109642.786849:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109642.786872:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:0.0:1786109642.786873:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922120320 00000100:00100000:0.0:1786109642.786879:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922120320 00000100:00100000:3.0:1786109642.786886:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922120064:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109642.786920:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922120192 00000100:00100000:0.0:1786109642.786924:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922120192 00000100:00100000:0.0:1786109642.786949:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 326 00000100:00100000:0.0:1786109642.786958:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922120320:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109642.786964:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922120064:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109642.786974:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:2.0:1786109642.786991:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922120576 00000100:00100000:2.0:1786109642.786996:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922120576 00000100:00100000:0.0:1786109642.786998:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922120320:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 40us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109642.787007:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 326 00000100:00100000:0.0:1786109642.787027:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 327 00000100:00080000:3.0:1786109642.787030:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109642.787032:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922120448 00000100:00100000:2.0:1786109642.787036:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922120448 00000100:00080000:3.0:1786109642.787038:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109642.787038:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922120192:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:3.0:1786109642.787045:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786109642.787050:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109642.787065:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7043 00000100:00100000:2.0:1786109642.787073:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922120576:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109642.787110:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922120576:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 39us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109642.787116:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7043 00000100:00100000:1.0:1786109642.787136:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7044 00000100:00100000:1.0:1786109642.787153:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922120448:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109642.787183:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922120448:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109642.787219:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922120192:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 185us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109642.787226:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 327 00000100:00100000:1.0:1786109642.787359:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7044 00000100:00100000:2.0:1786109643.012848:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933323008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109643.012983:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109643.012997:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933323136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109643.013325:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109643.013336:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933323264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109643.013453:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109643.013620:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933323136 00000100:00100000:3.0:1786109643.013628:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933323136 00000100:00100000:3.0:1786109643.013677:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5879 00000100:00100000:3.0:1786109643.013687:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933323136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109643.013715:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109643.013955:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109643.013999:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933323008 00000100:00100000:2.0:1786109643.014003:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933323008 00000100:00100000:2.0:1786109643.014270:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5880 00000100:00100000:2.0:1786109643.014279:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933323008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109643.014292:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109643.014329:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933323008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109643.014335:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5880 00000100:00100000:2.0:1786109643.014382:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933323008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109643.014759:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933323136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1073us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109643.014767:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5879 00000100:00100000:0.0:1786109643.014830:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109643.014916:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933323264 00000100:00100000:2.0:1786109643.014921:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933323264 00000100:00100000:2.0:1786109643.014958:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5881 00000100:00100000:2.0:1786109643.014965:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933323264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109643.014985:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109643.015023:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933323264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109643.015028:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5881 00000100:00100000:0.0:1786109643.015192:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933323264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109643.015269:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933323136:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1786109643.543964:0:197025:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1786109643.782825:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109644.805114:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109645.080791:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933323392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109645.080872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109645.081395:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933323392 00000100:00100000:3.0:1786109645.081404:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933323392 00000100:00100000:3.0:1786109645.081513:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5882 00000100:00100000:3.0:1786109645.081524:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933323392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109645.081554:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109645.082291:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933323392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109645.082353:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933323392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 830us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109645.082361:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5882 00000100:00080000:0.0:1786109645.088483:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109645.246619:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109645.246730:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922120704 00000100:00100000:1.0:1786109645.246740:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922120704 00000100:00100000:1.0:1786109645.246857:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1088 00000100:00100000:1.0:1786109645.246868:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+7:163571:x1872862922120704:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:1.0:1786109645.246902:0:188678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00000100:00100000:1.0:1786109645.246999:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+7:163571:x1872862922120704:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 133us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109645.247006:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1088 00000100:00080000:0.0:1786109645.247036:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786109645.253846:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.254025:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922120832 00000100:00100000:0.0:1786109645.254034:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922120832 00000100:00080000:3.0:1786109645.254094:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109645.254117:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1089 00000100:00100000:0.0:1786109645.254129:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+5:163571:x1872862922120832:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:0.0:1786109645.254167:0:196401:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00000100:00100000:0.0:1786109645.254253:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+5:163571:x1872862922120832:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 127us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109645.254261:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1089 00000100:00100000:3.0:1786109645.262344:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.262579:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922120960 00000100:00100000:2.0:1786109645.262588:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922120960 00000100:00100000:2.0:1786109645.262653:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5883 00000100:00100000:2.0:1786109645.262664:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:163571:x1872862922120960:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1786109645.262689:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00080000:3.0:1786109645.262787:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109645.262932:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:163571:x1872862922120960:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 270us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109645.262940:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5883 00000100:00100000:2.0:1786109645.265600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.265696:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922121088 00000100:00100000:3.0:1786109645.265705:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922121088 00000100:00100000:3.0:1786109645.265806:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5884 00000100:00100000:3.0:1786109645.265817:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:163571:x1872862922121088:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:3.0:1786109645.265847:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109645.265916:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:163571:x1872862922121088:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 100us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109645.265923:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5884 00000100:00080000:0.0:1786109645.266297:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109645.314314:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.314608:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922121216 00000100:00100000:2.0:1786109645.314618:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922121216 00000100:00100000:2.0:1786109645.314708:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1090 00000100:00100000:2.0:1786109645.314719:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:163587:x1872862922121216:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109645.314741:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109645.314760:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bce00/0xdb52b77d7ca37708 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1682 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.314822:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3770f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.314834:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3770f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.314846:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3770f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.314859:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc600/0xdb52b77d7ca37716 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.314865:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc600/0xdb52b77d7ca37716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.314872:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc600/0xdb52b77d7ca37716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.314962:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc200/0xdb52b77d7ca3771d lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.314969:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc200/0xdb52b77d7ca3771d lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.314976:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc200/0xdb52b77d7ca3771d lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109645.315011:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1786109645.315015:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109645.315032:0:187899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc200/0xdb52b77d7ca3771d lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315044:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3770f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315050:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3770f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315057:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3770f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315063:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3770f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315069:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bc800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.315073:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3770f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315081:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3770f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315093:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:2.0:1786109645.315096:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.315100:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3770f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315105:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3770f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315118:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc600/0xdb52b77d7ca37716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315127:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc600/0xdb52b77d7ca37716 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315133:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc600/0xdb52b77d7ca37716 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315139:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bc600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.315141:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc600/0xdb52b77d7ca37716 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315147:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc600/0xdb52b77d7ca37716 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315155:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff930ab1d24c00) 00010000:00010000:2.0:1786109645.315157:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.315160:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc600/0xdb52b77d7ca37716 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315166:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc600/0xdb52b77d7ca37716 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315194:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bce00/0xdb52b77d7ca37708 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1682 expref: 9 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315207:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc200/0xdb52b77d7ca3771d lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1682 expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.315214:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930ab1d24500) 00010000:00010000:2.0:1786109645.315216:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109645.315219:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab28bc200, rc 0) 00000100:00100000:2.0:1786109645.315298:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+8:163587:x1872862922121216:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 581us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109645.315305:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1090 00000100:00100000:2.0:1786109645.324536:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.324647:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922121472 00000100:00100000:0.0:1786109645.324657:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922121472 00000100:00100000:0.0:1786109645.324726:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1091 00000100:00100000:0.0:1786109645.324738:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:163587:x1872862922121472:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109645.324757:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109645.324777:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37724 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1689 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.324849:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3772b lrc: 3/1,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.324862:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3772b lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.324872:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3772b lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.324882:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.324895:0:187901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37525 lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37246 expref: 6 pid: 196426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.324903:0:187901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 4/1,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.324933:0:187901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37525 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca37246 expref: 6 pid: 196426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109645.324948:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:187901:1872862933323520:0@lo:104: 00000100:00100000:0.0:1786109645.324988:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109645.325078:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dca80 going to sleep for 11 seconds 00000100:00100000:3.0:1786109645.325172:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933323520 00000100:00100000:3.0:1786109645.325176:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933323520 00000100:00100000:3.0:1786109645.325253:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5266 00000100:00100000:3.0:1786109645.325261:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:187901:x1872862933323520:12345-0@lo:104: 00010000:00010000:3.0:1786109645.325272:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca37525 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.325337:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786109645.325343:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:187901:x1872862933323520:12345-0@lo:104: Request processed in 84us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109645.325349:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5266 00010000:00010000:1.0:1786109645.325393:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109645.325400:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca37525 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.325408:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6de00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109645.325413:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 4/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca37525 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109645.325422:0:6514:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 4/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca37525 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.325475:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 2/0,0 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca37525 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.325482:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109645.325503:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 1/0,0 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca37525 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.325515:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f6de00/0xdb52b77d7ca37246 lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca37525 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.325533:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.325535:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.325537:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109645.325547:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933323648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109645.325577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109645.325682:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:187901:1872862933323520:0@lo:104: 00010000:00010000:2.0:1786109645.325699:0:187901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109645.325732:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933323648 00000100:00100000:2.0:1786109645.325735:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933323648 00010000:00010000:2.0:1786109645.325753:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37525 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xdb52b77d7ca37246 expref: 7 pid: 196426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109645.325785:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12646 00000100:00100000:2.0:1786109645.325793:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3647:x1872862933323648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109645.325802:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109645.326270:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37525 lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca37246 expref: 7 pid: 196426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326284:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0xf7117594 (ffff930ab9367c00) 00010000:00010000:2.0:1786109645.326289:0:177416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326298:0:177416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326306:0:177416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 4/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326330:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109645.326364:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933323648:12345-0@lo:103:ldlm_bl.0 Request processed in 572us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109645.326371:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12646 00010000:00010000:2.0:1786109645.326390:0:187901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326397:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109645.326543:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:187901:1872862933323776:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786109645.326570:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109645.326593:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a597540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109645.326608:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933323776 00000100:00100000:2.0:1786109645.326611:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933323776 00000100:00100000:2.0:1786109645.326638:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12425 00000100:00100000:2.0:1786109645.326644:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:187901:x1872862933323776:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786109645.326706:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:187901:x1872862933323776:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109645.326713:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12425 00000100:00100000:2.0:1786109645.326742:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:187901:1872862933323776:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1786109645.326779:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bce00/0xdb52b77d7ca37739 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326789:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bce00/0xdb52b77d7ca37739 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326797:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bce00/0xdb52b77d7ca37739 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326808:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3772b lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326814:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3772b lrc: 2/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326820:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3772b lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326825:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.326829:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3772b lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326835:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3772b lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326843:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930ab1d24500) 00010000:00010000:2.0:1786109645.326846:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.326849:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3772b lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326854:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3772b lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326863:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326869:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326875:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326880:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.326882:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326887:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326894:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0xf7117594 (ffff930ab9367c00) 00010000:00010000:2.0:1786109645.326896:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.326899:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 2/0,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326903:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37732 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326940:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37724 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1689 expref: 10 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326954:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bce00/0xdb52b77d7ca37739 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1689 expref: 9 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.326961:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930ab1d24c00) 00010000:00010000:2.0:1786109645.326963:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786109645.326966:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab28bce00, rc 0) 00000100:00100000:2.0:1786109645.327005:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+9:163587:x1872862922121472:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2270us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109645.327011:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1091 00000100:00100000:1.0:1786109645.327179:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933323648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109645.331396:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109645.331679:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922121600 00000100:00100000:1.0:1786109645.331688:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922121600 00000100:00100000:1.0:1786109645.331776:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1786109645.331787:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fac74500-4523-4794-af20-dfdcdfae19c1+5:163587:x1872862922121600:12345-192.168.203.38@tcp:900:lfs.0 00000100:00100000:1.0:1786109645.331896:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fac74500-4523-4794-af20-dfdcdfae19c1+5:163587:x1872862922121600:12345-192.168.203.38@tcp:900:lfs.0 Request processed in 111us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109645.331902:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1786109645.338772:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.338920:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922121856 00000100:00100000:0.0:1786109645.338931:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922121856 00000100:00100000:0.0:1786109645.339059:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1092 00000100:00100000:0.0:1786109645.339069:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+5:163587:x1872862922121856:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109645.339093:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109645.339118:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37740 lrc: 2/0,0 mode: --/CR res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1690 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109645.339239:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1786109645.339339:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37740 lrc: 1/0,0 mode: --/CR res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1690 expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.339353:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930984516000) 00010000:00010000:0.0:1786109645.339356:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786109645.339362:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37740 lrc: 0/0,0 mode: --/CR res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1690 expref: 7 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.339381:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2600, rc 0) 00000100:00100000:0.0:1786109645.339483:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:163587:x1872862922121856:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 415us (720us total) trans 25769804573 rc 301/301 00000100:00100000:0.0:1786109645.339490:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1092 00000100:00100000:2.0:1786109645.347146:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.347250:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922122112 00000100:00100000:3.0:1786109645.347260:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922122112 00000100:00100000:3.0:1786109645.347349:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1786109645.347360:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:163587:x1872862922122112:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1786109645.347636:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:163587:x1872862922122112:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 277us (497us total) trans 25769804574 rc 0/0 00000100:00100000:3.0:1786109645.347645:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1786109645.363599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.363952:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922122368 00000100:00100000:0.0:1786109645.363963:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922122368 00000100:00100000:0.0:1786109645.364038:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1093 00000100:00100000:0.0:1786109645.364060:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+7:163590:x1872862922122368:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109645.364084:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109645.364109:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3774e lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1697 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109645.364217:0:189813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID:189813:1872862933323904:0@lo:900:mdt00_004.0 00000100:00100000:0.0:1786109645.364279:0:189813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109645.364317:0:189813:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109645.364380:0:187911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933323904 00000100:00100000:2.0:1786109645.364385:0:187911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933323904 00000100:00100000:1.0:1786109645.364493:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786109645.364504:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:189813:x1872862933323904:12345-0@lo:900:mdt00_004.0 00000100:00100000:1.0:1786109645.364565:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:189813:x1872862933323904:12345-0@lo:900:mdt00_004.0 Request processed in 64us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109645.364573:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786109645.364649:0:189813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID:189813:1872862933323904:0@lo:900:mdt00_004.0 00000100:00100000:0.0:1786109645.364703:0:189813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933324032:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1786109645.364733:0:189813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109645.364757:0:189813:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109645.364791:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933324032 00000100:00100000:2.0:1786109645.364796:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933324032 00000100:00100000:2.0:1786109645.364834:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12426 00000100:00100000:2.0:1786109645.364842:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:189813:x1872862933324032:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1786109645.365018:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:189813:x1872862933324032:12345-0@lo:1000:mdt00_004.0 Request processed in 176us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109645.365026:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12426 00000100:00100000:1.0:1786109645.365079:0:189813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933324032:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1786109645.365147:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ac1f39000/0xdb52b77d7ca37755 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.365157:0:189813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ac1f39000/0xdb52b77d7ca37755 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.365167:0:189813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ac1f39000/0xdb52b77d7ca37755 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109645.365178:0:189813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933324160:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1786109645.365203:0:189813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109645.365271:0:189813:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a887180 going to sleep for 11 seconds 00000100:00100000:2.0:1786109645.365310:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933324160 00000100:00100000:2.0:1786109645.365313:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933324160 00000100:00100000:2.0:1786109645.365378:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12427 00000100:00100000:2.0:1786109645.365385:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:189813:x1872862933324160:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786109645.365409:0:179257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109645.365423:0:179257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3775c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37755 expref: -99 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.365477:0:179257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3775c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37755 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.365493:0:179257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3775c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37755 expref: 7 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.365502:0:179257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:2.0:1786109645.365504:0:179257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786109645.365507:0:179257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab28bc800, rc 0) 00000100:00100000:2.0:1786109645.365564:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:189813:x1872862933324160:12345-0@lo:101:mdt00_004.0 Request processed in 180us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109645.365572:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12427 00000100:00100000:0.0:1786109645.365628:0:189813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933324160:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1786109645.365640:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ac1f39000/0xdb52b77d7ca37755 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3775c expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.365650:0:189813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ac1f39000/0xdb52b77d7ca37755 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3775c expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109645.365665:0:189813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1786109645.365671:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ac1f39000/0xdb52b77d7ca37755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3775c expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.365679:0:189813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ac1f39000/0xdb52b77d7ca37755 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3775c expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.365732:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37763 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.365740:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37763 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.365749:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37763 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.365761:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3776a lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.365767:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3776a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.365772:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3776a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109645.365874:0:189813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933324288:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1786109645.365900:0:189813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109645.366130:0:189813:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc780 going to sleep for 11 seconds 00000100:00100000:1.0:1786109645.366210:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933324288 00000100:00100000:1.0:1786109645.366215:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933324288 00000100:00100000:1.0:1786109645.366267:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12428 00000100:00100000:1.0:1786109645.366275:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:189813:x1872862933324288:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1786109645.366326:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:189813:x1872862933324288:12345-0@lo:1000:mdt00_004.0 Request processed in 52us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109645.366331:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12428 00000100:00100000:0.0:1786109645.366396:0:189813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933324288:0@lo:1000:mdt00_004.0 00000004:00080000:0.0:1786109645.366657:0:189813:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x3c3:0x0], count =31 00000004:00080000:0.0:1786109645.366664:0:189813:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x3c3:0x0]+31 in llog 00000004:00080000:0.0:1786109645.366678:0:189813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x3e2:0x0], index 0: 0 00010000:00010000:0.0:1786109645.366835:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37771 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.366851:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37771 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.366860:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37771 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.366891:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37763 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.366899:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37763 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.366906:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37763 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.366912:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.366919:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37763 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.366928:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37763 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.366942:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930984516000) 00010000:00010000:0.0:1786109645.366944:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.366948:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37763 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.366960:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37763 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.366973:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e8dbfc9 reply state 00000000f214ccd1 transno 25769804575 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3776a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.366983:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3776a lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.366988:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x679fc7b1 (ffff930984516100) 00010000:00010000:0.0:1786109645.366990:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.366992:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109645.367021:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3774e lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1697 expref: 10 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.367037:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37771 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1697 expref: 9 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.367043:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x2:0x0].0x0 (ffff930984516300) 00010000:00010000:0.0:1786109645.367045:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109645.367047:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3000, rc 0) 00000100:00100000:0.0:1786109645.367195:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+10:163590:x1872862922122368:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 3138us (3604us total) trans 25769804575 rc 0/0 00000100:00100000:0.0:1786109645.367202:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1093 00000100:00100000:1.0:1786109645.373064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.373202:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922122624 00000100:00100000:2.0:1786109645.373213:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922122624 00000100:00100000:2.0:1786109645.373336:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1786109645.373348:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+10:163590:x1872862922122624:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.373897:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+11:163590:x1872862922122624:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 549us (840us total) trans 25769804576 rc 0/0 00000100:00100000:2.0:1786109645.373906:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1786109645.377999:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.378161:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922122880 00000100:00100000:0.0:1786109645.378171:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922122880 00000100:00100000:0.0:1786109645.378281:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1094 00000100:00100000:0.0:1786109645.378290:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+11:163590:x1872862922122880:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109645.378313:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109645.378334:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3777f lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a169e expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.378426:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37786 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.378486:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37786 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.378497:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37786 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.378524:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3778d lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.378532:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3778d lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.378539:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3778d lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109645.378967:0:188678:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x3c3:0x0], count =31 00000004:00080000:0.0:1786109645.378974:0:188678:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x3c3:0x0]+31 in llog 00000004:00080000:0.0:1786109645.378982:0:188678:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3e2:0x0], index 1: 0 00010000:00010000:0.0:1786109645.379114:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2800/0xdb52b77d7ca37794 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379123:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2800/0xdb52b77d7ca37794 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379131:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2800/0xdb52b77d7ca37794 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379160:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37786 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379166:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37786 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379172:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37786 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379178:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.379182:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37786 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379189:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37786 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379200:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930984516000) 00010000:00010000:0.0:1786109645.379204:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.379207:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37786 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379213:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37786 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.379237:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088256ce4 reply state 000000007c55b234 transno 25769804577 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3778d lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379247:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3778d lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379254:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x94c295fa (ffff930984516800) 00010000:00010000:0.0:1786109645.379256:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.379259:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109645.379287:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3777f lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a169e expref: 14 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379305:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2800/0xdb52b77d7ca37794 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a169e expref: 13 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.379312:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x3:0x0].0x0 (ffff930984516500) 00010000:00010000:0.0:1786109645.379314:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109645.379316:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2800, rc 0) 00000100:00100000:0.0:1786109645.379375:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+14:163590:x1872862922122880:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1086us (1385us total) trans 25769804577 rc 0/0 00000100:00100000:0.0:1786109645.379383:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1094 00000100:00100000:3.0:1786109645.383146:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.383256:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922123136 00000100:00100000:2.0:1786109645.383266:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922123136 00000100:00100000:2.0:1786109645.383325:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1786109645.383335:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+14:163590:x1872862922123136:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.383644:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+15:163590:x1872862922123136:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 309us (505us total) trans 25769804578 rc 0/0 00000100:00100000:2.0:1786109645.383651:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:1.0:1786109645.390834:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.390975:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922123392 00000100:00100000:2.0:1786109645.390984:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922123392 00000100:00100000:2.0:1786109645.391096:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1095 00000100:00100000:2.0:1786109645.391106:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+15:163590:x1872862922123392:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:2.0:1786109645.391127:0:196401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109645.391151:0:196401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca377a2 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16a5 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.391301:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca377a9 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.391318:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca377a9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.391329:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca377a9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.391342:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc000/0xdb52b77d7ca377b0 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.391349:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc000/0xdb52b77d7ca377b0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.391356:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc000/0xdb52b77d7ca377b0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109645.391797:0:196401:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x3e3:0x0], index 0: 0 00010000:00010000:2.0:1786109645.391935:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd200/0xdb52b77d7ca377b7 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.391945:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd200/0xdb52b77d7ca377b7 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.391953:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd200/0xdb52b77d7ca377b7 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.391984:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca377a9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.391992:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca377a9 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.391997:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca377a9 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.392004:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bde00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.392008:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca377a9 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.392014:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca377a9 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.392025:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930ab1d24300) 00010000:00010000:2.0:1786109645.392028:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.392032:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca377a9 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.392038:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca377a9 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.392049:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a99cdc57 reply state 00000000f77bd5b6 transno 25769804579 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc000/0xdb52b77d7ca377b0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.392059:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc000/0xdb52b77d7ca377b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.392064:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xc1e56442 (ffff930ab1d24b00) 00010000:00010000:2.0:1786109645.392067:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.392069:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109645.392094:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca377a2 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16a5 expref: 18 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.392112:0:196401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd200/0xdb52b77d7ca377b7 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16a5 expref: 17 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.392125:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x4:0x0].0x0 (ffff930ab1d24200) 00010000:00010000:2.0:1786109645.392128:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786109645.392130:0:196401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab28bd200, rc 0) 00000100:00100000:2.0:1786109645.392258:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+18:163590:x1872862922123392:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1153us (1432us total) trans 25769804579 rc 0/0 00000100:00100000:2.0:1786109645.392266:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1095 00000100:00100000:1.0:1786109645.396162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.396269:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922123648 00000100:00100000:2.0:1786109645.396279:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922123648 00000100:00100000:2.0:1786109645.396363:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:2.0:1786109645.396373:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+18:163590:x1872862922123648:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.396689:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+19:163590:x1872862922123648:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 303us (522us total) trans 25769804580 rc 0/0 00000100:00100000:2.0:1786109645.396698:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1786109645.399978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.400154:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922123904 00000100:00100000:2.0:1786109645.400163:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922123904 00000100:00100000:2.0:1786109645.400265:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1096 00000100:00100000:2.0:1786109645.400275:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+19:163590:x1872862922123904:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:2.0:1786109645.400296:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109645.400317:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca377c5 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16ac expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.400411:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca377cc lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.400425:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca377cc lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.400473:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca377cc lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.400486:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd000/0xdb52b77d7ca377d3 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.400493:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd000/0xdb52b77d7ca377d3 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.400499:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd000/0xdb52b77d7ca377d3 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109645.400994:0:187899:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3e3:0x0], index 1: 0 00010000:00010000:2.0:1786109645.401143:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc600/0xdb52b77d7ca377da lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401154:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc600/0xdb52b77d7ca377da lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401161:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc600/0xdb52b77d7ca377da lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401192:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca377cc lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401200:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca377cc lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401207:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca377cc lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401214:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca377cc lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401234:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bd600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.401239:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca377cc lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401247:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca377cc lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401258:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930ab1d24100) 00010000:00010000:2.0:1786109645.401261:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.401266:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca377cc lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401272:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca377cc lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.401286:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bd29adb reply state 0000000000f7e1f6 transno 25769804581 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd000/0xdb52b77d7ca377d3 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401296:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd000/0xdb52b77d7ca377d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401303:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xef08328a (ffff930ab1d24800) 00010000:00010000:2.0:1786109645.401305:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.401308:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109645.401337:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca377c5 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16ac expref: 22 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401356:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc600/0xdb52b77d7ca377da lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16ac expref: 21 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.401368:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x5:0x0].0x0 (ffff930ab1d24f00) 00010000:00010000:2.0:1786109645.401370:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786109645.401373:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab28bc600, rc 0) 00000100:00100000:2.0:1786109645.401867:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+22:163590:x1872862922123904:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1592us (1906us total) trans 25769804581 rc 0/0 00000100:00100000:2.0:1786109645.401876:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1096 00000100:00100000:0.0:1786109645.405156:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.405358:0:195049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922124160 00000100:00100000:2.0:1786109645.406418:0:195049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922124160 00000100:00100000:2.0:1786109645.406689:0:195049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1786109645.406703:0:195049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+22:163590:x1872862922124160:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.407369:0:195049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+23:163590:x1872862922124160:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 667us (2218us total) trans 25769804582 rc 0/0 00000100:00100000:2.0:1786109645.407379:0:195049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1786109645.411661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.411860:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922124416 00000100:00100000:2.0:1786109645.411870:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922124416 00000100:00100000:2.0:1786109645.412061:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1097 00000100:00100000:2.0:1786109645.412073:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+23:163590:x1872862922124416:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:2.0:1786109645.412097:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109645.412413:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca377e8 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16b3 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.413103:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca377ef lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.413204:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca377ef lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.413219:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca377ef lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.413248:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca377f6 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.413255:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca377f6 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.413263:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca377f6 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109645.413729:0:187901:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x3e4:0x0], index 0: 0 00010000:00010000:3.0:1786109645.414011:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06400/0xdb52b77d7ca377fd lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414021:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06400/0xdb52b77d7ca377fd lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414029:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06400/0xdb52b77d7ca377fd lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414061:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca377ef lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414068:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca377ef lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414075:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca377ef lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414082:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109645.414086:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca377ef lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414093:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca377ef lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414105:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930ab1d24100) 00010000:00010000:3.0:1786109645.414108:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109645.414112:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca377ef lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414118:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca377ef lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109645.414282:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a4ece13 reply state 00000000c10fc1a7 transno 25769804583 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca377f6 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414293:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca377f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414300:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x1c2b00d3 (ffff930a85613c00) 00010000:00010000:3.0:1786109645.414302:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109645.414305:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109645.414337:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca377e8 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16b3 expref: 26 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414356:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06400/0xdb52b77d7ca377fd lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16b3 expref: 25 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.414369:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x6:0x0].0x0 (ffff930a85613400) 00010000:00010000:3.0:1786109645.414372:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109645.414374:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f06400, rc 0) 00000100:00100000:3.0:1786109645.415009:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+26:163590:x1872862922124416:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 2936us (3354us total) trans 25769804583 rc 0/0 00000100:00100000:3.0:1786109645.415019:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1097 00000100:00100000:3.0:1786109645.421785:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.421953:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922124672 00000100:00100000:2.0:1786109645.421964:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922124672 00000100:00100000:2.0:1786109645.422060:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:2.0:1786109645.422071:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b60050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+26:163590:x1872862922124672:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.423038:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b60050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+27:163590:x1872862922124672:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 964us (1259us total) trans 25769804584 rc 0/0 00000100:00100000:2.0:1786109645.423049:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:0.0:1786109645.435246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109645.435736:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922124928 00000100:00100000:1.0:1786109645.435747:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922124928 00000100:00100000:1.0:1786109645.435924:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1098 00000100:00100000:1.0:1786109645.435938:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+27:163590:x1872862922124928:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:1.0:1786109645.435962:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109645.435987:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39400/0xdb52b77d7ca3780b lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16ba expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.436117:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37812 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.436334:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37812 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.436348:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37812 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.436364:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca37819 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.436371:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca37819 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.436378:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca37819 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109645.436873:0:187900:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3e4:0x0], index 1: 0 00010000:00010000:1.0:1786109645.437023:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39600/0xdb52b77d7ca37820 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437033:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39600/0xdb52b77d7ca37820 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437041:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39600/0xdb52b77d7ca37820 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437072:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37812 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437083:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37812 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437101:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37812 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437107:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109645.437111:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37812 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437118:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37812 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437140:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930a90aba400) 00010000:00010000:1.0:1786109645.437143:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109645.437147:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37812 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437153:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38800/0xdb52b77d7ca37812 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109645.437166:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4ed6de5 reply state 00000000cb603663 transno 25769804585 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca37819 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437176:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca37819 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437183:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x494dcf1b (ffff930a90abad00) 00010000:00010000:1.0:1786109645.437185:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109645.437188:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109645.437230:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39400/0xdb52b77d7ca3780b lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16ba expref: 30 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437250:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39600/0xdb52b77d7ca37820 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16ba expref: 29 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.437258:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x7:0x0].0x0 (ffff930a90aba300) 00010000:00010000:1.0:1786109645.437260:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786109645.437262:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac1f39600, rc 0) 00000100:00100000:1.0:1786109645.437331:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+30:163590:x1872862922124928:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1396us (2095us total) trans 25769804585 rc 0/0 00000100:00100000:1.0:1786109645.437339:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1098 00000100:00100000:1.0:1786109645.445587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.445710:0:195049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922125184 00000100:00100000:2.0:1786109645.445720:0:195049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922125184 00000100:00100000:2.0:1786109645.445779:0:195049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:2.0:1786109645.445790:0:195049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+30:163590:x1872862922125184:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.446081:0:195049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+31:163590:x1872862922125184:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 292us (503us total) trans 25769804586 rc 0/0 00000100:00100000:2.0:1786109645.446090:0:195049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:3.0:1786109645.455802:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.457300:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922125440 00000100:00100000:0.0:1786109645.457313:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922125440 00000100:00100000:0.0:1786109645.457382:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1099 00000100:00100000:0.0:1786109645.457672:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+31:163590:x1872862922125440:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109645.457884:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109645.457908:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3782e lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16c1 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.458007:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37835 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.458021:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37835 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.458033:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37835 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.458047:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3783c lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.458054:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3783c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.458061:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3783c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109645.458827:0:189813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x3e5:0x0], index 0: 0 00010000:00010000:0.0:1786109645.458977:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b800/0xdb52b77d7ca37843 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.458988:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b800/0xdb52b77d7ca37843 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.458996:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b800/0xdb52b77d7ca37843 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.459030:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37835 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.459038:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37835 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.459044:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37835 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.459050:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.459055:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37835 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.459062:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37835 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.459074:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930984516000) 00010000:00010000:0.0:1786109645.459078:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.459082:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37835 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.459102:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37835 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.459115:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077e5d477 reply state 000000004d8172b2 transno 25769804587 ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3783c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.459126:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3783c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.459131:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x76709d63 (ffff930984516e00) 00010000:00010000:0.0:1786109645.459134:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.459137:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109645.459165:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3782e lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16c1 expref: 34 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.459183:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b800/0xdb52b77d7ca37843 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16c1 expref: 33 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.459191:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x8:0x0].0x0 (ffff930984516700) 00010000:00010000:0.0:1786109645.459193:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109645.459196:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628b800, rc 0) 00000100:00100000:0.0:1786109645.459283:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+34:163590:x1872862922125440:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1617us (3490us total) trans 25769804587 rc 0/0 00000100:00100000:0.0:1786109645.459291:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1099 00000100:00100000:0.0:1786109645.479344:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.479599:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922125696 00000100:00100000:2.0:1786109645.479622:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922125696 00000100:00100000:2.0:1786109645.479721:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:2.0:1786109645.479733:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+34:163590:x1872862922125696:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.480026:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+35:163590:x1872862922125696:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 293us (689us total) trans 25769804588 rc 0/0 00000100:00100000:2.0:1786109645.480034:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:1.0:1786109645.497861:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.497955:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922125952 00000100:00100000:0.0:1786109645.497965:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922125952 00000100:00100000:0.0:1786109645.498033:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1100 00000100:00100000:0.0:1786109645.498043:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+35:163590:x1872862922125952:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109645.498063:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109645.498084:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37851 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16c8 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498183:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca37858 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498196:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca37858 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498207:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca37858 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498229:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca3785f lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498237:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca3785f lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498243:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca3785f lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109645.498595:0:188678:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3e5:0x0], index 1: 0 00010000:00010000:0.0:1786109645.498725:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca37866 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498734:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca37866 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498742:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca37866 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498773:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca37858 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498781:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca37858 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498788:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca37858 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498794:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.498798:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca37858 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498804:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca37858 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498816:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930984516000) 00010000:00010000:0.0:1786109645.498818:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.498822:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca37858 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498831:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca37858 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.498843:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064a9e9f8 reply state 0000000091d48aa7 transno 25769804589 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca3785f lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498854:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca3785f lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498859:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xa3936bac (ffff930984516f00) 00010000:00010000:0.0:1786109645.498861:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.498863:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109645.498891:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37851 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16c8 expref: 38 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498910:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca37866 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16c8 expref: 37 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.498918:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x9:0x0].0x0 (ffff930984516a00) 00010000:00010000:0.0:1786109645.498920:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109645.498922:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628ae00, rc 0) 00000100:00100000:0.0:1786109645.498975:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+38:163590:x1872862922125952:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 934us (1123us total) trans 25769804589 rc 0/0 00000100:00100000:0.0:1786109645.498981:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1100 00000100:00100000:0.0:1786109645.564230:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.564325:0:195049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922126208 00000100:00100000:2.0:1786109645.564335:0:195049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922126208 00000100:00100000:2.0:1786109645.564392:0:195049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:2.0:1786109645.564402:0:195049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+38:163590:x1872862922126208:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.567408:0:195049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+39:163590:x1872862922126208:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 2996us (3194us total) trans 25769804590 rc 0/0 00000100:00100000:2.0:1786109645.567422:0:195049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:1.0:1786109645.585687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.618724:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922126464 00000100:00100000:2.0:1786109645.618860:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922126464 00000100:00100000:2.0:1786109645.619049:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1101 00000100:00100000:2.0:1786109645.619060:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+39:163590:x1872862922126464:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:2.0:1786109645.619084:0:196401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109645.619110:0:196401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca37874 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16cf expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.619215:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca3787b lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.619240:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca3787b lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.619252:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca3787b lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.619264:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca37882 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.619272:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca37882 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.619279:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca37882 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109645.620201:0:196401:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x3e6:0x0], index 0: 0 00010000:00010000:2.0:1786109645.620347:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd400/0xdb52b77d7ca37889 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620360:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd400/0xdb52b77d7ca37889 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620369:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd400/0xdb52b77d7ca37889 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620402:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca3787b lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620421:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca3787b lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620567:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca3787b lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620641:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bda00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.620646:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca3787b lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620654:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca3787b lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620666:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930ab1d24300) 00010000:00010000:2.0:1786109645.620669:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.620673:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca3787b lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620679:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca3787b lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.620692:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d2070a2 reply state 0000000015e9de87 transno 25769804591 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca37882 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620702:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca37882 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620709:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xd0b639f4 (ffff930ab1d24d00) 00010000:00010000:2.0:1786109645.620711:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.620714:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109645.620746:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca37874 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16cf expref: 42 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620764:0:196401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd400/0xdb52b77d7ca37889 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16cf expref: 41 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.620772:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xa:0x0].0x0 (ffff930ab1d24e00) 00010000:00010000:2.0:1786109645.620774:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786109645.620777:0:196401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab28bd400, rc 0) 00000100:00100000:2.0:1786109645.620852:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+42:163590:x1872862922126464:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1793us (35181us total) trans 25769804591 rc 0/0 00000100:00100000:2.0:1786109645.620860:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1101 00000100:00100000:1.0:1786109645.633840:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.633987:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922126720 00000100:00100000:2.0:1786109645.633996:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922126720 00000100:00100000:2.0:1786109645.634061:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:2.0:1786109645.634072:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+42:163590:x1872862922126720:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.635548:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+43:163590:x1872862922126720:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 1471us (1710us total) trans 25769804592 rc 0/0 00000100:00100000:2.0:1786109645.635561:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:3.0:1786109645.644181:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.644373:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922126976 00000100:00100000:2.0:1786109645.644383:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922126976 00000100:00100000:0.0:1786109645.644836:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1102 00000100:00100000:0.0:1786109645.644851:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+43:163590:x1872862922126976:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:3.0:1786109645.645075:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109645.645101:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37897 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16d6 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.645206:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3789e lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.645230:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3789e lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.645242:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3789e lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.645255:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca378a5 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.645263:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca378a5 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.645270:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca378a5 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109645.645724:0:189813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3e6:0x0], index 1: 0 00010000:00010000:3.0:1786109645.645856:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca378ac lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.645866:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca378ac lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.645956:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca378ac lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.645991:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3789e lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.645998:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3789e lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.646006:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3789e lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.646012:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109645.646016:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3789e lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.646024:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3789e lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.646035:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930a85613900) 00010000:00010000:3.0:1786109645.646038:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109645.646043:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3789e lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.646053:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3789e lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109645.646066:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb50ac7e reply state 00000000ba60ae38 transno 25769804593 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca378a5 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.646077:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca378a5 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.646083:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xfdd9083c (ffff930a85613200) 00010000:00010000:3.0:1786109645.646085:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109645.646088:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109645.646118:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37897 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16d6 expref: 46 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.646136:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca378ac lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16d6 expref: 45 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.646143:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xb:0x0].0x0 (ffff930a85613d00) 00010000:00010000:3.0:1786109645.646145:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109645.646148:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f06c00, rc 0) 00000100:00100000:3.0:1786109645.646235:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+46:163590:x1872862922126976:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1388us (2065us total) trans 25769804593 rc 0/0 00000100:00100000:3.0:1786109645.646244:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1102 00000100:00100000:3.0:1786109645.653965:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.654102:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922127232 00000100:00100000:2.0:1786109645.654112:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922127232 00000100:00100000:2.0:1786109645.654280:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:2.0:1786109645.654291:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+46:163590:x1872862922127232:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.655039:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+47:163590:x1872862922127232:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 746us (1079us total) trans 25769804594 rc 0/0 00000100:00100000:2.0:1786109645.655047:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:1.0:1786109645.660327:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.660422:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922127488 00000100:00100000:0.0:1786109645.660561:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922127488 00000100:00100000:1.0:1786109645.660679:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1103 00000100:00100000:1.0:1786109645.660690:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+47:163590:x1872862922127488:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:1.0:1786109645.660714:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109645.660738:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38800/0xdb52b77d7ca378ba lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16dd expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.660838:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39400/0xdb52b77d7ca378c1 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.660853:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39400/0xdb52b77d7ca378c1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.660869:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39400/0xdb52b77d7ca378c1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661016:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39a00/0xdb52b77d7ca378c8 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661025:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39a00/0xdb52b77d7ca378c8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661033:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39a00/0xdb52b77d7ca378c8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109645.661343:0:188678:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x3e7:0x0], index 0: 0 00010000:00010000:1.0:1786109645.661516:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca378cf lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661526:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca378cf lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661534:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca378cf lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661566:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39400/0xdb52b77d7ca378c1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661573:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39400/0xdb52b77d7ca378c1 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661580:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39400/0xdb52b77d7ca378c1 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661586:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109645.661591:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39400/0xdb52b77d7ca378c1 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661598:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39400/0xdb52b77d7ca378c1 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661611:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930a90aba400) 00010000:00010000:1.0:1786109645.661614:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109645.661618:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39400/0xdb52b77d7ca378c1 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661624:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39400/0xdb52b77d7ca378c1 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109645.661635:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ec14563 reply state 0000000037580583 transno 25769804595 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39a00/0xdb52b77d7ca378c8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661647:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39a00/0xdb52b77d7ca378c8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661653:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x1b7026cc (ffff930a90abaf00) 00010000:00010000:1.0:1786109645.661655:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109645.661658:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109645.661686:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38800/0xdb52b77d7ca378ba lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16dd expref: 50 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661706:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca378cf lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16dd expref: 49 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.661714:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xc:0x0].0x0 (ffff930a90aba100) 00010000:00010000:1.0:1786109645.661716:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786109645.661719:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9453c00, rc 0) 00000100:00100000:1.0:1786109645.661973:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+50:163590:x1872862922127488:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1283us (1652us total) trans 25769804595 rc 0/0 00000100:00100000:1.0:1786109645.661982:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1103 00000100:00100000:3.0:1786109645.664621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.664779:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922127744 00000100:00100000:2.0:1786109645.664789:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922127744 00000100:00100000:2.0:1786109645.664876:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:2.0:1786109645.664887:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b60c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+50:163590:x1872862922127744:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.665184:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b60c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+51:163590:x1872862922127744:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 298us (570us total) trans 25769804596 rc 0/0 00000100:00100000:2.0:1786109645.665192:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:3.0:1786109645.667796:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.669292:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922128000 00000100:00100000:2.0:1786109645.669304:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922128000 00000100:00100000:2.0:1786109645.669415:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1104 00000100:00100000:2.0:1786109645.669426:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+51:163590:x1872862922128000:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:2.0:1786109645.669474:0:196401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109645.669498:0:196401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca378dd lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16e4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.669597:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca378e4 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.669610:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca378e4 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.669619:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca378e4 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.669632:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bdc00/0xdb52b77d7ca378eb lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.669640:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bdc00/0xdb52b77d7ca378eb lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.669647:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bdc00/0xdb52b77d7ca378eb lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109645.669969:0:196401:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3e7:0x0], index 1: 0 00010000:00010000:2.0:1786109645.670097:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca378f2 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670107:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca378f2 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670114:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca378f2 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670144:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca378e4 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670151:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca378e4 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670158:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca378e4 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670164:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bda00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.670168:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca378e4 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670180:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca378e4 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670192:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930ab1d24300) 00010000:00010000:2.0:1786109645.670194:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.670198:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca378e4 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670205:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca378e4 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.670575:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022806fbf reply state 000000002eb57ec8 transno 25769804597 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bdc00/0xdb52b77d7ca378eb lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670590:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bdc00/0xdb52b77d7ca378eb lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670596:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x3e3e6f26 (ffff930ab1d24900) 00010000:00010000:2.0:1786109645.670598:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.670601:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109645.670628:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca378dd lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16e4 expref: 54 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670645:0:196401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca378f2 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16e4 expref: 53 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.670651:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xd:0x0].0x0 (ffff930ab1d24400) 00010000:00010000:2.0:1786109645.670653:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786109645.670655:0:196401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab28bd800, rc 0) 00000100:00100000:2.0:1786109645.670753:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+54:163590:x1872862922128000:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1329us (2964us total) trans 25769804597 rc 0/0 00000100:00100000:2.0:1786109645.670760:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1104 00000100:00100000:1.0:1786109645.673903:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.674104:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922128256 00000100:00100000:2.0:1786109645.674116:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922128256 00000100:00100000:2.0:1786109645.674173:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:2.0:1786109645.674184:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+54:163590:x1872862922128256:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.674499:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+55:163590:x1872862922128256:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 315us (604us total) trans 25769804598 rc 0/0 00000100:00100000:2.0:1786109645.674507:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:3.0:1786109645.677149:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.677300:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922128512 00000100:00100000:0.0:1786109645.677310:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922128512 00000100:00100000:0.0:1786109645.677408:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1105 00000100:00100000:0.0:1786109645.677418:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+55:163590:x1872862922128512:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109645.677478:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109645.677501:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca37900 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16eb expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.677596:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca37907 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.677608:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca37907 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.677618:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca37907 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.677630:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca3790e lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.677637:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca3790e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.677643:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca3790e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109645.677918:0:187899:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x3e8:0x0], index 0: 0 00010000:00010000:0.0:1786109645.678034:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca37915 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678043:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca37915 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678049:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca37915 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678076:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca37907 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678083:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca37907 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678088:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca37907 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678095:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca37907 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678100:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.678104:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca37907 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678110:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca37907 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678121:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930984516000) 00010000:00010000:0.0:1786109645.678123:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.678128:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca37907 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678134:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca37907 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.678146:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a347b8c6 reply state 00000000d5396560 transno 25769804599 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca3790e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678156:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca3790e lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678161:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x610cb780 (ffff930984516200) 00010000:00010000:0.0:1786109645.678164:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.678166:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109645.678187:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca37900 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16eb expref: 58 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678203:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca37915 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16eb expref: 57 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.678210:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xe:0x0].0x0 (ffff930984516b00) 00010000:00010000:0.0:1786109645.678212:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109645.678214:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628a200, rc 0) 00000100:00100000:0.0:1786109645.678278:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+58:163590:x1872862922128512:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 862us (1143us total) trans 25769804599 rc 0/0 00000100:00100000:0.0:1786109645.678285:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1105 00000100:00100000:0.0:1786109645.681982:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.682059:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922128768 00000100:00100000:2.0:1786109645.682077:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922128768 00000100:00100000:2.0:1786109645.682248:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1786109645.682262:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+58:163590:x1872862922128768:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.683122:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+59:163590:x1872862922128768:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 858us (1143us total) trans 25769804600 rc 0/0 00000100:00100000:2.0:1786109645.683134:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:1.0:1786109645.685944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.686055:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922129024 00000100:00100000:3.0:1786109645.686065:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922129024 00000100:00100000:3.0:1786109645.686155:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1106 00000100:00100000:3.0:1786109645.686166:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+59:163590:x1872862922129024:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:3.0:1786109645.686188:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109645.686211:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37923 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16f2 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686326:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3792a lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686339:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3792a lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686350:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3792a lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686364:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca37931 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686371:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca37931 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686378:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca37931 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109645.686706:0:187901:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3e8:0x0], index 1: 0 00010000:00010000:3.0:1786109645.686836:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37938 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686846:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37938 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686855:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37938 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686886:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3792a lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686893:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3792a lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686899:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3792a lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686904:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109645.686908:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3792a lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686914:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3792a lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686924:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930a85613900) 00010000:00010000:3.0:1786109645.686927:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109645.686932:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3792a lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686938:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca3792a lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109645.686950:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086333971 reply state 00000000f6797bb6 transno 25769804601 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca37931 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686960:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca37931 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.686966:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x83daffd9 (ffff930a85613500) 00010000:00010000:3.0:1786109645.686968:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109645.686970:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109645.686998:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37923 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16f2 expref: 62 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.687014:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37938 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16f2 expref: 61 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.687022:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xf:0x0].0x0 (ffff930a85613b00) 00010000:00010000:3.0:1786109645.687024:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109645.687026:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07600, rc 0) 00000100:00100000:3.0:1786109645.687083:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+62:163590:x1872862922129024:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 919us (1149us total) trans 25769804601 rc 0/0 00000100:00100000:3.0:1786109645.687091:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1106 00000100:00100000:0.0:1786109645.690336:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.690538:0:195049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922129280 00000100:00100000:3.0:1786109645.690549:0:195049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922129280 00000100:00100000:3.0:1786109645.690598:0:195049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:3.0:1786109645.690608:0:195049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+62:163590:x1872862922129280:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:3.0:1786109645.690998:0:195049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+63:163590:x1872862922129280:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 389us (669us total) trans 25769804602 rc 0/0 00000100:00100000:3.0:1786109645.691007:0:195049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:0.0:1786109645.693734:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.693844:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922129536 00000100:00100000:3.0:1786109645.693854:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922129536 00000100:00100000:3.0:1786109645.693941:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1107 00000100:00100000:3.0:1786109645.693951:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+63:163590:x1872862922129536:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:3.0:1786109645.693985:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109645.694008:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37946 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a16f9 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694109:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca3794d lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694120:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca3794d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694131:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca3794d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694141:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca37954 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694148:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca37954 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694153:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca37954 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109645.694471:0:187900:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x3e9:0x0], index 0: 0 00010000:00010000:3.0:1786109645.694600:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca3795b lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694610:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca3795b lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694618:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca3795b lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694653:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca3794d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694660:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca3794d lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694666:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca3794d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694672:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109645.694675:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca3794d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694681:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca3794d lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694692:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930a85613100) 00010000:00010000:3.0:1786109645.694695:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109645.694699:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca3794d lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694705:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca3794d lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109645.694718:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009401a4d1 reply state 0000000086c6859b transno 25769804603 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca37954 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694727:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca37954 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694732:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xa6a94833 (ffff930a85613e00) 00010000:00010000:3.0:1786109645.694734:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109645.694737:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109645.694762:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37946 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16f9 expref: 66 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694782:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca3795b lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16f9 expref: 65 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.694789:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x10:0x0].0x0 (ffff930a85613600) 00010000:00010000:3.0:1786109645.694792:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109645.694794:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f06000, rc 0) 00000100:00100000:3.0:1786109645.694855:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+66:163590:x1872862922129536:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 905us (1128us total) trans 25769804603 rc 0/0 00000100:00100000:3.0:1786109645.694862:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1107 00000100:00100000:0.0:1786109645.697965:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.698087:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922129792 00000100:00100000:2.0:1786109645.698096:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922129792 00000100:00100000:2.0:1786109645.698176:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1786109645.698186:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+66:163590:x1872862922129792:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.698566:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+67:163590:x1872862922129792:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 381us (621us total) trans 25769804604 rc 0/0 00000100:00100000:2.0:1786109645.698574:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:0.0:1786109645.701249:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.701346:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922130048 00000100:00100000:3.0:1786109645.701356:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922130048 00000100:00100000:3.0:1786109645.701484:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1108 00000100:00100000:3.0:1786109645.701495:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+67:163590:x1872862922130048:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:3.0:1786109645.701516:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109645.701538:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37969 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1700 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.701632:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37970 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.701645:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37970 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.701656:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37970 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.701668:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37977 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.701675:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37977 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.701695:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37977 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109645.702033:0:189813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3e9:0x0], index 1: 0 00010000:00010000:3.0:1786109645.702166:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca3797e lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702175:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca3797e lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702183:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca3797e lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702230:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37970 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702238:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37970 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702244:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37970 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702250:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109645.702255:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37970 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702265:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37970 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702276:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930a85613000) 00010000:00010000:3.0:1786109645.702278:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109645.702283:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37970 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702289:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37970 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109645.702301:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070103d7e reply state 00000000b0b9dff3 transno 25769804605 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37977 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702311:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37977 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702316:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xc977908d (ffff930a85613300) 00010000:00010000:3.0:1786109645.702318:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109645.702321:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109645.702347:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37969 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1700 expref: 70 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702366:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca3797e lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1700 expref: 69 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.702374:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x11:0x0].0x0 (ffff930a85613700) 00010000:00010000:3.0:1786109645.702376:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109645.702378:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07800, rc 0) 00000100:00100000:3.0:1786109645.702481:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+70:163590:x1872862922130048:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 987us (1240us total) trans 25769804605 rc 0/0 00000100:00100000:3.0:1786109645.702488:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1108 00000100:00100000:0.0:1786109645.705824:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.705938:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922130304 00000100:00100000:2.0:1786109645.705947:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922130304 00000100:00100000:2.0:1786109645.706044:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:2.0:1786109645.706055:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+70:163590:x1872862922130304:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.706413:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+71:163590:x1872862922130304:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 359us (596us total) trans 25769804606 rc 0/0 00000100:00100000:2.0:1786109645.706421:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:1.0:1786109645.710137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.710240:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922130560 00000100:00100000:2.0:1786109645.710250:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922130560 00000100:00100000:2.0:1786109645.710335:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1109 00000100:00100000:2.0:1786109645.710345:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+71:163590:x1872862922130560:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:2.0:1786109645.710368:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109645.710390:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca3798c lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1707 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.710688:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca37993 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.710702:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca37993 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.710714:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca37993 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.710727:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca3799a lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.710735:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca3799a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.710740:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca3799a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109645.711021:0:188678:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x3ea:0x0], index 0: 0 00010000:00010000:0.0:1786109645.711145:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca379a1 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711155:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca379a1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711162:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca379a1 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711193:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca37993 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711201:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca37993 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711213:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca37993 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711234:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.711238:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca37993 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711246:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca37993 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711257:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930ab1d24300) 00010000:00010000:0.0:1786109645.711260:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.711266:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca37993 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711273:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca37993 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.711285:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae8c43dd reply state 00000000f99d812a transno 25769804607 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca3799a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711295:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca3799a lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711301:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xec45d8e7 (ffff930984516000) 00010000:00010000:0.0:1786109645.711303:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.711306:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109645.711334:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca3798c lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1707 expref: 74 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711357:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca379a1 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1707 expref: 73 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.711365:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x12:0x0].0x0 (ffff930984516c00) 00010000:00010000:0.0:1786109645.711368:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109645.711371:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628b200, rc 0) 00000100:00100000:0.0:1786109645.711523:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+74:163590:x1872862922130560:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1178us (1394us total) trans 25769804607 rc 0/0 00000100:00100000:0.0:1786109645.711531:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1109 00000100:00100000:1.0:1786109645.714775:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.714870:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922130816 00000100:00100000:2.0:1786109645.714879:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922130816 00000100:00100000:2.0:1786109645.714949:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:2.0:1786109645.714958:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+74:163590:x1872862922130816:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.715250:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+75:163590:x1872862922130816:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 291us (481us total) trans 25769804608 rc 0/0 00000100:00100000:2.0:1786109645.715257:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:1.0:1786109645.719866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.719950:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922131072 00000100:00100000:0.0:1786109645.719971:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922131072 00000100:00100000:0.0:1786109645.720024:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1110 00000100:00100000:0.0:1786109645.720033:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+75:163590:x1872862922131072:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109645.720053:0:196401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109645.720073:0:196401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca379af lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a170e expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720185:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379b6 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720199:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379b6 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720211:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379b6 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720235:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca379bd lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720243:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca379bd lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720250:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca379bd lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109645.720623:0:196401:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3ea:0x0], index 1: 0 00010000:00010000:0.0:1786109645.720735:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca379c4 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720744:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca379c4 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720752:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca379c4 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720778:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379b6 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720786:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379b6 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720792:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379b6 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720798:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.720802:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379b6 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720809:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379b6 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720824:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930984516400) 00010000:00010000:0.0:1786109645.720827:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.720831:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379b6 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720838:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379b6 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.720850:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087f017e5 reply state 000000007ae321af transno 25769804609 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca379bd lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720860:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca379bd lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720865:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xf142140 (ffff930984516600) 00010000:00010000:0.0:1786109645.720868:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.720870:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109645.720892:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca379af lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a170e expref: 78 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720908:0:196401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca379c4 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a170e expref: 77 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.720916:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x13:0x0].0x0 (ffff930984516900) 00010000:00010000:0.0:1786109645.720918:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109645.720920:0:196401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628a800, rc 0) 00000100:00100000:0.0:1786109645.720968:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+78:163590:x1872862922131072:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 935us (1111us total) trans 25769804609 rc 0/0 00000100:00100000:0.0:1786109645.720975:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1110 00000100:00100000:1.0:1786109645.726167:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.726250:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922131328 00000100:00100000:2.0:1786109645.726259:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922131328 00000100:00100000:2.0:1786109645.726359:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:2.0:1786109645.726370:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+78:163590:x1872862922131328:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.726826:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+79:163590:x1872862922131328:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 457us (667us total) trans 25769804610 rc 0/0 00000100:00100000:2.0:1786109645.726834:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:1.0:1786109645.729747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.729857:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922131584 00000100:00100000:0.0:1786109645.729867:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922131584 00000100:00100000:0.0:1786109645.729926:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1111 00000100:00100000:0.0:1786109645.729937:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+79:163590:x1872862922131584:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109645.729972:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109645.729996:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca379d2 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1715 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730096:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379d9 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730110:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379d9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730122:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379d9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730135:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca379e0 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730143:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca379e0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730150:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca379e0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109645.730480:0:187899:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x3eb:0x0], index 0: 0 00010000:00010000:0.0:1786109645.730612:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca379e7 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730623:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca379e7 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730631:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca379e7 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730664:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379d9 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730671:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379d9 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730679:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379d9 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730686:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379d9 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730692:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.730696:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379d9 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730704:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379d9 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730716:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930984516400) 00010000:00010000:0.0:1786109645.730719:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.730723:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379d9 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730729:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca379d9 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.730743:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c60e63d9 reply state 00000000fc18988c transno 25769804611 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca379e0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730755:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca379e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730761:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x31e2699a (ffff930984516d00) 00010000:00010000:0.0:1786109645.730764:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.730766:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109645.730794:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca379d2 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1715 expref: 82 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730813:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca379e7 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1715 expref: 81 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.730820:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x14:0x0].0x0 (ffff930a92c11000) 00010000:00010000:0.0:1786109645.730822:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109645.730824:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628b400, rc 0) 00000100:00100000:0.0:1786109645.730879:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+82:163590:x1872862922131584:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 945us (1142us total) trans 25769804611 rc 0/0 00000100:00100000:0.0:1786109645.730887:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1111 00000100:00100000:1.0:1786109645.734813:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.734908:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922131840 00000100:00100000:2.0:1786109645.734919:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922131840 00000100:00100000:2.0:1786109645.735016:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:2.0:1786109645.735028:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+82:163590:x1872862922131840:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.735306:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+83:163590:x1872862922131840:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 280us (503us total) trans 25769804612 rc 0/0 00000100:00100000:2.0:1786109645.735314:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:1.0:1786109645.742268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.742397:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922132096 00000100:00100000:3.0:1786109645.742407:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922132096 00000100:00100000:3.0:1786109645.742487:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1112 00000100:00100000:3.0:1786109645.742496:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+83:163590:x1872862922132096:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:3.0:1786109645.742519:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109645.742542:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca379f5 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a171c expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.742638:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca379fc lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.742650:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca379fc lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.742662:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca379fc lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.742673:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37a03 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.742694:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37a03 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.742701:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37a03 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109645.743124:0:187901:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3eb:0x0], index 1: 0 00010000:00010000:3.0:1786109645.743255:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37a0a lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.743265:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37a0a lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.743273:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37a0a lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.743301:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca379fc lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.743309:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca379fc lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.743315:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca379fc lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.743321:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109645.743326:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca379fc lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.743332:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca379fc lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.743343:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930a85613000) 00010000:00010000:3.0:1786109645.743345:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109645.743349:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca379fc lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.743356:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca379fc lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109645.743372:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055929de8 reply state 00000000cb4244a6 transno 25769804613 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37a03 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.743383:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37a03 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.743389:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x54b0b1f4 (ffff930a85613100) 00010000:00010000:3.0:1786109645.743392:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109645.743394:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109645.743418:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca379f5 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a171c expref: 86 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.744169:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37a0a lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a171c expref: 85 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.744180:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x15:0x0].0x0 (ffff930a85613900) 00010000:00010000:3.0:1786109645.744182:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109645.744185:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f06200, rc 0) 00000100:00100000:3.0:1786109645.744265:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+86:163590:x1872862922132096:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1769us (2005us total) trans 25769804613 rc 0/0 00000100:00100000:3.0:1786109645.744273:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1112 00000100:00100000:1.0:1786109645.748299:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.748635:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922132352 00000100:00100000:2.0:1786109645.748645:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922132352 00000100:00100000:2.0:1786109645.748781:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:2.0:1786109645.748792:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+86:163590:x1872862922132352:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109645.749064:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+87:163590:x1872862922132352:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 274us (772us total) trans 25769804614 rc 0/0 00000100:00100000:2.0:1786109645.749072:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:0.0:1786109645.768513:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.768852:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922132608 00000100:00100000:3.0:1786109645.768863:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922132608 00000100:00100000:0.0:1786109645.769125:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1113 00000100:00100000:0.0:1786109645.769138:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+87:163600:x1872862922132608:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109645.769165:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109645.769189:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a18 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1723 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109645.769294:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1786109645.769381:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a18 lrc: 1/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1723 expref: 89 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.769396:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930a92c11900) 00010000:00010000:0.0:1786109645.769399:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786109645.769404:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a18 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1723 expref: 89 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.769422:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628b000, rc 0) 00000100:00100000:0.0:1786109645.769782:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+88:163600:x1872862922132608:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 645us (1276us total) trans 25769804615 rc 301/301 00000100:00100000:0.0:1786109645.769790:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1113 00000100:00100000:1.0:1786109645.775270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.775546:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922132864 00000100:00100000:0.0:1786109645.775556:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922132864 00000100:00100000:0.0:1786109645.775757:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1114 00000100:00100000:0.0:1786109645.775769:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+88:163600:x1872862922132864:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109645.775794:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109645.775817:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a26 lrc: 2/0,0 mode: --/CR res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a172a expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.775928:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a2d lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.775944:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a2d lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.775956:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a2d lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109645.775972:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x3:0x0]: returning size 0 00010000:00010000:0.0:1786109645.776071:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a26 lrc: 0/0,0 mode: --/CR res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a172a expref: 91 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.776092:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a2d lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a172a expref: 90 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.776100:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x3:0x0].0x0 (ffff930984516500) 00010000:00010000:0.0:1786109645.776102:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109645.776106:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628a000, rc 0) 00000100:00100000:0.0:1786109645.776174:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+90:163600:x1872862922132864:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 408us (914us total) trans 25769804616 rc 0/0 00000100:00100000:0.0:1786109645.776182:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1114 00000100:00100000:3.0:1786109645.780657:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.780727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109645.780816:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922133248 00000100:00100000:1.0:1786109645.780832:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922133248 00000100:00100000:1.0:1786109645.780909:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4524 00000100:00100000:1.0:1786109645.780920:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fac74500-4523-4794-af20-dfdcdfae19c1+90:2403:x1872862922133248:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786109645.780937:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109645.780964:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a2d lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a172a expref: 90 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.780985:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x3:0x0].0x0 (ffff930984516500) 00010000:00010000:1.0:1786109645.780989:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109645.781065:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fac74500-4523-4794-af20-dfdcdfae19c1+89:2403:x1872862922133248:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 147us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109645.781076:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4524 00000100:00100000:2.0:1786109645.782630:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922133120 00000100:00100000:2.0:1786109645.782644:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922133120 00000100:00100000:3.0:1786109645.782840:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:3.0:1786109645.782851:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+89:163600:x1872862922133120:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1786109645.783124:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+90:163600:x1872862922133120:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 273us (2480us total) trans 25769804617 rc 0/0 00000100:00100000:3.0:1786109645.783132:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:3.0:1786109645.785731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.785862:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922133504 00000100:00100000:2.0:1786109645.785872:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922133504 00000100:00100000:2.0:1786109645.785966:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:2.0:1786109645.785977:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+90:163600:x1872862922133504:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1786109645.786192:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+91:163600:x1872862922133504:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 217us (472us total) trans 25769804618 rc 0/0 00000100:00100000:2.0:1786109645.786200:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:1.0:1786109645.796298:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.796419:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922133760 00000100:00100000:0.0:1786109645.796521:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922133760 00000100:00100000:1.0:1786109645.796657:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1115 00000100:00100000:1.0:1786109645.796672:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+9:163601:x1872862922133760:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:1.0:1786109645.796692:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109645.796714:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37a3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1731 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109645.796815:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1786109645.796926:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37a3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1731 expref: 11 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.796942:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:1.0:1786109645.796946:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786109645.796952:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37a3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1731 expref: 11 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.796967:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9453000, rc 0) 00000100:00100000:1.0:1786109645.797092:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+10:163601:x1872862922133760:12345-192.168.203.38@tcp:101:rm.0 Request processed in 425us (803us total) trans 343597383684 rc 301/301 00000100:00100000:1.0:1786109645.797100:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1115 00000100:00100000:1.0:1786109645.801917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.802108:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922133888 00000100:00100000:3.0:1786109645.802122:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922133888 00000100:00100000:3.0:1786109645.802198:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:3.0:1786109645.802212:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b62c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+10:163601:x1872862922133888:12345-192.168.203.38@tcp:37:rm.0 00000100:00100000:3.0:1786109645.807253:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b62c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+10:163601:x1872862922133888:12345-192.168.203.38@tcp:37:rm.0 Request processed in 5027us (5334us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109645.807270:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:1.0:1786109645.810932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.811055:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922134144 00000100:00100000:2.0:1786109645.811067:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922134144 00000100:00100000:2.0:1786109645.811180:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:2.0:1786109645.811194:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+10:163601:x1872862922134144:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:2.0:1786109645.811628:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+11:163601:x1872862922134144:12345-192.168.203.38@tcp:35:rm.0 Request processed in 435us (710us total) trans 343597383685 rc 0/0 00000100:00100000:2.0:1786109645.811637:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:1.0:1786109645.814595:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.814945:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922134400 00000100:00100000:2.0:1786109645.814959:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922134400 00000100:00100000:2.0:1786109645.815076:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1116 00000100:00100000:2.0:1786109645.815089:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+11:163601:x1872862922134400:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1786109645.815121:0:196401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109645.815150:0:196401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bcc00/0xdb52b77d7ca37a49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1738 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.815334:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bca00/0xdb52b77d7ca37a50 lrc: 3/1,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.815352:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bca00/0xdb52b77d7ca37a50 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.815366:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bca00/0xdb52b77d7ca37a50 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109645.815378:0:196401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1786109645.815550:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bcc00/0xdb52b77d7ca37a49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1738 expref: 14 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.815570:0:196401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bca00/0xdb52b77d7ca37a50 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1738 expref: 13 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.815582:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930ab1d24500) 00010000:00010000:2.0:1786109645.815585:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786109645.815590:0:196401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab28bca00, rc 0) 00000100:00100000:2.0:1786109645.815723:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+13:163601:x1872862922134400:12345-192.168.203.38@tcp:101:rm.0 Request processed in 636us (1140us total) trans 343597383686 rc 0/0 00000100:00100000:2.0:1786109645.815732:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1116 00000100:00100000:0.0:1786109645.819654:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.819766:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922134528 00000100:00100000:3.0:1786109645.819779:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922134528 00000100:00100000:3.0:1786109645.819854:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1117 00000100:00100000:3.0:1786109645.819867:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+91:163601:x1872862922134528:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1786109645.819899:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109645.819930:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37a5e lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a173f expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.820044:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37a65 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.820059:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37a65 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.820073:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37a65 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109645.820133:0:189813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1786109645.820138:0:189813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109645.820184:0:189813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37a65 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.820235:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37a5e lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a173f expref: 93 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.820264:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37a65 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a173f expref: 92 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.820273:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:3.0:1786109645.820277:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786109645.820281:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f06800, rc 0) 00000100:00100000:3.0:1786109645.820420:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+92:163601:x1872862922134528:12345-192.168.203.38@tcp:101:rm.0 Request processed in 554us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109645.820427:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1117 00000100:00100000:1.0:1786109645.825925:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.826133:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922134784 00000100:00100000:3.0:1786109645.826147:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922134784 00000100:00100000:3.0:1786109645.826266:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1118 00000100:00100000:3.0:1786109645.826280:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+92:163601:x1872862922134784:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1786109645.826309:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109645.826342:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37a6c lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1746 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.826631:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37a73 lrc: 3/1,0 mode: --/CR res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.826654:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37a73 lrc: 3/1,0 mode: CR/CR res: [0x240002ef9:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.826667:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37a73 lrc: 3/1,0 mode: CR/CR res: [0x240002ef9:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109645.826679:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1786109645.826812:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37a6c lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1746 expref: 95 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.826837:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37a73 lrc: 3/0,0 mode: CR/CR res: [0x240002ef9:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1746 expref: 94 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.826847:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:3.0:1786109645.826851:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786109645.826855:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07400, rc 0) 00000100:00100000:3.0:1786109645.826983:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+94:163601:x1872862922134784:12345-192.168.203.38@tcp:101:rm.0 Request processed in 706us (1071us total) trans 25769804619 rc 0/0 00000100:00100000:3.0:1786109645.826991:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1118 00000100:00100000:1.0:1786109645.831166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.831261:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922134912 00000100:00100000:3.0:1786109645.831274:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922134912 00000100:00100000:3.0:1786109645.831354:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:3.0:1786109645.831369:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+94:163601:x1872862922134912:12345-192.168.203.38@tcp:37:rm.0 00010000:00010000:0.0:1786109645.832341:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109645.836741:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+94:163601:x1872862922134912:12345-192.168.203.38@tcp:37:rm.0 Request processed in 5360us (5574us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109645.836759:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:1.0:1786109645.841062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.841191:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922135168 00000100:00100000:0.0:1786109645.841206:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922135168 00000100:00100000:0.0:1786109645.841329:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1119 00000100:00100000:0.0:1786109645.841343:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+94:163601:x1872862922135168:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1786109645.841419:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786109645.841511:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca378cf lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16dd expref: 94 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.841535:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xc:0x0].0x0 (ffff930a90aba100) 00010000:00010000:0.0:1786109645.841558:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37a65 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a173f expref: 93 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.841568:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:0.0:1786109645.841572:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109645.841600:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628be00/0xdb52b77d7ca37a81 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.841614:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628be00/0xdb52b77d7ca37a81 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.841625:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628be00/0xdb52b77d7ca37a81 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.841639:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37a88 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.841647:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37a88 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.841654:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37a88 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.841752:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a8f lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.841760:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a8f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.841766:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a8f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109645.842056:0:187900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].2, 64 off8320 00000004:00080000:0.0:1786109645.842068:0:187900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8502508636771ns, next at 8503508633637ns, rc = 0 00010000:00010000:0.0:1786109645.842124:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a96 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842135:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a96 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842143:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a96 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842151:0:187900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a96 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842158:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a96 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842165:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a96 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842191:0:187900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109645.842335:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a8f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842343:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a8f lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842351:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a8f lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842358:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.842363:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a8f lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842375:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a8f lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842384:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xc:0x0].0x0 (ffff930a92c11900) 00010000:00010000:0.0:1786109645.842387:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109645.842392:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a8f lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842398:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b000/0xdb52b77d7ca37a8f lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842417:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628be00/0xdb52b77d7ca37a81 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842424:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628be00/0xdb52b77d7ca37a81 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842576:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628be00/0xdb52b77d7ca37a81 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842584:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628be00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.842588:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628be00/0xdb52b77d7ca37a81 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842594:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628be00/0xdb52b77d7ca37a81 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842604:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:0.0:1786109645.842607:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.842610:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628be00/0xdb52b77d7ca37a81 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842622:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628be00/0xdb52b77d7ca37a81 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.842633:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd259efe reply state 00000000a40e7ace transno 25769804620 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37a88 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842644:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37a88 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.842651:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x1b7026cc (ffff930a90abaf00) 00010000:00010000:0.0:1786109645.842654:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.842657:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109645.842835:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109645.842843:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a96 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.842851:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109645.842855:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a96 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.842863:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a96 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.842873:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xc:0x0].0x0 (ffff930a92c11900) 00010000:00010000:3.0:1786109645.842876:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109645.842879:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a96 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.842885:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a000/0xdb52b77d7ca37a96 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.842899:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109645.842902:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109645.842904:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109645.842943:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+94:163601:x1872862922135168:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1600us (1893us total) trans 25769804620 rc 0/0 00000100:00100000:0.0:1786109645.842953:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1119 00000100:00100000:1.0:1786109645.846171:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.846357:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922135424 00000100:00100000:3.0:1786109645.846370:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922135424 00000100:00100000:0.0:1786109645.846691:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1120 00000100:00100000:0.0:1786109645.846707:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+94:163601:x1872862922135424:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1786109645.846782:0:189813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109645.846817:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd400/0xdb52b77d7ca37889 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16cf expref: 94 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.846838:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xa:0x0].0x0 (ffff930ab1d24e00) 00010000:00010000:0.0:1786109645.846849:0:189813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109645.846877:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca37a9d lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.846891:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca37a9d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.846905:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca37a9d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.846917:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37aa4 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.846925:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37aa4 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.846932:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37aa4 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847031:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37aab lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847039:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37aab lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847046:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37aab lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109645.847332:0:189813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].3, 64 off8384 00010000:00010000:0.0:1786109645.847390:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37ab2 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847399:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37ab2 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847407:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37ab2 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847414:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37ab2 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847421:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37ab2 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847428:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37ab2 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847563:0:189813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109645.847589:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37aab lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847596:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37aab lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847603:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37aab lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847610:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.847615:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37aab lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847624:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37aab lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847634:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xa:0x0].0x0 (ffff930a92c11500) 00010000:00010000:0.0:1786109645.847637:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109645.847642:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37aab lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847648:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3200/0xdb52b77d7ca37aab lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847672:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca37a9d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847678:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca37a9d lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847683:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca37a9d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847688:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628bc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.847691:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca37a9d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847696:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca37a9d lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847703:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:0.0:1786109645.847706:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.847709:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca37a9d lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847715:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca37a9d lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.847726:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbaa928a reply state 00000000b37ef5db transno 25769804621 ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37aa4 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847738:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37aa4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.847743:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xd0b639f4 (ffff930ab1d24d00) 00010000:00010000:0.0:1786109645.847746:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.847749:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109645.847915:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109645.847923:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37ab2 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.847930:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109645.847933:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37ab2 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.847941:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37ab2 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.847950:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xa:0x0].0x0 (ffff930a92c11500) 00010000:00010000:1.0:1786109645.847953:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109645.847956:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37ab2 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.847962:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37ab2 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.847978:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.847980:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.847982:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109645.848096:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+95:163601:x1872862922135424:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1389us (1935us total) trans 25769804621 rc 0/0 00000100:00100000:0.0:1786109645.848105:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1120 00000100:00100000:1.0:1786109645.850999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.851132:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922135680 00000100:00100000:2.0:1786109645.851148:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922135680 00000100:00100000:2.0:1786109645.851273:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1121 00000100:00100000:2.0:1786109645.851285:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+95:163601:x1872862922135680:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109645.851367:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109645.851401:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca378f2 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16e4 expref: 95 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.851423:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xd:0x0].0x0 (ffff930ab1d24400) 00010000:00010000:2.0:1786109645.851600:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109645.851630:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bcc00/0xdb52b77d7ca37ab9 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.851646:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bcc00/0xdb52b77d7ca37ab9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.851658:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bcc00/0xdb52b77d7ca37ab9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.851671:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca37ac0 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.851680:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca37ac0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.851686:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca37ac0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.851791:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca37ac7 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.851800:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca37ac7 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.851808:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca37ac7 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109645.852096:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].2, 64 off8320 00000004:00080000:2.0:1786109645.852109:0:188678:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8502518677088ns, next at 8503518673958ns, rc = 0 00010000:00010000:2.0:1786109645.852165:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca37ace lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852175:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca37ace lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852184:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca37ace lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852191:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca37ace lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852203:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca37ace lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852210:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca37ace lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852333:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109645.852361:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca37ac7 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852368:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca37ac7 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852375:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca37ac7 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852383:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bd600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.852388:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca37ac7 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852396:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca37ac7 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852406:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xd:0x0].0x0 (ffff930ab1d24000) 00010000:00010000:2.0:1786109645.852409:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109645.852413:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca37ac7 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852420:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd600/0xdb52b77d7ca37ac7 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852482:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bcc00/0xdb52b77d7ca37ab9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852490:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bcc00/0xdb52b77d7ca37ab9 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852495:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bcc00/0xdb52b77d7ca37ab9 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852501:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bcc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.852504:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bcc00/0xdb52b77d7ca37ab9 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852510:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bcc00/0xdb52b77d7ca37ab9 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852519:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:2.0:1786109645.852522:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.852525:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bcc00/0xdb52b77d7ca37ab9 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852531:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bcc00/0xdb52b77d7ca37ab9 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.852541:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a29542ac reply state 000000000bdbd507 transno 25769804622 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca37ac0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852552:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca37ac0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.852558:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x3e3e6f26 (ffff930ab1d24900) 00010000:00010000:2.0:1786109645.852561:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.852564:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109645.852667:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+96:163601:x1872862922135680:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1381us (1678us total) trans 25769804622 rc 0/0 00000100:00100000:2.0:1786109645.852676:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1121 00010000:00010000:1.0:1786109645.853375:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109645.853385:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca37ace lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.853394:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bc400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109645.853398:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca37ace lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.853406:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca37ace lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.853420:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xd:0x0].0x0 (ffff930ab1d24000) 00010000:00010000:1.0:1786109645.853422:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109645.853426:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca37ace lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.853578:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc400/0xdb52b77d7ca37ace lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.853598:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.853600:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.853602:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109645.856136:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.856275:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922135936 00000100:00100000:3.0:1786109645.856289:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922135936 00000100:00100000:3.0:1786109645.856390:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1122 00000100:00100000:3.0:1786109645.856403:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+96:163601:x1872862922135936:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109645.856671:0:196401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109645.856706:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca378ac lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16d6 expref: 96 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.856727:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xb:0x0].0x0 (ffff930a85613d00) 00010000:00010000:2.0:1786109645.856740:0:196401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109645.856768:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca37ad5 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.856782:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca37ad5 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.856793:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca37ad5 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.856809:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424e00/0xdb52b77d7ca37adc lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.856817:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424e00/0xdb52b77d7ca37adc lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.856823:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424e00/0xdb52b77d7ca37adc lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.856938:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37ae3 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.856947:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37ae3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.856954:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37ae3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109645.857235:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].3, 64 off8384 00010000:00010000:2.0:1786109645.857297:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37aea lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857306:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37aea lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857314:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37aea lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857321:0:196401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37aea lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857327:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37aea lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857333:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37aea lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857355:0:196401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109645.857376:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37ae3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857382:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37ae3 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857392:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37ae3 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857398:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.857403:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37ae3 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857410:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37ae3 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857419:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xb:0x0].0x0 (ffff930ab1d24700) 00010000:00010000:2.0:1786109645.857422:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109645.857425:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37ae3 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857466:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37ae3 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857484:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca37ad5 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857489:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca37ad5 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857495:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca37ad5 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857500:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bd800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.857503:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca37ad5 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857514:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca37ad5 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857522:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:2.0:1786109645.857524:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.857527:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca37ad5 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857533:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd800/0xdb52b77d7ca37ad5 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.857543:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aabe7db4 reply state 000000007ca1ef38 transno 25769804623 ns: mdt-lustre-MDT0001_UUID lock: ffff930986424e00/0xdb52b77d7ca37adc lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857555:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424e00/0xdb52b77d7ca37adc lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.857561:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xfdd9083c (ffff930a85613200) 00010000:00010000:2.0:1786109645.857563:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.857566:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109645.857747:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+97:163601:x1872862922135936:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1343us (1622us total) trans 25769804623 rc 0/0 00000100:00100000:2.0:1786109645.857756:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1122 00010000:00010000:1.0:1786109645.857847:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109645.857855:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37aea lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.857861:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109645.857865:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37aea lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.857871:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37aea lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.857881:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xb:0x0].0x0 (ffff930ab1d24700) 00010000:00010000:1.0:1786109645.857883:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109645.857886:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37aea lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.857891:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37aea lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.857909:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.857911:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.857912:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109645.862378:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.862799:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922136192 00000100:00100000:3.0:1786109645.862812:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922136192 00000100:00100000:0.0:1786109645.862967:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1123 00000100:00100000:0.0:1786109645.862980:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+97:163601:x1872862922136192:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1786109645.863058:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109645.863093:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca3795b lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16f9 expref: 97 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863114:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x10:0x0].0x0 (ffff930a85613600) 00010000:00010000:0.0:1786109645.863128:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109645.863156:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37af1 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863172:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37af1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863182:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37af1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863195:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37af8 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863203:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37af8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863210:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37af8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863331:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37aff lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863341:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37aff lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863348:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37aff lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109645.863659:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].4, 64 off8448 00010000:00010000:0.0:1786109645.863717:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37b06 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863727:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37b06 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863735:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37b06 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863742:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37b06 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863749:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37b06 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863756:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37b06 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863894:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109645.863918:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37aff lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863929:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37aff lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863935:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37aff lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863941:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.863945:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37aff lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863952:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37aff lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863962:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x10:0x0].0x0 (ffff930a92c11e00) 00010000:00010000:0.0:1786109645.863964:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109645.863968:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37aff lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863974:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37aff lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.863997:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37af1 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.864004:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37af1 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.864009:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37af1 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.864015:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37af1 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.864022:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.864025:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37af1 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.864031:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37af1 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.864039:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:0.0:1786109645.864041:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.864045:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37af1 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.864051:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37af1 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.864061:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000610f0c66 reply state 00000000ccee4f1c transno 25769804624 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37af8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.864072:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37af8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.864080:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xa6a94833 (ffff930a85613e00) 00010000:00010000:0.0:1786109645.864082:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.864085:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109645.864186:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+98:163601:x1872862922136192:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1206us (1836us total) trans 25769804624 rc 0/0 00000100:00100000:0.0:1786109645.864195:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1123 00010000:00010000:3.0:1786109645.864835:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109645.864846:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37b06 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.864856:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109645.864860:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37b06 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.864869:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37b06 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.864882:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x10:0x0].0x0 (ffff930a92c11e00) 00010000:00010000:3.0:1786109645.864885:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109645.864888:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37b06 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.864894:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37b06 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.864911:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109645.864913:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109645.864915:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109645.867651:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.867868:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922136448 00000100:00100000:2.0:1786109645.867882:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922136448 00000100:00100000:2.0:1786109645.867995:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1124 00000100:00100000:2.0:1786109645.868009:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+98:163601:x1872862922136448:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109645.868122:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109645.868158:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2800/0xdb52b77d7ca37794 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a169e expref: 98 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868181:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x3:0x0].0x0 (ffff930984516500) 00010000:00010000:2.0:1786109645.868194:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109645.868236:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b0d lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868251:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b0d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868261:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b0d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868274:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca37b14 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868282:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca37b14 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868289:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca37b14 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868399:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37b1b lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868408:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37b1b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868416:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37b1b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109645.868874:0:187901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].4, 64 off8448 00010000:00010000:2.0:1786109645.868927:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37b22 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868937:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37b22 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868945:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37b22 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868953:0:187901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37b22 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868960:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37b22 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.868967:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37b22 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869022:0:187901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109645.869046:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37b1b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869051:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37b1b lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869057:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37b1b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869062:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.869067:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37b1b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869076:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37b1b lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869090:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x3:0x0].0x0 (ffff930ab1d24400) 00010000:00010000:2.0:1786109645.869093:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109645.869098:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37b1b lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869105:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37b1b lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869125:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b0d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869132:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b0d lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869138:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b0d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869144:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.869147:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b0d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869153:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b0d lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869161:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:2.0:1786109645.869164:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.869167:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b0d lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869173:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b0d lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.869188:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d32697f0 reply state 00000000aa2f3c3a transno 25769804625 ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca37b14 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869200:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca37b14 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.869206:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x94c295fa (ffff930984516800) 00010000:00010000:2.0:1786109645.869208:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.869212:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109645.869336:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+99:163601:x1872862922136448:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1327us (1696us total) trans 25769804625 rc 0/0 00000100:00100000:2.0:1786109645.869345:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1124 00010000:00010000:0.0:1786109645.870058:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109645.870068:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37b22 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.870081:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109645.870085:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37b22 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.870092:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37b22 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.870105:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x3:0x0].0x0 (ffff930ab1d24400) 00010000:00010000:0.0:1786109645.870108:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109645.870112:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37b22 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.870117:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37b22 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.870133:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.870135:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.870137:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109645.872916:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.873043:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922136704 00000100:00100000:0.0:1786109645.873059:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922136704 00000100:00100000:0.0:1786109645.873166:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1125 00000100:00100000:0.0:1786109645.873178:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+99:163601:x1872862922136704:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1786109645.873267:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109645.873299:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca37866 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16c8 expref: 99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.873320:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x9:0x0].0x0 (ffff930984516a00) 00010000:00010000:0.0:1786109645.873333:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109645.873363:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b29 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.873378:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b29 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.873390:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b29 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.873402:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37b30 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.873410:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37b30 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.873417:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37b30 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.873758:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37b37 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.873767:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37b37 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.873775:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37b37 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109645.874056:0:187900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].5, 64 off8512 00010000:00010000:0.0:1786109645.874115:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37b3e lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874125:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37b3e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874136:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37b3e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874143:0:187900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37b3e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874148:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37b3e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874155:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37b3e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874244:0:187900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109645.874268:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37b37 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874275:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37b37 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874281:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37b37 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874288:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.874293:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37b37 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874301:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37b37 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874310:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x9:0x0].0x0 (ffff930a92c11300) 00010000:00010000:0.0:1786109645.874314:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109645.874320:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37b37 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874326:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37b37 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874343:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b29 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874350:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b29 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874356:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b29 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874361:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.874364:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b29 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874370:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b29 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874377:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:0.0:1786109645.874379:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.874382:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b29 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874387:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b29 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.874395:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe04f8d6 reply state 00000000ce4981e9 transno 25769804626 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37b30 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874412:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37b30 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.874418:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xa3936bac (ffff930984516f00) 00010000:00010000:0.0:1786109645.874420:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.874423:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109645.874627:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+100:163601:x1872862922136704:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1446us (1720us total) trans 25769804626 rc 0/0 00000100:00100000:0.0:1786109645.874636:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1125 00010000:00010000:1.0:1786109645.875226:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109645.875235:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37b3e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.875244:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109645.875248:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37b3e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.875256:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37b3e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.875268:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x9:0x0].0x0 (ffff930a92c11300) 00010000:00010000:1.0:1786109645.875271:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109645.875274:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37b3e lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.875281:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37b3e lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.875300:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.875302:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.875304:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109645.877573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.877754:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922136960 00000100:00100000:2.0:1786109645.877767:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922136960 00000100:00100000:2.0:1786109645.877839:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1126 00000100:00100000:2.0:1786109645.877850:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+100:163601:x1872862922136960:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109645.877923:0:189813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109645.878102:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca3797e lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1700 expref: 100 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.878123:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x11:0x0].0x0 (ffff930a85613700) 00010000:00010000:2.0:1786109645.878136:0:189813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109645.878338:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37b45 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.878356:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37b45 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.878373:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37b45 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.878386:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453800/0xdb52b77d7ca37b4c lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.878394:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453800/0xdb52b77d7ca37b4c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.878402:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453800/0xdb52b77d7ca37b4c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.878708:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37b53 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.878718:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37b53 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.878726:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37b53 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109645.878980:0:189813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].6, 64 off8576 00010000:00010000:1.0:1786109645.879034:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452200/0xdb52b77d7ca37b5a lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879045:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452200/0xdb52b77d7ca37b5a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879053:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452200/0xdb52b77d7ca37b5a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879060:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452200/0xdb52b77d7ca37b5a lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879067:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452200/0xdb52b77d7ca37b5a lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879073:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452200/0xdb52b77d7ca37b5a lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879139:0:189813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109645.879168:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37b53 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879175:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37b53 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879181:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37b53 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879189:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109645.879194:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37b53 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879202:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37b53 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879212:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x11:0x0].0x0 (ffff930a90aba400) 00010000:00010000:1.0:1786109645.879229:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109645.879233:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37b53 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879241:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37b53 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879263:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37b45 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879270:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37b45 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879275:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37b45 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879282:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109645.879285:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37b45 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879291:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37b45 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879297:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:1.0:1786109645.879300:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109645.879303:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37b45 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879310:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37b45 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109645.879320:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eaab6d6f reply state 00000000769f0f79 transno 25769804627 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453800/0xdb52b77d7ca37b4c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879332:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453800/0xdb52b77d7ca37b4c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.879339:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xc977908d (ffff930a85613300) 00010000:00010000:1.0:1786109645.879342:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109645.879345:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109645.879530:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+101:163601:x1872862922136960:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1677us (1966us total) trans 25769804627 rc 0/0 00000100:00100000:1.0:1786109645.879539:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1126 00010000:00010000:0.0:1786109645.880038:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109645.880047:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452200/0xdb52b77d7ca37b5a lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.880056:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109645.880059:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452200/0xdb52b77d7ca37b5a lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.880066:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452200/0xdb52b77d7ca37b5a lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.880078:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x11:0x0].0x0 (ffff930a90aba400) 00010000:00010000:0.0:1786109645.880080:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109645.880084:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452200/0xdb52b77d7ca37b5a lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.880089:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452200/0xdb52b77d7ca37b5a lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.880106:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.880108:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.880111:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109645.882542:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109645.882797:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922137216 00000100:00100000:1.0:1786109645.882809:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922137216 00000100:00100000:1.0:1786109645.882946:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1127 00000100:00100000:1.0:1786109645.882971:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+101:163601:x1872862922137216:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109645.883045:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109645.883077:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc600/0xdb52b77d7ca377da lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16ac expref: 101 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883099:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x5:0x0].0x0 (ffff930ab1d24f00) 00010000:00010000:1.0:1786109645.883110:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109645.883138:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452c00/0xdb52b77d7ca37b61 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883152:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452c00/0xdb52b77d7ca37b61 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883163:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452c00/0xdb52b77d7ca37b61 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883174:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452800/0xdb52b77d7ca37b68 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883182:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452800/0xdb52b77d7ca37b68 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883188:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452800/0xdb52b77d7ca37b68 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883306:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37b6f lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883315:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37b6f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883322:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37b6f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109645.883625:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].7, 64 off8640 00010000:00010000:1.0:1786109645.883686:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca37b76 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883696:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca37b76 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883704:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca37b76 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883713:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca37b76 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883719:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca37b76 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883726:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca37b76 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883949:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109645.883974:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37b6f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883986:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37b6f lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.883992:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37b6f lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884000:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109645.884004:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37b6f lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884012:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37b6f lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884022:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x5:0x0].0x0 (ffff930a90aba800) 00010000:00010000:1.0:1786109645.884025:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109645.884029:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37b6f lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884034:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37b6f lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884053:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452c00/0xdb52b77d7ca37b61 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884060:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452c00/0xdb52b77d7ca37b61 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884066:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452c00/0xdb52b77d7ca37b61 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884071:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109645.884075:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452c00/0xdb52b77d7ca37b61 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884081:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452c00/0xdb52b77d7ca37b61 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884088:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:1.0:1786109645.884091:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109645.884094:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452c00/0xdb52b77d7ca37b61 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884100:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452c00/0xdb52b77d7ca37b61 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109645.884110:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d083f56 reply state 0000000073b459ae transno 25769804628 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452800/0xdb52b77d7ca37b68 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884122:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452800/0xdb52b77d7ca37b68 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.884129:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xef08328a (ffff930ab1d24800) 00010000:00010000:1.0:1786109645.884131:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109645.884134:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109645.884253:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+102:163601:x1872862922137216:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1292us (1721us total) trans 25769804628 rc 0/0 00000100:00100000:1.0:1786109645.884262:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1127 00010000:00010000:3.0:1786109645.884843:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109645.884852:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca37b76 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.884863:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109645.884867:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca37b76 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.884875:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca37b76 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.884888:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x5:0x0].0x0 (ffff930a90aba800) 00010000:00010000:3.0:1786109645.884890:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109645.884894:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca37b76 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.884899:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453c00/0xdb52b77d7ca37b76 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.884917:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109645.884919:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109645.884920:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109645.887625:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.887760:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922137472 00000100:00100000:0.0:1786109645.887773:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922137472 00000100:00100000:0.0:1786109645.887847:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1128 00000100:00100000:0.0:1786109645.887860:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+102:163601:x1872862922137472:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1786109645.888120:0:196401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109645.888157:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37a0a lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a171c expref: 102 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.888177:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x15:0x0].0x0 (ffff930a85613900) 00010000:00010000:0.0:1786109645.888189:0:196401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109645.888230:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37b7d lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.888247:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37b7d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.888258:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37b7d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.888272:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37b84 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.888281:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37b84 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.888288:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37b84 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.888392:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37b8b lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.888406:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37b8b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.888413:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37b8b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109645.888907:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].8, 64 off8704 00010000:00010000:0.0:1786109645.888971:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b92 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.888983:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b92 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.888991:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b92 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.888999:0:196401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b92 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889006:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b92 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889012:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b92 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889073:0:196401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109645.889097:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37b8b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889104:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37b8b lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889117:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37b8b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889123:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.889128:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37b8b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889137:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37b8b lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889147:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x15:0x0].0x0 (ffff930a92c11c00) 00010000:00010000:0.0:1786109645.889151:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109645.889154:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37b8b lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889161:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37b8b lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889178:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37b7d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889185:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37b7d lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889192:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37b7d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889197:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.889201:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37b7d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889211:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37b7d lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889232:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:0.0:1786109645.889235:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.889238:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37b7d lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889243:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37b7d lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.889253:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8588205 reply state 000000007077bfe4 transno 25769804629 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37b84 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889265:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37b84 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.889271:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x54b0b1f4 (ffff930a85613100) 00010000:00010000:0.0:1786109645.889274:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.889277:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109645.889382:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+103:163601:x1872862922137472:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1522us (1770us total) trans 25769804629 rc 0/0 00000100:00100000:0.0:1786109645.889391:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1128 00010000:00010000:1.0:1786109645.890055:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109645.890066:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b92 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.890075:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109645.890080:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b92 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.890088:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b92 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.890102:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x15:0x0].0x0 (ffff930a92c11c00) 00010000:00010000:1.0:1786109645.890105:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109645.890109:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b92 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.890114:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca37b92 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.890132:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.890134:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.890136:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109645.893326:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.893607:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922137728 00000100:00100000:2.0:1786109645.893622:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922137728 00000100:00100000:2.0:1786109645.893733:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1129 00000100:00100000:2.0:1786109645.893748:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+103:163601:x1872862922137728:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109645.893828:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109645.893865:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca379e7 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1715 expref: 103 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.893887:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x14:0x0].0x0 (ffff930a92c11000) 00010000:00010000:2.0:1786109645.893899:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109645.893928:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b99 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.893944:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b99 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.893956:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b99 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.893968:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37ba0 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.893975:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37ba0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.893981:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37ba0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894089:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37ba7 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894099:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37ba7 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894111:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37ba7 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109645.894390:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].5, 64 off8512 00010000:00010000:2.0:1786109645.894493:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca37bae lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894504:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca37bae lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894512:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca37bae lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894521:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca37bae lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894528:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca37bae lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894534:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca37bae lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894555:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109645.894578:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37ba7 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894584:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37ba7 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894590:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37ba7 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894600:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.894605:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37ba7 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894612:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37ba7 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894621:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x14:0x0].0x0 (ffff930ab1d24a00) 00010000:00010000:2.0:1786109645.894624:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109645.894627:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37ba7 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894632:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37ba7 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894654:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b99 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894660:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b99 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894666:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b99 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894672:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b99 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894677:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.894680:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b99 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894690:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b99 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894698:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:2.0:1786109645.894700:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.894703:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b99 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894708:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37b99 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.894717:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec5b9bee reply state 000000000b22b6b6 transno 25769804630 ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37ba0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894729:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37ba0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.894735:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x31e2699a (ffff930984516d00) 00010000:00010000:2.0:1786109645.894737:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.894740:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109645.894849:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+104:163601:x1872862922137728:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1102us (1533us total) trans 25769804630 rc 0/0 00000100:00100000:2.0:1786109645.894858:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1129 00010000:00010000:0.0:1786109645.895318:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109645.895328:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca37bae lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.895336:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109645.895340:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca37bae lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.895348:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca37bae lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.895360:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x14:0x0].0x0 (ffff930ab1d24a00) 00010000:00010000:0.0:1786109645.895362:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109645.895366:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca37bae lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.895372:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca37bae lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.895389:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.895391:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.895392:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109645.898065:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.898333:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922137984 00000100:00100000:2.0:1786109645.898346:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922137984 00000100:00100000:2.0:1786109645.898561:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1130 00000100:00100000:2.0:1786109645.898575:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+104:163601:x1872862922137984:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109645.898657:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109645.898691:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca37915 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16eb expref: 104 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.898716:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xe:0x0].0x0 (ffff930984516b00) 00010000:00010000:2.0:1786109645.898728:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109645.898758:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37bb5 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.898774:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37bb5 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.898785:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37bb5 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.898795:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425600/0xdb52b77d7ca37bbc lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.898802:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425600/0xdb52b77d7ca37bbc lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.898809:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425600/0xdb52b77d7ca37bbc lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.898916:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37bc3 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.898925:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37bc3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.898932:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37bc3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109645.899187:0:187901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].6, 64 off8576 00010000:00010000:2.0:1786109645.899307:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424200/0xdb52b77d7ca37bca lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899318:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424200/0xdb52b77d7ca37bca lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899327:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424200/0xdb52b77d7ca37bca lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899335:0:187901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424200/0xdb52b77d7ca37bca lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899343:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424200/0xdb52b77d7ca37bca lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899350:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424200/0xdb52b77d7ca37bca lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899410:0:187901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109645.899460:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37bc3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899467:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37bc3 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899475:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37bc3 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899482:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.899487:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37bc3 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899494:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37bc3 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899508:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xe:0x0].0x0 (ffff930ab1d24f00) 00010000:00010000:2.0:1786109645.899511:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109645.899515:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37bc3 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899521:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37bc3 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899542:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37bb5 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899548:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37bb5 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899553:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37bb5 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899558:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.899561:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37bb5 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899566:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37bb5 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899573:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:2.0:1786109645.899575:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.899578:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37bb5 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899584:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37bb5 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.899600:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055d56dec reply state 00000000cc9bc2d1 transno 25769804631 ns: mdt-lustre-MDT0001_UUID lock: ffff930986425600/0xdb52b77d7ca37bbc lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899612:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425600/0xdb52b77d7ca37bbc lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.899618:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x610cb780 (ffff930984516200) 00010000:00010000:2.0:1786109645.899620:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.899623:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109645.899719:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+105:163601:x1872862922137984:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1145us (1666us total) trans 25769804631 rc 0/0 00000100:00100000:2.0:1786109645.899727:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1130 00010000:00010000:0.0:1786109645.900039:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109645.900047:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424200/0xdb52b77d7ca37bca lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.900055:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109645.900059:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424200/0xdb52b77d7ca37bca lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.900066:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424200/0xdb52b77d7ca37bca lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.900078:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xe:0x0].0x0 (ffff930ab1d24f00) 00010000:00010000:0.0:1786109645.900080:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109645.900083:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424200/0xdb52b77d7ca37bca lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.900089:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424200/0xdb52b77d7ca37bca lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.900104:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.900106:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.900107:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109645.903024:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.903273:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922138240 00000100:00100000:2.0:1786109645.903286:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922138240 00000100:00100000:2.0:1786109645.903394:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1131 00000100:00100000:2.0:1786109645.903408:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+105:163601:x1872862922138240:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109645.903507:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109645.903541:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37938 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16f2 expref: 105 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.903563:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xf:0x0].0x0 (ffff930a85613b00) 00010000:00010000:2.0:1786109645.903576:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109645.903604:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37bd1 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.903619:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37bd1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.903634:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37bd1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.903646:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37bd8 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.903654:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37bd8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.903662:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37bd8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.903767:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37bdf lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.903777:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37bdf lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.903784:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37bdf lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109645.904038:0:187900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].9, 64 off8768 00010000:00010000:2.0:1786109645.904096:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37be6 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904106:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37be6 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904114:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37be6 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904121:0:187900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37be6 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904128:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37be6 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904134:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37be6 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904163:0:187900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109645.904184:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37bdf lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904192:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37bdf lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904198:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37bdf lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904205:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.904210:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37bdf lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904229:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37bdf lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904239:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xf:0x0].0x0 (ffff930ab1d24400) 00010000:00010000:2.0:1786109645.904242:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109645.904246:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37bdf lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904251:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37bdf lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904273:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37bd1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904280:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37bd1 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904286:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37bd1 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904290:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.904293:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37bd1 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904298:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37bd1 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904305:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:2.0:1786109645.904307:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.904310:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37bd1 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904316:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37bd1 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.904328:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5f8bc8a reply state 00000000955d4cf0 transno 25769804632 ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37bd8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904340:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37bd8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.904346:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x83daffd9 (ffff930a85613500) 00010000:00010000:2.0:1786109645.904348:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.904351:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109645.904476:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+106:163601:x1872862922138240:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1069us (1463us total) trans 25769804632 rc 0/0 00000100:00100000:2.0:1786109645.904485:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1131 00010000:00010000:3.0:1786109645.905023:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109645.905032:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37be6 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.905041:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109645.905045:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37be6 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.905052:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37be6 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.905065:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0xf:0x0].0x0 (ffff930ab1d24400) 00010000:00010000:3.0:1786109645.905068:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109645.905071:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37be6 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.905078:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424800/0xdb52b77d7ca37be6 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.905096:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109645.905098:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109645.905100:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109645.907736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109645.907816:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922138496 00000100:00100000:1.0:1786109645.907830:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922138496 00000100:00100000:1.0:1786109645.907938:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1132 00000100:00100000:1.0:1786109645.907952:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+106:163601:x1872862922138496:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109645.908030:0:189813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109645.908062:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca379a1 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1707 expref: 106 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908082:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x12:0x0].0x0 (ffff930984516c00) 00010000:00010000:1.0:1786109645.908093:0:189813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109645.908121:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37bed lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908137:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37bed lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908154:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37bed lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908167:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37bf4 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908174:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37bf4 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908181:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37bf4 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908295:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37bfb lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908303:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37bfb lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908311:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37bfb lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109645.908775:0:189813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].7, 64 off8640 00010000:00010000:1.0:1786109645.908841:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37c02 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908852:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37c02 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908860:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37c02 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908868:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37c02 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908876:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37c02 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908882:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37c02 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908900:0:189813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109645.908925:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37bfb lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908931:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37bfb lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908938:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37bfb lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908945:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109645.908949:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37bfb lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908957:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37bfb lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908966:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x12:0x0].0x0 (ffff930a90abab00) 00010000:00010000:1.0:1786109645.908969:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109645.908974:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37bfb lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.908981:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37bfb lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.909003:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37bed lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.909009:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37bed lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.909014:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37bed lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.909019:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109645.909021:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37bed lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.909027:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37bed lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.909035:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:1.0:1786109645.909037:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109645.909040:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37bed lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.909046:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453200/0xdb52b77d7ca37bed lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109645.909057:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d55e637e reply state 00000000e8de953c transno 25769804633 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37bf4 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.909068:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37bf4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.909073:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xec45d8e7 (ffff930984516000) 00010000:00010000:1.0:1786109645.909076:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109645.909079:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109645.909184:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+107:163601:x1872862922138496:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1231us (1457us total) trans 25769804633 rc 0/0 00000100:00100000:1.0:1786109645.909193:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1132 00010000:00010000:0.0:1786109645.909286:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109645.909295:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37c02 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.909302:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109645.909306:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37c02 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.909313:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37c02 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.909323:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x12:0x0].0x0 (ffff930a90abab00) 00010000:00010000:0.0:1786109645.909326:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109645.909329:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37c02 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.909335:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37c02 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.909349:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.909351:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.909352:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109645.912111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.912630:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922138752 00000100:00100000:2.0:1786109645.912642:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922138752 00000100:00100000:3.0:1786109645.912855:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1133 00000100:00100000:3.0:1786109645.912868:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+107:163601:x1872862922138752:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:3.0:1786109645.912949:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109645.912983:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39600/0xdb52b77d7ca37820 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16ba expref: 107 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913002:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x7:0x0].0x0 (ffff930a90aba300) 00010000:00010000:3.0:1786109645.913014:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109645.913041:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c09 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913055:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c09 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913066:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c09 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913080:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37c10 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913088:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37c10 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913094:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37c10 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913197:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c17 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913211:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c17 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913229:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c17 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786109645.913623:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].10, 64 off8832 00010000:00010000:3.0:1786109645.913697:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37c1e lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913708:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37c1e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913717:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37c1e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913725:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37c1e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913733:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37c1e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913739:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37c1e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913800:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109645.913826:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c17 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913832:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c17 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913842:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c17 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913849:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109645.913854:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c17 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913862:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c17 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913872:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x7:0x0].0x0 (ffff930aa0615b00) 00010000:00010000:3.0:1786109645.913875:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109645.913880:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c17 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913886:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c17 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913905:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c09 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913911:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c09 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913918:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c09 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913924:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c09 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913930:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109645.913933:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c09 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913940:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c09 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913948:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:3.0:1786109645.913951:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109645.913954:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c09 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913961:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c09 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109645.913971:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000926be08d reply state 000000005cafc1ab transno 25769804634 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37c10 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913985:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37c10 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.913991:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x494dcf1b (ffff930a90abad00) 00010000:00010000:3.0:1786109645.913993:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109645.913996:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786109645.914098:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+108:163601:x1872862922138752:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1231us (1999us total) trans 25769804634 rc 0/0 00000100:00100000:3.0:1786109645.914106:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1133 00010000:00010000:0.0:1786109645.918578:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109645.918602:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37c1e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.918618:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109645.918623:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37c1e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.918634:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37c1e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.918661:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x7:0x0].0x0 (ffff930aa0615b00) 00010000:00010000:0.0:1786109645.918665:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109645.918671:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37c1e lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.918677:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37c1e lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.918710:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.918713:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.918715:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109645.921011:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109645.921158:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922139008 00000100:00100000:0.0:1786109645.921170:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922139008 00000100:00100000:0.0:1786109645.921287:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1134 00000100:00100000:0.0:1786109645.921300:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+108:163601:x1872862922139008:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1786109645.921376:0:196401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109645.921407:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd200/0xdb52b77d7ca377b7 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16a5 expref: 108 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921458:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x4:0x0].0x0 (ffff930ab1d24200) 00010000:00010000:0.0:1786109645.921470:0:196401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109645.921497:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37c25 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921510:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37c25 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921522:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37c25 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921533:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37c2c lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921540:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37c2c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921546:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37c2c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921640:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca37c33 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921647:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca37c33 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921653:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca37c33 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109645.921902:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].8, 64 off8704 00010000:00010000:0.0:1786109645.921954:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca37c3a lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921964:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca37c3a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921973:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca37c3a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921981:0:196401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca37c3a lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921989:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca37c3a lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.921996:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca37c3a lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922019:0:196401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109645.922039:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca37c33 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922045:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca37c33 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922052:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca37c33 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922059:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.922064:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca37c33 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922071:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca37c33 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922079:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x4:0x0].0x0 (ffff930a92c11600) 00010000:00010000:0.0:1786109645.922081:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109645.922085:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca37c33 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922091:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca37c33 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922111:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37c25 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922117:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37c25 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922123:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37c25 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922127:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109645.922130:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37c25 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922136:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37c25 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922142:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:0.0:1786109645.922144:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.922146:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37c25 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922152:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37c25 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109645.922161:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3fe8e9a reply state 0000000059264ea2 transno 25769804635 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37c2c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922172:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37c2c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.922178:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xc1e56442 (ffff930ab1d24b00) 00010000:00010000:0.0:1786109645.922181:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109645.922184:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109645.922289:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+109:163601:x1872862922139008:12345-192.168.203.38@tcp:36:rm.0 Request processed in 990us (1289us total) trans 25769804635 rc 0/0 00000100:00100000:0.0:1786109645.922299:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1134 00010000:00010000:1.0:1786109645.922535:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109645.922544:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca37c3a lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.922551:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109645.922555:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca37c3a lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.922562:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca37c3a lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.922572:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x4:0x0].0x0 (ffff930a92c11600) 00010000:00010000:1.0:1786109645.922574:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109645.922577:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca37c3a lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.922583:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca37c3a lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.922597:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.922598:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.922600:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109645.925370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.925843:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922139264 00000100:00100000:2.0:1786109645.925858:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922139264 00000100:00100000:2.0:1786109645.925939:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1135 00000100:00100000:2.0:1786109645.925963:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+109:163601:x1872862922139264:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109645.926038:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109645.926072:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06400/0xdb52b77d7ca377fd lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16b3 expref: 109 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.926092:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x6:0x0].0x0 (ffff930a85613400) 00010000:00010000:2.0:1786109645.926104:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109645.926134:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c41 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.926150:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c41 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.926162:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c41 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.926173:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37c48 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.926181:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37c48 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.926189:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37c48 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.926310:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c4f lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.926318:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c4f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.926325:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c4f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109645.927133:0:187900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].9, 64 off8768 00010000:00010000:2.0:1786109645.927201:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37c56 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927213:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37c56 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927237:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37c56 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927245:0:187900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37c56 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927251:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37c56 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927258:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37c56 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927290:0:187900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109645.927315:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c4f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927321:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c4f lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927328:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c4f lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927334:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.927338:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c4f lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927346:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c4f lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927357:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x6:0x0].0x0 (ffff930ab1d24700) 00010000:00010000:2.0:1786109645.927360:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109645.927365:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c4f lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927371:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c4f lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927393:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c41 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927399:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c41 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927405:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c41 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927414:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.927417:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c41 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927423:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c41 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.927539:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109645.927548:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37c56 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.927558:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109645.927562:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37c56 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.927569:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37c56 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.927580:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x6:0x0].0x0 (ffff930ab1d24700) 00010000:00010000:1.0:1786109645.927582:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109645.927586:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37c56 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.927592:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca37c56 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.927611:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.927613:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.927615:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109645.927659:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:2.0:1786109645.927662:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.927665:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c41 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927671:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c41 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.927748:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000803c9b8b reply state 00000000ba74e3bd transno 25769804636 ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37c48 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927762:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37c48 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.927769:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x1c2b00d3 (ffff930a85613c00) 00010000:00010000:2.0:1786109645.927771:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.927774:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109645.927920:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+110:163601:x1872862922139264:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1966us (2562us total) trans 25769804636 rc 0/0 00000100:00100000:2.0:1786109645.927931:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1135 00000100:00100000:3.0:1786109645.931297:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.932106:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922139520 00000100:00100000:2.0:1786109645.932120:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922139520 00000100:00100000:2.0:1786109645.932248:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1136 00000100:00100000:2.0:1786109645.932263:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+110:163601:x1872862922139520:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109645.932342:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109645.932374:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c3000/0xdb52b77d7ca37771 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1697 expref: 110 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.932395:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x2:0x0].0x0 (ffff930984516300) 00010000:00010000:2.0:1786109645.932408:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109645.932651:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c5d lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.932668:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c5d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.932765:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c5d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.932782:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c64 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.932790:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c64 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.932797:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c64 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.932904:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c6b lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.932913:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c6b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.932924:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c6b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109645.933260:0:187901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].10, 64 off8832 00010000:00010000:2.0:1786109645.933319:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37c72 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933329:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37c72 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933337:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37c72 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933344:0:187901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37c72 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933350:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37c72 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933356:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37c72 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933589:0:187901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109645.933617:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c6b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933623:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c6b lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933631:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c6b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933641:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.933645:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c6b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933654:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c6b lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933664:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x2:0x0].0x0 (ffff930ab1d24000) 00010000:00010000:2.0:1786109645.933667:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109645.933671:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c6b lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933744:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c6b lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933767:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c5d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933773:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c5d lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933779:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c5d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933784:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.933787:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c5d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933794:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c5d lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933808:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:2.0:1786109645.933810:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.933813:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c5d lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933818:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c5d lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.933830:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000780ec4cc reply state 000000008b254a13 transno 25769804637 ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c64 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933841:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c64 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.933847:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x679fc7b1 (ffff930984516100) 00010000:00010000:2.0:1786109645.933849:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.933852:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109645.934061:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+111:163601:x1872862922139520:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1797us (2775us total) trans 25769804637 rc 0/0 00000100:00100000:2.0:1786109645.934071:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1136 00010000:00010000:0.0:1786109645.934152:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109645.934160:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37c72 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.934167:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109645.934171:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37c72 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.934179:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37c72 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.934189:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x2:0x0].0x0 (ffff930ab1d24000) 00010000:00010000:0.0:1786109645.934191:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109645.934194:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37c72 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.934200:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca37c72 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.934345:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.934348:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.934350:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109645.937419:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.937880:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922139776 00000100:00100000:3.0:1786109645.937895:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922139776 00000100:00100000:3.0:1786109645.938058:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1137 00000100:00100000:3.0:1786109645.938072:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+111:163601:x1872862922139776:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:3.0:1786109645.938180:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109645.938226:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b800/0xdb52b77d7ca37843 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a16c1 expref: 111 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.938249:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x8:0x0].0x0 (ffff930984516700) 00010000:00010000:3.0:1786109645.938262:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109645.938289:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c79 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.938303:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c79 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.938314:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c79 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.938326:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c80 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.938333:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c80 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.938340:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c80 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.938471:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37c87 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.938480:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37c87 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.938492:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37c87 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786109645.939029:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].11, 64 off8896 00010000:00010000:3.0:1786109645.939083:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37c8e lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939092:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37c8e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939100:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37c8e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939107:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37c8e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939114:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37c8e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939121:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37c8e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939141:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109645.939160:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37c87 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939166:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37c87 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939172:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37c87 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939183:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109645.939188:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37c87 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939195:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37c87 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939203:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x8:0x0].0x0 (ffff930aa0615d00) 00010000:00010000:3.0:1786109645.939206:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109645.939209:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37c87 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939214:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37c87 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939243:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c79 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939249:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c79 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939255:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c79 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939260:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109645.939263:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c79 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939269:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c79 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939281:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:3.0:1786109645.939283:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109645.939286:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c79 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939293:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37c79 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109645.939302:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c93759c1 reply state 00000000d820fe1c transno 25769804638 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c80 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939313:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c80 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.939319:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x76709d63 (ffff930984516e00) 00010000:00010000:3.0:1786109645.939321:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109645.939324:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786109645.939416:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+112:163601:x1872862922139776:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1346us (2012us total) trans 25769804638 rc 0/0 00000100:00100000:3.0:1786109645.939424:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1137 00010000:00010000:0.0:1786109645.939569:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109645.939578:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37c8e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.939585:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109645.939589:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37c8e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.939601:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37c8e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.939612:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x8:0x0].0x0 (ffff930aa0615d00) 00010000:00010000:0.0:1786109645.939614:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109645.939617:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37c8e lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.939623:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37c8e lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.939637:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.939638:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109645.939640:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109645.945837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.946296:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922140032 00000100:00100000:2.0:1786109645.946309:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922140032 00000100:00100000:2.0:1786109645.946420:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1138 00000100:00100000:2.0:1786109645.946466:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+112:163601:x1872862922140032:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109645.946546:0:196401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109645.946582:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca379c4 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a170e expref: 112 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.946615:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x13:0x0].0x0 (ffff930984516900) 00010000:00010000:2.0:1786109645.946629:0:196401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109645.946658:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c95 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.946673:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c95 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.946940:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c95 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.947100:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c9c lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.947111:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c9c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.947118:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c9c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.947235:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37ca3 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.947245:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37ca3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.947252:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37ca3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109645.947841:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].11, 64 off8896 00010000:00010000:2.0:1786109645.947906:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca37caa lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.947918:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca37caa lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.947927:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca37caa lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.947934:0:196401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca37caa lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.947941:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca37caa lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.947948:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca37caa lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948212:0:196401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109645.948249:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37ca3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948256:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37ca3 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948262:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37ca3 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948269:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.948274:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37ca3 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948282:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37ca3 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948297:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x13:0x0].0x0 (ffff930ab1d24e00) 00010000:00010000:2.0:1786109645.948300:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109645.948305:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37ca3 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948311:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37ca3 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948334:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c95 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948340:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c95 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948346:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c95 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948351:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109645.948354:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c95 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948360:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c95 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948368:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:2.0:1786109645.948370:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109645.948374:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c95 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948380:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37c95 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109645.948395:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099d05850 reply state 00000000d182122a transno 25769804639 ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c9c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948408:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c9c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.948414:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xf142140 (ffff930984516600) 00010000:00010000:2.0:1786109645.948416:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109645.948419:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109645.948829:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109645.948839:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca37caa lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.948846:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109645.948850:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca37caa lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.948860:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca37caa lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.949070:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x13:0x0].0x0 (ffff930ab1d24e00) 00010000:00010000:1.0:1786109645.949074:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109645.949077:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca37caa lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.949084:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca37caa lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.949102:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.949104:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109645.949106:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109645.949170:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+113:163601:x1872862922140032:12345-192.168.203.38@tcp:36:rm.0 Request processed in 2734us (3341us total) trans 25769804639 rc 0/0 00000100:00100000:2.0:1786109645.949181:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1138 00000100:00100000:1.0:1786109645.953339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.954050:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922140160 00000100:00100000:3.0:1786109645.954065:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922140160 00000100:00100000:3.0:1786109645.954148:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1139 00000100:00100000:3.0:1786109645.954161:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+13:163601:x1872862922140160:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1786109645.954194:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109645.954400:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37cb1 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a174d expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.954897:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37cb8 lrc: 3/1,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.954915:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37cb8 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.954927:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37cb8 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.954944:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37cbf lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.954951:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37cbf lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.954958:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37cbf lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955025:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37cc6 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955034:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37cc6 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955042:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37cc6 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109645.955067:0:187899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37cc6 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955084:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37cb8 lrc: 4/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955091:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37cb8 lrc: 4/1,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955102:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37cb8 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955109:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37cb8 lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955116:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109645.955121:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37cb8 lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955129:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37cb8 lrc: 5/0,0 mode: CR/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955143:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930ab1d24500) 00010000:00010000:3.0:1786109645.955146:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109645.955151:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37cb8 lrc: 3/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955157:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37cb8 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955177:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37cbf lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955183:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37cbf lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955190:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37cbf lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955195:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109645.955199:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37cbf lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955205:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37cbf lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955212:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0xf7117594 (ffff930aa0615700) 00010000:00010000:3.0:1786109645.955215:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109645.955721:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37cbf lrc: 2/0,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955729:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37cbf lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955775:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37cb1 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a174d expref: 15 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955789:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37cc6 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a174d expref: 14 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.955797:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930ab1d24c00) 00010000:00010000:3.0:1786109645.955800:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786109645.955803:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f06c00, rc 0) 00000100:00100000:3.0:1786109645.956392:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+14:163601:x1872862922140160:12345-192.168.203.38@tcp:101:rm.0 Request processed in 2230us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109645.956403:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1139 00000100:00100000:0.0:1786109645.959672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109645.959746:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922140288 00000100:00100000:2.0:1786109645.959759:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922140288 00000100:00100000:2.0:1786109645.960252:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1140 00000100:00100000:2.0:1786109645.960267:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+113:163601:x1872862922140288:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1786109645.960310:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109645.960347:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37ccd lrc: 2/0,0 mode: --/CR res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1754 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.960961:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37cd4 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.960979:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37cd4 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.961109:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37cd4 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109645.961174:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1786109645.961179:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1786109645.961240:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca37ccd lrc: 0/0,0 mode: --/CR res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1754 expref: 115 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.961263:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37cd4 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1754 expref: 114 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.961384:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:2.0:1786109645.961387:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786109645.961392:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986424c00, rc 0) 00000100:00100000:2.0:1786109645.961513:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+114:163601:x1872862922140288:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1248us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109645.961521:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1140 00000100:00100000:1.0:1786109645.961786:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.962134:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922140416 00000100:00100000:3.0:1786109645.962146:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922140416 00000100:00100000:3.0:1786109645.962212:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4525 00000100:00100000:3.0:1786109645.962232:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fac74500-4523-4794-af20-dfdcdfae19c1+14:2405:x1872862922140416:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109645.962248:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109645.962284:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca37cc6 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a174d expref: 14 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.962300:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930ab1d24c00) 00010000:00010000:3.0:1786109645.962304:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109645.962353:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fac74500-4523-4794-af20-dfdcdfae19c1+13:2405:x1872862922140416:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 123us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109645.962360:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4525 00000100:00100000:0.0:1786109645.966815:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109645.966883:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922140544 00000100:00100000:1.0:1786109645.966896:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922140544 00000100:00100000:1.0:1786109645.966975:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4526 00000100:00100000:1.0:1786109645.966988:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fac74500-4523-4794-af20-dfdcdfae19c1+13:2402:x1872862922140544:12345-192.168.203.38@tcp:103:rm.0 00010000:00010000:1.0:1786109645.967009:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109645.967407:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bce00/0xdb52b77d7ca37739 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1689 expref: 13 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.967428:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930ab1d24c00) 00010000:00010000:1.0:1786109645.967459:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109645.968797:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fac74500-4523-4794-af20-dfdcdfae19c1+12:2402:x1872862922140544:12345-192.168.203.38@tcp:103:rm.0 Request processed in 1802us (1986us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109645.968812:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4526 00000100:00100000:0.0:1786109645.969876:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.971162:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922140800 00000100:00100000:3.0:1786109645.971178:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922140800 00000100:00100000:3.0:1786109645.971861:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:3.0:1786109645.971878:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+114:163601:x1872862922140800:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:3.0:1786109645.972494:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+115:163601:x1872862922140800:12345-192.168.203.38@tcp:35:rm.0 Request processed in 619us (2621us total) trans 25769804640 rc 0/0 00000100:00100000:3.0:1786109645.972505:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:0.0:1786109645.976095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109645.976208:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922141056 00000100:00100000:3.0:1786109645.976231:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922141056 00000100:00100000:3.0:1786109645.976345:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1141 00000100:00100000:3.0:1786109645.976357:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+115:163601:x1872862922141056:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:3.0:1786109645.976534:0:189813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786109645.976571:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca37cd4 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1754 expref: 115 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.976599:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37a73 lrc: 0/0,0 mode: --/CR res: [0x240002ef9:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1746 expref: 114 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.976618:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615800) 00010000:00010000:3.0:1786109645.976630:0:189813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109645.976707:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.976716:0:189813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.976728:0:189813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109645.976756:0:189813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933324416:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1786109645.976820:0:189813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109645.976856:0:189813:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098e3493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109645.977176:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933324416 00000100:00100000:1.0:1786109645.977183:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933324416 00000100:00100000:1.0:1786109645.977242:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12429 00000100:00100000:1.0:1786109645.977251:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:189813:x1872862933324416:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1786109645.977267:0:177399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109645.977294:0:177399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ce2 lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37cdb expref: -99 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.977322:0:177399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc200/0xdb52b77d7ca3771d lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1682 expref: 11 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.977332:0:177399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ce2 lrc: 4/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37cdb expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.977369:0:177399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc200/0xdb52b77d7ca3771d lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1682 expref: 11 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.977384:0:177399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc200/0xdb52b77d7ca3771d lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1682 expref: 11 pid: 187899 timeout: 8602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109645.977398:0:177399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:177399:1872862933324544:192.168.203.38@tcp:104: 00000100:00100000:1.0:1786109645.977512:0:177399:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab2a31d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109645.983825:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109645.984314:0:177399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:177399:1872862933324544:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109645.984367:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ce2 lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37cdb expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.984385:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930ab1d24500) 00010000:00010000:1.0:1786109645.984388:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109645.984396:0:177399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ce2 lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37cdb expref: 8 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.984407:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9452e00, rc 0) 00000100:00100000:1.0:1786109645.984655:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:189813:x1872862933324416:12345-0@lo:101:mdt00_004.0 Request processed in 7404us (7833us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109645.984665:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12429 00000100:00100000:0.0:1786109645.984801:0:189813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933324416:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1786109645.984823:0:189813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 4/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.984835:0:189813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 4/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109645.985537:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922141184 00000100:00100000:3.0:1786109645.985548:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922141184 00010000:00010000:0.0:1786109645.985755:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc200/0xdb52b77d7ca3771d lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1682 expref: 12 pid: 187899 timeout: 8602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109645.986240:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12647 00000100:00100000:0.0:1786109645.986258:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fac74500-4523-4794-af20-dfdcdfae19c1+12:2403:x1872862922141184:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109645.986281:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109645.986291:0:43921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc200/0xdb52b77d7ca3771d lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1682 expref: 12 pid: 187899 timeout: 8602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.986305:0:43921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc200/0xdb52b77d7ca3771d lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1682 expref: 12 pid: 187899 timeout: 8602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.986334:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc200/0xdb52b77d7ca3771d lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1682 expref: 12 pid: 187899 timeout: 8602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.986354:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930ab1d24500) 00010000:00010000:0.0:1786109645.986361:0:43921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ce2 lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37cdb expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.986374:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ce2 lrc: 2/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca37cdb expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.986383:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ce2 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca37cdb expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.986427:0:43921:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ce2 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37cdb expref: 7 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109645.987075:0:43921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:43921:1872862933324672:0@lo:105: 00000100:00100000:0.0:1786109645.987157:0:43921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109645.987265:0:43921:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc600 going to sleep for 11 seconds 00000100:00100000:1.0:1786109645.987397:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933324672 00000100:00100000:1.0:1786109645.987406:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933324672 00000100:00100000:1.0:1786109645.987487:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5267 00000100:00100000:1.0:1786109645.987498:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:43921:x1872862933324672:12345-0@lo:105: 00010000:00010000:1.0:1786109645.987513:0:10344:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 5/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.987525:0:10344:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 5/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.987535:0:10344:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 5/0,1 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.987545:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 5/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.987554:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 6/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.987564:0:10344:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 6/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.987595:0:10344:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ab8f06c00) 00000100:00100000:1.0:1786109645.987645:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:43921:x1872862933324672:12345-0@lo:105: Request processed in 150us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109645.987652:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5267 00000100:00100000:1.0:1786109645.987696:0:43921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:43921:1872862933324672:0@lo:105: 00010000:00010000:1.0:1786109645.987720:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109645.987912:0:189813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.987924:0:189813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109645.988077:0:189813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x2:0x0] 00010000:00010000:3.0:1786109645.988129:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07200/0xdb52b77d7ca37ce9 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.988138:0:189813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07200/0xdb52b77d7ca37ce9 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.988153:0:189813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07200/0xdb52b77d7ca37ce9 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109645.988172:0:189813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933324800:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1786109645.988256:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fac74500-4523-4794-af20-dfdcdfae19c1+11:2403:x1872862922141184:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 2002us (4443us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109645.988267:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12647 00000100:00100000:2.0:1786109645.990263:0:189813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109645.990357:0:189813:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098e3493c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109645.990417:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933324800 00000100:00100000:0.0:1786109645.990428:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933324800 00000100:00100000:0.0:1786109645.990672:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12430 00000100:00100000:0.0:1786109645.990684:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:189813:x1872862933324800:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1786109645.990710:0:179257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109645.990739:0:179257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37cf0 lrc: 2/0,0 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37ce9 expref: -99 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.990775:0:179257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37cf0 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37ce9 expref: 9 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.990791:0:179257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37cf0 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37ce9 expref: 9 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109645.990801:0:179257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0xf7117594 (ffff930a92c11f00) 00010000:00010000:0.0:1786109645.990804:0:179257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109645.990809:0:179257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8600, rc 0) 00000100:00100000:0.0:1786109645.990871:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:189813:x1872862933324800:12345-0@lo:101:mdt00_004.0 Request processed in 189us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109645.990878:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12430 00000100:00100000:2.0:1786109645.991031:0:189813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933324800:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786109645.991054:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07200/0xdb52b77d7ca37ce9 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37cf0 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.991066:0:189813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07200/0xdb52b77d7ca37ce9 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37cf0 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109645.991095:0:189813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x2:0x0] 00000100:00100000:2.0:1786109645.991158:0:189813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933324928:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1786109645.991204:0:189813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109645.991396:0:189813:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab1a1a000 going to sleep for 11 seconds 00000100:00100000:3.0:1786109645.991657:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933324928 00000100:00100000:3.0:1786109645.991666:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933324928 00000100:00100000:3.0:1786109645.991751:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12431 00000100:00100000:3.0:1786109645.991762:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:189813:x1872862933324928:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786109645.991850:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:189813:x1872862933324928:12345-0@lo:1000:mdt00_004.0 Request processed in 89us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109645.991857:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12431 00000100:00100000:3.0:1786109645.991974:0:189813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933324928:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786109645.992158:0:189813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933325056:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786109645.992194:0:189813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109645.992264:0:189813:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a841083c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109645.992298:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933325056 00000100:00100000:1.0:1786109645.992303:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933325056 00000100:00100000:1.0:1786109645.992346:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12432 00000100:00100000:1.0:1786109645.992354:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:189813:x1872862933325056:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1786109645.992540:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:189813:x1872862933325056:12345-0@lo:1000:mdt00_004.0 Request processed in 186us (344us total) trans 0 rc 1/1 00000100:00100000:1.0:1786109645.992547:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12432 00000100:00100000:3.0:1786109645.992633:0:189813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933325056:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1786109645.992707:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.992717:0:189813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.992727:0:189813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109645.992739:0:189813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933325184:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1786109645.992765:0:189813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109645.992887:0:189813:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a597000 going to sleep for 11 seconds 00000100:00100000:1.0:1786109645.992942:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933325184 00000100:00100000:1.0:1786109645.992947:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933325184 00000100:00100000:1.0:1786109645.993103:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12433 00000100:00100000:1.0:1786109645.993112:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:189813:x1872862933325184:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1786109645.993124:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109645.993145:0:8451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37cfe lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37cf7 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.993172:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37cfe lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37cf7 expref: 10 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.993187:0:8451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37cfe lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37cf7 expref: 10 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.993196:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930a90aba000) 00010000:00010000:1.0:1786109645.993201:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786109645.993205:0:8451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9453a00, rc 0) 00000100:00100000:1.0:1786109645.993253:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:189813:x1872862933325184:12345-0@lo:101:mdt00_004.0 Request processed in 142us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109645.993259:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12433 00000100:00100000:3.0:1786109645.993326:0:189813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933325184:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786109645.993341:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 4/0,1 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37cfe expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.993352:0:189813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 4/0,1 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37cfe expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.993379:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37d05 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.993389:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37d05 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.993398:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37d05 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786109645.993983:0:189813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002efa:0x1:0x0].2, 424 off34288 00000100:00100000:1.0:1786109645.994701:0:189813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933325312:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1786109645.994769:0:189813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109645.994842:0:189813:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a89f5b900 going to sleep for 11 seconds 00000100:00100000:0.0:1786109645.994892:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933325312 00000100:00100000:0.0:1786109645.994901:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933325312 00000100:00100000:0.0:1786109645.995075:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12434 00000100:00100000:0.0:1786109645.995088:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:189813:x1872862933325312:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1786109645.995187:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:189813:x1872862933325312:12345-0@lo:1000:mdt00_004.0 Request processed in 102us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109645.995196:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12434 00000100:00100000:1.0:1786109645.995330:0:189813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:189813:1872862933325312:0@lo:1000:mdt00_004.0 00000040:00080000:1.0:1786109645.995375:0:189813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026d32:0x1:0x0].2, 504 off34512 00000004:00080000:1.0:1786109645.995385:0:189813:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930a8a597000 with version 8 00000004:00080000:2.0:1786109645.995531:0:187918:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930986abf840 version 8 rpc_version 8 00000020:00100000:2.0:1786109645.995556:0:187918:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109645.995565:0:187918:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1f52d80 x1872862933325568/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109645.995583:0:187918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933325568:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109645.995618:0:187918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109645.995760:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab1a1a540 going to sleep for 11 seconds 00000100:00100000:3.0:1786109645.995834:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933325568 00000100:00100000:3.0:1786109645.995840:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933325568 00000100:00100000:3.0:1786109645.995885:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12435 00000100:00100000:3.0:1786109645.995893:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:187918:x1872862933325568:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786109645.996498:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:187918:x1872862933325568:12345-0@lo:1000:osp_up0-1.0 Request processed in 603us (876us total) trans 343597383687 rc 0/0 00000100:00100000:3.0:1786109645.996507:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12435 00000100:00100000:3.0:1786109645.996566:0:187918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933325568:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1786109645.997085:0:189813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1786109645.997113:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37d05 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.997124:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37d05 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.997132:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37d05 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.997139:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109645.997144:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37d05 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.997153:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37d05 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.997172:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930aa0615c00) 00010000:00010000:1.0:1786109645.997176:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109645.997181:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37d05 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.997187:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca37d05 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.997210:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 4/0,1 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37cfe expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.997229:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 4/0,1 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37cfe expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.997236:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37cfe expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.997300:0:189813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786109645.997319:0:189813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x2:0x0] 00010000:00010000:1.0:1786109645.997326:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.997334:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.997341:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.997408:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109645.997416:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37cfe expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.997423:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:3.0:1786109645.997466:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca37cfe expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109645.997477:0:10402:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca37cfe expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.997511:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37cfe expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.997518:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109645.997548:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 1/0,0 mode: --/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37cfe expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.997556:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07400/0xdb52b77d7ca37cf7 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37cfe expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.997573:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109645.997577:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 4/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.997583:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06c00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:3.0:1786109645.997587:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 5/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109645.997595:0:10402:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 5/0,0 mode: CW/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.997614:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 4/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.997620:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109645.997626:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109645.997634:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109645.997635:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109645.997637:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109645.997755:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933325824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109645.997818:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109645.997867:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109645.997873:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933325696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109645.997898:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109645.998650:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933325696 00000100:00100000:2.0:1786109645.998660:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933325696 00000100:00100000:2.0:1786109645.998725:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4527 00000100:00100000:2.0:1786109645.998736:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3649:x1872862933325696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109645.998752:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109645.998776:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37cfe lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37cf7 expref: 11 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109645.998793:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x0 (ffff930a90aba000) 00010000:00010000:2.0:1786109645.998803:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109645.998853:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3649:x1872862933325696:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109645.998862:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4527 00000100:00100000:2.0:1786109645.998916:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933325696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109645.999284:0:189813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786109645.999294:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06c00/0xdb52b77d7ca37cdb lrc: 0/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37ce2 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109645.999324:0:189813:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x2:0x0] 00010000:00010000:1.0:1786109645.999332:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07200/0xdb52b77d7ca37ce9 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37cf0 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109645.999340:0:189813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07200/0xdb52b77d7ca37ce9 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37cf0 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109645.999691:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933325824 00000100:00100000:3.0:1786109645.999712:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933325824 00000100:00100000:3.0:1786109645.999813:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4528 00000100:00100000:3.0:1786109645.999828:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a90736050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3649:x1872862933325824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109645.999845:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109645.999873:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ce2 lrc: 0/0,0 mode: --/CW res: [0x200026d31:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37cdb expref: 10 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109645.999888:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+114:163601:x1872862922141056:12345-192.168.203.38@tcp:36:rm.0 Request processed in 23524us (23922us total) trans 25769804641 rc 0/0 00000100:00100000:1.0:1786109645.999900:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1141 00010000:00010000:3.0:1786109645.999901:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930ab1d24500) 00010000:00010000:3.0:1786109645.999909:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109645.999991:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a90736050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3649:x1872862933325824:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109645.999998:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4528 00000100:00100000:2.0:1786109646.000123:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933325824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109646.000197:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109646.005518:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109646.005877:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922141312 00000100:00100000:2.0:1786109646.005889:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922141312 00000100:00100000:2.0:1786109646.006574:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1142 00000100:00100000:2.0:1786109646.006593:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+11:163601:x1872862922141312:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1786109646.006623:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109646.006651:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425e00/0xdb52b77d7ca37d0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a175b expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.007257:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37d13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.007277:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37d13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.007291:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37d13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.007311:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca37d1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.007319:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca37d1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.007326:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca37d1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.007668:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca37d21 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.007836:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca37d21 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.007844:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca37d21 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109646.007900:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1786109646.007905:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109646.007929:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca37d21 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.007942:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37d13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008152:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37d13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008161:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37d13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008168:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109646.008173:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37d13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008182:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37d13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008196:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:2.0:1786109646.008199:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109646.008204:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37d13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008211:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37d13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008237:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca37d1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008243:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca37d1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008250:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca37d1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008256:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109646.008259:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca37d1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008265:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca37d1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008272:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff930ab1d24300) 00010000:00010000:2.0:1786109646.008275:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109646.008278:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca37d1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008283:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca37d1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008329:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425e00/0xdb52b77d7ca37d0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a175b expref: 13 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008351:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca37d21 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a175b expref: 12 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109646.008358:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930ab1d24500) 00010000:00010000:2.0:1786109646.008361:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109646.008363:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986425400, rc 0) 00000100:00100000:2.0:1786109646.008674:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+12:163601:x1872862922141312:12345-192.168.203.38@tcp:101:rm.0 Request processed in 2084us (3167us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109646.008771:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1142 00000100:00100000:0.0:1786109646.012621:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109646.012811:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922141568 00000100:00100000:1.0:1786109646.012824:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922141568 00000100:00100000:1.0:1786109646.012894:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:1.0:1786109646.012907:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+12:163601:x1872862922141568:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:1.0:1786109646.013958:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+13:163601:x1872862922141568:12345-192.168.203.38@tcp:35:rm.0 Request processed in 1046us (1520us total) trans 343597383688 rc 0/0 00000100:00100000:1.0:1786109646.013971:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:1.0:1786109646.018078:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109646.018168:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922141824 00000100:00100000:3.0:1786109646.018178:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922141824 00000100:00100000:3.0:1786109646.018305:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1143 00000100:00100000:3.0:1786109646.018318:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+13:163601:x1872862922141824:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:3.0:1786109646.018394:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1786109646.018424:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca37d21 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a175b expref: 13 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109646.018939:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bca00/0xdb52b77d7ca37a50 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1738 expref: 12 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109646.018950:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930ab1d24500) 00010000:00010000:3.0:1786109646.018964:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca376f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a167b expref: 11 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109646.018971:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:3.0:1786109646.018974:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109646.019138:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37d28 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.019152:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37d28 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.019160:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37d28 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.019173:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37d2f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.019178:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37d2f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.019182:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37d2f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.019309:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d36 lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.019317:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d36 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.019324:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d36 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109646.020316:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1786109646.020345:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d36 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020354:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d36 lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020361:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d36 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020367:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109646.020372:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d36 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020380:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d36 lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020392:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0x0 (ffff930a92c11b00) 00010000:00010000:0.0:1786109646.020395:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109646.020400:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d36 lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020406:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d36 lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020447:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37d28 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020453:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37d28 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020463:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37d28 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020468:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109646.020470:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37d28 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020476:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37d28 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020483:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:0.0:1786109646.020485:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109646.020488:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37d28 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020494:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37d28 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109646.020503:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e495bd3 reply state 000000009c84efa4 transno 343597383689 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37d2f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020514:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37d2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109646.020520:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff930a92c11700) 00010000:00010000:0.0:1786109646.020522:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109646.020525:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109646.020643:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+12:163601:x1872862922141824:12345-192.168.203.38@tcp:36:rm.0 Request processed in 2324us (2571us total) trans 343597383689 rc 0/0 00000100:00100000:0.0:1786109646.020653:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1143 00010000:00010000:0.0:1786109646.852743:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109647.620728:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109647.620753:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933325952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109647.620824:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109647.620996:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933325952 00000100:00100000:1.0:1786109647.621005:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933325952 00000100:00100000:0.0:1786109647.621194:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933326208:0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.621270:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933326336:0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.621304:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109647.621328:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933326848:0@lo:400:kworker.0 00000100:00100000:1.0:1786109647.621336:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12436 00000100:00100000:1.0:1786109647.621349:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933325952:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109647.621355:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109647.621377:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933327360:0@lo:400:kworker.0 00000004:00000024:1.0:1786109647.621387:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446060032 avail 1299820544 00000100:00100000:2.0:1786109647.621404:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109647.621462:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933325952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109647.621470:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12436 00000100:00100000:2.0:1786109647.621473:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933326336 00000100:00100000:2.0:1786109647.621479:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933326336 00000100:00100000:1.0:1786109647.621500:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933326848 00000100:00100000:1.0:1786109647.621506:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933326848 00000100:00100000:2.0:1786109647.621526:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1786109647.621537:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933326336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109647.621541:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1786109647.621552:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933326848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.621588:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933326336:12345-0@lo:400:kworker.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109647.621596:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1786109647.621601:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933326848:12345-0@lo:400:kworker.0 Request processed in 49us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109647.621610:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1786109647.621622:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933327360 00000100:00100000:2.0:1786109647.621627:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933327360 00000100:00100000:1.0:1786109647.621636:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933326464:0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.621659:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7045 00000100:00100000:1.0:1786109647.621670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109647.621671:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933327360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.621711:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933327360:12345-0@lo:400:kworker.0 Request processed in 44us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109647.621718:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933326976:0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.621719:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7045 00000100:00080000:2.0:1786109647.621741:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109647.621747:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109647.621751:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109647.621771:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933327488:0@lo:400:kworker.0 00000100:00100000:1.0:1786109647.621794:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109647.621803:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933326080:0@lo:400:kworker.0 00000100:00100000:3.0:1786109647.621900:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109647.621926:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933326592:0@lo:400:kworker.0 00000100:00100000:3.0:1786109647.621944:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109647.621960:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933327104:0@lo:400:kworker.0 00000100:00100000:3.0:1786109647.621983:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933326592 00000100:00100000:3.0:1786109647.621986:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933326592 00000100:00100000:3.0:1786109647.622015:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7046 00000100:00100000:3.0:1786109647.622021:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933326592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109647.622052:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933326592:12345-0@lo:400:kworker.0 Request processed in 32us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109647.622057:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7046 00000100:00080000:3.0:1786109647.622069:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109647.622108:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933326336:0@lo:400:kworker.0 00000100:00100000:3.0:1786109647.622119:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933326848:0@lo:400:kworker.0 00000100:00100000:3.0:1786109647.622128:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933327360:0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.622418:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933326976 00000100:00100000:2.0:1786109647.622423:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933326976 00000100:00100000:1.0:1786109647.622471:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933326080 00000100:00100000:1.0:1786109647.622476:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933326080 00000100:00100000:1.0:1786109647.622506:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1786109647.622511:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933327488 00000100:00100000:1.0:1786109647.622515:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933326080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109647.622517:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933327488 00000100:00100000:1.0:1786109647.622557:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933326080:12345-0@lo:400:kworker.0 Request processed in 44us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109647.622562:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1786109647.622569:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1786109647.622574:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933327488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109647.622607:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109647.622625:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933327488:12345-0@lo:400:kworker.0 Request processed in 53us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109647.622634:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1786109647.622637:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933327616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109647.622654:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933327104 00000100:00100000:0.0:1786109647.622658:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933327104 00000100:00100000:1.0:1786109647.622667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109647.622693:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1786109647.622701:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933327104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109647.622707:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933325952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109647.622729:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933326080:0@lo:400:kworker.0 00000100:00100000:0.0:1786109647.622740:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933327104:12345-0@lo:400:kworker.0 Request processed in 40us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109647.622746:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933326592:0@lo:400:kworker.0 00000100:00100000:0.0:1786109647.622750:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1786109647.622762:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933327104:0@lo:400:kworker.0 00000100:00100000:0.0:1786109647.622779:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933326464 00000100:00100000:0.0:1786109647.622784:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933326464 00000100:00100000:1.0:1786109647.622795:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933327616 00000100:00100000:1.0:1786109647.622800:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933327616 00000100:00100000:0.0:1786109647.622815:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12437 00000100:00100000:2.0:1786109647.622885:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1786109647.622891:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933326976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.622924:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933326976:12345-0@lo:400:kworker.0 Request processed in 34us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109647.622930:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00080000:2.0:1786109647.622972:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786109647.622975:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109647.622996:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109647.623015:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933326720:0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.623039:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109647.623057:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933327232:0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.623078:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109647.623108:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933326208 00000100:00100000:2.0:1786109647.623112:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933326208 00000100:00100000:2.0:1786109647.623139:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1786109647.623146:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933326208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.623181:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933326208:12345-0@lo:400:kworker.0 Request processed in 37us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109647.623189:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1786109647.623299:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3646:x1872862933326464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109647.623339:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3646:x1872862933326464:12345-0@lo:400:kworker.0 Request processed in 518us (1673us total) trans 0 rc 0/0 00000100:00080000:2.0:1786109647.623363:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109647.623389:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933326208:0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.623487:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933326720 00000100:00100000:2.0:1786109647.623492:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933326720 00000100:00100000:2.0:1786109647.623526:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933327232 00000100:00100000:2.0:1786109647.623529:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933327232 00000100:00100000:2.0:1786109647.623563:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7047 00000100:00100000:2.0:1786109647.623571:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933326720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109647.623603:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7048 00000100:00100000:3.0:1786109647.623625:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933327232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109647.623640:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933326720:12345-0@lo:400:kworker.0 Request processed in 67us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109647.623649:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7047 00000100:00080000:2.0:1786109647.623670:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109647.623673:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109647.623693:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933326720:0@lo:400:kworker.0 00000100:00100000:1.0:1786109647.623732:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12438 00000100:00100000:1.0:1786109647.623743:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3647:x1872862933327616:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109647.623772:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933327232:12345-0@lo:400:kworker.0 Request processed in 153us (690us total) trans 0 rc 0/0 00000004:00000024:1.0:1786109647.623773:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445646336 avail 1299406848 00000100:00100000:2.0:1786109647.623782:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933327232:0@lo:400:kworker.0 00000100:00100000:3.0:1786109647.623797:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7048 00000100:00100000:1.0:1786109647.623843:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3647:x1872862933327616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109647.623853:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12438 00000100:00100000:0.0:1786109647.623904:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12437 00000100:00100000:1.0:1786109647.624021:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933326464:0@lo:400:kworker.0 00000100:00100000:0.0:1786109647.624054:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933327616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109647.624111:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933326976:0@lo:400:kworker.0 00000100:00100000:1.0:1786109647.624126:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933327488:0@lo:400:kworker.0 00010000:00010000:1.0:1786109647.878762:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109647.949808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109647.950050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109647.950091:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109647.950354:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109647.950405:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109647.950774:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922142208 00000100:00100000:0.0:1786109647.950787:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922142208 00000100:00100000:0.0:1786109647.950863:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922142080 00000100:00100000:0.0:1786109647.950867:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922142080 00000100:00100000:0.0:1786109647.950898:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 334 00000100:00100000:0.0:1786109647.950911:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+114:2403:x1872862922142208:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109647.951033:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+114:2403:x1872862922142208:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 124us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109647.951042:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 334 00000100:00100000:0.0:1786109647.951063:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 335 00000100:00100000:0.0:1786109647.951071:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+12:2403:x1872862922142080:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109647.951102:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+12:2403:x1872862922142080:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 32us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109647.951108:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 335 00000100:00080000:0.0:1786109647.951133:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109647.951138:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109647.951898:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922142464 00000100:00100000:2.0:1786109647.951909:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922142464 00000100:00080000:0.0:1786109647.952074:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109647.952114:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922142336 00000100:00100000:0.0:1786109647.952118:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922142336 00000100:00100000:0.0:1786109647.952164:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7049 00000100:00100000:0.0:1786109647.952174:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922142464:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109647.952249:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922142464:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 77us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109647.952268:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7049 00000100:00100000:0.0:1786109647.952288:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7050 00000100:00100000:0.0:1786109647.952295:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922142336:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109647.952321:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922142336:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109647.952327:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7050 00000100:00080000:0.0:1786109647.952342:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109647.953775:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922141952 00000100:00100000:3.0:1786109647.953789:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922141952 00000100:00100000:0.0:1786109647.954788:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:0.0:1786109647.954802:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922141952:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109647.954904:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922141952:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 105us (5111us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109647.954914:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:0.0:1786109648.133349:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786109648.133379:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933327744:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1786109648.133528:0:187924:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8504800096138ns, next at 8505800092471ns, rc = 0 00000100:00100000:3.0:1786109648.134158:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109648.134176:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933327872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109648.134256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109648.134326:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933327872 00000100:00100000:3.0:1786109648.134335:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933327872 00000100:00100000:3.0:1786109648.134390:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5885 00000100:00100000:3.0:1786109648.134400:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933327872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109648.134453:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109648.134495:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933327872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109648.134501:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5885 00000100:00100000:3.0:1786109648.134542:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933327872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109648.134932:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109648.135111:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933327744 00000100:00100000:2.0:1786109648.135117:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933327744 00000100:00100000:2.0:1786109648.135175:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5886 00000100:00100000:2.0:1786109648.135185:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933327744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109648.135221:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109648.135335:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109648.135351:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933328000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109648.135390:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109648.135495:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933328000 00000100:00100000:3.0:1786109648.135499:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933328000 00000100:00100000:3.0:1786109648.135538:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5887 00000100:00100000:3.0:1786109648.135545:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933328000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109648.135559:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109648.135596:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933328000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109648.135603:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5887 00000100:00100000:0.0:1786109648.135691:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933328000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109648.136035:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933327744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 851us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109648.136043:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5886 00000100:00100000:1.0:1786109648.136111:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933327744:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1786109648.141658:0:187891:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00010000:00010000:3.0:1786109648.141848:0:187891:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07200/0xdb52b77d7ca37ce9 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca37cf0 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109648.141868:0:187891:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07200/0xdb52b77d7ca37ce9 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca37cf0 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109648.141929:0:187891:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07200/0xdb52b77d7ca37ce9 lrc: 2/0,0 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37cf0 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109648.141937:0:187891:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109648.141982:0:187891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07200/0xdb52b77d7ca37ce9 lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37cf0 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786109648.142006:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804641 is committed 00000004:00080000:3.0:1786109648.142074:0:187891:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000100:00100000:1.0:1786109648.142131:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109648.142160:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933328128:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1786109648.142271:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109648.142350:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933328128 00000100:00100000:1.0:1786109648.142359:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933328128 00000100:00100000:1.0:1786109648.142418:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4529 00000100:00100000:1.0:1786109648.142468:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933328128:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1786109648.142487:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109648.142511:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37cf0 lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x2:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37ce9 expref: 9 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.142528:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x2:0x0].0xf7117594 (ffff930a92c11f00) 00010000:00010000:1.0:1786109648.142539:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786109648.142583:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933328128:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 156us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109648.142591:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4529 00000100:00100000:1.0:1786109648.142650:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933328128:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1786109648.142916:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933328256:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1786109648.142952:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109648.142986:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933328768:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1786109648.143040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109648.143064:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786109648.143071:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933328384:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1786109648.143093:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109648.143111:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933328896:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1786109648.143131:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109648.143165:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933328256 00000100:00100000:1.0:1786109648.143170:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933328256 00000100:00100000:2.0:1786109648.143249:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933328384 00000100:00100000:2.0:1786109648.143253:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933328384 00000100:00100000:2.0:1786109648.143280:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933328896 00000100:00100000:2.0:1786109648.143283:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933328896 00000100:00100000:2.0:1786109648.143302:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23135 00000100:00100000:2.0:1786109648.143310:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3648:x1872862933328256:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1786109648.143340:0:17009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:999 count 1 00002000:00010000:2.0:1786109648.143379:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109648.143389:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae484d35/0xdb52b77d7ca37d3d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143407:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e7:0x0].0x0 since=8504s v=(0 0) 00010000:00010000:2.0:1786109648.143412:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109648.143420:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae484d35/0xdb52b77d7ca37d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143456:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae484d35/0xdb52b77d7ca37d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143469:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae484d35/0xdb52b77d7ca37d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143478:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae484d35/0xdb52b77d7ca37d3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143498:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786109648.143691:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933328256:12345-0@lo:6:osp-syn-1-1.0 Request processed in 381us (737us total) trans 4294975827 rc 0/0 00000100:00100000:2.0:1786109648.143702:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23135 00000100:00100000:2.0:1786109648.143718:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23136 00000100:00100000:2.0:1786109648.143725:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3648:x1872862933328384:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1786109648.143737:0:17009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:998 count 1 00002000:00010000:2.0:1786109648.143753:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109648.143757:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000137d1e7c/0xdb52b77d7ca37d44 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143766:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e6:0x0].0x0 since=8504s v=(0 0) 00010000:00010000:2.0:1786109648.143769:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109648.143773:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000137d1e7c/0xdb52b77d7ca37d44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143782:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000137d1e7c/0xdb52b77d7ca37d44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143791:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000137d1e7c/0xdb52b77d7ca37d44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143798:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000137d1e7c/0xdb52b77d7ca37d44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143815:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786109648.143884:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933328384:12345-0@lo:6:osp-syn-1-1.0 Request processed in 160us (789us total) trans 4294975828 rc 0/0 00000100:00100000:2.0:1786109648.143891:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23136 00000100:00100000:2.0:1786109648.143906:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23137 00000100:00100000:2.0:1786109648.143913:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3648:x1872862933328896:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1786109648.143925:0:17009:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:995 count 1 00002000:00010000:2.0:1786109648.143942:0:17009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109648.143948:0:17009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d4b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143956:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e3:0x0].0x0 since=8504s v=(0 0) 00010000:00010000:2.0:1786109648.143959:0:17009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109648.143964:0:17009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143973:0:17009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143981:0:17009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.143989:0:17009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144004:0:17009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1786109648.144066:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933328896:12345-0@lo:6:osp-syn-1-1.0 Request processed in 153us (933us total) trans 4294975829 rc 0/0 00000100:00100000:2.0:1786109648.144072:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23137 00010000:00010000:2.0:1786109648.144093:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786109648.144100:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae484d35/0xdb52b77d7ca37d3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144110:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109648.144115:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae484d35/0xdb52b77d7ca37d3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144126:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae484d35/0xdb52b77d7ca37d3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144144:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae484d35/0xdb52b77d7ca37d3d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144151:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae484d35/0xdb52b77d7ca37d3d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144171:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786109648.144175:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000137d1e7c/0xdb52b77d7ca37d44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144182:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109648.144185:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000137d1e7c/0xdb52b77d7ca37d44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144192:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000137d1e7c/0xdb52b77d7ca37d44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144215:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000137d1e7c/0xdb52b77d7ca37d44 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144224:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000137d1e7c/0xdb52b77d7ca37d44 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144237:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109648.144241:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144248:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109648.144251:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144258:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144269:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d4b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144277:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d4b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.144288:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109648.144290:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109648.144292:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109648.144299:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109648.144390:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933328768 00000100:00100000:1.0:1786109648.144398:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933328768 00000100:00100000:1.0:1786109648.144455:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23138 00000100:00100000:1.0:1786109648.144464:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933328768:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1786109648.144479:0:40692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1001 count 1 00002000:00010000:1.0:1786109648.144497:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109648.144503:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37d52 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.144512:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e9:0x0].0x0 since=8504s v=(0 0) 00010000:00010000:1.0:1786109648.144515:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109648.144519:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37d52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.144529:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37d52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.144538:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37d52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.144544:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37d52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.144559:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786109648.144644:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933328768:12345-0@lo:6:osp-syn-1-1.0 Request processed in 182us (1603us total) trans 4294975830 rc 0/0 00000100:00100000:1.0:1786109648.144652:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23138 00010000:00010000:1.0:1786109648.144694:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109648.144699:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37d52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.144708:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109648.144711:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37d52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.144719:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37d52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.144731:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37d52 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.144738:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca37d52 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.144752:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109648.144754:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109648.144755:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109648.144771:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933328640:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1786109648.144807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109648.144842:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933329152:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1786109648.144864:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109648.144886:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786109648.144893:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933328512:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1786109648.144913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109648.144931:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933329024:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1786109648.144950:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109648.144980:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933328640 00000100:00100000:1.0:1786109648.144984:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933328640 00000100:00100000:1.0:1786109648.145009:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933329152 00000100:00100000:1.0:1786109648.145012:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933329152 00000100:00100000:1.0:1786109648.145026:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933328512 00000100:00100000:1.0:1786109648.145028:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933328512 00000100:00100000:1.0:1786109648.145040:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933329024 00000100:00100000:1.0:1786109648.145042:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933329024 00000100:00100000:1.0:1786109648.145058:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23139 00000100:00100000:1.0:1786109648.145066:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+12:3647:x1872862933328640:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1786109648.145080:0:8443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:997 count 1 00002000:00010000:1.0:1786109648.145096:0:8443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109648.145102:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37d59 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.145111:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e5:0x0].0x0 since=8504s v=(0 0) 00010000:00010000:1.0:1786109648.145114:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109648.145119:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37d59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.145129:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37d59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.145137:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37d59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.145145:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37d59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.145159:0:8443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109648.145336:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3776a lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145347:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3776a lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145353:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3776a lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145363:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.145368:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3776a lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145375:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3776a lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145389:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x679fc7b1 (ffff930984516100) 00010000:00010000:0.0:1786109648.145392:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.145396:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3776a lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145402:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3776a lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145420:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3778d lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145427:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3778d lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109648.145496:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23140 00000100:00100000:2.0:1786109648.145507:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+13:3647:x1872862933329152:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1786109648.145561:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3778d lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145567:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.145570:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3778d lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145577:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3778d lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145590:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x94c295fa (ffff930984516800) 00010000:00010000:0.0:1786109648.145593:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.145597:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3778d lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145604:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3778d lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145618:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc000/0xdb52b77d7ca377b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145624:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc000/0xdb52b77d7ca377b0 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145631:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc000/0xdb52b77d7ca377b0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145636:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bc000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.145639:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc000/0xdb52b77d7ca377b0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145645:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc000/0xdb52b77d7ca377b0 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145652:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xc1e56442 (ffff930ab1d24b00) 00010000:00010000:0.0:1786109648.145655:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.145658:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc000/0xdb52b77d7ca377b0 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145663:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bc000/0xdb52b77d7ca377b0 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145676:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd000/0xdb52b77d7ca377d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145682:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd000/0xdb52b77d7ca377d3 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145687:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd000/0xdb52b77d7ca377d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145692:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bd000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.145695:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd000/0xdb52b77d7ca377d3 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145701:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd000/0xdb52b77d7ca377d3 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145709:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xef08328a (ffff930ab1d24800) 00010000:00010000:0.0:1786109648.145711:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.145714:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd000/0xdb52b77d7ca377d3 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145720:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bd000/0xdb52b77d7ca377d3 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145732:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca377f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145738:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca377f6 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145744:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca377f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145751:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.145754:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca377f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145761:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca377f6 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145769:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x1c2b00d3 (ffff930a85613c00) 00010000:00010000:0.0:1786109648.145771:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.145774:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca377f6 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145780:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca377f6 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145794:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca37819 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145799:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca37819 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145805:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca37819 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145810:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.145812:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca37819 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145818:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca37819 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145830:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x494dcf1b (ffff930a90abad00) 00010000:00010000:0.0:1786109648.145832:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.145835:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca37819 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145841:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f38c00/0xdb52b77d7ca37819 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145855:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3783c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145862:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3783c lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145868:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3783c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145874:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166de00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.145877:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3783c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145883:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3783c lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145891:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x76709d63 (ffff930984516e00) 00010000:00010000:0.0:1786109648.145893:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.145896:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3783c lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145903:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3783c lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145918:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca3785f lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145924:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca3785f lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145930:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca3785f lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145935:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.145938:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca3785f lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145944:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca3785f lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145951:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xa3936bac (ffff930984516f00) 00010000:00010000:0.0:1786109648.145953:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.145956:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca3785f lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145962:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca3785f lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145973:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca37882 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145979:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca37882 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145985:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca37882 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.145991:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bde00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.145994:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca37882 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146000:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca37882 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146007:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xd0b639f4 (ffff930ab1d24d00) 00010000:00010000:0.0:1786109648.146010:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.146012:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca37882 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146018:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bde00/0xdb52b77d7ca37882 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146029:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca378a5 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146035:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca378a5 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146040:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca378a5 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146044:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.146047:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca378a5 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146053:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca378a5 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146065:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xfdd9083c (ffff930a85613200) 00010000:00010000:0.0:1786109648.146067:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.146070:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca378a5 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146077:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca378a5 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146088:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39a00/0xdb52b77d7ca378c8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146093:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39a00/0xdb52b77d7ca378c8 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146100:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39a00/0xdb52b77d7ca378c8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146105:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.146108:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39a00/0xdb52b77d7ca378c8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146113:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39a00/0xdb52b77d7ca378c8 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146120:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x1b7026cc (ffff930a90abaf00) 00010000:00010000:0.0:1786109648.146122:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.146125:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39a00/0xdb52b77d7ca378c8 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146131:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac1f39a00/0xdb52b77d7ca378c8 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146143:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bdc00/0xdb52b77d7ca378eb lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146149:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bdc00/0xdb52b77d7ca378eb lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146155:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bdc00/0xdb52b77d7ca378eb lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146160:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bdc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.146163:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bdc00/0xdb52b77d7ca378eb lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146169:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bdc00/0xdb52b77d7ca378eb lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146177:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x3e3e6f26 (ffff930ab1d24900) 00010000:00010000:0.0:1786109648.146180:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.146183:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bdc00/0xdb52b77d7ca378eb lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146189:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bdc00/0xdb52b77d7ca378eb lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.146199:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca3790e lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1786109648.146310:0:43912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1000 count 1 00002000:00010000:2.0:1786109648.146334:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109648.146341:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000469d09f9/0xdb52b77d7ca37d60 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146352:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e8:0x0].0x0 since=8504s v=(0 0) 00010000:00010000:2.0:1786109648.146356:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109648.146361:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000469d09f9/0xdb52b77d7ca37d60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146373:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000469d09f9/0xdb52b77d7ca37d60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146381:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000469d09f9/0xdb52b77d7ca37d60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146389:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000469d09f9/0xdb52b77d7ca37d60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146406:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786109648.146550:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3647:x1872862933329152:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1045us (1684us total) trans 4294975832 rc 0/0 00000100:00100000:2.0:1786109648.146558:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23140 00000100:00100000:2.0:1786109648.146582:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23141 00000100:00100000:2.0:1786109648.146589:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+13:3647:x1872862933328512:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1786109648.146605:0:43912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:994 count 1 00002000:00010000:2.0:1786109648.146619:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109648.146624:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012d062fc/0xdb52b77d7ca37d67 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146631:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e2:0x0].0x0 since=8504s v=(0 0) 00010000:00010000:2.0:1786109648.146635:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109648.146639:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d062fc/0xdb52b77d7ca37d67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146648:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012d062fc/0xdb52b77d7ca37d67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146655:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012d062fc/0xdb52b77d7ca37d67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146662:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012d062fc/0xdb52b77d7ca37d67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146677:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1786109648.146745:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3647:x1872862933328512:12345-0@lo:6:osp-syn-1-1.0 Request processed in 157us (1830us total) trans 4294975833 rc 0/0 00000100:00100000:2.0:1786109648.146751:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23141 00000100:00100000:2.0:1786109648.146764:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23142 00000100:00100000:2.0:1786109648.146771:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+13:3647:x1872862933329024:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1786109648.146784:0:43912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1003 count 1 00002000:00010000:2.0:1786109648.146800:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109648.146805:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37d6e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146813:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3eb:0x0].0x0 since=8504s v=(0 0) 00010000:00010000:2.0:1786109648.146815:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109648.146820:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37d6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146829:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37d6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146837:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37d6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146844:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37d6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146853:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1786109648.146917:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3647:x1872862933329024:12345-0@lo:6:osp-syn-1-1.0 Request processed in 147us (1965us total) trans 4294975834 rc 0/0 00000100:00100000:2.0:1786109648.146933:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23142 00010000:00010000:2.0:1786109648.146955:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1786109648.146961:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37d59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146968:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109648.146972:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37d59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146981:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37d59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.146993:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37d59 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147000:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca37d59 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147015:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786109648.147018:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000469d09f9/0xdb52b77d7ca37d60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147024:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109648.147027:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000469d09f9/0xdb52b77d7ca37d60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147034:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000469d09f9/0xdb52b77d7ca37d60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147042:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000469d09f9/0xdb52b77d7ca37d60 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147048:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000469d09f9/0xdb52b77d7ca37d60 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147064:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786109648.147067:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012d062fc/0xdb52b77d7ca37d67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147073:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109648.147076:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012d062fc/0xdb52b77d7ca37d67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147082:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012d062fc/0xdb52b77d7ca37d67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147091:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012d062fc/0xdb52b77d7ca37d67 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147097:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012d062fc/0xdb52b77d7ca37d67 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147110:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109648.147113:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37d6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147120:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109648.147123:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37d6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147136:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37d6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147145:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37d6e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147153:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37d6e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.147165:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109648.147167:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109648.147168:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109648.147280:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3647:x1872862933328640:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2213us (2471us total) trans 4294975831 rc 0/0 00000100:00100000:1.0:1786109648.147288:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23139 00010000:00010000:1.0:1786109648.147333:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109648.147339:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786109648.147383:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab94c7800/2, rc 0, transno 4294975828 00010000:00010000:0.0:1786109648.147504:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca3790e lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147511:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca3790e lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147518:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.147522:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca3790e lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147530:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca3790e lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147541:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x610cb780 (ffff930984516200) 00010000:00010000:0.0:1786109648.147544:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.147547:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca3790e lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147553:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca3790e lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147571:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca37931 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147577:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca37931 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147582:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca37931 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147587:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.147590:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca37931 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147596:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca37931 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147609:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x83daffd9 (ffff930a85613500) 00010000:00010000:0.0:1786109648.147611:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.147614:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca37931 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147620:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca37931 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147632:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca37954 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147638:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca37954 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147644:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca37954 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147649:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.147652:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca37954 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147657:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca37954 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147664:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xa6a94833 (ffff930a85613e00) 00010000:00010000:0.0:1786109648.147666:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.147669:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca37954 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147675:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca37954 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147686:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37977 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147693:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37977 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147700:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37977 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147704:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.147707:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37977 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147713:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37977 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147720:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xc977908d (ffff930a85613300) 00010000:00010000:0.0:1786109648.147723:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.147726:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37977 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147732:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37977 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147743:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca3799a lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147749:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca3799a lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147754:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca3799a lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147760:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ba00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.147763:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca3799a lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147769:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca3799a lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147777:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xec45d8e7 (ffff930984516000) 00010000:00010000:0.0:1786109648.147779:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.147782:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca3799a lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147788:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca3799a lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147799:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca379bd lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147806:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca379bd lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147812:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca379bd lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147817:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ac00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.147820:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca379bd lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147826:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca379bd lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147839:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xf142140 (ffff930984516600) 00010000:00010000:0.0:1786109648.147841:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.147844:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca379bd lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147849:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca379bd lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147860:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca379e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147866:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca379e0 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147873:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca379e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147879:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.147881:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca379e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147888:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca379e0 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147895:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x31e2699a (ffff930984516d00) 00010000:00010000:0.0:1786109648.147897:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.147901:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca379e0 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147906:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca379e0 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147919:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37a03 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147925:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37a03 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147931:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37a03 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147937:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.147940:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37a03 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147946:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37a03 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147955:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x54b0b1f4 (ffff930a85613100) 00010000:00010000:0.0:1786109648.147957:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.147960:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37a03 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147966:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37a03 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147978:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37a88 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147984:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37a88 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147989:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37a88 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.147995:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628aa00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.147998:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37a88 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148003:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37a88 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148011:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x1b7026cc (ffff930a90abaf00) 00010000:00010000:0.0:1786109648.148013:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148016:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37a88 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148022:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca37a88 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148039:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37aa4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148044:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37aa4 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148050:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37aa4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148055:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148058:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37aa4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148063:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37aa4 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148073:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xd0b639f4 (ffff930ab1d24d00) 00010000:00010000:0.0:1786109648.148075:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148078:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37aa4 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148084:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2600/0xdb52b77d7ca37aa4 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148098:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca37ac0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148104:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca37ac0 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148110:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca37ac0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148116:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab28bda00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148118:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca37ac0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148124:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca37ac0 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148131:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x3e3e6f26 (ffff930ab1d24900) 00010000:00010000:0.0:1786109648.148133:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148136:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca37ac0 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148141:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab28bda00/0xdb52b77d7ca37ac0 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148157:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424e00/0xdb52b77d7ca37adc lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148163:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424e00/0xdb52b77d7ca37adc lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148169:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424e00/0xdb52b77d7ca37adc lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148174:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148177:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424e00/0xdb52b77d7ca37adc lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148183:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424e00/0xdb52b77d7ca37adc lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148191:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xfdd9083c (ffff930a85613200) 00010000:00010000:0.0:1786109648.148193:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148196:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424e00/0xdb52b77d7ca37adc lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148215:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424e00/0xdb52b77d7ca37adc lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148231:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37af8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148237:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37af8 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148242:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37af8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148248:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148251:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37af8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148256:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37af8 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148263:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xa6a94833 (ffff930a85613e00) 00010000:00010000:0.0:1786109648.148266:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148269:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37af8 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148275:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37af8 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148288:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca37b14 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148294:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca37b14 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148300:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca37b14 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148306:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148309:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca37b14 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148316:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca37b14 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148327:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x94c295fa (ffff930984516800) 00010000:00010000:0.0:1786109648.148329:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148332:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca37b14 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148339:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca37b14 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148354:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37b30 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148360:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37b30 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148367:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37b30 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148371:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148374:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37b30 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148381:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37b30 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148389:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xa3936bac (ffff930984516f00) 00010000:00010000:0.0:1786109648.148392:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148394:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37b30 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148400:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37b30 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148415:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453800/0xdb52b77d7ca37b4c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148422:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453800/0xdb52b77d7ca37b4c lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148427:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453800/0xdb52b77d7ca37b4c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148459:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148462:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453800/0xdb52b77d7ca37b4c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148469:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453800/0xdb52b77d7ca37b4c lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148477:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xc977908d (ffff930a85613300) 00010000:00010000:0.0:1786109648.148480:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148483:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453800/0xdb52b77d7ca37b4c lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148489:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9453800/0xdb52b77d7ca37b4c lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148504:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452800/0xdb52b77d7ca37b68 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148510:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452800/0xdb52b77d7ca37b68 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148516:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452800/0xdb52b77d7ca37b68 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148522:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148525:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452800/0xdb52b77d7ca37b68 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148531:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452800/0xdb52b77d7ca37b68 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148539:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xef08328a (ffff930ab1d24800) 00010000:00010000:0.0:1786109648.148542:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148544:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452800/0xdb52b77d7ca37b68 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148550:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452800/0xdb52b77d7ca37b68 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148563:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37b84 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148569:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37b84 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148574:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37b84 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148580:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148583:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37b84 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148589:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37b84 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148600:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x54b0b1f4 (ffff930a85613100) 00010000:00010000:0.0:1786109648.148602:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148604:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37b84 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148610:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37b84 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148623:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37ba0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148630:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37ba0 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148635:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37ba0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148640:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148642:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37ba0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148648:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37ba0 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148654:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x31e2699a (ffff930984516d00) 00010000:00010000:0.0:1786109648.148656:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148659:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37ba0 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148664:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca37ba0 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148676:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425600/0xdb52b77d7ca37bbc lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148682:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425600/0xdb52b77d7ca37bbc lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148688:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425600/0xdb52b77d7ca37bbc lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148693:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148696:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425600/0xdb52b77d7ca37bbc lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148702:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425600/0xdb52b77d7ca37bbc lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148709:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x610cb780 (ffff930984516200) 00010000:00010000:0.0:1786109648.148711:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148714:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425600/0xdb52b77d7ca37bbc lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148720:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425600/0xdb52b77d7ca37bbc lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148742:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37bd8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148749:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37bd8 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148755:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37bd8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148761:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148764:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37bd8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148770:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37bd8 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148778:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x83daffd9 (ffff930a85613500) 00010000:00010000:0.0:1786109648.148781:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148784:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37bd8 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148789:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37bd8 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148805:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37bf4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148811:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37bf4 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148816:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37bf4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148821:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148824:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37bf4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148830:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37bf4 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148842:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xec45d8e7 (ffff930984516000) 00010000:00010000:0.0:1786109648.148844:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148847:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37bf4 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148853:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9452400/0xdb52b77d7ca37bf4 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148868:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37c10 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148874:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37c10 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148881:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37c10 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148886:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148889:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37c10 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148895:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37c10 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148903:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x494dcf1b (ffff930a90abad00) 00010000:00010000:0.0:1786109648.148905:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148908:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37c10 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148913:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37c10 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148927:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37c2c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148932:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37c2c lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148937:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37c2c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148941:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148943:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37c2c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148949:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37c2c lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148955:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xc1e56442 (ffff930ab1d24b00) 00010000:00010000:0.0:1786109648.148958:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.148960:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37c2c lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148966:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37c2c lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148979:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37c48 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148985:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37c48 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148990:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37c48 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.148995:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.148998:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37c48 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149004:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37c48 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149011:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x1c2b00d3 (ffff930a85613c00) 00010000:00010000:0.0:1786109648.149013:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.149016:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37c48 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149021:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425200/0xdb52b77d7ca37c48 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149035:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c64 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149040:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c64 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149046:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c64 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149052:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.149055:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c64 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149061:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c64 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149072:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x679fc7b1 (ffff930984516100) 00010000:00010000:0.0:1786109648.149075:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.149078:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c64 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149084:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424a00/0xdb52b77d7ca37c64 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149098:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c80 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149104:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c80 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149110:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c80 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149115:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.149118:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c80 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149124:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c80 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149131:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0x76709d63 (ffff930984516e00) 00010000:00010000:0.0:1786109648.149133:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.149136:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c80 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149142:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37c80 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149156:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c9c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149163:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c9c lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149169:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c9c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149175:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109648.149178:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c9c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149184:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c9c lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149191:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1:0x0].0xf142140 (ffff930984516600) 00010000:00010000:0.0:1786109648.149194:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109648.149196:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c9c lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109648.149276:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933328384:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1786109648.149323:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab94c5f80/2, rc 0, transno 4294975829 00010000:00010000:0.0:1786109648.149349:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424400/0xdb52b77d7ca37c9c lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x1:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.149388:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786109648.149517:0:187891:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000020:00080000:3.0:1786109648.149618:0:187891:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 21474840725 batchid updated 00000004:00080000:3.0:1786109648.149706:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab94c5c00/2, rc 0, transno 4294975833 00000100:00100000:3.0:1786109648.149712:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933328512:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1786109648.149723:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab94c4700/2, rc 0, transno 4294975834 00000100:00100000:3.0:1786109648.149726:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933329024:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1786109648.149735:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab94c4000/2, rc 0, transno 4294975831 00000100:00100000:3.0:1786109648.149739:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933328640:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1786109648.149747:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab94c4e00/2, rc 0, transno 4294975832 00000100:00100000:3.0:1786109648.149751:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933329152:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1786109648.149980:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109648.149997:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933329280:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786109648.150073:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109648.150168:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933329280 00000100:00100000:0.0:1786109648.150177:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933329280 00000100:00100000:0.0:1786109648.150258:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23143 00000100:00100000:0.0:1786109648.150269:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933329280:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1786109648.150331:0:179239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:999 count 1 00002000:00010000:0.0:1786109648.150945:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109648.150955:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008535a32c/0xdb52b77d7ca37d75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.150973:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e7:0x0].0x0 since=8504s v=(0 0) 00010000:00010000:0.0:1786109648.150979:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109648.150987:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008535a32c/0xdb52b77d7ca37d75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.151006:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008535a32c/0xdb52b77d7ca37d75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.151016:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008535a32c/0xdb52b77d7ca37d75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.151025:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008535a32c/0xdb52b77d7ca37d75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.151045:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109648.151289:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109648.151297:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008535a32c/0xdb52b77d7ca37d75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.151307:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109648.151311:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008535a32c/0xdb52b77d7ca37d75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.151322:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008535a32c/0xdb52b77d7ca37d75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.151340:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008535a32c/0xdb52b77d7ca37d75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.151354:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008535a32c/0xdb52b77d7ca37d75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.151376:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109648.151378:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109648.151380:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109648.151388:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109648.151402:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933329536:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1786109648.151470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109648.151512:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933329536 00000100:00100000:2.0:1786109648.151518:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933329536 00000100:00100000:2.0:1786109648.151559:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23144 00000100:00100000:2.0:1786109648.151569:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+13:3647:x1872862933329536:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1786109648.151592:0:179238:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1002 count 1 00002000:00010000:2.0:1786109648.151614:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109648.151620:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d7c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.151629:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ea:0x0].0x0 since=8504s v=(0 0) 00010000:00010000:2.0:1786109648.151632:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109648.151637:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.151648:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.151662:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.151669:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109648.151688:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786109648.151789:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+14:3647:x1872862933329536:12345-0@lo:6:osp-syn-1-1.0 Request processed in 220us (318us total) trans 4294975835 rc 0/0 00000100:00100000:2.0:1786109648.151797:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23144 00000004:00080000:2.0:1786109648.151850:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ac1d3d180/2, rc 0, transno 4294975835 00000100:00100000:2.0:1786109648.151857:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933329536:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1786109648.151878:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933329408:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1786109648.151904:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109648.152067:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933329280:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1799us (1993us total) trans 38654705669 rc 0/0 00000100:00100000:0.0:1786109648.152076:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23143 00000100:00100000:0.0:1786109648.152091:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933329408 00000100:00100000:0.0:1786109648.152095:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933329408 00000100:00100000:0.0:1786109648.152133:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23145 00000100:00100000:0.0:1786109648.152140:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+14:3649:x1872862933329408:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1786109648.152154:0:179239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:996 count 1 00002000:00010000:0.0:1786109648.152174:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109648.152179:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f315e8/0xdb52b77d7ca37d83 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.152188:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e4:0x0].0x0 since=8504s v=(0 0) 00010000:00010000:0.0:1786109648.152192:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109648.152196:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f315e8/0xdb52b77d7ca37d83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.152222:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6f315e8/0xdb52b77d7ca37d83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.152230:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f315e8/0xdb52b77d7ca37d83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.152238:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f315e8/0xdb52b77d7ca37d83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109648.152255:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1786109648.152331:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+15:3649:x1872862933329408:12345-0@lo:6:osp-syn-1-1.0 Request processed in 191us (426us total) trans 4294975836 rc 0/0 00000100:00100000:0.0:1786109648.152338:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23145 00000100:00100000:1.0:1786109648.152512:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933328896:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1786109648.152537:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab94c6300/2, rc 0, transno 4294975827 00000100:00100000:1.0:1786109648.152542:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933328256:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1786109648.152553:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab94c5880/2, rc 0, transno 4294975830 00000100:00100000:1.0:1786109648.152556:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933328768:0@lo:6:osp-syn-1-1.0 00000020:00080000:1.0:1786109648.152575:0:187933:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840725 00000004:00080000:1.0:1786109648.152644:0:187933:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9309855a76c0 with version 9 00000020:00080000:1.0:1786109648.152659:0:187933:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474840725 cancel update log [0x200026d32:0x1:0x0].1: rc = 0 00000020:00080000:1.0:1786109648.152724:0:187933:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474840725 cancel update log [0x240002efa:0x1:0x0].1: rc = 0 00000020:00080000:1.0:1786109648.152734:0:187933:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840725 00010000:00010000:1.0:1786109648.152744:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786109648.152750:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.152765:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109648.152769:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.152778:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.152794:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d7c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.152802:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37d7c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.152824:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109648.152828:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6f315e8/0xdb52b77d7ca37d83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.152834:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109648.152837:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f315e8/0xdb52b77d7ca37d83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.152845:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f315e8/0xdb52b77d7ca37d83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.152855:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6f315e8/0xdb52b77d7ca37d83 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.152862:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6f315e8/0xdb52b77d7ca37d83 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109648.152874:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109648.152876:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109648.152878:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109648.152885:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786109648.152960:0:187918:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930986abf840 version 9 rpc_version 9 00000020:00100000:0.0:1786109648.152993:0:187918:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109648.153001:0:187918:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a97c4e300 x1872862933329792/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109648.153023:0:187918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933329792:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109648.153064:0:187918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109648.153087:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc900 going to sleep for 11 seconds 00000100:00100000:0.0:1786109648.153104:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933329792 00000100:00100000:0.0:1786109648.153108:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933329792 00000100:00100000:0.0:1786109648.153149:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12439 00000100:00100000:0.0:1786109648.153159:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187918:x1872862933329792:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109648.153334:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187918:x1872862933329792:12345-0@lo:1000:osp_up0-1.0 Request processed in 175us (268us total) trans 343597383690 rc 0/0 00000100:00100000:0.0:1786109648.153342:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12439 00000100:00100000:0.0:1786109648.153388:0:187918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933329792:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786109648.153860:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930a97c4ca80/2, rc 0, transno 38654705669 00000100:00100000:2.0:1786109648.153917:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933329280:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1786109648.153944:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab94c7480/2, rc 0, transno 4294975836 00000100:00100000:2.0:1786109648.153948:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933329408:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1786109648.901873:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109649.926290:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786109650.216469:0:187922:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8506883034734ns, next at 8507883030559ns, rc = 0 00000100:00100000:2.0:1786109650.216547:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933329920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109650.216649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109650.216771:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933329920 00000100:00100000:3.0:1786109650.216780:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933329920 00000100:00100000:3.0:1786109650.216902:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5888 00000100:00100000:3.0:1786109650.216915:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933329920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109650.216951:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109650.217012:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933329920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109650.217020:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5888 00000100:00100000:2.0:1786109650.217108:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933329920:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1786109650.217367:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786109650.951855:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786109651.224132:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383690 is committed 00000001:00080000:0.0:1786109651.224165:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383689 is committed 00010000:00010000:0.0:1786109651.224233:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37d2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109651.224248:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37d2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109651.224257:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37d2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109651.224265:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109651.224270:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37d2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109651.224278:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37d2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109651.224302:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa42ff64a (ffff930a92c11700) 00010000:00010000:0.0:1786109651.224306:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109651.224311:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37d2f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109651.224318:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37d2f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa42ff64a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109651.973027:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109652.743224:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933330048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109652.743327:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109652.744308:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933330048 00000100:00100000:0.0:1786109652.744320:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933330048 00000100:00100000:0.0:1786109652.744381:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12440 00000100:00100000:0.0:1786109652.744392:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab538b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1872862933330048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786109652.745136:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445646336 avail 1299406848 00000100:00100000:0.0:1786109652.745305:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab538b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1872862933330048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 913us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109652.745314:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12440 00000100:00100000:2.0:1786109652.746197:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383690 gen 2 00000004:00080000:2.0:1786109652.746208:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 343597383687 committed transno 343597383690 00000020:00080000:2.0:1786109652.746217:0:3648:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff93098e3493c0 refcount 2 committed 0 result 0 batchid 21474840726 00000020:00080000:2.0:1786109652.746222:0:3648:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab1d83200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff930a8a597000 00000020:00080000:2.0:1786109652.746226:0:3648:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200026d32:0x1:0x0].2 00000020:00080000:2.0:1786109652.746229:0:3648:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab1d83100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ab1d0a000 00000020:00080000:2.0:1786109652.746232:0:3648:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002efa:0x1:0x0].2 00000004:00080000:2.0:1786109652.746267:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 343597383690 committed transno 343597383690 00000100:00100000:2.0:1786109652.746296:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933330048:0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1786109652.754028:0:187933:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 21474840726 committed batchid 21474840725 00000020:00080000:1.0:1786109652.754123:0:187933:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840725 00000100:00100000:1.0:1786109652.754347:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933330176:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.754471:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.754533:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933330688:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.754562:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.754586:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933331200:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.754609:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.754637:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1786109652.754642:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933330560:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.754663:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.754680:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933331072:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.754704:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.754722:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933331584:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.754741:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.754770:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933330304:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.754793:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.754812:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933330816:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.754834:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.754851:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933331328:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.754873:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.754893:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1786109652.754900:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933330432:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.754923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.754941:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933330944:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.754961:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.754978:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933331456:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.755000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.755036:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933330176 00000100:00100000:1.0:1786109652.755045:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933330176 00000100:00100000:1.0:1786109652.755098:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1786109652.755108:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933330176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.755163:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933330176:12345-0@lo:400:kworker.0 Request processed in 56us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.755185:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1786109652.755226:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933330688 00000100:00100000:1.0:1786109652.755230:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933330688 00000100:00100000:1.0:1786109652.755268:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933330560 00000100:00100000:1.0:1786109652.755271:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933330560 00000100:00100000:1.0:1786109652.755294:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933331328 00000100:00100000:1.0:1786109652.755297:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933331328 00000100:00100000:1.0:1786109652.755317:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933331456 00000100:00100000:1.0:1786109652.755321:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933331456 00000100:00100000:1.0:1786109652.755342:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7051 00000100:00100000:1.0:1786109652.755349:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+15:3649:x1872862933330688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.755385:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+15:3649:x1872862933330688:12345-0@lo:400:kworker.0 Request processed in 36us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.755391:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7051 00000100:00100000:1.0:1786109652.755404:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7052 00000100:00100000:1.0:1786109652.755410:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933330560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.755464:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933330560:12345-0@lo:400:kworker.0 Request processed in 54us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.755471:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7052 00000100:00100000:1.0:1786109652.755482:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7053 00000100:00100000:1.0:1786109652.755488:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933331328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.755520:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933331328:12345-0@lo:400:kworker.0 Request processed in 32us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.755526:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7053 00000100:00100000:1.0:1786109652.755537:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7054 00000100:00100000:1.0:1786109652.755543:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933331456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.755570:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933331456:12345-0@lo:400:kworker.0 Request processed in 27us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.755576:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7054 00000100:00100000:1.0:1786109652.755596:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933331200 00000100:00100000:1.0:1786109652.755600:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933331200 00000100:00100000:1.0:1786109652.755626:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12441 00000100:00100000:1.0:1786109652.755633:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933331200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.755669:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933331200:12345-0@lo:400:kworker.0 Request processed in 36us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.755675:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12441 00000100:00100000:1.0:1786109652.755715:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933331072 00000100:00100000:1.0:1786109652.755719:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933331072 00000100:00100000:1.0:1786109652.755744:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933331584 00000100:00100000:1.0:1786109652.755747:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933331584 00000100:00100000:1.0:1786109652.755759:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933330304 00000100:00100000:1.0:1786109652.755762:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933330304 00000100:00100000:1.0:1786109652.755775:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933330816 00000100:00100000:1.0:1786109652.755777:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933330816 00000100:00100000:1.0:1786109652.755787:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933330432 00000100:00100000:1.0:1786109652.755789:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933330432 00000100:00100000:1.0:1786109652.755802:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933330944 00000100:00100000:1.0:1786109652.755805:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933330944 00000100:00100000:1.0:1786109652.755820:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1786109652.755827:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933331072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.755860:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933331072:12345-0@lo:400:kworker.0 Request processed in 34us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.755867:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1786109652.755883:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1786109652.755889:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933331584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.755918:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933331584:12345-0@lo:400:kworker.0 Request processed in 30us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.755925:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1786109652.755940:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1786109652.755946:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933330304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.755977:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933330304:12345-0@lo:400:kworker.0 Request processed in 30us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.755983:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1786109652.755998:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1786109652.756004:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933330816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756034:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933330816:12345-0@lo:400:kworker.0 Request processed in 30us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.756040:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1786109652.756055:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1786109652.756060:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933330432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756088:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933330432:12345-0@lo:400:kworker.0 Request processed in 27us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.756094:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1786109652.756107:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1786109652.756112:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933330944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756136:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933330944:12345-0@lo:400:kworker.0 Request processed in 24us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.756141:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1786109652.756224:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933330560:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756237:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933331072:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756247:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933331584:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756256:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933330176:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756268:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933330688:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756279:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933331200:0@lo:400:kworker.0 00000100:00080000:1.0:1786109652.756317:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786109652.756322:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109652.756326:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109652.756328:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109652.756363:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933330432:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756374:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933330944:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756385:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933331456:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756394:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933330304:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756403:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933330816:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756413:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933331328:0@lo:400:kworker.0 00000100:00100000:1.0:1786109652.756569:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab928a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933331712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109652.756604:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109652.756658:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933331712 00000100:00100000:1.0:1786109652.756663:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933331712 00000100:00100000:1.0:1786109652.756692:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12442 00000100:00100000:1.0:1786109652.756699:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933331712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109652.756734:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446060032 avail 1299820544 00000100:00100000:1.0:1786109652.756775:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933331712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109652.756781:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12442 00000100:00100000:1.0:1786109652.756807:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab928a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933331712:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1786109653.003993:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109653.029306:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109653.029344:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109653.029369:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109653.029388:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109653.029465:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109653.029498:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922142592 00000100:00100000:0.0:1786109653.029507:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922142592 00000100:00100000:0.0:1786109653.029552:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:0.0:1786109653.029562:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922142592:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109653.029627:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922142592:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109653.029638:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:0.0:1786109653.029682:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922142848 00000100:00100000:0.0:1786109653.029687:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922142848 00000100:00100000:0.0:1786109653.029724:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922142720 00000100:00100000:0.0:1786109653.029727:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922142720 00000100:00100000:0.0:1786109653.029747:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 342 00000100:00100000:0.0:1786109653.029752:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922142848:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109653.029779:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922142848:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109653.029785:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 342 00000100:00100000:0.0:1786109653.029798:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 343 00000100:00100000:0.0:1786109653.029804:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922142720:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109653.029824:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922142720:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 21us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109653.029830:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 343 00000100:00100000:0.0:1786109653.029851:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922143104 00000100:00100000:0.0:1786109653.029855:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922143104 00000100:00100000:0.0:1786109653.029880:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922142976 00000100:00100000:0.0:1786109653.029883:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922142976 00000100:00100000:0.0:1786109653.029905:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7055 00000100:00100000:0.0:1786109653.029911:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922143104:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109653.029937:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922143104:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109653.029943:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7055 00000100:00100000:0.0:1786109653.029956:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7056 00000100:00100000:0.0:1786109653.029962:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922142976:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109653.029983:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922142976:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109653.029988:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7056 00000100:00080000:0.0:1786109653.030013:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109653.030017:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109653.030020:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109653.030021:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:2.0:1786109653.125926:0:197221:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80b: DNE: create remote dir, drop update rep from MDT0, fail MDT1 ========================================================== 09:34:11 (1786109651) 00000100:00100000:1.0:1786109653.252657:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933331840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109653.252729:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109653.253993:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933331840 00000100:00100000:0.0:1786109653.254003:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933331840 00000100:00100000:0.0:1786109653.254068:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5889 00000100:00100000:0.0:1786109653.254079:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933331840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109653.254109:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109653.254192:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933331840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109653.254198:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5889 00000100:00100000:0.0:1786109653.254266:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933331840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109653.256301:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786109653.256306:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109653.256323:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933332096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109653.256323:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933331968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109653.268363:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109653.268631:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109653.272104:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933332096 00000100:00100000:3.0:1786109653.272115:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933332096 00000100:00100000:3.0:1786109653.272207:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933331968 00000100:00100000:3.0:1786109653.272211:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933331968 00000100:00100000:3.0:1786109653.272234:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5890 00000100:00100000:3.0:1786109653.272242:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+15:3649:x1872862933332096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109653.272272:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109653.272334:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+15:3649:x1872862933332096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (3977us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109653.272340:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5890 00000100:00100000:3.0:1786109653.272354:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5891 00000100:00100000:3.0:1786109653.272359:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933331968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109653.272367:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109653.272531:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933331968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109653.272538:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5891 00000100:00100000:3.0:1786109653.272583:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933332096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109653.272669:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933331968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109653.276564:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109653.276611:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922143232 00000100:00100000:0.0:1786109653.276620:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922143232 00000100:00100000:0.0:1786109653.276674:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1144 00000100:00100000:0.0:1786109653.276684:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:164170:x1872862922143232:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109653.276703:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109653.276725:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37d8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1762 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109653.276789:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109653.276803:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109653.276815:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109653.276859:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:0.0:1786109653.276864:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109653.276882:0:187899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109653.276907:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca37d8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1762 expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109653.276924:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1762 expref: 7 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109653.276933:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:0.0:1786109653.276935:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109653.276939:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9e00, rc 0) 00000100:00100000:0.0:1786109653.278524:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:164170:x1872862922143232:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 308us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109653.278536:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1144 00000100:00100000:0.0:1786109653.301350:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109653.304442:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922143360 00000100:00100000:3.0:1786109653.304456:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922143360 00000100:00100000:3.0:1786109653.304517:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1145 00000100:00100000:3.0:1786109653.304527:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:164170:x1872862922143360:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109653.305605:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109653.305630:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37d98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1769 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305691:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37d9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305705:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37d9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305716:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37d9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305731:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37da6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305738:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37da6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305744:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37da6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305802:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37d9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305809:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37d9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305814:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37d9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305820:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109653.305824:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37d9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305831:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37d9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305841:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:3.0:1786109653.305844:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109653.305849:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37d9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305856:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37d9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305867:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37da6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305872:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37da6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305877:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37da6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305881:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109653.305883:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37da6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305887:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37da6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305893:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff930aa0615f00) 00010000:00010000:3.0:1786109653.305895:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109653.305897:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37da6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305903:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37da6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305930:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37d98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1769 expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305939:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:3.0:1786109653.305942:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109653.305946:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37d98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1769 expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109653.305954:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07200, rc 0) 00000100:00100000:3.0:1786109653.306998:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:164170:x1872862922143360:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2467us (5649us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109653.307008:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1145 00000100:00100000:0.0:1786109653.312251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109653.312345:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922143616 00000100:00100000:1.0:1786109653.312355:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922143616 00000100:00100000:1.0:1786109653.313158:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1146 00000100:00100000:1.0:1786109653.313188:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+7:164170:x1872862922143616:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1786109653.313245:0:196401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109653.313271:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca37d91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1762 expref: 7 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.313288:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:1.0:1786109653.313292:0:196401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109653.313359:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37dad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.313373:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37dad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.313383:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37dad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.313397:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453800/0xdb52b77d7ca37db4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.313404:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453800/0xdb52b77d7ca37db4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.313410:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453800/0xdb52b77d7ca37db4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.314919:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.314937:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.314952:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109653.314968:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008675b882 reply state 00000000d307a667 transno 343597383691 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.314979:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.314985:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:1.0:1786109653.314988:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109653.314990:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1786109653.314995:0:196401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1786109653.315003:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37dad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.315010:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37dad lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.315017:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37dad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.315023:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109653.315027:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37dad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.315033:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37dad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.315233:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:1.0:1786109653.315237:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109653.315241:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37dad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.315247:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37dad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109653.315259:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008675b882 reply state 00000000d307a667 transno 343597383691 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453800/0xdb52b77d7ca37db4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.315267:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453800/0xdb52b77d7ca37db4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109653.315273:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff930a90aba200) 00010000:00010000:1.0:1786109653.315275:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109653.315277:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1786109653.315369:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+8:164170:x1872862922143616:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 2198us (3123us total) trans 343597383691 rc 0/0 00000100:00100000:1.0:1786109653.315378:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1146 00010000:00010000:1.0:1786109654.034128:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109654.289402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109654.289490:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922143744 00000100:00100000:2.0:1786109654.289500:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922143744 00000100:00100000:2.0:1786109654.289626:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1147 00000100:00100000:2.0:1786109654.289637:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+8:164190:x1872862922143744:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109654.289663:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109654.289684:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca37dc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1770 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.289746:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37dc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.289765:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.289777:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109654.289823:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:2.0:1786109654.289827:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109654.289846:0:187899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.289869:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca37dc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1770 expref: 10 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.289884:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1770 expref: 9 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.289893:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:2.0:1786109654.289896:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109654.289900:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986424c00, rc 0) 00000100:00100000:2.0:1786109654.289960:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+9:164190:x1872862922143744:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 324us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109654.289967:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1147 00000100:00100000:3.0:1786109654.310580:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109654.310633:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922143872 00000100:00100000:3.0:1786109654.310642:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922143872 00000100:00100000:3.0:1786109654.310696:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1148 00000100:00100000:3.0:1786109654.310706:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+9:164190:x1872862922143872:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109654.310728:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109654.310748:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37dd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1777 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.311916:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37dd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.311939:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.311952:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.311973:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37dde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.311982:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.311994:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.312935:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06400/0xdb52b77d7ca37de5 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.312952:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06400/0xdb52b77d7ca37de5 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.312962:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06400/0xdb52b77d7ca37de5 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109654.313009:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1786109654.313014:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109654.313038:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06400/0xdb52b77d7ca37de5 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313051:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313058:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37dd7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313065:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313071:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109654.313075:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313716:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37dd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313735:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:3.0:1786109654.313738:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109654.313742:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37dd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313748:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07400/0xdb52b77d7ca37dd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313762:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313768:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37dde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313775:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37dde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313779:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109654.313782:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37dde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313787:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37dde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313793:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff930a90aba200) 00010000:00010000:3.0:1786109654.313796:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109654.313798:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37dde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313803:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06000/0xdb52b77d7ca37dde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313906:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca37dd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1777 expref: 11 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313921:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06400/0xdb52b77d7ca37de5 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1777 expref: 10 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.313927:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:3.0:1786109654.313929:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786109654.313932:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f06400, rc 0) 00000100:00100000:3.0:1786109654.314009:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+10:164190:x1872862922143872:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 3303us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109654.314925:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1148 00000020:00080000:0.0:1786109654.328296:0:187891:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 21474840726 batchid updated 00000004:00080000:0.0:1786109654.328323:0:187891:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000020:00080000:0.0:1786109654.328342:0:187933:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840726 00000004:00080000:0.0:1786109654.328420:0:187933:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff93098c1dca80 with version 10 00000020:00080000:0.0:1786109654.328449:0:187933:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 21474840726 cancel update log [0x200026d32:0x1:0x0].2: rc = 0 00000020:00080000:0.0:1786109654.328523:0:187933:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 21474840726 cancel update log [0x240002efa:0x1:0x0].2: rc = 0 00000020:00080000:0.0:1786109654.328531:0:187933:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840726 00000004:00080000:0.0:1786109654.328660:0:187918:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930986abf840 version 10 rpc_version 10 00000020:00100000:0.0:1786109654.328678:0:187918:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109654.328690:0:187918:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac17bf800 x1872862933333376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109654.328711:0:187918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bf800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933333376:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109654.328778:0:187918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109654.328826:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109654.328842:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933332608:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1786109654.328868:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109654.328885:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933333120:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1786109654.328903:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109654.328924:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786109654.328930:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933332224:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1786109654.328950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109654.328965:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933332736:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1786109654.328985:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109654.329004:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933332352:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1786109654.329025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109654.329042:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098ba4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933332864:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1786109654.329061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109654.329077:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786109654.331767:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933332480:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1786109654.331844:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109654.331887:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933332992:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1786109654.331971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109654.332014:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933333376 00000100:00100000:0.0:1786109654.332021:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933333376 00000100:00100000:0.0:1786109654.332065:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12443 00000100:00100000:0.0:1786109654.332073:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:187918:x1872862933333376:12345-0@lo:1000:osp_up0-1.0 00010000:02000000:0.0:1786109654.333223:0:179257:0:(ldlm_lib.c:3345:target_send_reply_msg()) *** cfs_fail_loc=1701, val=2147483648*** 00000100:00100000:2.0:1786109654.338933:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933332608 00000100:00100000:2.0:1786109654.338948:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933332608 00000100:00100000:2.0:1786109654.339009:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933333120 00000100:00100000:2.0:1786109654.339012:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933333120 00000100:00100000:2.0:1786109654.339029:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933332224 00000100:00100000:2.0:1786109654.339032:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933332224 00000100:00100000:2.0:1786109654.339045:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933332736 00000100:00100000:2.0:1786109654.339047:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933332736 00000100:00100000:2.0:1786109654.339061:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933332352 00000100:00100000:2.0:1786109654.339064:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933332352 00000100:00100000:2.0:1786109654.339080:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933332864 00000100:00100000:2.0:1786109654.339370:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933332864 00000100:00100000:2.0:1786109654.339398:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933332480 00000100:00100000:2.0:1786109654.339401:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933332480 00000100:00100000:2.0:1786109654.339416:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933332992 00000100:00100000:2.0:1786109654.339419:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933332992 00000100:00100000:2.0:1786109654.339458:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23146 00000100:00100000:2.0:1786109654.339468:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+13:3648:x1872862933332608:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1786109654.339499:0:43912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1000 count 1 00000100:00100000:2.0:1786109654.340266:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23147 00000100:00100000:2.0:1786109654.340277:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+13:3648:x1872862933333120:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1786109654.340293:0:43915:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:994 count 1 00000100:00100000:2.0:1786109654.340361:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23148 00000100:00100000:2.0:1786109654.340369:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+13:3648:x1872862933332224:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1786109654.340383:0:179238:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:998 count 1 00000100:00100000:2.0:1786109654.340526:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23149 00000100:00100000:2.0:1786109654.340534:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+13:3648:x1872862933332736:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1786109654.340548:0:43916:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1002 count 1 00000100:00100000:2.0:1786109654.341029:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23150 00000100:00100000:2.0:1786109654.341039:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+13:3646:x1872862933332352:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1786109654.341055:0:179240:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1001 count 1 00000100:00100000:1.0:1786109654.341889:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23151 00000100:00100000:1.0:1786109654.341914:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+13:3646:x1872862933332864:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1786109654.341930:0:43917:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:995 count 1 00000100:00100000:1.0:1786109654.342012:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23152 00000100:00100000:1.0:1786109654.342258:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+13:3646:x1872862933332480:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1786109654.342273:0:43911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1003 count 1 00000100:00100000:2.0:1786109654.342583:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23153 00000100:00100000:2.0:1786109654.342592:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3646:x1872862933332992:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1786109654.342608:0:9990:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:996 count 1 00002000:00010000:1.0:1786109654.343978:0:43911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109654.343990:0:43911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37dec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.344013:0:43911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3eb:0x0].0x0 since=8511s v=(0 0) 00010000:00010000:1.0:1786109654.344017:0:43911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109654.344023:0:43911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37dec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.344040:0:43911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37dec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.344050:0:43911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37dec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.344058:0:43911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37dec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.344077:0:43911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786109654.344622:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+14:3646:x1872862933332480:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2599us (12775us total) trans 38654705670 rc 0/0 00000100:00100000:1.0:1786109654.344632:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23152 00002000:00010000:1.0:1786109654.346407:0:43912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109654.346421:0:43912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37df3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.346452:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e8:0x0].0x0 since=8511s v=(0 0) 00010000:00010000:1.0:1786109654.346456:0:43912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109654.346462:0:43912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37df3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.346477:0:43912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37df3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.346486:0:43912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37df3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.346493:0:43912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37df3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.346513:0:43912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1786109654.346675:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3648:x1872862933332608:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7207us (17803us total) trans 38654705671 rc 0/0 00000100:00100000:1.0:1786109654.346918:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23146 00010000:00010000:1.0:1786109654.346951:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786109654.346958:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37dec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.346968:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109654.346972:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37dec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.346981:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37dec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.346999:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37dec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.347007:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000155ebdd1/0xdb52b77d7ca37dec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.347024:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109654.347027:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37df3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.347033:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109654.347036:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37df3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.347044:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37df3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.347052:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37df3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.347059:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca37df3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.347069:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109654.347071:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109654.347072:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786109654.347760:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1786109654.348482:0:179240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109654.348492:0:179240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca37dfa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.348504:0:179240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e9:0x0].0x0 since=8511s v=(0 0) 00010000:00010000:2.0:1786109654.348508:0:179240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109654.348513:0:179240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca37dfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.348525:0:179240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca37dfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.348534:0:179240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca37dfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.348541:0:179240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca37dfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.348559:0:179240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786109654.348710:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+14:3646:x1872862933332352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7671us (19681us total) trans 38654705672 rc 0/0 00000100:00100000:2.0:1786109654.348720:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23150 00002000:00010000:2.0:1786109654.348780:0:43916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109654.348785:0:43916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37e01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.348798:0:43916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ea:0x0].0x0 since=8511s v=(0 0) 00010000:00010000:2.0:1786109654.348801:0:43916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109654.348805:0:43916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37e01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.348813:0:43916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37e01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.348820:0:43916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37e01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.348826:0:43916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37e01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.348840:0:43916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786109654.350943:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+14:3648:x1872862933332736:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10400us (21946us total) trans 38654705673 rc 0/0 00000100:00100000:2.0:1786109654.350957:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23149 00002000:00010000:2.0:1786109654.351076:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109654.355053:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37e08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.355076:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e6:0x0].0x0 since=8511s v=(0 0) 00010000:00010000:2.0:1786109654.355456:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109654.355464:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37e08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.355482:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37e08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.355494:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37e08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.355501:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37e08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.355526:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00020000:0.0:1786109654.359811:0:179257:0:(ldlm_lib.c:3346:target_send_reply_msg()) @@@ dropping reply req@ffff930ac17bfb80 x1872862933333376/t343597383692(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:125/0 lens 488/4320 e 0 to 0 dl 1786109665 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1786109654.360571:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786109654.360584:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca37dfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.360598:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109654.360603:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca37dfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.360616:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca37dfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.360638:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca37dfa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.360647:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca37dfa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109654.360998:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+14:3648:x1872862933332224:12345-0@lo:6:osp-syn-0-1.0 Request processed in 20626us (32042us total) trans 38654705674 rc 0/0 00000100:00100000:2.0:1786109654.361009:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23148 00010000:00010000:1.0:1786109654.361790:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786109654.361799:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37e01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.361810:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109654.361813:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37e01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.361822:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37e01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.361837:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37e01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.361845:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca37e01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.361868:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109654.361872:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37e08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.361878:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109654.361881:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37e08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.361888:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37e08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786109654.362196:0:9990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109654.362204:0:9990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca37e0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362217:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e4:0x0].0x0 since=8511s v=(0 0) 00010000:00010000:2.0:1786109654.362221:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109654.362227:0:9990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca37e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362238:0:9990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca37e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362253:0:9990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca37e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362261:0:9990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca37e0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362273:0:9990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786109654.362447:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3646:x1872862933332992:12345-0@lo:6:osp-syn-0-1.0 Request processed in 19838us (30456us total) trans 38654705675 rc 0/0 00000100:00100000:2.0:1786109654.362456:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23153 00002000:00010000:2.0:1786109654.362511:0:43915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109654.362516:0:43915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca37e16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362525:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e2:0x0].0x0 since=8511s v=(0 0) 00010000:00010000:2.0:1786109654.362528:0:43915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109654.362532:0:43915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca37e16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362542:0:43915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca37e16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362550:0:43915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca37e16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362561:0:43915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca37e16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362570:0:43915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786109654.362640:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+14:3648:x1872862933333120:12345-0@lo:6:osp-syn-0-1.0 Request processed in 22366us (33735us total) trans 38654705676 rc 0/0 00000100:00100000:2.0:1786109654.362647:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23147 00010000:00010000:2.0:1786109654.362830:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786109654.362835:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca37e0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362843:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109654.362846:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca37e0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362854:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca37e0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362866:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca37e0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362873:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca37e0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362890:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109654.362894:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca37e16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362900:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109654.362904:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca37e16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362911:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca37e16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362921:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca37e16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362929:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca37e16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.362940:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109654.362942:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109654.362944:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109654.364887:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37e08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.366760:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca37e08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.366800:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109654.366803:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109654.366805:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109654.368375:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109654.371054:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109654.371413:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922144000 00000100:00100000:3.0:1786109654.371423:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922144000 00000100:00100000:3.0:1786109654.371495:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1149 00000100:00100000:3.0:1786109654.371507:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+10:164190:x1872862922144000:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109654.371528:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109654.371550:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37e1d lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a177e expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.371616:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37e24 lrc: 3/1,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.371629:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37e24 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.371646:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37e24 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.371661:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37e2b lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.371668:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37e2b lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.371675:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37e2b lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372783:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37e24 lrc: 4/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372791:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37e24 lrc: 4/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372797:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37e24 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372804:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37e24 lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372810:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109654.372814:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37e24 lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372822:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37e24 lrc: 5/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372837:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:3.0:1786109654.372841:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109654.372846:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37e24 lrc: 3/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372852:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37e24 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372866:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37e2b lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372872:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37e2b lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372877:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37e2b lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372882:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109654.372885:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37e2b lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.372890:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37e2b lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786109654.374298:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975836 is committed 00010000:00010000:3.0:1786109654.374729:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0xf7117594 (ffff930aa0615800) 00010000:00010000:3.0:1786109654.374734:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109654.374739:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37e2b lrc: 2/0,0 mode: --/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.374747:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37e2b lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.374799:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37e1d lrc: 1/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a177e expref: 11 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.374810:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:3.0:1786109654.374812:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109654.374816:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07800/0xdb52b77d7ca37e1d lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a177e expref: 11 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.374825:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07800, rc 0) 00000100:00100000:3.0:1786109654.374889:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+10:164190:x1872862922144000:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 3384us (3842us total) trans 0 rc 301/301 00000100:00100000:3.0:1786109654.376485:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1149 00002000:00010000:2.0:1786109654.377294:0:43917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109654.377304:0:43917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca37e32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.377321:0:43917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e3:0x0].0x0 since=8511s v=(0 0) 00010000:00010000:2.0:1786109654.377325:0:43917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109654.377331:0:43917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca37e32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.377349:0:43917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca37e32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.377359:0:43917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca37e32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.377366:0:43917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca37e32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786109654.380978:0:194579:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705669 is committed 00010000:00010000:2.0:1786109654.385226:0:43917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786109654.385470:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+13:3646:x1872862933332864:12345-0@lo:6:osp-syn-0-1.0 Request processed in 43567us (56403us total) trans 38654705677 rc 0/0 00000100:00100000:2.0:1786109654.385481:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23151 00010000:00010000:2.0:1786109654.385517:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109654.385525:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca37e32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.385537:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109654.385542:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca37e32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.385553:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca37e32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.385573:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca37e32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.385582:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca37e32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.385604:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109654.385606:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109654.385608:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109654.386980:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109654.392332:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109654.394302:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922144128 00000100:00100000:1.0:1786109654.394316:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922144128 00000100:00100000:1.0:1786109654.394379:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1150 00000100:00100000:1.0:1786109654.394389:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+10:164190:x1872862922144128:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109654.394409:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109654.394445:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e39 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1785 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394532:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452400/0xdb52b77d7ca37e40 lrc: 3/1,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394547:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452400/0xdb52b77d7ca37e40 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394558:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452400/0xdb52b77d7ca37e40 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394573:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e47 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394580:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e47 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394587:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e47 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394625:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452400/0xdb52b77d7ca37e40 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394634:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452400/0xdb52b77d7ca37e40 lrc: 2/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394641:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452400/0xdb52b77d7ca37e40 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394648:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109654.394652:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452400/0xdb52b77d7ca37e40 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394660:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452400/0xdb52b77d7ca37e40 lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394672:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:1.0:1786109654.394675:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109654.394679:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452400/0xdb52b77d7ca37e40 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394686:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452400/0xdb52b77d7ca37e40 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394700:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e47 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394706:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e47 lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394713:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e47 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394718:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109654.394721:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e47 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394727:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e47 lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394738:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0xf7117594 (ffff930a90aba400) 00010000:00010000:1.0:1786109654.394741:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109654.394744:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e47 lrc: 2/0,0 mode: --/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394750:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e47 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394781:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e39 lrc: 1/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1785 expref: 11 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394791:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:1.0:1786109654.394793:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109654.394797:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e39 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1785 expref: 11 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.394805:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9452800, rc 0) 00000100:00100000:1.0:1786109654.394871:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+10:164190:x1872862922144128:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 483us (2548us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109654.394878:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1150 00000004:00080000:1.0:1786109654.406269:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ac0ced180/2, rc 0, transno 38654705670 00000100:00100000:1.0:1786109654.406293:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933332480:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1786109654.406306:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930aa66e8000/2, rc 0, transno 38654705675 00000100:00100000:1.0:1786109654.406311:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933332992:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1786109654.406320:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ac0ceed80/2, rc 0, transno 38654705672 00000100:00100000:1.0:1786109654.406323:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933332352:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1786109654.406332:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705669 gen 2 00000004:00080000:1.0:1786109654.406336:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930a97c4ca80, transno 38654705669 00000100:00100000:1.0:1786109654.406344:0:3646:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff930ac0ced180 x1872862933332480/t38654705670(38654705670) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786109670 ref 2 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1786109654.406352:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93098ba4e300/2, rc 0, transno 38654705677 00000100:00100000:1.0:1786109654.406356:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933332864:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786109654.416821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109654.416867:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922144256 00000100:00100000:3.0:1786109654.416876:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922144256 00000100:00100000:3.0:1786109654.416925:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1151 00000100:00100000:3.0:1786109654.416935:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+10:164190:x1872862922144256:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109654.416955:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109654.416974:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37e4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a178c expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.417040:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37e55 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.417055:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37e55 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.417071:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37e55 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109654.418354:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1786109654.418363:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109654.420769:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37e55 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.420830:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37e4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a178c expref: 12 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.420854:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37e55 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a178c expref: 11 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.420863:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:3.0:1786109654.420866:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109654.420869:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07c00, rc 0) 00000100:00100000:3.0:1786109654.421797:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+11:164190:x1872862922144256:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 4856us (4978us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109654.421807:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1151 00000004:00080000:1.0:1786109654.438468:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab9660a80/2, rc 0, transno 38654705674 00000100:00100000:1.0:1786109654.438484:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933332224:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1786109654.438499:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93098ba4dc00/2, rc 0, transno 38654705673 00000100:00100000:1.0:1786109654.438502:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933332736:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1786109654.438510:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930a89098e00/2, rc 0, transno 38654705671 00000100:00100000:1.0:1786109654.438513:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933332608:0@lo:6:osp-syn-0-1.0 00000004:00080000:1.0:1786109654.438520:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930aa66ea680/2, rc 0, transno 38654705676 00000100:00100000:1.0:1786109654.438523:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933333120:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786109654.440349:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109654.440614:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922144512 00000100:00100000:1.0:1786109654.440624:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922144512 00000100:00100000:1.0:1786109654.440872:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1152 00000100:00100000:1.0:1786109654.440885:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+11:164190:x1872862922144512:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109654.440971:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109654.440993:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37e5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1793 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109654.441750:0:189813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1786109654.441863:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37e5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1793 expref: 13 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.441879:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:1.0:1786109654.441881:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786109654.441887:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452000/0xdb52b77d7ca37e5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1793 expref: 13 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.441917:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9452000, rc 0) 00000100:00100000:1.0:1786109654.441980:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+12:164190:x1872862922144512:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1098us (1640us total) trans 343597383693 rc 301/301 00000100:00100000:1.0:1786109654.441988:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1152 00000100:00100000:1.0:1786109654.453896:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab928aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933333504:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1786109654.455020:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109654.455414:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933333504 00000100:00100000:1.0:1786109654.455422:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933333504 00000100:00100000:2.0:1786109654.456365:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109654.458009:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23154 00000100:00100000:1.0:1786109654.458023:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+13:3649:x1872862933333504:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1786109654.458055:0:43918:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:997 count 1 00002000:00010000:1.0:1786109654.459278:0:43918:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109654.459289:0:43918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000352071d3/0xdb52b77d7ca37e6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.459305:0:43918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e5:0x0].0x0 since=8511s v=(0 0) 00010000:00010000:1.0:1786109654.459311:0:43918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109654.459317:0:43918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000352071d3/0xdb52b77d7ca37e6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.459336:0:43918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000352071d3/0xdb52b77d7ca37e6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.459345:0:43918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000352071d3/0xdb52b77d7ca37e6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.459354:0:43918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000352071d3/0xdb52b77d7ca37e6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.459371:0:43918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786109654.459577:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+14:3649:x1872862933333504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1555us (4555us total) trans 38654705678 rc 0/0 00000100:00100000:1.0:1786109654.459587:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23154 00010000:00010000:1.0:1786109654.459618:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109654.459624:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000352071d3/0xdb52b77d7ca37e6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.459632:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109654.459636:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000352071d3/0xdb52b77d7ca37e6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.459645:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000352071d3/0xdb52b77d7ca37e6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.459662:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000352071d3/0xdb52b77d7ca37e6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.459669:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000352071d3/0xdb52b77d7ca37e6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109654.459855:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109654.459858:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109654.459860:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786109654.459901:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab928aa00/2, rc 0, transno 38654705678 00000100:00100000:1.0:1786109654.459908:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab928aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933333504:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786109654.460260:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922144768 00000100:00100000:3.0:1786109654.460269:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922144768 00000100:00100000:0.0:1786109654.460605:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:187918:x1872862933333376:12345-0@lo:1000:osp_up0-1.0 Request processed in 128529us (131824us total) trans 343597383692 rc 0/0 00000100:00100000:0.0:1786109654.460617:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12443 00000100:00100000:2.0:1786109654.461031:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1153 00000100:00100000:2.0:1786109654.461042:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+5:164190:x1872862922144768:12345-192.168.203.38@tcp:36:lfs.0 00000100:00100000:2.0:1786109654.462076:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933333632:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.462521:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109654.462660:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933333632 00000100:00100000:1.0:1786109654.462668:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933333632 00000100:00100000:1.0:1786109654.462709:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12444 00000100:00100000:1.0:1786109654.462719:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:188678:x1872862933333632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786109654.462787:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:188678:x1872862933333632:12345-0@lo:1000:mdt00_003.0 Request processed in 71us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109654.462794:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12444 00000100:00100000:2.0:1786109654.463268:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109654.463298:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933333632:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.463366:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933333760:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.463408:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109654.463452:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1786109654.463837:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933333760 00000100:00100000:3.0:1786109654.463842:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933333760 00000100:00100000:3.0:1786109654.463882:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12445 00000100:00100000:3.0:1786109654.463891:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:188678:x1872862933333760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786109654.463969:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:188678:x1872862933333760:12345-0@lo:1000:mdt00_003.0 Request processed in 80us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109654.463977:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12445 00000100:00100000:2.0:1786109654.464971:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933333760:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.465028:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933333888:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.465066:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109654.465245:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933333888 00000100:00100000:3.0:1786109654.465250:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933333888 00000100:00100000:3.0:1786109654.465287:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12446 00000100:00100000:3.0:1786109654.465299:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:188678:x1872862933333888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786109654.467397:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:188678:x1872862933333888:12345-0@lo:1000:mdt00_003.0 Request processed in 2096us (2322us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786109654.467410:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12446 00000100:00100000:2.0:1786109654.467636:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109654.467664:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933333888:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1786109654.467728:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.467743:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109654.467754:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109654.467770:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933334016:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786109654.467803:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109654.467832:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109654.467931:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933334016 00000100:00100000:3.0:1786109654.467938:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933334016 00000100:00100000:3.0:1786109654.467978:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12447 00000100:00100000:3.0:1786109654.467987:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:188678:x1872862933334016:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786109654.468110:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109654.468128:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37e78 lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37e71 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.468153:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 2/0,1 mode: TXN/TXN res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.468357:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37e55 lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a178c expref: 11 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.468368:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37e78 lrc: 5/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37e71 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.468395:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37e55 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a178c expref: 11 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.468413:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37e55 lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a178c expref: 11 pid: 187900 timeout: 8611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109654.468425:0:8452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8452:1872862933334144:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109654.469315:0:8452:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1786109654.469346:0:8452:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1786109654.469374:0:8452:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a59e0c0 going to sleep for 11 seconds 00000001:00080000:3.0:1786109654.473731:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383693 is committed 00000001:00080000:3.0:1786109654.473748:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383692 is committed 00010000:00010000:0.0:1786109654.475021:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453800/0xdb52b77d7ca37db4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475035:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453800/0xdb52b77d7ca37db4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475043:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453800/0xdb52b77d7ca37db4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475049:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109654.475055:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453800/0xdb52b77d7ca37db4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475063:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453800/0xdb52b77d7ca37db4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475140:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff930a90aba200) 00010000:00010000:0.0:1786109654.475145:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109654.475150:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453800/0xdb52b77d7ca37db4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475158:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453800/0xdb52b77d7ca37db4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475189:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475196:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 2/0,0 mode: TXN/TXN res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475202:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 3/0,0 mode: TXN/TXN res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475207:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109654.475210:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 3/0,0 mode: TXN/TXN res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475216:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 4/0,0 mode: TXN/TXN res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475225:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:0.0:1786109654.475227:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109654.475234:0:3632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37e78 lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37e71 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475246:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 2/0,0 mode: --/TXN res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.475252:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453000/0xdb52b77d7ca37dbb lrc: 0/0,0 mode: --/TXN res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109654.476056:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109654.476169:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922144896 00000100:00100000:3.0:1786109654.476177:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922144896 00010000:00010000:3.0:1786109654.476211:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37e55 lrc: 5/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a178c expref: 9 pid: 187900 timeout: 8611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109654.476242:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12648 00000100:00100000:3.0:1786109654.476253:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fac74500-4523-4794-af20-dfdcdfae19c1+9:2403:x1872862922144896:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109654.476267:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109654.476274:0:177416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37e55 lrc: 5/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a178c expref: 9 pid: 187900 timeout: 8611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.476287:0:177416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37e55 lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a178c expref: 9 pid: 187900 timeout: 8611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.476310:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:3.0:1786109654.476316:0:177416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37e78 lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37e71 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.476327:0:177416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37e78 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca37e71 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.476335:0:177416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37e78 lrc: 4/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xdb52b77d7ca37e71 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.476365:0:177416:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37e78 lrc: 4/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37e71 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109654.476380:0:177416:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:177416:1872862933334272:0@lo:105: 00000100:00100000:3.0:1786109654.476450:0:177416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109654.476495:0:177416:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a59e480 going to sleep for 11 seconds 00000100:00100000:3.0:1786109654.476528:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933334272 00000100:00100000:3.0:1786109654.476532:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933334272 00000100:00100000:3.0:1786109654.476562:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5268 00000100:00100000:3.0:1786109654.476569:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:177416:x1872862933334272:12345-0@lo:105: 00010000:00010000:3.0:1786109654.476579:0:10344:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 4/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.476588:0:10344:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 4/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.476597:0:10344:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 4/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.476605:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.476612:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 5/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.476620:0:10344:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 5/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.476635:0:10344:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930986425600) 00000100:00100000:3.0:1786109654.476672:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:177416:x1872862933334272:12345-0@lo:105: Request processed in 103us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109654.476836:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5268 00000100:00100000:3.0:1786109654.476876:0:177416:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:177416:1872862933334272:0@lo:105: 00010000:00010000:3.0:1786109654.476890:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109654.477003:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fac74500-4523-4794-af20-dfdcdfae19c1+9:2403:x1872862922144896:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 751us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109654.477011:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12648 00010000:00010000:0.0:1786109654.477839:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca37e55 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a178c expref: 8 pid: 187900 timeout: 8611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109654.477858:0:8452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8452:1872862933334144:192.168.203.38@tcp:104: 00010000:00010000:0.0:1786109654.477881:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37e78 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37e71 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.477890:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:0.0:1786109654.477892:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109654.478142:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07e00, rc 0) 00000100:00100000:0.0:1786109654.478222:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:188678:x1872862933334016:12345-0@lo:101:mdt00_003.0 Request processed in 10235us (10417us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109654.478230:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12447 00000100:00100000:3.0:1786109654.478627:0:188678:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383692 gen 2 00000100:00100000:3.0:1786109654.478634:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933334016:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786109654.478650:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109654.478670:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x4:0x0] 00010000:00010000:3.0:1786109654.478706:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07800/0xdb52b77d7ca37e7f lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.478714:0:188678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07800/0xdb52b77d7ca37e7f lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.478723:0:188678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07800/0xdb52b77d7ca37e7f lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109654.478740:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933334400:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1786109654.478774:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109654.478805:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a59e480 going to sleep for 11 seconds 00000100:00100000:0.0:1786109654.479139:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933334400 00000100:00100000:0.0:1786109654.479146:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933334400 00000100:00100000:0.0:1786109654.479202:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12448 00000100:00100000:0.0:1786109654.479211:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:188678:x1872862933334400:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786109654.479226:0:177399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109654.479241:0:177399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca37e86 lrc: 2/0,0 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37e7f expref: -99 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.479269:0:177399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca37e86 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37e7f expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.479281:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca37e86 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37e7f expref: 9 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109654.479289:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0xf7117594 (ffff930984516d00) 00010000:00010000:0.0:1786109654.479292:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109654.479295:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9400, rc 0) 00000100:00100000:0.0:1786109654.479324:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933334400:12345-0@lo:101:mdt00_003.0 Request processed in 115us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109654.479331:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12448 00000100:00100000:3.0:1786109654.479796:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933334400:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786109654.479811:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07800/0xdb52b77d7ca37e7f lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37e86 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109654.479822:0:188678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07800/0xdb52b77d7ca37e7f lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37e86 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109654.479838:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x4:0x0] 00000100:00100000:3.0:1786109654.479872:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933334528:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786109654.479917:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109654.480031:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a59e600 going to sleep for 11 seconds 00000100:00100000:0.0:1786109654.480287:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933334528 00000100:00100000:0.0:1786109654.480293:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933334528 00000100:00100000:0.0:1786109654.480356:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12449 00000100:00100000:0.0:1786109654.480363:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933334528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786109654.480462:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933334528:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109654.480469:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12449 00000100:00100000:3.0:1786109654.480815:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933334528:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786109654.480854:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933334656:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786109654.480876:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109654.480891:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8a59e600 going to sleep for 11 seconds 00000100:00100000:2.0:1786109654.482526:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933334656 00000100:00100000:2.0:1786109654.482537:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933334656 00000100:00100000:3.0:1786109654.487290:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12450 00000100:00100000:3.0:1786109654.487304:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933334656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786109654.487472:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933334656:12345-0@lo:1000:mdt00_003.0 Request processed in 170us (6593us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786109654.487481:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12450 00000100:00100000:2.0:1786109654.490537:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933334656:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.490650:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933334784:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.490701:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109654.490729:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109654.490748:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933334784 00000100:00100000:2.0:1786109654.490754:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933334784 00000100:00100000:2.0:1786109654.490795:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12451 00000100:00100000:2.0:1786109654.490803:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933334784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.490884:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933334784:12345-0@lo:1000:mdt00_003.0 Request processed in 81us (181us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786109654.490892:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12451 00000100:00100000:2.0:1786109654.490999:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933334784:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.491044:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933334912:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.491067:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109654.491174:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109654.492573:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933334912 00000100:00100000:1.0:1786109654.492583:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933334912 00000100:00100000:1.0:1786109654.492630:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12452 00000100:00100000:1.0:1786109654.492640:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933334912:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786109654.492731:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933334912:12345-0@lo:1000:mdt00_003.0 Request processed in 92us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109654.492738:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12452 00000100:00100000:2.0:1786109654.494232:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933334912:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.494312:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933335040:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.494356:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109654.499196:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109654.499374:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933335040 00000100:00100000:0.0:1786109654.499382:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933335040 00000100:00100000:0.0:1786109654.499449:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12453 00000100:00100000:0.0:1786109654.499459:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933335040:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786109654.502521:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933335040:12345-0@lo:1000:mdt00_003.0 Request processed in 3056us (8156us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109654.502539:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12453 00000100:00100000:2.0:1786109654.503041:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933335040:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.503212:0:188678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933335168:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786109654.503269:0:188678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109654.505822:0:188678:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109654.506143:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933335168 00000100:00100000:0.0:1786109654.506152:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933335168 00000100:00100000:0.0:1786109654.508222:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12454 00000100:00100000:0.0:1786109654.508245:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933335168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786109654.508396:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:188678:x1872862933335168:12345-0@lo:1000:mdt00_003.0 Request processed in 162us (5126us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109654.508403:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12454 00000100:00100000:3.0:1786109654.511533:0:188678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:188678:1872862933335168:0@lo:1000:mdt00_003.0 00000040:00080000:3.0:1786109654.512184:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002efa:0x1:0x0].3, 1096 off35384 00000040:00080000:3.0:1786109654.512247:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200026d32:0x1:0x0].3, 1240 off35752 00000004:00080000:3.0:1786109654.512254:0:188678:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930a8a59e600 with version 11 00010000:00010000:2.0:1786109655.064483:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109655.304635:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933335296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109655.304702:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109655.304827:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933335296 00000100:00100000:1.0:1786109655.304836:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933335296 00000100:00100000:1.0:1786109655.304890:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5892 00000100:00100000:1.0:1786109655.304901:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+14:3646:x1872862933335296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109655.304928:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109655.305094:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+14:3646:x1872862933335296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 194us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109655.305102:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5892 00000100:00100000:0.0:1786109655.306334:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933335296:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1786109655.326010:0:194579:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705678 is committed 00000001:00080000:3.0:1786109655.327812:0:187891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 25769804642 is committed 00000100:00100000:2.0:1786109655.406593:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109655.407600:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922145024 00000100:00100000:0.0:1786109655.407611:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922145024 00000100:00100000:0.0:1786109655.407850:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1154 00000100:00100000:0.0:1786109655.407865:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:164200:x1872862922145024:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:0.0:1786109655.408130:0:187901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445642240 avail 1299402752 00000100:00100000:0.0:1786109655.408214:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:164200:x1872862922145024:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 352us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109655.408223:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1154 00000100:00080000:0.0:1786109655.408249:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786109655.411796:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109655.411861:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922145152 00000100:00100000:0.0:1786109655.411870:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922145152 00000100:00100000:0.0:1786109655.411994:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1155 00000100:00100000:0.0:1786109655.412004:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:164200:x1872862922145152:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:0.0:1786109655.412040:0:189813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00000100:00100000:0.0:1786109655.412174:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:164200:x1872862922145152:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 170us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109655.412182:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1155 00000100:00080000:0.0:1786109655.412205:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109655.415071:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109655.415144:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922145280 00000100:00100000:2.0:1786109655.415162:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922145280 00000100:00100000:2.0:1786109655.415221:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5893 00000100:00100000:2.0:1786109655.415231:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:164200:x1872862922145280:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1786109655.415254:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109655.415303:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:164200:x1872862922145280:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 74us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109655.415310:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5893 00000100:00080000:3.0:1786109655.415358:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109655.418175:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109655.418256:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922145408 00000100:00100000:3.0:1786109655.418266:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922145408 00000100:00100000:3.0:1786109655.418362:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5894 00000100:00100000:3.0:1786109655.418373:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:164200:x1872862922145408:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:3.0:1786109655.418414:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109655.418609:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:164200:x1872862922145408:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 237us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109655.418618:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5894 00000100:00080000:0.0:1786109655.418673:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109655.469665:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109655.469788:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922145664 00000100:00100000:1.0:1786109655.469799:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922145664 00000100:00100000:1.0:1786109655.469858:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1156 00000100:00100000:1.0:1786109655.469868:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+8:164207:x1872862922145664:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00010000:1.0:1786109655.469920:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109655.470216:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37dc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1770 expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.470235:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:1.0:1786109655.470241:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109655.470308:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.470320:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.470330:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.470532:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e94 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.470542:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.470554:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.470893:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e8d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.470901:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e8d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.470908:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.470914:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e8d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.470921:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109655.471025:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e8d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.471036:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e8d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.471046:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:1.0:1786109655.471049:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109655.471053:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e8d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.471058:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452800/0xdb52b77d7ca37e8d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109655.471071:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2a1a173 reply state 00000000fb7279c3 transno 343597383694 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.471082:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.471088:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a90aba400) 00010000:00010000:1.0:1786109655.471090:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109655.471092:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109655.471257:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+9:164207:x1872862922145664:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 1388us (1599us total) trans 343597383694 rc 0/0 00000100:00100000:1.0:1786109655.471265:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1156 00000100:00100000:3.0:1786109655.491610:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109655.492612:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922145792 00000100:00100000:0.0:1786109655.492623:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922145792 00000100:00100000:0.0:1786109655.492722:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1157 00000100:00100000:0.0:1786109655.492733:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+9:164210:x1872862922145792:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1786109655.492755:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109655.492772:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37e9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a179a expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109655.492828:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37ea2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109655.492842:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109655.492853:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109655.492998:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:0.0:1786109655.493002:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109655.493021:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109655.493043:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37e9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a179a expref: 11 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109655.493063:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a179a expref: 10 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109655.493071:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:0.0:1786109655.493074:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109655.493077:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8c00, rc 0) 00000100:00100000:0.0:1786109655.493190:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+10:164210:x1872862922145792:12345-192.168.203.38@tcp:101:rm.0 Request processed in 457us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109655.493197:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1157 00000100:00100000:1.0:1786109655.498701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109655.498816:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922145920 00000100:00100000:2.0:1786109655.498826:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922145920 00000100:00100000:2.0:1786109655.498883:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1158 00000100:00100000:2.0:1786109655.499050:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+10:164210:x1872862922145920:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1786109655.499072:0:196401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109655.499093:0:196401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425800/0xdb52b77d7ca37ea9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17a1 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499172:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca37eb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499187:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca37eb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499197:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca37eb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499209:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca37eb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499215:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca37eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499221:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca37eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499312:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37ebe lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499320:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37ebe lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499327:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37ebe lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109655.499716:0:196401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x5:0x0]: returning size 0 00000004:00200000:2.0:1786109655.499721:0:196401:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786109655.499739:0:196401:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37ebe lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499755:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37ebe lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499764:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca37eb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499770:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca37eb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499777:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca37eb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499783:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109655.499787:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca37eb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499795:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca37eb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499807:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:2.0:1786109655.499810:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109655.499815:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca37eb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499821:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca37eb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499833:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca37eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499839:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca37eb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499845:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca37eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499851:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109655.499854:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca37eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499859:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca37eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499866:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a90aba400) 00010000:00010000:2.0:1786109655.499868:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109655.499872:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca37eb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.499877:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca37eb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.500010:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425800/0xdb52b77d7ca37ea9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17a1 expref: 12 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.500026:0:196401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37ebe lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17a1 expref: 11 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109655.500033:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x5:0x0].0x0 (ffff930986232800) 00010000:00010000:2.0:1786109655.500035:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786109655.500038:0:196401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986424c00, rc 0) 00000100:00100000:2.0:1786109655.500187:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+11:164210:x1872862922145920:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1142us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109655.500199:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1158 00000100:00100000:1.0:1786109655.549124:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109655.549181:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922146176 00000100:00100000:1.0:1786109655.549190:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922146176 00000100:00100000:1.0:1786109655.549242:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1159 00000100:00100000:1.0:1786109655.549253:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+11:164210:x1872862922146176:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109655.549306:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1786109655.549331:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca37ebe lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17a1 expref: 11 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549350:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x5:0x0].0x0 (ffff930986232800) 00010000:00010000:1.0:1786109655.549366:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37ea2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a179a expref: 10 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549388:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:1.0:1786109655.549392:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109655.549412:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ec5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549425:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ec5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549460:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ec5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549471:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37ecc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549479:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37ecc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549485:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37ecc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549575:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37ed3 lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549584:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37ed3 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549591:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37ed3 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549772:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca37eda lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549781:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca37eda lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549788:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca37eda lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549798:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca37eda lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549804:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca37eda lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549809:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca37eda lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549827:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109655.549843:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37ed3 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549848:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37ed3 lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549854:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37ed3 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549860:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109655.549864:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37ed3 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549872:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37ed3 lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.549880:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x5:0x0].0x0 (ffff930a90aba100) 00010000:00010000:1.0:1786109655.549883:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109655.551039:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37ed3 lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.551057:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452a00/0xdb52b77d7ca37ed3 lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552278:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ec5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552291:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ec5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552297:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ec5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552304:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ec5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552310:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109655.552314:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ec5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552322:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ec5 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552337:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:1.0:1786109655.552340:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109655.552345:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ec5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552352:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9452e00/0xdb52b77d7ca37ec5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109655.552366:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000ba4325 reply state 000000005cde9eb5 transno 343597383695 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37ecc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552389:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37ecc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552397:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a90aba400) 00010000:00010000:1.0:1786109655.552400:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109655.552403:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109655.552513:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+11:164210:x1872862922146176:12345-192.168.203.38@tcp:36:rm.0 Request processed in 3259us (3393us total) trans 343597383695 rc 0/0 00000100:00100000:1.0:1786109655.552522:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1159 00010000:00010000:1.0:1786109655.552567:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109655.552572:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca37eda lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552579:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109655.552582:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca37eda lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552588:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca37eda lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552596:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x5:0x0].0x0 (ffff930a90aba100) 00010000:00010000:1.0:1786109655.552599:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109655.552602:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca37eda lrc: 1/0,0 mode: --/PW res: [0x200026d31:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552606:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453400/0xdb52b77d7ca37eda lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109655.552620:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109655.552622:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109655.552624:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109656.068594:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109657.092666:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109657.860562:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109657.860584:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab928ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933335424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109657.860644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.860711:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933335424 00000100:00100000:1.0:1786109657.860719:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933335424 00000100:00100000:1.0:1786109657.860764:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12455 00000100:00100000:1.0:1786109657.860772:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933335424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109657.860803:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00000100:00100000:1.0:1786109657.860846:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933335424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109657.860853:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12455 00000100:00100000:1.0:1786109657.860896:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab928ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933335424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109657.861133:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933335552:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.861176:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.861215:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933336064:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.861238:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.861257:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933336576:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.861280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.861301:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1786109657.861306:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933335680:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.861327:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.861344:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933336192:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.861364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.861381:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933336704:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.861401:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.861447:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933336064 00000100:00100000:1.0:1786109657.861451:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933336064 00000100:00100000:1.0:1786109657.861493:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933336192 00000100:00100000:1.0:1786109657.861496:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933336192 00000100:00100000:1.0:1786109657.861516:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933336704 00000100:00100000:1.0:1786109657.861519:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933336704 00000100:00100000:1.0:1786109657.861538:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7057 00000100:00100000:1.0:1786109657.861546:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933336064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.861586:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933336064:12345-0@lo:400:kworker.0 Request processed in 41us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109657.861593:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7057 00000100:00100000:1.0:1786109657.861607:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7058 00000100:00100000:1.0:1786109657.861613:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933336192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.861641:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933336192:12345-0@lo:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109657.861647:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7058 00000100:00100000:1.0:1786109657.861659:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7059 00000100:00100000:1.0:1786109657.861664:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933336704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.861691:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933336704:12345-0@lo:400:kworker.0 Request processed in 27us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109657.861696:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7059 00000100:00100000:1.0:1786109657.861724:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933336576 00000100:00100000:1.0:1786109657.861728:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933336576 00000100:00100000:1.0:1786109657.861754:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933335680 00000100:00100000:1.0:1786109657.861758:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933335680 00000100:00100000:1.0:1786109657.861779:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1786109657.861786:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933336576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.861816:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933336576:12345-0@lo:400:kworker.0 Request processed in 31us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109657.861821:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1786109657.861833:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1786109657.861838:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933335680:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109657.861849:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9288000 x1872862933335680/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:128/0 lens 224/224 e 0 to 0 dl 1786109668 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109657.861873:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933335680:12345-0@lo:400:kworker.0 Request processed in 34us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109657.861878:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:1.0:1786109657.861903:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786109657.861907:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109657.861909:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109657.861911:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109657.861934:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933335808:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.861957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.861975:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933336320:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.861995:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.862010:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933336832:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.862030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.862046:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1786109657.862052:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933335936:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.862073:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.862092:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933336448:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.862115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.862132:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933336960:0@lo:400:kworker.0 00000100:00100000:0.0:1786109657.862406:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933335552 00000100:00100000:0.0:1786109657.862411:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933335552 00000100:00100000:0.0:1786109657.862472:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1786109657.862480:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933335552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109657.862515:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933335552:12345-0@lo:400:kworker.0 Request processed in 37us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109657.862522:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1786109657.862548:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933336832 00000100:00100000:0.0:1786109657.862552:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933336832 00000100:00100000:0.0:1786109657.862582:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7060 00000100:00100000:0.0:1786109657.862588:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933336832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109657.862615:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933336832:12345-0@lo:400:kworker.0 Request processed in 29us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109657.862621:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7060 00000100:00080000:0.0:1786109657.862636:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109657.864757:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933335936 00000100:00100000:3.0:1786109657.864770:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933335936 00000100:00100000:3.0:1786109657.864819:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12456 00000100:00100000:3.0:1786109657.864829:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933335936:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109657.864857:0:8452:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d89b480 x1872862933335936/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:128/0 lens 224/224 e 0 to 0 dl 1786109668 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109657.864917:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933335936:12345-0@lo:400:kworker.0 Request processed in 90us (2842us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109657.864924:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12456 00000100:00100000:3.0:1786109657.864980:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109657.864992:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933337088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109657.865024:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109657.865065:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933337088 00000100:00100000:3.0:1786109657.865070:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933337088 00000100:00100000:3.0:1786109657.865093:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12457 00000100:00100000:3.0:1786109657.865100:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3649:x1872862933337088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786109657.865124:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445642240 avail 1299402752 00000100:00100000:1.0:1786109657.865213:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109657.865252:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933336832:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.865272:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933335936:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.865292:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933335808 00000100:00100000:1.0:1786109657.865295:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933335808 00000100:00100000:1.0:1786109657.865328:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933336320 00000100:00100000:1.0:1786109657.865331:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933336320 00000100:00100000:1.0:1786109657.865342:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933336448 00000100:00100000:1.0:1786109657.865344:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933336448 00000100:00100000:1.0:1786109657.865355:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933336960 00000100:00100000:1.0:1786109657.865357:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933336960 00000100:00100000:1.0:1786109657.865367:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1786109657.865373:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933335808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.865412:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933335808:12345-0@lo:400:kworker.0 Request processed in 39us (3455us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109657.865419:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1786109657.865449:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1786109657.865456:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933336320:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109657.865469:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d898a80 x1872862933336320/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:128/0 lens 224/224 e 0 to 0 dl 1786109668 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109657.865497:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933336320:12345-0@lo:400:kworker.0 Request processed in 42us (3501us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109657.865503:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1786109657.865514:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1786109657.865521:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933336448:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109657.865531:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d898380 x1872862933336448/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:128/0 lens 224/224 e 0 to 0 dl 1786109668 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109657.865557:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933336448:12345-0@lo:400:kworker.0 Request processed in 36us (3441us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109657.865563:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1786109657.865573:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1786109657.865578:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933336960:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109657.865587:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d899f80 x1872862933336960/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:128/0 lens 224/224 e 0 to 0 dl 1786109668 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109657.865611:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933336960:12345-0@lo:400:kworker.0 Request processed in 33us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109657.865617:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1786109657.865659:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933335680:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.865670:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975836 gen 2 00000004:00080000:1.0:1786109657.865674:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab94c6300, transno 4294975827 00000004:00080000:1.0:1786109657.865682:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab94c7800, transno 4294975828 00000004:00080000:1.0:1786109657.865685:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab94c5f80, transno 4294975829 00000004:00080000:1.0:1786109657.865688:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab94c5880, transno 4294975830 00000004:00080000:1.0:1786109657.865690:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab94c4000, transno 4294975831 00000004:00080000:1.0:1786109657.865693:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab94c4e00, transno 4294975832 00000004:00080000:1.0:1786109657.865695:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab94c5c00, transno 4294975833 00000004:00080000:1.0:1786109657.865697:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab94c4700, transno 4294975834 00000004:00080000:1.0:1786109657.865700:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ac1d3d180, transno 4294975835 00000004:00080000:1.0:1786109657.865702:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab94c7480, transno 4294975836 00000100:00100000:1.0:1786109657.865707:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933336192:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.865719:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933336704:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.865729:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933335552:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.865738:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705678 gen 2 00000004:00080000:1.0:1786109657.865741:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ac0ced180, transno 38654705670 00000004:00080000:1.0:1786109657.865748:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930a89098e00, transno 38654705671 00000004:00080000:1.0:1786109657.865750:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ac0ceed80, transno 38654705672 00000004:00080000:1.0:1786109657.865753:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93098ba4dc00, transno 38654705673 00000004:00080000:1.0:1786109657.865756:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab9660a80, transno 38654705674 00000004:00080000:1.0:1786109657.865759:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930aa66e8000, transno 38654705675 00000004:00080000:1.0:1786109657.865761:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930aa66ea680, transno 38654705676 00000004:00080000:1.0:1786109657.865763:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93098ba4e300, transno 38654705677 00000004:00080000:1.0:1786109657.865766:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab928aa00, transno 38654705678 00000100:00100000:1.0:1786109657.865769:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933336064:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.865781:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933336576:0@lo:400:kworker.0 00000004:00080000:1.0:1786109657.865925:0:187921:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:1.0:1786109657.865950:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933336448:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.865961:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933336960:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.865969:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933335808:0@lo:400:kworker.0 00000100:00100000:1.0:1786109657.865978:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933336320:0@lo:400:kworker.0 00000100:00080000:0.0:1786109657.866093:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109657.866099:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1786109657.866501:0:187923:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 10 done 00010000:00000080:3.0:1786109657.869377:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0fdfb80 x1872862933337088/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:128/0 lens 224/368 e 0 to 0 dl 1786109668 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109657.869678:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3649:x1872862933337088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4575us (4649us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109657.869689:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12457 00000100:00100000:2.0:1786109657.873364:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933337088:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1786109658.119750:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109658.132062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109658.132195:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922146304 00000100:00100000:3.0:1786109658.132204:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922146304 00000100:00100000:3.0:1786109658.132291:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:3.0:1786109658.132302:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922146304:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109658.132880:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922146304:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 571us (3634us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109658.132890:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:1.0:1786109658.162407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109658.162482:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922146432 00000100:00100000:2.0:1786109658.162492:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922146432 00000100:00100000:2.0:1786109658.162553:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 350 00000100:00100000:2.0:1786109658.162565:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+11:2402:x1872862922146432:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:2.0:1786109658.162596:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d898000 x1872862922146432/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:129/0 lens 224/224 e 0 to 0 dl 1786109669 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786109658.162671:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109658.163172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109658.163185:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+11:2402:x1872862922146432:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 622us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109658.163193:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 350 00000100:00100000:2.0:1786109658.163209:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922146560 00000100:00100000:2.0:1786109658.163213:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922146560 00000100:00100000:2.0:1786109658.163243:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 351 00000100:00100000:2.0:1786109658.163250:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922146560:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109658.163280:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922146560:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109658.163287:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 351 00000100:00080000:2.0:1786109658.163310:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109658.164721:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109658.164776:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109658.164810:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922146816 00000100:00100000:1.0:1786109658.164817:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922146816 00000100:00100000:1.0:1786109658.164858:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922146688 00000100:00100000:1.0:1786109658.164862:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922146688 00000100:00100000:1.0:1786109658.164964:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7061 00000100:00100000:1.0:1786109658.164975:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922146816:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109658.165027:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922146816:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 55us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109658.165202:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7062 00000100:00100000:0.0:1786109658.165213:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922146688:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109658.165244:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922146688:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109658.165251:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7062 00000100:00100000:1.0:1786109658.165320:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7061 00000100:00080000:1.0:1786109658.165338:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109658.165342:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109658.375333:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933337472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109658.375398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109658.375450:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109658.375461:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933337344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109658.375487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109658.375875:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933337472 00000100:00100000:3.0:1786109658.375883:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933337472 00000100:00100000:3.0:1786109658.375923:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933337344 00000100:00100000:3.0:1786109658.375926:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933337344 00000100:00100000:3.0:1786109658.375946:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5895 00000100:00100000:3.0:1786109658.375955:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933337472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109658.375982:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109658.376027:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933337472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109658.376034:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5895 00000100:00100000:3.0:1786109658.376050:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5896 00000100:00100000:3.0:1786109658.376057:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933337344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109658.376067:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109658.376090:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933337344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109658.376095:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5896 00000100:00100000:3.0:1786109658.376155:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933337344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109658.376170:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933337472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109658.377938:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933337216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109658.377991:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109658.378487:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933337216 00000100:00100000:2.0:1786109658.378495:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933337216 00000100:00100000:2.0:1786109658.378615:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5897 00000100:00100000:2.0:1786109658.378625:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933337216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109658.378652:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109658.378696:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933337216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109658.378703:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5897 00000100:00100000:2.0:1786109658.378749:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933337216:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786109659.143651:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109660.164770:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109660.427339:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933337600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109660.427428:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109660.428526:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933337600 00000100:00100000:2.0:1786109660.428538:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933337600 00000100:00100000:2.0:1786109660.429159:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5898 00000100:00100000:2.0:1786109660.429178:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933337600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109660.429211:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00080000:1.0:1786109660.433729:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109660.439767:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933337600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10585us (12326us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109660.439782:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5898 00000100:00100000:3.0:1786109660.441979:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933337600:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1786109661.188514:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786109661.480330:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383695 is committed 00010000:00010000:2.0:1786109661.480478:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480491:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480499:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480505:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109661.480510:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480517:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480534:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a90aba400) 00010000:00010000:2.0:1786109661.480538:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109661.480543:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e94 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480548:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453e00/0xdb52b77d7ca37e94 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480567:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37ecc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480573:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37ecc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480579:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37ecc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480583:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109661.480586:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37ecc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480592:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37ecc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480598:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a90aba400) 00010000:00010000:2.0:1786109661.480601:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109661.480604:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37ecc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109661.480610:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9453a00/0xdb52b77d7ca37ecc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109662.215498:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786109662.509888:0:197664:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1786109662.980696:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933337728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109662.980762:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109662.982179:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933337728 00000100:00100000:3.0:1786109662.982190:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933337728 00000100:00100000:3.0:1786109662.982237:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12458 00000100:00100000:3.0:1786109662.982246:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3649:x1872862933337728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786109662.982278:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445642240 avail 1299402752 00010000:00000080:3.0:1786109662.982292:0:8452:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c5f80 x1872862933337728/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:133/0 lens 224/368 e 0 to 0 dl 1786109673 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109662.982358:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3649:x1872862933337728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109662.982365:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12458 00000100:00100000:3.0:1786109662.982415:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933337728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109662.982585:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933337856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109662.982616:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109662.982685:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933337856 00000100:00100000:0.0:1786109662.982690:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933337856 00000100:00100000:0.0:1786109662.982723:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12459 00000100:00100000:0.0:1786109662.982730:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933337856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1786109662.982747:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00000100:00100000:0.0:1786109662.982777:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933337856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109662.982782:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12459 00000100:00100000:3.0:1786109662.982838:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933337856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109662.983560:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933338112:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.983596:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109662.983619:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933338624:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.983643:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109662.983657:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933339136:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.983676:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109662.983692:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1786109662.983697:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933338240:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.983713:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109662.983725:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933338752:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.983739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109662.983752:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933339264:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.983770:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109662.983791:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933338112 00000100:00100000:2.0:1786109662.983795:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933338112 00000100:00100000:2.0:1786109662.983823:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933338624 00000100:00100000:2.0:1786109662.983825:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933338624 00000100:00100000:2.0:1786109662.983835:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933338240 00000100:00100000:2.0:1786109662.983837:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933338240 00000100:00100000:2.0:1786109662.983848:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933338752 00000100:00100000:2.0:1786109662.983850:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933338752 00000100:00100000:2.0:1786109662.983862:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933339264 00000100:00100000:2.0:1786109662.983864:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933339264 00000100:00100000:2.0:1786109662.983875:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1786109662.983883:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933338112:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109662.983899:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab94c5180 x1872862933338112/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1786109673 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109662.983933:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933338112:12345-0@lo:400:kworker.0 Request processed in 51us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109662.983939:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1786109662.983952:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1786109662.983958:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933338624:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109662.983967:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97c4ca80 x1872862933338624/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1786109673 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109662.983988:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933338624:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109662.983993:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1786109662.984003:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1786109662.984008:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933338240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984027:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933338240:12345-0@lo:400:kworker.0 Request processed in 19us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109662.984032:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1786109662.984040:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1786109662.984045:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933338752:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109662.984053:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97c4c000 x1872862933338752/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1786109673 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109662.984072:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933338752:12345-0@lo:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109662.984077:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1786109662.984085:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1786109662.984090:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933339264:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109662.984099:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97c4e300 x1872862933339264/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1786109673 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109662.984136:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933339264:12345-0@lo:400:kworker.0 Request processed in 46us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109662.984141:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1786109662.984161:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933339136 00000100:00100000:2.0:1786109662.984164:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933339136 00000100:00100000:2.0:1786109662.984186:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7063 00000100:00100000:2.0:1786109662.984192:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933339136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984217:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933339136:12345-0@lo:400:kworker.0 Request processed in 26us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109662.984223:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7063 00000100:00080000:2.0:1786109662.984243:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109662.984246:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109662.984248:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109662.984266:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933338240:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984275:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933338752:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984283:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933339264:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984292:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933338112:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984300:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933338624:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984308:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933339136:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984335:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933338368:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984359:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109662.984378:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933338880:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109662.984415:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1786109662.984421:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933337984:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109662.984494:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933338496:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984510:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109662.984526:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933339008:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984545:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109662.984572:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933338368 00000100:00100000:2.0:1786109662.984575:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933338368 00000100:00100000:2.0:1786109662.984601:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933338496 00000100:00100000:2.0:1786109662.984604:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933338496 00000100:00100000:2.0:1786109662.984619:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933339008 00000100:00100000:2.0:1786109662.984621:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933339008 00000100:00100000:2.0:1786109662.984638:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7064 00000100:00100000:2.0:1786109662.984644:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933338368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984678:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933338368:12345-0@lo:400:kworker.0 Request processed in 35us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109662.984684:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7064 00000100:00100000:2.0:1786109662.984696:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7065 00000100:00100000:2.0:1786109662.984702:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933338496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984729:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933338496:12345-0@lo:400:kworker.0 Request processed in 27us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109662.984734:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7065 00000100:00100000:2.0:1786109662.984744:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7066 00000100:00100000:2.0:1786109662.984750:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933339008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984777:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933339008:12345-0@lo:400:kworker.0 Request processed in 28us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109662.984782:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7066 00000100:00100000:2.0:1786109662.984799:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933337984 00000100:00100000:2.0:1786109662.984802:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933337984 00000100:00100000:2.0:1786109662.984827:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1786109662.984833:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933337984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.984863:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933337984:12345-0@lo:400:kworker.0 Request processed in 30us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109662.984868:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1786109662.984906:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109662.984910:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109662.984921:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933338880 00000100:00100000:2.0:1786109662.984924:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933338880 00000100:00100000:2.0:1786109662.985259:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1786109662.985266:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933338880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.985296:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933338880:12345-0@lo:400:kworker.0 Request processed in 31us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109662.985302:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1786109662.985331:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933337984:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.985342:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933338496:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.985350:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933339008:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.985359:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933338368:0@lo:400:kworker.0 00000100:00100000:2.0:1786109662.985367:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933338880:0@lo:400:kworker.0 00000100:00080000:0.0:1786109662.988658:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1786109663.238375:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109663.251737:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109663.251773:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109663.251806:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109663.251825:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109663.251930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109663.251957:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922146944 00000100:00100000:0.0:1786109663.251966:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922146944 00000100:00100000:0.0:1786109663.252014:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:0.0:1786109663.252024:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922146944:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109663.252087:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922146944:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 64us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109663.252095:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:0.0:1786109663.252140:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922147072 00000100:00100000:0.0:1786109663.252144:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922147072 00000100:00100000:0.0:1786109663.252178:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922147200 00000100:00100000:0.0:1786109663.252181:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922147200 00000100:00100000:0.0:1786109663.252202:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 358 00000100:00100000:0.0:1786109663.252209:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+7:2404:x1872862922147072:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:0.0:1786109663.252226:0:196401:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c7800 x1872862922147072/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:134/0 lens 224/224 e 0 to 0 dl 1786109674 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109663.252252:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+7:2404:x1872862922147072:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 44us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109663.252258:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 358 00000100:00100000:0.0:1786109663.252270:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 359 00000100:00100000:0.0:1786109663.252276:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+6:2405:x1872862922147200:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109663.252301:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+6:2405:x1872862922147200:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109663.252332:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 359 00000100:00100000:0.0:1786109663.252351:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922147328 00000100:00100000:0.0:1786109663.252354:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922147328 00000100:00100000:0.0:1786109663.252380:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922147456 00000100:00100000:0.0:1786109663.252383:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922147456 00000100:00100000:0.0:1786109663.252403:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7067 00000100:00100000:0.0:1786109663.252410:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922147328:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109663.252464:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fac74500-4523-4794-af20-dfdcdfae19c1+5:2404:x1872862922147328:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 54us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109663.252470:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7067 00000100:00100000:0.0:1786109663.252482:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7068 00000100:00100000:0.0:1786109663.252488:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922147456:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109663.252512:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922147456:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109663.252518:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7068 00000100:00080000:0.0:1786109663.252652:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109663.252657:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109663.252659:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109663.252661:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109663.348534:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109663.348966:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922147584 00000100:00100000:3.0:1786109663.348977:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922147584 00000100:00100000:3.0:1786109663.349035:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1160 00000100:00100000:3.0:1786109663.349678:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:164291:x1872862922147584:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109663.349705:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109663.349728:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37ee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17a8 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.349800:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37ee8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.349814:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.349827:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109663.349940:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:3.0:1786109663.349945:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786109663.349964:0:187899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.349988:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37ee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17a8 expref: 9 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.350005:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17a8 expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.350013:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:3.0:1786109663.350015:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109663.350018:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07600, rc 0) 00010000:00000080:3.0:1786109663.350025:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0ceed80 x1872862922147584/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:173/0 lens 576/688 e 0 to 0 dl 1786109713 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1786109663.350179:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+8:164291:x1872862922147584:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1134us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109663.350186:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1160 00000100:00100000:0.0:1786109663.364920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109663.365123:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922147712 00000100:00100000:3.0:1786109663.365132:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922147712 00000100:00100000:3.0:1786109663.365234:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1161 00000100:00100000:3.0:1786109663.365245:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:164291:x1872862922147712:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:3.0:1786109663.365287:0:187901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445642240 avail 1299402752 00010000:00000080:3.0:1786109663.365307:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c7480 x1872862922147712/t0(0) o41->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:173/0 lens 224/368 e 0 to 0 dl 1786109713 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109663.365753:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:164291:x1872862922147712:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 508us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109663.365762:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1161 00000100:00100000:0.0:1786109663.378542:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109663.379503:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922147840 00000100:00100000:3.0:1786109663.379515:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922147840 00000100:00100000:3.0:1786109663.379595:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1162 00000100:00100000:3.0:1786109663.379606:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:164291:x1872862922147840:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:3.0:1786109663.379643:0:187900:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00000100:00100000:3.0:1786109663.379707:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:164291:x1872862922147840:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 103us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109663.379714:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1162 00000100:00100000:3.0:1786109663.401789:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109663.401826:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922147968 00000100:00100000:3.0:1786109663.402397:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922147968 00000100:00100000:3.0:1786109663.402470:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5899 00000100:00100000:3.0:1786109663.402482:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:164291:x1872862922147968:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:3.0:1786109663.402516:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109663.403353:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:164291:x1872862922147968:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 869us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109663.403367:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5899 00000100:00100000:1.0:1786109663.414523:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109663.415571:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922148096 00000100:00100000:1.0:1786109663.416711:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922148096 00000100:00100000:1.0:1786109663.416786:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5900 00000100:00100000:1.0:1786109663.416795:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:164291:x1872862922148096:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109663.416827:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109663.419375:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:164291:x1872862922148096:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 2569us (4850us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109663.419390:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5900 00000100:00100000:0.0:1786109663.496615:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933339392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109663.496691:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109663.496747:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933339392 00000100:00100000:0.0:1786109663.496756:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933339392 00000100:00100000:0.0:1786109663.496801:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5901 00000100:00100000:0.0:1786109663.496809:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933339392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109663.496830:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109663.496872:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933339392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109663.496879:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5901 00000100:00100000:0.0:1786109663.496925:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933339392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109663.498221:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933339520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109663.498270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109663.498322:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933339520 00000100:00100000:1.0:1786109663.498328:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933339520 00000100:00100000:1.0:1786109663.498365:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5902 00000100:00100000:1.0:1786109663.498373:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933339520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109663.498391:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109663.498445:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933339520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109663.498452:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5902 00000100:00100000:1.0:1786109663.498492:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933339520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109663.500216:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109663.500236:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933339648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109663.500289:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109663.501473:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933339648 00000100:00100000:1.0:1786109663.501483:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933339648 00000100:00100000:1.0:1786109663.501533:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5903 00000100:00100000:1.0:1786109663.501543:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933339648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109663.501566:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109663.501631:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933339648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109663.501638:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5903 00000100:00100000:1.0:1786109663.501688:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933339648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109663.584278:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109663.585092:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922148352 00000100:00100000:1.0:1786109663.585114:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922148352 00000100:00100000:3.0:1786109663.586232:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1163 00000100:00100000:3.0:1786109663.586250:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:164298:x1872862922148352:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00010000:3.0:1786109663.586307:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109663.588182:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca37ee8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17a8 expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.588209:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:3.0:1786109663.588214:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109663.588299:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37eef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.588312:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37eef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.588321:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37eef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.588335:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37ef6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.588343:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.588349:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.589912:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37eef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.589927:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37eef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.589934:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37eef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.589941:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109663.589946:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37eef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.589953:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37eef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.589968:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:3.0:1786109663.589971:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109663.589976:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37eef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.589982:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca37eef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109663.589995:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000439929a2 reply state 0000000073fd4e77 transno 343597383696 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.590007:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37ef6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109663.590013:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a8607d200) 00010000:00010000:3.0:1786109663.590015:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109663.590018:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1786109663.590891:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c56680 x1872862922148352/t343597383696(0) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:173/0 lens 528/448 e 0 to 0 dl 1786109713 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109663.591642:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+9:164298:x1872862922148352:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 5394us (7369us total) trans 343597383696 rc 0/0 00000100:00100000:3.0:1786109663.591653:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1163 00000100:00100000:1.0:1786109663.638414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109663.638748:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922148480 00000100:00100000:0.0:1786109663.638758:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922148480 00000100:00100000:0.0:1786109663.638861:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1164 00000100:00100000:0.0:1786109663.638873:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+9:164301:x1872862922148480:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1786109663.638897:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109663.638917:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37efd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17af expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.638980:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37f04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.638993:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37f04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.639005:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37f04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109663.639046:0:189813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:0.0:1786109663.639050:0:189813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109663.639067:0:189813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37f04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.639090:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37efd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17af expref: 11 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.639387:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37f04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17af expref: 10 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.639397:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:0.0:1786109663.639400:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109663.639404:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9800, rc 0) 00010000:00000080:0.0:1786109663.639411:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa66e8000 x1872862922148480/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:173/0 lens 576/688 e 0 to 0 dl 1786109713 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1786109663.640569:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+10:164301:x1872862922148480:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1692us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109663.640580:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1164 00000100:00100000:1.0:1786109663.644386:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109663.645003:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922148608 00000100:00100000:0.0:1786109663.645013:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922148608 00000100:00100000:0.0:1786109663.645063:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1165 00000100:00100000:0.0:1786109663.645071:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+10:164301:x1872862922148608:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1786109663.645090:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109663.645121:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37f0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17b6 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645181:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37f12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645193:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37f12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645202:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37f12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645210:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37f19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645216:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37f19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645226:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37f19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645315:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37f20 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645393:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37f20 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645402:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37f20 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109663.645466:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x6:0x0]: returning size 0 00000004:00200000:0.0:1786109663.645546:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109663.645567:0:187899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37f20 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645579:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37f20 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645588:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37f12 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645594:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37f12 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645601:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37f12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645607:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37f12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645617:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109663.645622:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37f12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645629:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37f12 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645641:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:0.0:1786109663.645644:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109663.645649:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37f12 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645655:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca37f12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645669:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37f19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645675:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37f19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645680:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37f19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645685:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109663.645688:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37f19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645695:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37f19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645706:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a8607d200) 00010000:00010000:0.0:1786109663.645708:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109663.645711:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37f19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645717:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca37f19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645743:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca37f0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17b6 expref: 12 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645756:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37f20 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17b6 expref: 11 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.645762:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x6:0x0].0x0 (ffff930a92c11e00) 00010000:00010000:0.0:1786109663.645764:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109663.645766:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8e00, rc 0) 00010000:00000080:0.0:1786109663.645773:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098ba4dc00 x1872862922148608/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:173/0 lens 600/584 e 0 to 0 dl 1786109713 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1786109663.645959:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+11:164301:x1872862922148608:12345-192.168.203.38@tcp:101:rm.0 Request processed in 887us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109663.645967:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1165 00000100:00100000:1.0:1786109663.650207:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109663.650311:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922148864 00000100:00100000:0.0:1786109663.650380:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922148864 00000100:00100000:0.0:1786109663.650532:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1166 00000100:00100000:0.0:1786109663.650543:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+11:164301:x1872862922148864:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1786109663.650598:0:196401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786109663.650625:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca37f20 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17b6 expref: 11 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.650643:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x6:0x0].0x0 (ffff930a92c11e00) 00010000:00010000:0.0:1786109663.650659:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca37f04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17af expref: 10 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.650667:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:0.0:1786109663.650670:0:196401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109663.650690:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37f27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.650703:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37f27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.650713:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37f27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.650723:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca37f2e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.650730:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca37f2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.650737:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca37f2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.650826:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37f35 lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.650835:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37f35 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.650843:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37f35 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651027:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37f3c lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651037:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37f3c lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651044:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37f3c lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651053:0:196401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37f3c lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651060:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37f3c lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651067:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37f3c lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651190:0:196401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109663.651209:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37f35 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651216:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37f35 lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651223:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37f35 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651230:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109663.651235:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37f35 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651243:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37f35 lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651252:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x6:0x0].0x0 (ffff930a92c11300) 00010000:00010000:0.0:1786109663.651255:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109663.651259:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37f35 lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651265:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca37f35 lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651280:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37f27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651287:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37f27 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651294:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37f27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651299:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109663.651302:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37f27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651309:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37f27 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651315:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:0.0:1786109663.651318:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109663.651333:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37f27 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651340:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca37f27 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109663.651349:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffb6965d reply state 00000000bd10e41a transno 343597383697 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca37f2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651360:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca37f2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109663.651367:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a8607d200) 00010000:00010000:0.0:1786109663.651369:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109663.651372:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1786109663.651390:0:196401:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098ba4e300 x1872862922148864/t343597383697(0) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:173/0 lens 512/456 e 0 to 0 dl 1786109713 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109663.651488:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+11:164301:x1872862922148864:12345-192.168.203.38@tcp:36:rm.0 Request processed in 946us (1290us total) trans 343597383697 rc 0/0 00000100:00100000:0.0:1786109663.651496:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1166 00010000:00010000:1.0:1786109663.651618:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109663.651624:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37f3c lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109663.651631:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109663.651634:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37f3c lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109663.651641:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37f3c lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109663.651650:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x6:0x0].0x0 (ffff930a92c11300) 00010000:00010000:1.0:1786109663.651652:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109663.651655:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37f3c lrc: 1/0,0 mode: --/PW res: [0x200026d31:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109663.651661:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca37f3c lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109663.651675:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109663.651677:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109663.651679:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109664.260708:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109665.284675:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109665.541102:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc0c0 going to sleep for 1 seconds 00000100:00100000:1.0:1786109665.542389:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933339776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109665.542697:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109665.542837:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933339776 00000100:00100000:3.0:1786109665.542845:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933339776 00000100:00100000:3.0:1786109665.542939:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5904 00000100:00100000:3.0:1786109665.542949:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933339776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109665.543043:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109665.543106:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933339776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109665.543114:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5904 00000100:00100000:2.0:1786109665.543237:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933339776:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1786109665.543312:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786109666.308824:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109666.564525:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc0c0 going to sleep for 1 seconds 00010000:00010000:1.0:1786109667.374964:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109667.588556:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc0c0 going to sleep for 1 seconds 00000100:00100000:1.0:1786109668.111258:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933339904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109668.111337:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109668.111644:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933340160:0@lo:400:kworker.0 00000100:00100000:2.0:1786109668.111680:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109668.111706:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933340288:0@lo:400:kworker.0 00000100:00100000:2.0:1786109668.111732:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109668.111759:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933340160 00000100:00100000:2.0:1786109668.111766:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933340160 00000100:00100000:1.0:1786109668.111969:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933340416:0@lo:400:kworker.0 00000100:00100000:1.0:1786109668.111996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109668.112025:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933340928:0@lo:400:kworker.0 00000100:00100000:1.0:1786109668.112046:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109668.112063:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933341440:0@lo:400:kworker.0 00000100:00100000:2.0:1786109668.112097:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786109668.112109:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933340160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109668.112155:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933340160:12345-0@lo:400:kworker.0 Request processed in 49us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109668.112162:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786109668.112194:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933340288 00000100:00100000:2.0:1786109668.112198:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933340288 00000100:00100000:2.0:1786109668.112227:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933340416 00000100:00100000:2.0:1786109668.112230:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933340416 00000100:00100000:2.0:1786109668.112244:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933340928 00000100:00100000:2.0:1786109668.112246:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933340928 00000100:00100000:2.0:1786109668.112257:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1786109668.112263:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933340288:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109668.112276:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1707800 x1872862933340288/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:178/0 lens 224/224 e 0 to 0 dl 1786109718 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109668.112380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109668.112414:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1786109668.112421:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933340032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109668.112462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109668.112467:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933341440 00000100:00100000:0.0:1786109668.112472:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933341440 00000100:00100000:1.0:1786109668.112493:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933340544:0@lo:400:kworker.0 00000100:00100000:0.0:1786109668.112502:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7069 00000100:00100000:0.0:1786109668.112509:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933341440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109668.112513:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109668.112528:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933341056:0@lo:400:kworker.0 00000100:00100000:0.0:1786109668.112544:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933341440:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109668.112547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109668.112550:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7069 00000100:00100000:1.0:1786109668.112557:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933341568:0@lo:400:kworker.0 00000100:00100000:0.0:1786109668.112572:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933339904 00000100:00100000:1.0:1786109668.112575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109668.112576:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933339904 00000100:00100000:0.0:1786109668.112597:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933340032 00000100:00100000:0.0:1786109668.112599:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933340032 00000100:00100000:1.0:1786109668.112601:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933341440:0@lo:400:kworker.0 00000100:00100000:0.0:1786109668.112608:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933340544 00000100:00100000:0.0:1786109668.112610:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933340544 00000100:00100000:0.0:1786109668.112619:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12460 00000100:00100000:0.0:1786109668.112625:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933339904:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109668.112629:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12461 00000100:00100000:1.0:1786109668.112635:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3646:x1872862933340032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109668.112650:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445642240 avail 1299402752 00000004:00000024:0.0:1786109668.112650:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446055936 avail 1299816448 00010000:00000080:0.0:1786109668.112662:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309854f8700 x1872862933339904/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:139/0 lens 224/368 e 0 to 0 dl 1786109679 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00000080:1.0:1786109668.112663:0:8452:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309854fb480 x1872862933340032/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:139/0 lens 224/368 e 0 to 0 dl 1786109679 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109668.112695:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3646:x1872862933340032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109668.112701:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12461 00000100:00100000:1.0:1786109668.112716:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12462 00000100:00100000:1.0:1786109668.112722:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933340544:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109668.112733:0:8452:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309854fa300 x1872862933340544/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:139/0 lens 224/224 e 0 to 0 dl 1786109679 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109668.112808:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933340288:12345-0@lo:400:kworker.0 Request processed in 544us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109668.112815:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1786109668.112828:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933341056 00000100:00100000:2.0:1786109668.112831:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933341056 00000100:00100000:2.0:1786109668.112845:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933341568 00000100:00100000:2.0:1786109668.112847:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933341568 00000100:00100000:2.0:1786109668.112859:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1786109668.112865:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933340416:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109668.112874:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309854fad80 x1872862933340416/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:178/0 lens 224/224 e 0 to 0 dl 1786109718 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109668.113803:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1786109668.113818:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933340928:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109668.113838:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309854faa00 x1872862933340928/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:178/0 lens 224/224 e 0 to 0 dl 1786109718 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109668.113937:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933340544:12345-0@lo:400:kworker.0 Request processed in 1213us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109668.113937:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933339904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1310us (2598us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109668.113944:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12460 00000100:00100000:1.0:1786109668.113950:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12462 00000100:00100000:1.0:1786109668.113972:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1786109668.113980:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933341056:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109668.113992:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309854f9180 x1872862933341056/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:178/0 lens 224/224 e 0 to 0 dl 1786109718 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109668.114085:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933340928:12345-0@lo:400:kworker.0 Request processed in 272us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109668.114087:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933341056:12345-0@lo:400:kworker.0 Request processed in 110us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109668.114092:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1786109668.114098:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1786109668.114110:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1786109668.114116:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933341568:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109668.114128:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930982e50700 x1872862933341568/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:178/0 lens 224/224 e 0 to 0 dl 1786109718 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109668.114150:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933340032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109668.114154:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933341568:12345-0@lo:400:kworker.0 Request processed in 39us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109668.114160:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1786109668.114160:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933340544:0@lo:400:kworker.0 00000100:00100000:1.0:1786109668.114169:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933341056:0@lo:400:kworker.0 00000100:00080000:3.0:1786109668.114179:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109668.114179:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933341568:0@lo:400:kworker.0 00000100:00080000:3.0:1786109668.114184:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109668.114186:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786109668.114226:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933340160:0@lo:400:kworker.0 00000100:00100000:3.0:1786109668.114234:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933340672:0@lo:400:kworker.0 00000100:00100000:2.0:1786109668.114403:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933340416:12345-0@lo:400:kworker.0 Request processed in 1536us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109668.114410:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1786109668.114411:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109668.114512:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933341184:0@lo:400:kworker.0 00000100:00100000:3.0:1786109668.114535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109668.114621:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933341184 00000100:00100000:2.0:1786109668.114627:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933341184 00000100:00100000:2.0:1786109668.114660:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1786109668.114667:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933341184:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786109668.114672:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00000080:2.0:1786109668.114678:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c55f80 x1872862933341184/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:178/0 lens 224/224 e 0 to 0 dl 1786109718 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109668.114713:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933341184:12345-0@lo:400:kworker.0 Request processed in 47us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109668.114719:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1786109668.115460:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933340416:0@lo:400:kworker.0 00000100:00100000:1.0:1786109668.115476:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933340928:0@lo:400:kworker.0 00000100:00100000:1.0:1786109668.115494:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933339904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109668.115902:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933340672 00000100:00100000:0.0:1786109668.115908:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933340672 00000100:00100000:0.0:1786109668.115949:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7070 00000100:00100000:0.0:1786109668.115958:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933340672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109668.116012:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933340672:12345-0@lo:400:kworker.0 Request processed in 56us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109668.116019:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7070 00000100:00080000:0.0:1786109668.116034:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109668.117155:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933340288:0@lo:400:kworker.0 00000100:00100000:3.0:1786109668.117167:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933340800:0@lo:400:kworker.0 00000100:00100000:3.0:1786109668.117214:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109668.117254:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933341312:0@lo:400:kworker.0 00000100:00100000:3.0:1786109668.117277:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109668.117460:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933340672:0@lo:400:kworker.0 00000100:00100000:3.0:1786109668.117473:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933341184:0@lo:400:kworker.0 00000100:00100000:0.0:1786109668.117588:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933340800 00000100:00100000:0.0:1786109668.117595:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933340800 00000100:00100000:0.0:1786109668.117637:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933341312 00000100:00100000:0.0:1786109668.117641:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933341312 00000100:00100000:0.0:1786109668.117665:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7071 00000100:00100000:0.0:1786109668.117674:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933340800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109668.117724:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933340800:12345-0@lo:400:kworker.0 Request processed in 51us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109668.117732:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7071 00000100:00100000:0.0:1786109668.117747:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7072 00000100:00100000:0.0:1786109668.117753:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933341312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109668.117781:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933341312:12345-0@lo:400:kworker.0 Request processed in 29us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109668.117787:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7072 00000100:00080000:0.0:1786109668.117803:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109668.117806:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109668.117822:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933340800:0@lo:400:kworker.0 00000100:00100000:0.0:1786109668.117830:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933341312:0@lo:400:kworker.0 00000100:00100000:2.0:1786109668.369741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109668.369779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109668.369809:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109668.369830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109668.369852:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109668.369890:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922149120 00000100:00100000:2.0:1786109668.369900:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922149120 00000100:00100000:2.0:1786109668.369959:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922149248 00000100:00100000:2.0:1786109668.369962:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922149248 00000100:00100000:2.0:1786109668.369987:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 366 00000100:00100000:2.0:1786109668.369997:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+11:2405:x1872862922149120:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:2.0:1786109668.371039:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1706d80 x1872862922149120/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:178/0 lens 224/224 e 0 to 0 dl 1786109718 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109668.371119:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+11:2405:x1872862922149120:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1122us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109668.371127:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 366 00000100:00100000:2.0:1786109668.371160:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 367 00000100:00100000:2.0:1786109668.371170:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2405:x1872862922149248:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:2.0:1786109668.371185:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1706680 x1872862922149248/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:178/0 lens 224/224 e 0 to 0 dl 1786109718 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109668.371207:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2405:x1872862922149248:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 40us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109668.371213:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 367 00000100:00100000:2.0:1786109668.371238:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922149376 00000100:00100000:2.0:1786109668.371243:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922149376 00000100:00100000:2.0:1786109668.371276:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922149504 00000100:00100000:2.0:1786109668.371280:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922149504 00000100:00100000:2.0:1786109668.371983:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7073 00000100:00100000:2.0:1786109668.371999:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922149376:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109668.372138:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922149376:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 144us (2357us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109668.372146:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7073 00000100:00100000:2.0:1786109668.372163:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7074 00000100:00100000:2.0:1786109668.372170:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922149504:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109668.372195:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922149504:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109668.372200:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7074 00000100:00100000:2.0:1786109668.372219:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922148992 00000100:00100000:2.0:1786109668.372225:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922148992 00000100:00100000:2.0:1786109668.375111:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:2.0:1786109668.375134:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922148992:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109668.375203:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922148992:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 79us (5392us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109668.375211:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00080000:2.0:1786109668.383592:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109668.383602:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109668.383606:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109668.383609:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786109668.434373:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109668.612630:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109668.612651:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933341696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109668.612717:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109668.612762:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933341696 00000100:00100000:1.0:1786109668.612770:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933341696 00000100:00100000:1.0:1786109668.612811:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5905 00000100:00100000:1.0:1786109668.612820:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933341696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109668.612850:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109668.612894:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933341696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109668.612900:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5905 00000100:00100000:1.0:1786109668.612945:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933341696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109668.613045:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933341824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109668.613131:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109668.613220:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933341824 00000100:00100000:2.0:1786109668.613225:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933341824 00000100:00100000:2.0:1786109668.613260:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5906 00000100:00100000:2.0:1786109668.613267:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933341824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109668.613277:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109668.613310:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933341824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109668.613316:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5906 00000100:00100000:2.0:1786109668.613369:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc0c0 going to sleep for 1 seconds 00000100:00100000:0.0:1786109668.615754:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933341824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109668.617741:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933341952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109668.617812:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109668.617865:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933341952 00000100:00100000:1.0:1786109668.617872:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933341952 00000100:00100000:1.0:1786109668.617913:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5907 00000100:00100000:1.0:1786109668.617922:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933341952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786109668.617952:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109668.617995:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933341952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109668.618002:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5907 00000100:00100000:1.0:1786109668.618045:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933341952:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1786109669.126382:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383697 is committed 00010000:00010000:2.0:1786109669.127277:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37ef6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127467:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37ef6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127476:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37ef6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127482:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109669.127487:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37ef6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127495:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37ef6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127512:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a8607d200) 00010000:00010000:2.0:1786109669.127515:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109669.127520:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37ef6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127526:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06200/0xdb52b77d7ca37ef6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127546:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca37f2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127553:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca37f2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127564:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca37f2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127569:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109669.127577:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca37f2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127583:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca37f2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127903:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a8607d200) 00010000:00010000:2.0:1786109669.127907:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109669.127911:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca37f2e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109669.127917:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca37f2e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109669.445612:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109669.639760:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc0c0 going to sleep for 1 seconds 00010000:00010000:0.0:1786109670.472125:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109670.662156:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933342080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109670.662259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000400:1.0:1786109670.662354:0:187918:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109654/real 1786109654] req@ffff930ac17bf800 x1872862933333376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 1 dl 1786109670 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109670.662377:0:187918:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1786109670.662381:0:187918:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1786109670.662386:0:187918:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1786109670.662402:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc0c0 going to sleep for 0 seconds 00000100:00100000:2.0:1786109670.662518:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933342080 00000100:00100000:2.0:1786109670.662525:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933342080 00000100:00100000:2.0:1786109670.662578:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5908 00000100:00100000:2.0:1786109670.662589:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933342080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109670.662618:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00080000:1.0:1786109670.662771:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109670.662776:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109670.662778:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109670.662783:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8488 00000100:00080000:1.0:1786109670.662791:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a89101800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109670.662813:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309854f8000 x1872862933342592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109670.662962:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933342592:0@lo:38:kworker.0 00000100:00100000:3.0:1786109670.663160:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.663262:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933342208:0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.663297:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.663335:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933342848:0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.663361:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.663380:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933343360:0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.663404:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.663422:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1786109670.663449:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933342336:0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.663474:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.663491:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933342976:0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.663510:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.663525:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933343488:0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.663544:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.663572:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933342464:0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.663594:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.663612:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933343104:0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.663634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.663651:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933343616:0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.663670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.663682:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786109670.663687:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933342720:0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.663706:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.663723:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933343232:0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.663744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.663780:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933342848 00000100:00100000:1.0:1786109670.663785:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933342848 00000100:00100000:1.0:1786109670.663817:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933342336 00000100:00100000:1.0:1786109670.663820:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933342336 00000100:00100000:1.0:1786109670.663834:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933342976 00000100:00100000:1.0:1786109670.663837:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933342976 00000100:00100000:1.0:1786109670.663851:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933342464 00000100:00100000:1.0:1786109670.663854:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933342464 00000100:00100000:1.0:1786109670.663867:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933343104 00000100:00100000:1.0:1786109670.663869:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933343104 00000100:00100000:3.0:1786109670.663983:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933342208 00000100:00100000:3.0:1786109670.663986:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933342208 00000100:00100000:3.0:1786109670.664017:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1786109670.664025:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933342208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109670.664088:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933342208:12345-0@lo:400:kworker.0 Request processed in 63us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109670.664096:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1786109670.664232:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933343616 00000100:00100000:1.0:1786109670.664236:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933343616 00000100:00100000:1.0:1786109670.664250:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1786109670.664257:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933342848:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109670.664270:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c52680 x1872862933342848/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:141/0 lens 224/224 e 0 to 0 dl 1786109681 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109670.664300:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933342848:12345-0@lo:400:kworker.0 Request processed in 44us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109670.664306:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1786109670.664323:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1786109670.664329:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933342336:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109670.664339:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c50700 x1872862933342336/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:141/0 lens 224/224 e 0 to 0 dl 1786109681 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109670.664364:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933342336:12345-0@lo:400:kworker.0 Request processed in 36us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109670.664370:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1786109670.664386:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1786109670.664392:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933342976:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109670.664402:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c50e00 x1872862933342976/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:141/0 lens 224/224 e 0 to 0 dl 1786109681 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786109670.664484:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109670.664488:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786109670.664491:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109670.667091:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933342976:12345-0@lo:400:kworker.0 Request processed in 36us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109670.667113:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1786109670.667162:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1786109670.667176:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933342464:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109670.667200:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c51180 x1872862933342464/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:141/0 lens 224/224 e 0 to 0 dl 1786109681 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109670.667285:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933342464:12345-0@lo:400:kworker.0 Request processed in 114us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109670.667293:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1786109670.667309:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1786109670.667316:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933343104:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109670.667328:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c53100 x1872862933343104/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:141/0 lens 224/224 e 0 to 0 dl 1786109681 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109670.667357:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933343104:12345-0@lo:400:kworker.0 Request processed in 42us (3721us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109670.667362:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1786109670.667378:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1786109670.667385:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933343616:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109670.667396:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c53800 x1872862933343616/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:141/0 lens 224/224 e 0 to 0 dl 1786109681 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109670.667421:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933343616:12345-0@lo:400:kworker.0 Request processed in 37us (3750us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109670.667442:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1786109670.667473:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933343360 00000100:00100000:1.0:1786109670.667480:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933343360 00000100:00100000:1.0:1786109670.667531:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933343488 00000100:00100000:1.0:1786109670.667535:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933343488 00000100:00100000:1.0:1786109670.667552:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933342720 00000100:00100000:1.0:1786109670.667555:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933342720 00000100:00100000:1.0:1786109670.667573:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7075 00000100:00100000:1.0:1786109670.667580:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933343360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.667613:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933343360:12345-0@lo:400:kworker.0 Request processed in 33us (4208us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109670.667620:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7075 00000100:00100000:1.0:1786109670.667631:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7076 00000100:00100000:1.0:1786109670.667638:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933343488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.667666:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933343488:12345-0@lo:400:kworker.0 Request processed in 28us (4120us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109670.667671:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7076 00000100:00100000:1.0:1786109670.667683:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7077 00000100:00100000:1.0:1786109670.667688:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933342720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109670.667715:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933342720:12345-0@lo:400:kworker.0 Request processed in 27us (4008us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109670.667721:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7077 00000100:00100000:1.0:1786109670.667802:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933342592 00000100:00100000:1.0:1786109670.667806:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933342592 00000100:00100000:1.0:1786109670.667843:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933343232 00000100:00100000:1.0:1786109670.667847:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933343232 00000100:00100000:1.0:1786109670.667867:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12463 00000100:00100000:1.0:1786109670.669189:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3645:x1872862933342592:12345-0@lo:38:kworker.0 00010000:02000400:1.0:1786109670.669221:0:8452:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-MDT0000: Received new MDS connection from 0@lo, keep former export from same NID 00000100:00100000:2.0:1786109670.671533:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933342080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8938us (9265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109670.671548:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5908 00000100:00100000:0.0:1786109670.671765:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933342080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109670.671810:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12464 00000100:00100000:0.0:1786109670.671825:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933343232:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109670.671850:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c51500 x1872862933343232/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:141/0 lens 224/224 e 0 to 0 dl 1786109681 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109670.671922:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933343232:12345-0@lo:400:kworker.0 Request processed in 104us (8176us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109670.671933:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12464 00000100:00100000:0.0:1786109670.672997:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933342720:0@lo:400:kworker.0 00000100:00100000:0.0:1786109670.673013:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933343232:0@lo:400:kworker.0 00000100:00100000:0.0:1786109670.673024:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933342464:0@lo:400:kworker.0 00000100:00100000:0.0:1786109670.673034:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933343104:0@lo:400:kworker.0 00000100:00100000:0.0:1786109670.673045:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933343616:0@lo:400:kworker.0 00000100:00100000:0.0:1786109670.673099:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933342336:0@lo:400:kworker.0 00000100:00100000:0.0:1786109670.673112:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933342976:0@lo:400:kworker.0 00000100:00100000:0.0:1786109670.673124:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933343488:0@lo:400:kworker.0 00000100:00100000:0.0:1786109670.673134:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933342208:0@lo:400:kworker.0 00000100:00100000:0.0:1786109670.673146:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933342848:0@lo:400:kworker.0 00000100:00100000:0.0:1786109670.673157:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933343360:0@lo:400:kworker.0 00000100:00080000:3.0:1786109670.674082:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109670.674089:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786109670.723623:0:8452:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp ffff930a90aa1800 cur 8527 last 1786109626 00000004:00100000:1.0:1786109670.723647:0:8452:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli 0@lo does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786109670.723664:0:8452:0:(import.c:65:import_set_state_nolock()) ffff930ac0c88000 : changing import state from FULL to RECOVER 00000100:00080000:1.0:1786109670.723990:0:8452:0:(import.c:65:import_set_state_nolock()) ffff930ac0c88000 : changing import state from RECOVER to FULL 00010000:00000080:1.0:1786109670.724014:0:8452:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c56300 x1872862933342592/t0(0) o38->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1786109690 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109670.724105:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3645:x1872862933342592:12345-0@lo:38:kworker.0 Request processed in 56231us (60945us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109670.724116:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12463 00000100:00080000:3.0:1786109670.724302:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 80 00000100:00080000:3.0:1786109670.724313:0:3645:0:(import.c:1297:ptlrpc_connect_interpret()) reconnected to lustre-MDT0000_UUID@0@lo after partition 00000100:00080000:3.0:1786109670.724316:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1786109670.724703:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1786109670.724714:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1786109670.724721:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000139269e2): req@ffff930ac17bf800 x1872862933333376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 1 dl 1786109670 ref 2 fl Rpc:XQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109670.724737:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933342592:0@lo:38:kworker.0 00000100:00100000:0.0:1786109670.724851:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109670.724863:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933343744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109670.724909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109670.724948:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933343744 00000100:00100000:0.0:1786109670.724954:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933343744 00000100:00100000:0.0:1786109670.724990:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12465 00000100:00100000:0.0:1786109670.725000:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933343744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786109670.725027:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445642240 avail 1299402752 00010000:00000080:0.0:1786109670.725040:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c6d80 x1872862933343744/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:141/0 lens 224/368 e 0 to 0 dl 1786109681 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109670.725296:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933343744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 296us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109670.725303:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12465 00000100:00100000:1.0:1786109670.725528:0:187918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.725549:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1dc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109670.725563:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933333376 00000100:00100000:1.0:1786109670.725568:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933333376 00000100:00100000:1.0:1786109670.725592:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12466 00000100:00100000:1.0:1786109670.725598:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187918:x1872862933333376:12345-0@lo:1000:osp_up0-1.0 00000020:00080000:1.0:1786109670.725622:0:179257:0:(tgt_handler.c:3156:tgt_check_resent()) @@@ reconstruct resent RPC req@ffff930ab7c50380 x1872862933333376/t343597383692(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:141/0 lens 488/4320 e 0 to 0 dl 1786109681 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00080000:1.0:1786109670.725636:0:179257:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff930aa601c208 index 0: rc = 0 00000020:00080000:1.0:1786109670.725642:0:179257:0:(out_handler.c:35:out_reconstruct()) lustre-MDT0000-osd: fork reply ffff930aa601c208 index 1: rc = 0 00010000:00000080:1.0:1786109670.725650:0:179257:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c50380 x1872862933333376/t343597383692(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:141/0 lens 488/4320 e 0 to 0 dl 1786109681 ref 1 fl Interpret:/202/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109670.725685:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187918:x1872862933333376:12345-0@lo:1000:osp_up0-1.0 Request processed in 87us (158us total) trans 343597383692 rc 0/0 00000100:00100000:1.0:1786109670.725691:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12466 00000100:00100000:1.0:1786109670.725729:0:187918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bf800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933333376:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1786109670.725741:0:187918:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930986abf840 version 11 rpc_version 11 00000020:00100000:1.0:1786109670.725762:0:187918:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109670.725768:0:187918:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab7c51880 x1872862933344000/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109670.725783:0:187918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c51880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933344000:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786109670.725808:0:187918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109670.726568:0:187918:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987d343c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109670.726590:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933344000 00000100:00100000:1.0:1786109670.726594:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933344000 00000100:00100000:0.0:1786109670.726857:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933343744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109670.728358:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12467 00000100:00100000:1.0:1786109670.728374:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:187918:x1872862933344000:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:1.0:1786109670.728744:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c51c00 x1872862933344000/t343597383698(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:141/0 lens 2520/4320 e 0 to 0 dl 1786109681 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109670.728817:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:187918:x1872862933344000:12345-0@lo:1000:osp_up0-1.0 Request processed in 446us (3005us total) trans 343597383698 rc 0/0 00000100:00100000:1.0:1786109670.728829:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12467 00000100:00100000:0.0:1786109670.729965:0:187918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c51880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:187918:1872862933344000:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1786109670.730917:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37f43 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.730938:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37f43 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.730952:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37f43 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109670.730972:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001409d266 reply state 00000000dffa4cf0 transno 25769804642 ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37f43 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.730982:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37f43 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.730990:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a97c9a400) 00010000:00010000:2.0:1786109670.730993:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109670.730996:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1786109670.731002:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x16:0x0]: returning size 4096 00000004:00080000:2.0:1786109670.731010:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x4:0x0] 00010000:00010000:2.0:1786109670.731021:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.731030:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.731039:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109670.731827:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109670.731837:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 4/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109670.731847:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425600 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:1.0:1786109670.731853:0:29734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 5/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109670.731862:0:29734:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 5/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.731887:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000004:00080000:2.0:1786109670.731899:0:188678:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x4:0x0] 00010000:00010000:1.0:1786109670.731900:0:29734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.731908:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07800/0xdb52b77d7ca37e7f lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37e86 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109670.731908:0:29734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786109670.731925:0:188678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07800/0xdb52b77d7ca37e7f lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37e86 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109670.731931:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 1/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109670.731940:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930986425600/0xdb52b77d7ca37e71 lrc: 0/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37e78 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109670.731956:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109670.731959:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109670.731961:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:2.0:1786109670.731966:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1d3e300 x1872862922144768/t25769804642(0) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:150/0 lens 560/448 e 1 to 0 dl 1786109690 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109670.731969:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109670.731988:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933344128:0@lo:103:ldlm_bl.0 00010000:00080000:2.0:1786109670.732028:0:188678:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1786109670.732043:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:164190:x1872862922144768:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 16271002us (16275681us total) trans 25769804642 rc 0/0 00000100:00100000:1.0:1786109670.732044:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109670.732069:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1153 00010000:00010000:2.0:1786109670.732166:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37f43 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.732174:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37f43 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.732180:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37f43 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.732187:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109670.732191:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37f43 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.732198:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37f43 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.732210:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a97c9a400) 00010000:00010000:2.0:1786109670.732213:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109670.732216:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37f43 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.732223:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424600/0xdb52b77d7ca37f43 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109670.734887:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933344128 00000100:00100000:2.0:1786109670.734900:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933344128 00000100:00100000:2.0:1786109670.735009:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4530 00000100:00100000:2.0:1786109670.735021:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3649:x1872862933344128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109670.735037:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109670.735072:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca37e78 lrc: 0/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37e71 expref: 10 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109670.735088:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:2.0:1786109670.735093:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109670.736046:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3649:x1872862933344128:12345-0@lo:103:ldlm_bl.0 Request processed in 1024us (3999us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109670.736066:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4530 00000100:00100000:0.0:1786109670.736535:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933344128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109670.743837:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109670.743917:0:195049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922149760 00000100:00100000:3.0:1786109670.743926:0:195049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922149760 00000100:00100000:3.0:1786109670.744032:0:195049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:3.0:1786109670.744044:0:195049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:164190:x1872862922149760:12345-192.168.203.38@tcp:35:lfs.0 00010000:00000080:3.0:1786109670.744483:0:195049:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1706300 x1872862922149760/t343597383699(0) o35->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:141/0 lens 392/456 e 0 to 0 dl 1786109681 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1786109670.744544:0:195049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:164190:x1872862922149760:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 502us (716us total) trans 343597383699 rc 0/0 00000100:00100000:3.0:1786109670.744552:0:195049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00080000:2.0:1786109670.760290:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1786109671.161108:0:198059:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds2 REPLAY BARRIER on lustre-MDT0001 00010000:00010000:1.0:1786109671.494400:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109672.516767:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1786109673.000547:0:198157:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1786109673.000601:0:198157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109673.000615:0:198157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109673.000622:0:198157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109673.000629:0:198157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109673.000646:0:198157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1786109673.000650:0:198157:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1786109673.000677:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109673.000683:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109673.000694:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c600 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:0.0:1786109673.000697:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109673.000704:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786109673.000711:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109673.000716:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786109673.000732:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1786109673.000735:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1786109673.000844:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109673.000851:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109673.000875:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109673.000882:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca37453 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3745a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109673.000893:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109673.000895:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109673.000896:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109673.000913:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933344256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109673.000976:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109673.001063:0:198157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109673.001067:0:198157:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1786109673.001073:0:198157:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1786109673.001086:0:198157:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1786109673.002392:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933344256 00000100:00100000:0.0:1786109673.002403:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933344256 00000100:00100000:0.0:1786109673.002475:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4531 00000100:00100000:0.0:1786109673.002485:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933344256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109673.002498:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109673.002516:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166ce00/0xdb52b77d7ca3745a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37453 expref: 24 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109673.002529:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109673.002581:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3649:x1872862933344256:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109673.002588:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4531 00000100:00100000:0.0:1786109673.002627:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933344256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109673.002894:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933344384:0@lo:39:umount.0 00000100:00100000:3.0:1786109673.002937:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109673.011066:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933344384 00000100:00100000:0.0:1786109673.011080:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933344384 00000100:00100000:3.0:1786109673.011345:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:3.0:1786109673.011357:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872862933344384:12345-0@lo:39:umount.0 00000020:00000080:3.0:1786109673.011390:0:187900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca374e6 00000100:00080000:3.0:1786109673.011630:0:187900:0:(import.c:65:import_set_state_nolock()) ffff930ab9961000 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1786109673.011662:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c54700 x1872862933344384/t0(0) o39->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:144/0 lens 224/224 e 0 to 0 dl 1786109684 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109673.011754:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+1:3645:x1872862933344384:12345-0@lo:39:umount.0 Request processed in 399us (8816us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109673.011762:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000020:00000080:3.0:1786109673.011840:0:187900:0:(genops.c:906:class_export_put()) final put ffff930ab9965800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:0.0:1786109673.011889:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109673.012094:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1786109673.012113:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933344384:0@lo:39:umount.0 00000100:00080000:0.0:1786109673.012240:0:198157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109673.012244:0:198157:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1786109673.012249:0:198157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1786109673.015134:0:198157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.015152:0:198157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.015159:0:198157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.015165:0:198157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.015649:0:198157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109673.015658:0:198157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.015666:0:198157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.015673:0:198157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.015679:0:198157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1786109673.015979:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab9965800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1786109673.016059:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab9961000 for lustre-MDT0000 00010000:00010000:3.0:1786109673.016414:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109673.016422:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109673.017046:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2c00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109673.017051:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109673.017061:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109673.017067:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109673.017073:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786109673.017076:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1786109673.017113:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109673.017123:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1786109673.017313:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933344512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109673.017379:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109673.017658:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933344512 00000100:00100000:2.0:1786109673.017665:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933344512 00000100:00100000:2.0:1786109673.017717:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4532 00000100:00100000:2.0:1786109673.017728:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3646:x1872862933344512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109673.017743:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109673.017759:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c3600/0xdb52b77d7ca37476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3746f expref: 23 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109673.018958:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109673.019076:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109673.019087:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac16c2c00/0xdb52b77d7ca3746f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37476 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109673.019102:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109673.019107:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109673.019113:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2200 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109673.019117:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109673.019125:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109673.019132:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109673.019136:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1786109673.019139:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1786109673.019163:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109673.019170:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109673.019292:0:198157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:1.0:1786109673.019300:0:198157:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1786109673.019316:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109673.019378:0:198157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.019388:0:198157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.019395:0:198157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.019402:0:198157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.019414:0:198157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109673.019419:0:198157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.019425:0:198157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.019446:0:198157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.019452:0:198157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.019463:0:198157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1786109673.019466:0:198157:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1786109673.019469:0:198157:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1786109673.019508:0:198157:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1786109673.019512:0:198157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:1.0:1786109673.019516:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1786109673.019521:0:198157:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0001 00000004:00000080:1.0:1786109673.022587:0:198157:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:1.0:1786109673.022946:0:198157:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1786109673.022955:0:198157:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff930a905fd000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786109673.022961:0:198157:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff930ac10a6000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786109673.022968:0:198157:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff930983774000 fac74500-4523-4794-af20-dfdcdfae19c1 192.168.203.38@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 25769804642 stale:0 00000020:00080000:1.0:1786109673.022973:0:198157:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff930ab2ab9800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786109673.022978:0:198157:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff930ab7c4b380) has exports, disconnecting them 00000020:00080000:1.0:1786109673.022982:0:198157:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff930a905fd000), last request at 1786109626 00000020:00000080:1.0:1786109673.022990:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37388 00000100:00080000:1.0:1786109673.022998:0:198157:0:(import.c:65:import_set_state_nolock()) ffff930aa0713000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1786109673.023023:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786109673.023031:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.023051:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3a00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:1.0:1786109673.023054:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.023063:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786109673.023070:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109673.023075:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1786109673.023078:0:10402:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1786109673.023080:0:10402:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1786109673.023114:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.023121:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109673.023152:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.023158:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca3748b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37492 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.023172:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109673.023176:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.023182:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3800 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:1.0:1786109673.023185:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.023192:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786109673.023197:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109673.023202:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1786109673.023204:0:10402:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1786109673.023205:0:10402:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1786109673.023217:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.023223:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109673.023228:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.023238:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca3747d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37484 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.023246:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109673.023247:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109673.023249:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109673.023878:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109673.023894:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca37461 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37468 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109673.023894:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3646:x1872862933344512:12345-0@lo:103:ldlm_bl.0 Request processed in 6166us (6511us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109673.023905:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4532 00010000:00010000:3.0:1786109673.023907:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109673.023908:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109673.023910:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109673.023933:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933344640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109673.023933:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933344768:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1786109673.023944:0:198157:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930a905fd000): rc 0 00000020:00000080:1.0:1786109673.023948:0:198157:0:(genops.c:906:class_export_put()) final put ffff930a905fd000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:1.0:1786109673.023962:0:198157:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff930ac10a6000), last request at 1786109670 00000020:00000080:1.0:1786109673.023968:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36fe5 00000100:00080000:1.0:1786109673.023975:0:198157:0:(import.c:65:import_set_state_nolock()) ffff930ac10a1800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1786109673.023993:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786109673.023993:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1786109673.024003:0:198157:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ac10a6000): rc 0 00000020:00000080:1.0:1786109673.024006:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ac10a6000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00080000:1.0:1786109673.024014:0:198157:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.203.38@tcp (ffff930983774000), last request at 1786109668 00000020:00000080:1.0:1786109673.024018:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36f60 00000100:00080000:1.0:1786109673.024029:0:198157:0:(import.c:65:import_set_state_nolock()) ffff930a87b2f800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1786109673.024108:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309854f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933344512:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1786109673.024177:0:198157:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.38@tcp (ffff930983774000): rc 0 00000020:00000080:1.0:1786109673.024180:0:198157:0:(genops.c:906:class_export_put()) final put ffff930983774000/fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00080000:1.0:1786109673.024185:0:198157:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff930ab2ab9800), last request at 1786109670 00000020:00000080:1.0:1786109673.024188:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3306e 00000100:00100000:3.0:1786109673.024195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786109673.024195:0:198157:0:(import.c:65:import_set_state_nolock()) ffff930ab2abd000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1786109673.024349:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786109673.024359:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a905fd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000100:00100000:2.0:1786109673.024402:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00000080:0.0:1786109673.024406:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac10a6000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:2.0:1786109673.024411:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933344896:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1786109673.024456:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930983774000/fac74500-4523-4794-af20-dfdcdfae19c1 for lustre-MDT0001 00000100:00100000:2.0:1786109673.024462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109673.024492:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933344768 00000100:00100000:2.0:1786109673.024497:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933344768 00000100:00100000:2.0:1786109673.024533:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933344640 00000100:00100000:2.0:1786109673.024536:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933344640 00000100:00100000:2.0:1786109673.024550:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933344896 00000100:00100000:2.0:1786109673.024551:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933344896 00000100:00100000:2.0:1786109673.024563:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4533 00000100:00100000:2.0:1786109673.024569:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933344768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109673.024580:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109673.024595:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac1f39200/0xdb52b77d7ca37492 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3748b expref: 24 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109673.024607:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109673.024634:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3648:x1872862933344768:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109673.024643:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4533 00000100:00100000:2.0:1786109673.024655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4534 00000100:00100000:2.0:1786109673.024662:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3647:x1872862933344640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109673.024669:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109673.024678:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c2a00/0xdb52b77d7ca37468 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37461 expref: 22 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109673.024687:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109673.024713:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3647:x1872862933344640:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109673.024719:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4534 00000100:00100000:2.0:1786109673.024755:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4535 00000100:00100000:2.0:1786109673.024762:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:3648:x1872862933344896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109673.024765:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109673.024769:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109673.024770:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109673.024779:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac1f39800/0xdb52b77d7ca37484 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3747d expref: 20 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109673.024787:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109673.024807:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3648:x1872862933344896:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109673.024812:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4535 00000100:00100000:2.0:1786109673.024837:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933344896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109673.024847:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933344768:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1786109673.024864:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930aa0713000 for lustre-MDT0001 00000020:00000080:0.0:1786109673.024872:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac10a1800 for lustre-MDT0001 00000100:00100000:2.0:1786109673.024879:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933344640:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1786109673.024879:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a87b2f800 for lustre-MDT0001 00010000:00010000:0.0:1786109673.024907:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1786109673.025340:0:198157:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab2ab9800): rc 0 00000020:00000080:1.0:1786109673.025343:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ab2ab9800/lustre-MDT0001-lwp-OST0001_UUID 00000004:00000080:1.0:1786109673.025362:0:198157:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa66f01d1bae0 00000100:00080000:1.0:1786109673.025382:0:198157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786109673.025386:0:198157:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383692 gen 3 00000100:00100000:1.0:1786109673.025394:0:198157:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff930ac17bf800 x1872862933333376/t343597383692(343597383692) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1786109686 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1786109673.025404:0:198157:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 343597383692 committed transno 343597383692 00000100:00100000:1.0:1786109673.025475:0:198157:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff930ab7c51880 x1872862933344000/t343597383698(343597383698) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 0 dl 1786109686 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1786109673.025483:0:198157:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 343597383698 committed transno 343597383692 00000020:00080000:1.0:1786109673.025489:0:198157:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff930a8a59e240 refcount 2 committed 0 result 1 batchid 21474840727 00000020:00080000:1.0:1786109673.025493:0:198157:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab1d83900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff930a8a59e600 00000020:00080000:1.0:1786109673.025496:0:198157:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200026d32:0x1:0x0].3 00000020:00080000:1.0:1786109673.025499:0:198157:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab1d83300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930985f42e00 00000020:00080000:1.0:1786109673.025501:0:198157:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002efa:0x1:0x0].3 00000020:00080000:2.0:1786109673.025523:0:187933:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840726 00000020:00080000:2.0:1786109673.025528:0:187933:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840726 00010000:00010000:1.0:1786109673.025642:0:198157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ac1f39000/0xdb52b77d7ca37755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3775c expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109673.025654:0:198157:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ac1f39000/0xdb52b77d7ca37755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3775c expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109673.025752:0:198157:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000020:00000080:0.0:1786109673.026954:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2ab9800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1786109673.027028:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab2abd000 for lustre-MDT0001 00010000:00010000:1.0:1786109673.027207:0:198157:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1786109673.027223:0:198157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ac1f39000/0xdb52b77d7ca37755 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3775c expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.027334:0:198157:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07800/0xdb52b77d7ca37e7f lrc: 4/0,0 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca37e86 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109673.027344:0:198157:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07800/0xdb52b77d7ca37e7f lrc: 4/0,0 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca37e86 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109673.027352:0:198157:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1786109673.027356:0:198157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f07800/0xdb52b77d7ca37e7f lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca37e86 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786109673.028207:0:198157:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1786109673.028234:0:198157:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1786109673.029098:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933345024:0@lo:39:umount.0 00000100:00100000:2.0:1786109673.029170:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109673.030034:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933345024 00000100:00100000:3.0:1786109673.030054:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933345024 00000100:00080000:1.0:1786109673.030253:0:198157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1786109673.030917:0:198157:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705678 gen 3 00000004:00080000:1.0:1786109673.030981:0:198157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1786109673.031053:0:198157:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1786109673.031081:0:198157:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1786109673.031109:0:198157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1786109673.031111:0:198157:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975836 gen 3 00000100:00100000:0.0:1786109673.031161:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933345152:0@lo:9:umount.0 00000100:00100000:0.0:1786109673.031215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109673.031277:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933345152 00000100:00100000:0.0:1786109673.031282:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933345152 00000100:00100000:2.0:1786109673.031397:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12468 00000100:00100000:2.0:1786109673.031407:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3645:x1872862933345024:12345-0@lo:39:umount.0 00000020:00000080:2.0:1786109673.031446:0:177399:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37357 00000020:00010000:2.0:1786109673.031457:0:177399:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930a90aa1800: total 0 00000100:00080000:2.0:1786109673.031461:0:177399:0:(import.c:65:import_set_state_nolock()) ffff930ac0c88000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786109673.031479:0:177399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 80, last_transno is 343597383699 00010000:00000080:2.0:1786109673.031586:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1704a80 x1872862933345024/t343597383700(0) o39->lustre-MDT0001-mdtlov_UUID@0@lo:144/0 lens 224/224 e 0 to 0 dl 1786109684 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109673.031634:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1872862933345024:12345-0@lo:39:umount.0 Request processed in 228us (2463us total) trans 343597383700 rc 0/0 00000100:00100000:2.0:1786109673.031641:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12468 00000100:00080000:3.0:1786109673.032397:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1786109673.032872:0:198157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1786109673.032998:0:198157:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1786109673.033019:0:198157:0:(import.c:65:import_set_state_nolock()) ffff930ac1362800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1786109673.033071:0:198157:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff930ab7c4b380) has no exports 00000020:00080000:3.0:1786109673.033129:0:187933:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff930a8a59e240 refcount 1 committed 1 result 1 batchid 21474840727 00000020:00080000:3.0:1786109673.033134:0:187933:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab1d83900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 1 sub_th ffff930a8a59e600 00000020:00080000:3.0:1786109673.033137:0:187933:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200026d32:0x1:0x0].3 00000020:00080000:3.0:1786109673.033140:0:187933:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab1d83300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930985f42e00 00000020:00080000:3.0:1786109673.033143:0:187933:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002efa:0x1:0x0].3 00000040:00080000:1.0:1786109673.033508:0:198157:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 10, last_idx 12 00000020:00010000:2.0:1786109673.033613:0:29734:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930a90aa1800: total 0 00010000:00010000:2.0:1786109673.033618:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109673.033660:0:29734:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930a90aa1800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1786109673.033694:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930aa0658800) 00010000:00010000:2.0:1786109673.033696:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786109673.033705:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab28bc800/0xdb52b77d7ca3775c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37755 expref: 6 pid: 179257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109673.033727:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0xf7117594 (ffff930984516d00) 00010000:00010000:2.0:1786109673.033729:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109673.033733:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9400/0xdb52b77d7ca37e86 lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37e7f expref: 5 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109673.033746:0:29734:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930a90aa1800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1786109673.033758:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109673.033760:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109673.033762:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1786109673.034008:0:198157:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff930ab7c4b380) has no exports 00000100:00100000:0.0:1786109673.036658:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23155 00000100:00100000:0.0:1786109673.036682:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1872862933345152:12345-0@lo:9:umount.0 00000020:00000080:0.0:1786109673.036715:0:43911:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca36f98 00000100:00080000:0.0:1786109673.036724:0:43911:0:(import.c:65:import_set_state_nolock()) ffff930981e16800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786109673.036792:0:43911:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705678 00000100:00100000:0.0:1786109673.036962:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+2:3645:x1872862933345152:12345-0@lo:9:umount.0 Request processed in 292us (5745us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109673.036970:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23155 00000100:00100000:0.0:1786109673.037001:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933345280:0@lo:9:umount.0 00010000:00010000:3.0:1786109673.037120:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109673.037148:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109673.037206:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89106800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1786109673.037218:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1786109673.037220:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109673.037224:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933345152:0@lo:9:umount.0 00000100:00080000:0.0:1786109673.037240:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a89101800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1786109673.037245:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933345024:0@lo:39:umount.0 00000100:00100000:3.0:1786109673.037339:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933345280 00000100:00100000:3.0:1786109673.037345:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933345280 00000100:00100000:3.0:1786109673.037389:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23156 00000100:00100000:3.0:1786109673.037397:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1872862933345280:12345-0@lo:9:umount.0 00000020:00000080:3.0:1786109673.037411:0:43920:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3084a 00000100:00080000:3.0:1786109673.037417:0:43920:0:(import.c:65:import_set_state_nolock()) ffff930ac0ece800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786109673.037465:0:43920:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975836 00000100:00100000:3.0:1786109673.037664:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+2:3645:x1872862933345280:12345-0@lo:9:umount.0 Request processed in 267us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109673.037672:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23156 00000100:00080000:3.0:1786109673.037688:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786109673.037699:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109673.037737:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ac1362800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1786109673.037841:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1786109673.037909:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109673.037914:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933345280:0@lo:9:umount.0 00000020:01000000:0.0:1786109673.105610:0:198157:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ab1eb2060 - data ffff930abfacf288/ffff930985c4e400 00000020:01000000:0.0:1786109673.105761:0:198157:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ab8cd1ae0 - data ffff930abfaf60d8/ffff930a87bb8400 00000100:00100000:0.0:1786109673.220690:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933345408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109673.220779:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109673.221025:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933345408 00000100:00100000:1.0:1786109673.221032:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933345408 00000100:00100000:1.0:1786109673.221091:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12469 00000100:00100000:1.0:1786109673.221099:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1872862933345408:12345-0@lo:41:osp-pre-1-0.0 00000020:00080000:1.0:1786109673.221108:0:8451:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109673.221163:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1872862933345408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (390us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109673.221169:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12469 00000100:02020000:0.0:1786109673.221246:0:3646:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1786109673.221251:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1786109673.221255:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1786109673.221328:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1786109673.221334:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109673.221338:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8483 00000100:00080000:0.0:1786109673.221344:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930985f23800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109673.221365:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac16c5500 x1872862933345536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109673.221456:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933345536:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1786109673.221486:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109673.221560:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933345536 00000100:00100000:3.0:1786109673.221565:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933345536 00000100:00100000:3.0:1786109673.221634:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12470 00000100:00100000:3.0:1786109673.221640:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933345536:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1786109673.221655:0:177399:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1786109673.226007:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933345536:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 4357us (4511us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109673.226020:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12470 00000100:00080000:0.0:1786109673.226367:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109673.226374:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109673.226378:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933345536:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1786109673.231068:0:198157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786109673.231076:0:198157:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383692 gen 4 00000100:00100000:2.0:1786109673.231093:0:198157:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff930ab7c51880 x1872862933345024/t343597383700(343597383700) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109683 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109673.231120:0:198157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1786109673.232653:0:198157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1786109673.232659:0:198157:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705678 gen 4 00000004:00080000:3.0:1786109673.232695:0:198157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109673.232701:0:198157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1786109673.232946:0:187921:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1786109673.232951:0:187921:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x18:0x0] index 11 count 1 00000040:00080000:1.0:1786109673.232964:0:187921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 6 count 2 00000100:00080000:3.0:1786109673.233644:0:198157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1786109673.233647:0:198157:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975836 gen 4 00000004:00080000:3.0:1786109673.233684:0:198157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109673.233686:0:198157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1786109673.233889:0:187923:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1786109673.233893:0:187923:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 11 count 1 00000040:00080000:0.0:1786109673.233903:0:187923:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 6 count 2 00000020:00000080:3.0:1786109673.234933:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca307c5 00000020:00000080:3.0:1786109673.234943:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ac0b3e800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1786109673.235075:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0b3e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1786109673.235741:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca307da 00000020:00000080:3.0:1786109673.235747:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ac0b3d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1786109673.235786:0:198157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1786109673.235791:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109673.235799:0:198157:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1786109673.235802:0:198157:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff930ab7c4cd40) has no exports 00000004:01000000:3.0:1786109673.235963:0:198157:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1786109673.235969:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3083c 00000020:00000080:3.0:1786109673.235973:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ac0ecb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1786109673.235992:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0b3d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1786109673.236051:0:198157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1786109673.236055:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109673.236059:0:198157:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786109673.236062:0:198157:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff930ac11b4d40) has no exports 00000020:00000080:3.0:1786109673.236067:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30835 00000020:00000080:3.0:1786109673.236070:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ac1367800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1786109673.236091:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0ecb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1786109673.236658:0:198157:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1786109673.236662:0:198157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1786109673.236665:0:198157:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975836 gen 5 00000004:00080000:3.0:1786109673.236670:0:198157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109673.236673:0:198157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1786109673.236784:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac1367800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1786109673.236855:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109673.236861:0:198157:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1786109673.236866:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30820 00000020:00000080:3.0:1786109673.236871:0:198157:0:(genops.c:906:class_export_put()) final put ffff93098666f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1786109673.236894:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac1362800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1786109673.236899:0:192991:0:(genops.c:906:class_export_put()) final put ffff93098666c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1786109673.236901:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098666c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1786109673.236905:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1786109673.237028:0:198157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1786109673.237032:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109673.237045:0:198157:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786109673.237048:0:198157:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff930ab1d4b380) has no exports 00000020:00000080:3.0:1786109673.237052:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30819 00000020:00000080:3.0:1786109673.237055:0:198157:0:(genops.c:906:class_export_put()) final put ffff930a89102800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1786109673.237072:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098666f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:3.0:1786109673.237528:0:198157:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1786109673.237531:0:198157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1786109673.237534:0:198157:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705678 gen 5 00000004:00080000:3.0:1786109673.237537:0:198157:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109673.237539:0:198157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1786109673.237804:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a89102800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1786109673.237871:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109673.237876:0:198157:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1786109673.237886:0:198157:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1786109673.237890:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3080b 00000020:00000080:3.0:1786109673.237895:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ac1364000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1786109673.237899:0:198157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:3.0:1786109673.237903:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109673.237906:0:198157:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786109673.237909:0:198157:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff930ab1d499c0) has no exports 00000020:00000080:3.0:1786109673.237913:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30804 00000020:00000080:3.0:1786109673.237915:0:198157:0:(genops.c:906:class_export_put()) final put ffff930a89102000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1786109673.238702:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a89106800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1786109673.238710:0:192991:0:(genops.c:906:class_export_put()) final put ffff930ac1361000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1786109673.238712:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac1361000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1786109673.238717:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1786109673.238780:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac1364000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1786109673.238784:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a89102000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1786109673.239482:0:198157:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1786109673.239487:0:198157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786109673.239490:0:198157:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383692 gen 5 00000100:00100000:2.0:1786109673.239496:0:198157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1786109673.239538:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786109673.239548:0:198157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1786109673.239573:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786109673.239577:0:198157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1786109673.239581:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ac0af0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1786109673.239583:0:198157:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0af0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1786109673.239589:0:198157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1786109673.239657:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca307e1 00000020:00000080:2.0:1786109673.239664:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ac0b3a800/lustre-MDD0001_UUID 00000020:01000000:2.0:1786109673.239668:0:198157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1786109673.239671:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786109673.239676:0:198157:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1786109673.239679:0:198157:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff930984eab380) has no exports 00000020:00000080:2.0:1786109673.239697:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786109673.239701:0:198157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1786109673.239704:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca307e8 00000020:00000080:2.0:1786109673.239708:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ac0b3f800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1786109673.239715:0:198157:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930a92e3e800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1786109673.239718:0:198157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930a92e3e800 2 00000020:01000004:2.0:1786109673.239722:0:198157:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff930a92e3e800 from lustre-MDT0001 00000020:00000080:2.0:1786109673.239747:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786109673.239750:0:198157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1786109673.239753:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ac0b3d000/lustre-MDT0001_UUID 00000020:00000080:2.0:1786109673.239755:0:198157:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0b3d000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1786109673.239761:0:198157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1786109673.239794:0:198157:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1786109673.239798:0:198157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1786109673.239801:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786109673.239805:0:198157:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1786109673.239811:0:198157:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff930ab8da0800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1786109673.239816:0:198157:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff930ac11b19c0) has exports, disconnecting them 00000020:00080000:2.0:1786109673.239820:0:198157:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff930ab8da0800), last request at 1786109320 00000020:00000080:2.0:1786109673.239824:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3087b 00000020:00080000:2.0:1786109673.239837:0:198157:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab8da0800): rc 0 00000020:00000080:2.0:1786109673.239841:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ab8da0800/lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1786109673.240630:0:198157:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1786109673.240634:0:198157:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786109673.240637:0:198157:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1786109673.240642:0:198157:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1786109673.240733:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786109673.240739:0:198157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1786109673.240745:0:198157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930a92e3e800 1 00000020:00000080:2.0:1786109673.240749:0:198157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca30755 00000020:00000080:2.0:1786109673.240753:0:198157:0:(genops.c:906:class_export_put()) final put ffff93098c888000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1786109673.240757:0:198157:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1786109673.240761:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786109673.240764:0:198157:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1786109673.240767:0:198157:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff930ab1d48000) has no exports 00000020:00000080:0.0:1786109673.241097:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a89101800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1786109673.241104:0:192991:0:(genops.c:906:class_export_put()) final put ffff930a89103000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1786109673.241106:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a89103000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1786109673.241111:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1786109673.241177:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0b3a800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1786109673.241182:0:192991:0:(genops.c:906:class_export_put()) final put ffff930ac0b38000/lustre-MDD0001_UUID 00000020:00000080:0.0:1786109673.241184:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0b38000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1786109673.241187:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1786109673.241216:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0b3f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1786109673.241220:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab8da0800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1786109673.241224:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab8da4000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1786109673.241228:0:192991:0:(genops.c:906:class_export_put()) final put ffff930a8a642000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1786109673.241230:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a8a642000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1786109673.241233:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1786109673.241255:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098c888000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1786109673.303406:0:198157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109673.303419:0:198157:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1786109673.303425:0:198157:0:(genops.c:906:class_export_put()) final put ffff930ab19fc800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1786109673.303526:0:198157:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab19fc800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1786109673.303540:0:198157:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1786109673.303653:0:198157:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff930ab19fd800 00000020:02000400:1.0:1786109673.303715:0:198157:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00000100:00100000:3.0:1786109673.494754:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109673.494815:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109673.495096:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922149888 00000100:00100000:1.0:1786109673.495105:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922149888 00000100:00100000:3.0:1786109673.495116:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109673.495161:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:1.0:1786109673.495173:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922149888:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109673.495243:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922149888:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 73us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109673.495251:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:1.0:1786109673.495285:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922150144 00000100:00100000:1.0:1786109673.495289:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922150144 00000100:00100000:1.0:1786109673.495311:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1168 00000100:00100000:1.0:1786109673.495316:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1872862922150144:12345-192.168.203.38@tcp:400:kworker.0 00000020:00080000:1.0:1786109673.495322:0:189813:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.38@tcp 00000100:00100000:2.0:1786109673.495587:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922150400 00000100:00100000:2.0:1786109673.495592:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922150400 00000100:00100000:2.0:1786109673.495677:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7078 00000100:00100000:2.0:1786109673.495687:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922150400:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109673.495721:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922150400:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109673.495727:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7078 00000100:00100000:1.0:1786109673.495873:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1872862922150144:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 554us (1056us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109673.495939:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1168 00000100:00080000:3.0:1786109673.497227:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109673.505247:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109673.505295:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109673.505366:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922150016 00000100:00100000:1.0:1786109673.505376:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922150016 00000100:00100000:1.0:1786109673.505467:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 374 00000100:00100000:1.0:1786109673.505477:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+8:2403:x1872862922150016:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:1.0:1786109673.505510:0:196401:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac17bc000 x1872862922150016/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:144/0 lens 224/224 e 0 to 0 dl 1786109684 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109673.505571:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+8:2403:x1872862922150016:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 95us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109673.505578:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 374 00000100:00100000:0.0:1786109673.505846:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922150272 00000100:00100000:0.0:1786109673.505851:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922150272 00000100:00100000:0.0:1786109673.505893:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7079 00000100:00100000:0.0:1786109673.505902:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922150272:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109673.505937:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922150272:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109673.505943:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7079 00000100:00080000:3.0:1786109673.506267:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786109673.506272:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786109673.509616:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109673.509718:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922150528 00000100:00100000:1.0:1786109673.509728:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922150528 00000100:00100000:1.0:1786109673.509803:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1169 00000100:00100000:1.0:1786109673.509812:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922150528:12345-192.168.203.38@tcp:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1786109673.509834:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109673.509902:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922150528:12345-192.168.203.38@tcp:38:ptlrpcd_00_01.0 Request processed in 89us (294us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109673.509908:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1169 00010000:00010000:0.0:1786109673.541826:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109673.733181:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933345664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109673.733267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109673.733427:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933345664 00000100:00100000:3.0:1786109673.733476:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933345664 00000100:00100000:3.0:1786109673.733533:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5909 00000100:00100000:3.0:1786109673.733543:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933345664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109673.733571:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109673.733616:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933345664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109673.733624:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5909 00000100:00080000:3.0:1786109673.733654:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109673.733692:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933345664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109673.736720:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac16c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933345792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109673.736794:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109673.736870:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933345792 00000100:00100000:3.0:1786109673.736878:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933345792 00000100:00100000:3.0:1786109673.736933:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5910 00000100:00100000:3.0:1786109673.736942:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933345792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786109673.736970:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109673.740098:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933345792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3148us (3295us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109673.740112:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5910 00000100:00080000:3.0:1786109673.740142:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109673.740218:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac16c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933345792:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786109674.565975:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109675.588580:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109675.780747:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109675.780753:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109675.780757:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109675.780764:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8529 00000100:00080000:2.0:1786109675.780770:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109675.780776:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930985f23800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109675.780783:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933345920:0@lo:400:kworker.0 00000100:00100000:2.0:1786109675.780798:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098490a300 x1872862933346560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109675.780846:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933346048:0@lo:400:kworker.0 00000100:00100000:0.0:1786109675.780851:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109675.780875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109675.780887:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933346432:0@lo:400:kworker.0 00000100:00100000:2.0:1786109675.780894:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933346688:0@lo:400:kworker.0 00000100:00100000:0.0:1786109675.780908:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109675.780913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109675.780928:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786109675.780932:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786109675.780933:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933346304:0@lo:400:kworker.0 00000100:00100000:2.0:1786109675.780936:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933346176:0@lo:400:kworker.0 00000100:00100000:0.0:1786109675.780954:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109675.780965:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933346688 00000100:00100000:2.0:1786109675.780972:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933346688 00000100:00100000:0.0:1786109675.780987:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933346944:0@lo:400:kworker.0 00000100:00100000:0.0:1786109675.781007:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109675.781670:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933346048 00000100:00100000:1.0:1786109675.781676:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933346048 00000100:00100000:1.0:1786109675.781715:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933346432 00000100:00100000:1.0:1786109675.781718:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933346432 00000100:00100000:1.0:1786109675.781732:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933346304 00000100:00100000:1.0:1786109675.781735:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933346304 00000100:00100000:1.0:1786109675.781746:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933346944 00000100:00100000:1.0:1786109675.781749:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933346944 00000100:00100000:3.0:1786109675.782254:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933345920 00000100:00100000:3.0:1786109675.782259:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933345920 00000100:00100000:3.0:1786109675.782292:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1786109675.782301:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3649:x1872862933345920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109675.782369:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3649:x1872862933345920:12345-0@lo:400:kworker.0 Request processed in 69us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109675.782377:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1786109675.782420:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786109675.782425:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109675.782486:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933345920:0@lo:400:kworker.0 00000100:00100000:0.0:1786109675.782693:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933346560:0@lo:38:kworker.0 00000100:00100000:0.0:1786109675.782733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109675.782770:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933346560 00000100:00100000:0.0:1786109675.782774:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933346560 00000100:00100000:0.0:1786109675.782799:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12471 00000100:00100000:0.0:1786109675.782804:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933346560:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109675.782823:0:8452:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109675.782855:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933346560:12345-0@lo:38:kworker.0 Request processed in 50us (122us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109675.782860:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12471 00000100:00080000:0.0:1786109675.782885:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109675.782889:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109675.782892:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933346560:0@lo:38:kworker.0 00000100:00100000:1.0:1786109675.782944:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1786109675.782956:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933346048:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109675.782973:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984908e00 x1872862933346048/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:146/0 lens 224/224 e 0 to 0 dl 1786109686 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109675.783011:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933346048:12345-0@lo:400:kworker.0 Request processed in 59us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109675.783694:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7080 00000100:00100000:2.0:1786109675.783711:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933346688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109675.783759:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109675.783761:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933346688:12345-0@lo:400:kworker.0 Request processed in 56us (2845us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109675.783789:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933346816:0@lo:400:kworker.0 00000100:00100000:3.0:1786109675.783819:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109675.783855:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933346048:0@lo:400:kworker.0 00000100:00100000:3.0:1786109675.783868:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933346688:0@lo:400:kworker.0 00000100:00100000:3.0:1786109675.783899:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933346816 00000100:00100000:3.0:1786109675.783903:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933346816 00000100:00100000:3.0:1786109675.783936:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7081 00000100:00100000:3.0:1786109675.783942:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933346816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109675.783978:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7080 00000100:00100000:3.0:1786109675.783982:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933346816:12345-0@lo:400:kworker.0 Request processed in 37us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109675.783992:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7081 00000100:00100000:2.0:1786109675.784007:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933346176 00000100:00100000:2.0:1786109675.784013:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933346176 00000100:00080000:3.0:1786109675.784016:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109675.784051:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933346816:0@lo:400:kworker.0 00000100:00100000:0.0:1786109675.784086:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1786109675.784097:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933346304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109675.784101:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1786109675.784113:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933346944:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109675.784118:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c7b80 x1872862933346304/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:146/0 lens 224/224 e 0 to 0 dl 1786109686 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000080:3.0:1786109675.784131:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c5500 x1872862933346944/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:146/0 lens 224/224 e 0 to 0 dl 1786109686 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109675.784167:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933346304:12345-0@lo:400:kworker.0 Request processed in 72us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109675.784175:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933346944:12345-0@lo:400:kworker.0 Request processed in 63us (3163us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109675.784181:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1786109675.784188:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1786109675.784212:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:0.0:1786109675.784219:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1872862933346432:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1786109675.784225:0:187900:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1786109675.784329:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1872862933346432:12345-0@lo:400:kworker.0 Request processed in 34us (3345us total) trans 0 rc -107/-107 00000100:00100000:0.0:1786109675.784348:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:0.0:1786109675.784385:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933346304:0@lo:400:kworker.0 00000100:00100000:0.0:1786109675.784398:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933346944:0@lo:400:kworker.0 00000100:00080000:0.0:1786109675.784418:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1786109675.784423:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1786109675.784426:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1786109675.784445:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109675.784450:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8424 00000100:00080000:0.0:1786109675.784456:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109675.784480:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930982e51180 x1872862933347072/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109675.784497:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933346432:0@lo:400:kworker.0 00000100:00100000:0.0:1786109675.784520:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933347072:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1786109675.784544:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109675.784572:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933347072 00000100:00100000:0.0:1786109675.784576:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933347072 00000100:00100000:0.0:1786109675.784592:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:0.0:1786109675.784596:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933347072:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1786109675.784612:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109675.784642:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933347072:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 43us (96us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109675.784648:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00080000:0.0:1786109675.784672:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109675.784676:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109675.784679:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933347072:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1786109675.785014:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1786109675.785095:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1786109675.785102:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1872862933346176:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1786109675.785109:0:187899:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1786109675.785163:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1872862933346176:12345-0@lo:400:kworker.0 Request processed in 60us (1405us total) trans 0 rc -107/-107 00000100:00100000:3.0:1786109675.785169:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00080000:0.0:1786109675.785203:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1786109675.785207:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1786109675.785210:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1786109675.785213:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109675.785216:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8194 00000100:00080000:0.0:1786109675.785221:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff930983499000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109675.785236:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930982e51180 x1872862933347200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109675.785252:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933346176:0@lo:400:kworker.0 00000100:00100000:2.0:1786109675.785694:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933347200:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1786109675.785727:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109675.785949:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933347200 00000100:00100000:0.0:1786109675.785955:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933347200 00000100:00100000:0.0:1786109675.786141:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1786109675.786147:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933347200:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1786109675.786164:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109675.786543:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933347200:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 394us (814us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109675.786553:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00080000:2.0:1786109675.786598:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109675.786603:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109675.786606:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933347200:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:0.0:1786109676.293349:0:196392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1786109676.293364:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383700 is committed 00000001:00080000:0.0:1786109676.293371:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383699 is committed 00000020:00000080:0.0:1786109676.293376:0:196392:0:(genops.c:906:class_export_put()) final put ffff930a90aa1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1786109676.294058:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a90aa1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1786109676.294255:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac0c88000 for lustre-MDT0000 00010000:00010000:3.0:1786109676.612691:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109677.636652:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786109678.377029:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1786109678.377062:0:194579:0:(genops.c:906:class_export_put()) final put ffff93098e515800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1786109678.377174:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e515800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1786109678.377291:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930981e16800 for lustre-OST0000 00000100:00100000:1.0:1786109678.607983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109678.609469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109678.609506:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109678.609535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109678.609582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109678.609618:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922151040 00000100:00100000:1.0:1786109678.609628:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922151040 00000100:00100000:1.0:1786109678.609676:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922151168 00000100:00100000:1.0:1786109678.609679:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922151168 00000100:00100000:1.0:1786109678.609700:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7082 00000100:00100000:1.0:1786109678.609709:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922151040:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109678.609779:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922151040:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109678.609786:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7082 00000100:00100000:1.0:1786109678.609801:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7083 00000100:00100000:1.0:1786109678.609807:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922151168:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109678.609833:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922151168:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109678.609839:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7083 00000100:00100000:0.0:1786109678.610959:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922150784 00000100:00100000:0.0:1786109678.610967:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922150784 00000100:00100000:0.0:1786109678.611034:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922150912 00000100:00100000:0.0:1786109678.612105:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922150912 00000100:00100000:0.0:1786109678.612152:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 378 00000100:00100000:0.0:1786109678.612166:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922150784:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:0.0:1786109678.612204:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c52a00 x1872862922150784/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:163/0 lens 224/224 e 0 to 0 dl 1786109703 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109678.612259:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922150784:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 98us (2796us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109678.612267:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 378 00000100:00100000:0.0:1786109678.612287:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1174 00000100:00100000:0.0:1786109678.612303:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922150912:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:0.0:1786109678.612322:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109678.612344:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922150912:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 40us (2838us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109678.612350:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1174 00000100:00080000:3.0:1786109678.613144:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786109678.613152:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109678.613154:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109678.614547:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922150656 00000100:00100000:2.0:1786109678.614559:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922150656 00000100:00100000:2.0:1786109678.614874:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:2.0:1786109678.614886:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922150656:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109678.614964:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922150656:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 81us (6990us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109678.614972:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 93 00010000:00010000:2.0:1786109678.660702:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109678.852857:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109678.852879:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933347456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109678.852942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109678.853231:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933347328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109678.853264:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109678.853454:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933347456 00000100:00100000:2.0:1786109678.853463:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933347456 00000100:00100000:2.0:1786109678.853525:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933347328 00000100:00100000:2.0:1786109678.853528:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933347328 00000100:00100000:2.0:1786109678.853552:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5911 00000100:00100000:2.0:1786109678.853561:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933347456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109678.853591:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109678.853640:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933347456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109678.853647:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5911 00000100:00100000:2.0:1786109678.853664:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5912 00000100:00100000:2.0:1786109678.853671:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933347328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786109678.853687:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8579520 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109678.853718:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933347328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109678.853724:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5912 00000100:00100000:2.0:1786109678.853778:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933347456:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786109678.854011:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109678.854015:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109678.854096:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933347328:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1786109679.369274:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1786109679.369283:0:9518:0:(genops.c:906:class_export_put()) final put ffff930ac0ec9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1786109679.369872:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0ec9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1786109679.369942:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac0ece800 for lustre-OST0001 00010000:00010000:3.0:1786109679.684585:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109680.708581:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786109680.902776:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109680.902783:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1786109680.902786:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109680.902799:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8532 00000100:00080000:1.0:1786109680.902804:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1786109680.902812:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff930983499000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109680.902833:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac173f480 x1872862933347840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109680.902858:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109680.902861:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1786109680.902863:0:192991:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109680.902867:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8532 00000100:00080000:1.0:1786109680.902869:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1786109680.902873:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109680.902883:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac173e680 x1872862933348096/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109680.902892:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109680.902895:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1786109680.902896:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109680.902899:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8532 00000100:00080000:1.0:1786109680.902901:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1786109680.902904:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930985f23800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109680.902915:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac173f800 x1872862933348224/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109680.902957:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933347968:0@lo:400:kworker.0 00000100:00100000:1.0:1786109680.903034:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109680.903090:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786109680.903096:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933347712:0@lo:400:kworker.0 00000100:00100000:1.0:1786109680.903117:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109680.903130:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933348608:0@lo:400:kworker.0 00000100:00100000:1.0:1786109680.903146:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109680.903182:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933347968 00000100:00100000:1.0:1786109680.903188:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933347968 00000100:00100000:1.0:1786109680.903246:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933347712 00000100:00100000:1.0:1786109680.903250:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933347712 00000100:00100000:1.0:1786109680.903266:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933348608 00000100:00100000:1.0:1786109680.903269:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933348608 00000100:00100000:1.0:1786109680.903287:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1786109680.903295:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933347968:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109680.903315:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac173ca80 x1872862933347968/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:165/0 lens 224/224 e 0 to 0 dl 1786109705 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109680.903351:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933347968:12345-0@lo:400:kworker.0 Request processed in 56us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109680.903357:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1786109680.903373:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1786109680.903378:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933347712:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109680.903388:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac173c380 x1872862933347712/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:165/0 lens 224/224 e 0 to 0 dl 1786109705 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109680.903412:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933347712:12345-0@lo:400:kworker.0 Request processed in 34us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109680.903417:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1786109680.903454:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1786109680.903461:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933348608:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109680.903470:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac173d880 x1872862933348608/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:165/0 lens 224/224 e 0 to 0 dl 1786109705 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109680.903494:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933348608:12345-0@lo:400:kworker.0 Request processed in 34us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109680.903500:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:1.0:1786109680.903517:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109680.903552:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933347712:0@lo:400:kworker.0 00000100:00100000:1.0:1786109680.903564:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933348608:0@lo:400:kworker.0 00000100:00100000:1.0:1786109680.903572:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933347968:0@lo:400:kworker.0 00000100:00100000:0.0:1786109680.904345:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933348352:0@lo:400:kworker.0 00000100:00100000:0.0:1786109680.904389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109680.904427:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786109680.905032:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933347584:0@lo:400:kworker.0 00000100:00100000:0.0:1786109680.905068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109680.905095:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933348480:0@lo:400:kworker.0 00000100:00100000:0.0:1786109680.905114:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109680.906127:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933347840:0@lo:38:kworker.0 00000100:00100000:2.0:1786109680.906174:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109680.906212:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933348096:0@lo:38:kworker.0 00000100:00100000:2.0:1786109680.906233:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109680.906250:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933348224:0@lo:38:kworker.0 00000100:00100000:2.0:1786109680.906286:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109680.906322:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933348352 00000100:00100000:2.0:1786109680.906328:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933348352 00000100:00100000:2.0:1786109680.906382:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933348480 00000100:00100000:2.0:1786109680.906386:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933348480 00000100:00100000:2.0:1786109680.906407:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7084 00000100:00100000:2.0:1786109680.906416:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933348352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109680.906863:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933347840 00000100:00100000:0.0:1786109680.906868:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933347840 00000100:00100000:0.0:1786109680.906894:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933348096 00000100:00100000:0.0:1786109680.906897:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933348096 00000100:00100000:0.0:1786109680.906915:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1786109680.906921:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933347840:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109680.906941:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109680.907002:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933347840:12345-0@lo:38:kworker.0 Request processed in 80us (827us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109680.907009:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1786109680.907026:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1786109680.907030:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933348096:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109680.907039:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109680.907063:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933348096:12345-0@lo:38:kworker.0 Request processed in 31us (828us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109680.907068:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1786109680.907117:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7085 00000100:00100000:0.0:1786109680.907125:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933348480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109680.907163:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933348480:12345-0@lo:400:kworker.0 Request processed in 39us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109680.907168:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7085 00000100:00080000:0.0:1786109680.907186:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109680.907190:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109680.907221:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933348480:0@lo:400:kworker.0 00000100:00100000:3.0:1786109680.908203:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933347584 00000100:00100000:2.0:1786109680.908228:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933348352:12345-0@lo:400:kworker.0 Request processed in 1811us (3835us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109680.908238:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7084 00000100:00080000:2.0:1786109680.908288:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109680.908293:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109680.908297:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933347840:0@lo:38:kworker.0 00000100:00080000:2.0:1786109680.908307:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109680.908310:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109680.908313:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933348096:0@lo:38:kworker.0 00000100:00100000:2.0:1786109680.908342:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933348352:0@lo:400:kworker.0 00000100:00100000:3.0:1786109680.908366:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933347584 00000100:00100000:3.0:1786109680.908409:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1786109680.908417:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3646:x1872862933347584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109680.908482:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3646:x1872862933347584:12345-0@lo:400:kworker.0 Request processed in 66us (3413us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109680.908489:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1786109680.908526:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933348224 00000100:00100000:3.0:1786109680.908530:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933348224 00000100:00100000:3.0:1786109680.908552:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12472 00000100:00100000:3.0:1786109680.908558:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933348224:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109680.908578:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109680.908615:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933348224:12345-0@lo:38:kworker.0 Request processed in 57us (2328us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109680.908622:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12472 00000100:00080000:3.0:1786109680.908654:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109680.908658:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109680.908662:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933348224:0@lo:38:kworker.0 00000100:00100000:3.0:1786109680.908683:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933347584:0@lo:400:kworker.0 00010000:00010000:0.0:1786109681.734062:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109682.757027:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109683.727699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109683.727729:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109683.727767:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109683.727843:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109683.727870:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109683.727893:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922151680 00000100:00100000:1.0:1786109683.727902:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922151680 00000100:00100000:1.0:1786109683.727949:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922151808 00000100:00100000:1.0:1786109683.727953:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922151808 00000100:00100000:3.0:1786109683.728006:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922151424 00000100:00100000:3.0:1786109683.728011:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922151424 00000100:00100000:2.0:1786109683.728024:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922151552 00000100:00100000:2.0:1786109683.728027:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922151552 00000100:00100000:3.0:1786109683.728047:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 382 00000100:00100000:3.0:1786109683.728056:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922151424:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109683.728060:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1177 00000100:00100000:2.0:1786109683.728065:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922151552:12345-192.168.203.38@tcp:38:kworker.0 00010000:00000080:3.0:1786109683.728083:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac173f100 x1872862922151424/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:154/0 lens 224/224 e 0 to 0 dl 1786109694 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:2.0:1786109683.728083:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109683.728116:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922151296 00000100:00100000:0.0:1786109683.728122:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922151296 00000100:00100000:2.0:1786109683.728141:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922151552:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 73us (371us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109683.728150:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1177 00000100:00100000:0.0:1786109683.728161:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:0.0:1786109683.728172:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922151296:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109683.728200:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922151424:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 133us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109683.728207:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 382 00000100:00100000:0.0:1786109683.728213:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922151296:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 41us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109683.728222:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00080000:3.0:1786109683.728248:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786109683.728253:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109683.728255:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109683.728290:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23157 00000100:00100000:1.0:1786109683.728299:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fac74500-4523-4794-af20-dfdcdfae19c1+5:2401:x1872862922151680:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:1.0:1786109683.728320:0:8441:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca376fa 00000100:00080000:1.0:1786109683.728329:0:8441:0:(import.c:65:import_set_state_nolock()) ffff930ac0c89000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1786109683.728845:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23158 00000100:00100000:2.0:1786109683.728856:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:fac74500-4523-4794-af20-dfdcdfae19c1+5:2401:x1872862922151808:12345-192.168.203.38@tcp:9:kworker.0 00010000:00010000:0.0:1786109683.728864:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786109683.728872:0:43922:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37701 00000100:00080000:2.0:1786109683.728879:0:43922:0:(import.c:65:import_set_state_nolock()) ffff930ab9966800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1786109683.728900:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1786109683.728913:0:43922:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975836 00000001:00000004:1.0:1786109683.728959:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705678 00000100:00100000:1.0:1786109683.729701:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fac74500-4523-4794-af20-dfdcdfae19c1+2:2401:x1872862922151680:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 1400us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109683.729711:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23157 00000100:00100000:2.0:1786109683.730120:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:fac74500-4523-4794-af20-dfdcdfae19c1+2:2401:x1872862922151808:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 1264us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109683.730128:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23158 00010000:00010000:0.0:1786109683.781451:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109683.972744:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933348736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109683.972873:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109683.972989:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933348736 00000100:00100000:3.0:1786109683.972997:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933348736 00000100:00080000:0.0:1786109683.973055:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109683.973058:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5913 00000100:00100000:3.0:1786109683.973069:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933348736:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109683.973112:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933348864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109683.973144:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1786109683.973179:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141760 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109683.973247:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933348736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109683.973255:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5913 00000100:00100000:3.0:1786109683.973270:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933348864 00000100:00100000:3.0:1786109683.973273:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933348864 00000100:00100000:2.0:1786109683.973287:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933348736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109683.973368:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5914 00000100:00100000:1.0:1786109683.973376:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933348864:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786109683.973379:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1786109683.973394:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109683.973462:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933348864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109683.973468:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5914 00000100:00100000:0.0:1786109683.973620:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933348864:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786109684.804673:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109685.829100:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109686.020816:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933348992:0@lo:400:kworker.0 00000100:00100000:2.0:1786109686.020889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786109686.020948:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109686.020965:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1786109686.020968:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109686.020974:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8537 00000100:00080000:3.0:1786109686.020978:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1786109686.020983:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff930983499000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109686.021005:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930984ff3100 x1872862933349248/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109686.021030:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109686.021033:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1786109686.021035:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109686.021039:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8537 00000100:00080000:3.0:1786109686.021041:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1786109686.021046:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109686.021056:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930984ff0000 x1872862933349504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109686.021065:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109686.021067:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1786109686.021069:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1786109686.021202:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933349376:0@lo:400:kworker.0 00000100:00100000:2.0:1786109686.021248:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109686.021271:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109686.021277:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933349120:0@lo:400:kworker.0 00000100:00100000:2.0:1786109686.021298:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109686.021336:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933349376 00000100:00100000:2.0:1786109686.021343:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933349376 00000100:00100000:2.0:1786109686.021394:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933349120 00000100:00100000:2.0:1786109686.021397:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933349120 00000100:00100000:2.0:1786109686.021424:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1786109686.021461:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933349376:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109686.021483:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098490b800 x1872862933349376/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:157/0 lens 224/224 e 0 to 0 dl 1786109697 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109686.021523:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933349376:12345-0@lo:400:kworker.0 Request processed in 65us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109686.021531:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1786109686.021551:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1786109686.021558:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933349120:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109686.021569:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984909f80 x1872862933349120/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:157/0 lens 224/224 e 0 to 0 dl 1786109697 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109686.021596:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933349120:12345-0@lo:400:kworker.0 Request processed in 39us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109686.021602:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:2.0:1786109686.021624:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109686.021658:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933349120:0@lo:400:kworker.0 00000100:00100000:2.0:1786109686.021668:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933349376:0@lo:400:kworker.0 00000100:00100000:2.0:1786109686.021700:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933349248:0@lo:38:kworker.0 00000100:00100000:2.0:1786109686.021723:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109686.021741:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933349504:0@lo:38:kworker.0 00000100:00100000:2.0:1786109686.021759:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109686.021789:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933349248 00000100:00100000:2.0:1786109686.021793:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933349248 00000100:00100000:2.0:1786109686.021809:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933349504 00000100:00100000:2.0:1786109686.021812:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933349504 00000100:00100000:2.0:1786109686.021823:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1786109686.021827:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933349248:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109686.021844:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109686.021877:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933349248:12345-0@lo:38:kworker.0 Request processed in 48us (152us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109686.021883:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1786109686.021894:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:2.0:1786109686.021898:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933349504:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109686.021907:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109686.021930:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933349504:12345-0@lo:38:kworker.0 Request processed in 31us (170us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109686.021936:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00080000:2.0:1786109686.021973:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109686.021978:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109686.021981:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933349248:0@lo:38:kworker.0 00000100:00080000:2.0:1786109686.021988:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109686.021991:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109686.021993:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933349504:0@lo:38:kworker.0 00000100:00100000:0.0:1786109686.022132:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933348992 00000100:00100000:0.0:1786109686.022137:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933348992 00000100:00100000:0.0:1786109686.022178:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1786109686.022186:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3647:x1872862933348992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109686.022226:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3647:x1872862933348992:12345-0@lo:400:kworker.0 Request processed in 42us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109686.022232:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1786109686.022271:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933348992:0@lo:400:kworker.0 00000100:00080000:3.0:1786109686.022407:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8537 00000100:00080000:3.0:1786109686.022411:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1786109686.022416:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930985f23800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109686.022453:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930984ff0380 x1872862933349632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109686.022499:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933349632:0@lo:38:kworker.0 00000100:00100000:2.0:1786109686.022527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109686.022589:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933349632 00000100:00100000:0.0:1786109686.022593:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933349632 00000100:00100000:0.0:1786109686.022625:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12473 00000100:00100000:0.0:1786109686.022630:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933349632:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109686.022643:0:8451:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109686.022769:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109686.022777:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933350016:0@lo:400:kworker.0 00000100:00100000:3.0:1786109686.022809:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109686.022839:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933350016 00000100:00100000:3.0:1786109686.022843:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933350016 00000100:00100000:3.0:1786109686.022871:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1786109686.022877:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933350016:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109686.022889:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1d69500 x1872862933350016/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:157/0 lens 224/224 e 0 to 0 dl 1786109697 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109686.022920:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933350016:12345-0@lo:400:kworker.0 Request processed in 43us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109686.022925:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1786109686.022991:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933349760:0@lo:400:kworker.0 00000100:00100000:1.0:1786109686.023022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109686.023044:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109686.023052:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933349888:0@lo:400:kworker.0 00000100:00100000:1.0:1786109686.023071:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109686.023114:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933349760 00000100:00100000:1.0:1786109686.023117:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933349760 00000100:00100000:1.0:1786109686.023146:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933349888 00000100:00100000:1.0:1786109686.023148:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933349888 00000100:00100000:1.0:1786109686.023167:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7086 00000100:00100000:1.0:1786109686.023173:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933349760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109686.023205:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933349760:12345-0@lo:400:kworker.0 Request processed in 32us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109686.023211:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7086 00000100:00100000:1.0:1786109686.023220:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7087 00000100:00100000:1.0:1786109686.023226:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933349888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109686.023247:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933349888:12345-0@lo:400:kworker.0 Request processed in 23us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109686.023252:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7087 00000100:00080000:1.0:1786109686.023271:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109686.023274:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109686.023289:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933349888:0@lo:400:kworker.0 00000100:00100000:1.0:1786109686.023298:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933349760:0@lo:400:kworker.0 00000100:00100000:3.0:1786109686.023363:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933350016:0@lo:400:kworker.0 00000100:00100000:0.0:1786109686.023453:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933349632:12345-0@lo:38:kworker.0 Request processed in 821us (924us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109686.023460:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12473 00000100:00080000:2.0:1786109686.023524:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109686.023529:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109686.023532:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933349632:0@lo:38:kworker.0 00010000:00010000:2.0:1786109686.854880:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109687.878475:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109688.850782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109688.850857:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109688.850960:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922151936 00000100:00100000:3.0:1786109688.850970:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922151936 00000100:00100000:0.0:1786109688.850987:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922152064 00000100:00100000:0.0:1786109688.850993:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922152064 00000100:00100000:0.0:1786109688.851042:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 386 00000100:00100000:0.0:1786109688.851053:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922152064:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:0.0:1786109688.851105:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098490a680 x1872862922152064/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:159/0 lens 224/224 e 0 to 0 dl 1786109699 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109688.851167:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922152064:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 116us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109688.851175:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 386 00000100:00100000:3.0:1786109688.851295:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:3.0:1786109688.851305:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922151936:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109688.851334:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922151936:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109688.851560:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:0.0:1786109688.851851:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00080000:2.0:1786109688.852453:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109688.852469:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922152192 00000100:00100000:2.0:1786109688.852475:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922152192 00000100:00100000:2.0:1786109688.852566:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1180 00000100:00100000:2.0:1786109688.852573:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922152192:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:2.0:1786109688.852595:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109688.852640:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922152192:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 65us (789us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109688.852646:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1180 00010000:00010000:0.0:1786109688.900947:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109689.095325:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933350144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109689.095392:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109689.096519:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933350144 00000100:00100000:0.0:1786109689.096527:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933350144 00000100:00100000:0.0:1786109689.096584:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5915 00000100:00100000:0.0:1786109689.096594:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933350144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109689.096623:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141760 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109689.097281:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109689.097297:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933350272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109689.097413:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109689.097479:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933350272 00000100:00100000:1.0:1786109689.097484:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933350272 00000100:00100000:1.0:1786109689.097514:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5916 00000100:00100000:1.0:1786109689.097522:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933350272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786109689.097540:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109689.097577:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933350272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109689.097584:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5916 00000100:00100000:1.0:1786109689.097631:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933350272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109689.098288:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933350144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1693us (2892us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109689.098297:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5915 00000100:00080000:0.0:1786109689.098332:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109689.098337:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109689.099479:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933350144:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1786109689.101232:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:0.0:1786109689.101240:0:194579:0:(genops.c:906:class_export_put()) final put ffff930ac0c8b000/fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:0.0:1786109689.101269:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0c8b000/fac74500-4523-4794-af20-dfdcdfae19c1 for lustre-OST0000 00000020:00000080:0.0:1786109689.101309:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac0c89000 for lustre-OST0000 00000001:00100000:1.0:1786109689.101492:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:1.0:1786109689.101496:0:9518:0:(genops.c:906:class_export_put()) final put ffff930ac0c8e800/fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:0.0:1786109689.101627:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0c8e800/fac74500-4523-4794-af20-dfdcdfae19c1 for lustre-OST0001 00000020:00000080:0.0:1786109689.102137:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab9966800 for lustre-OST0001 00010000:00010000:0.0:1786109689.925560:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109690.948593:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109691.140986:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933350400:0@lo:400:kworker.0 00000100:00100000:1.0:1786109691.141075:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109691.141192:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933350400 00000100:00100000:0.0:1786109691.141200:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933350400 00000100:00100000:0.0:1786109691.141242:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786109691.141252:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3647:x1872862933350400:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786109691.141495:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109691.141501:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1786109691.141505:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109691.141510:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8542 00000100:00080000:3.0:1786109691.141515:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1786109691.141520:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff930983499000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109691.141540:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9674a80 x1872862933350656/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109691.141565:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109691.141569:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1786109691.141571:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109691.141574:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8542 00000100:00080000:3.0:1786109691.141577:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1786109691.141580:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109691.141590:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab992a680 x1872862933350912/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109691.141599:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786109691.141602:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1786109691.141604:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109691.141607:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8542 00000100:00080000:3.0:1786109691.141609:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1786109691.141612:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930985f23800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109691.141621:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab992b100 x1872862933351040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109691.141730:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933350656:0@lo:38:kworker.0 00000100:00100000:2.0:1786109691.141767:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109691.141795:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933350912:0@lo:38:kworker.0 00000100:00100000:2.0:1786109691.141816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109691.141832:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933351040:0@lo:38:kworker.0 00000100:00100000:2.0:1786109691.141855:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109691.141898:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933350656 00000100:00100000:2.0:1786109691.141903:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933350656 00000100:00100000:2.0:1786109691.141937:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933350912 00000100:00100000:2.0:1786109691.141941:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933350912 00000100:00100000:2.0:1786109691.141960:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1786109691.141965:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933350656:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109691.141982:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109691.142015:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933350656:12345-0@lo:38:kworker.0 Request processed in 48us (247us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109691.142022:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1786109691.142038:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1786109691.142042:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933350912:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109691.142050:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109691.142072:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933350912:12345-0@lo:38:kworker.0 Request processed in 29us (256us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109691.142077:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1786109691.142100:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933351040 00000100:00100000:2.0:1786109691.142103:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933351040 00000100:00100000:2.0:1786109691.142121:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12474 00000100:00100000:2.0:1786109691.142125:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933351040:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109691.142147:0:177399:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109691.142171:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933351040:12345-0@lo:38:kworker.0 Request processed in 45us (315us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109691.142177:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12474 00000100:00100000:2.0:1786109691.142203:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933351168:0@lo:400:kworker.0 00000100:00100000:2.0:1786109691.142229:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109691.142260:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933351168 00000100:00100000:2.0:1786109691.142263:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933351168 00000100:00100000:2.0:1786109691.142300:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7088 00000100:00100000:2.0:1786109691.142309:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933351168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109691.142348:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933351168:12345-0@lo:400:kworker.0 Request processed in 41us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109691.142353:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7088 00000100:00080000:2.0:1786109691.142368:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109691.142395:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933351168:0@lo:400:kworker.0 00000100:00080000:2.0:1786109691.142421:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109691.142425:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109691.142455:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933350656:0@lo:38:kworker.0 00000100:00080000:2.0:1786109691.142466:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109691.142469:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109691.142471:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933350912:0@lo:38:kworker.0 00000100:00080000:2.0:1786109691.142478:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109691.142481:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109691.142484:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933351040:0@lo:38:kworker.0 00000100:00100000:2.0:1786109691.142516:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933350528:0@lo:400:kworker.0 00000100:00100000:2.0:1786109691.142542:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109691.142560:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109691.142566:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933350784:0@lo:400:kworker.0 00000100:00100000:2.0:1786109691.142586:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109691.142608:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933350528 00000100:00100000:2.0:1786109691.142612:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933350528 00000100:00100000:2.0:1786109691.142638:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933350784 00000100:00100000:2.0:1786109691.142641:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933350784 00000100:00100000:2.0:1786109691.142659:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1786109691.142666:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933350528:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109691.142680:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab94c4700 x1872862933350528/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:162/0 lens 224/224 e 0 to 0 dl 1786109702 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109691.142713:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933350528:12345-0@lo:400:kworker.0 Request processed in 47us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109691.142719:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1786109691.142731:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1786109691.142737:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933350784:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109691.142748:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9674a80 x1872862933350784/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:162/0 lens 224/224 e 0 to 0 dl 1786109702 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109691.142773:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933350784:12345-0@lo:400:kworker.0 Request processed in 37us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109691.142779:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00080000:2.0:1786109691.142797:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109691.142814:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933350784:0@lo:400:kworker.0 00000100:00100000:2.0:1786109691.142827:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933350528:0@lo:400:kworker.0 00000100:00100000:0.0:1786109691.143044:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3647:x1872862933350400:12345-0@lo:400:kworker.0 Request processed in 1793us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109691.143052:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1786109691.143201:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109691.143210:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933351424:0@lo:400:kworker.0 00000100:00100000:3.0:1786109691.143237:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109691.143264:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933351424 00000100:00100000:3.0:1786109691.143268:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933351424 00000100:00100000:3.0:1786109691.143294:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1786109691.143301:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933351424:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109691.143314:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9929180 x1872862933351424/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:162/0 lens 224/224 e 0 to 0 dl 1786109702 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109691.143347:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933351424:12345-0@lo:400:kworker.0 Request processed in 47us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109691.143353:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1786109691.143380:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933351424:0@lo:400:kworker.0 00000100:00100000:2.0:1786109691.143534:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109691.143543:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933351296:0@lo:400:kworker.0 00000100:00100000:2.0:1786109691.143576:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109691.143652:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933351296 00000100:00100000:3.0:1786109691.143657:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933351296 00000100:00080000:2.0:1786109691.143742:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109691.143776:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7089 00000100:00100000:3.0:1786109691.143784:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9675500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933351296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109691.143827:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9675500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933351296:12345-0@lo:400:kworker.0 Request processed in 44us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109691.143834:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7089 00000100:00100000:2.0:1786109691.143884:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933351296:0@lo:400:kworker.0 00000100:00100000:1.0:1786109691.143958:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933350400:0@lo:400:kworker.0 00010000:00010000:0.0:1786109691.972609:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109692.996714:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109694.041307:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109694.053366:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109694.053415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109694.053476:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922152576 00000100:00100000:3.0:1786109694.053486:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922152576 00000100:00100000:3.0:1786109694.053524:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1183 00000100:00100000:3.0:1786109694.053532:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922152576:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:3.0:1786109694.053553:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109694.053618:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922152576:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 84us (258us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109694.053625:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1183 00000100:00100000:1.0:1786109694.062889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109694.063146:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922152320 00000100:00100000:2.0:1786109694.063156:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922152320 00000100:00100000:2.0:1786109694.063221:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:2.0:1786109694.063232:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922152320:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109694.063998:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922152448 00000100:00100000:1.0:1786109694.064004:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922152448 00000100:00100000:1.0:1786109694.064056:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 390 00000100:00100000:1.0:1786109694.064064:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922152448:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:1.0:1786109694.064086:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac173f480 x1872862922152448/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:165/0 lens 224/224 e 0 to 0 dl 1786109705 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786109694.064511:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109694.065363:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922152320:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 2127us (11941us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109694.065374:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:1.0:1786109694.065619:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922152448:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1553us (2741us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109694.065627:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 390 00000100:00100000:1.0:1786109694.213032:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933351680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109694.213104:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109694.213174:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933351552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109694.213198:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109694.213236:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933351680 00000100:00100000:1.0:1786109694.213243:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933351680 00000100:00100000:1.0:1786109694.213289:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933351552 00000100:00100000:1.0:1786109694.213292:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933351552 00000100:00100000:1.0:1786109694.215915:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5917 00000100:00100000:1.0:1786109694.215933:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933351680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786109694.215967:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109694.216049:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933351680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109694.216057:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5917 00000100:00100000:1.0:1786109694.216075:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5918 00000100:00100000:1.0:1786109694.216082:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933351552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109694.216099:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141760 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109694.216132:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933351552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (2933us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109694.216138:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5918 00000100:00100000:3.0:1786109694.216216:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933351680:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786109694.217417:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109694.217424:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109694.217503:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933351552:0@lo:13:osp-pre-1-0.0 00000020:01000004:1.0:1786109695.010168:0:198776:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1786109695.010173:0:198776:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1786109695.010175:0:198776:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1786109695.010282:0:198776:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff930ab1980800 00000020:01000004:1.0:1786109695.010298:0:198776:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1786109695.010312:0:198776:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1786109695.010325:0:198776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff930985214d40) 00000020:00000080:1.0:1786109695.010342:0:198776:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1786109695.077002:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1786109695.355710:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.356747:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1786109695.357223:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1786109695.357405:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1786109695.357627:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1786109695.358057:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1786109695.358502:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1786109695.358733:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1786109695.358978:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1786109695.359251:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1786109695.359474:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1786109695.359724:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1786109695.359916:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1786109695.360201:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1786109695.365294:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.365519:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.366086:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.366422:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.366761:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.367000:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.367287:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.367501:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.367712:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.367929:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.368219:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.368518:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.368743:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.368974:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.369262:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.369475:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.369687:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.369910:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.370179:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.370409:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.370729:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.370955:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.371234:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.371452:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.371691:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.371878:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.372297:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.372563:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.372780:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.372995:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1786109695.373297:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1786109695.373510:0:198776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00080000:01000000:1.0:1786109695.374277:0:198776:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1786109695.374634:0:198776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1786109695.374643:0:198776:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1786109695.374655:0:198776:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdb52b77d7ca37f51 00000020:01000004:1.0:1786109695.374662:0:198776:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1786109695.374686:0:198776:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1786109695.374689:0:198776:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1786109695.374695:0:198776:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1786109695.374719:0:198776:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1786109695.374723:0:198776:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1786109695.378661:0:198776:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:1.0:1786109695.378703:0:198776:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.138@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1786109695.378707:0:198776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1786109695.378709:0:198776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1786109695.378710:0:198776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109695.378711:0:198776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109695.378712:0:198776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109695.378714:0:198776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109695.378715:0:198776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786109695.378718:0:198776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109695.378719:0:198776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786109695.378722:0:198776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1786109695.378725:0:198776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786109695.378726:0:198776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1786109695.378727:0:198776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109695.378728:0:198776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109695.378729:0:198776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109695.378730:0:198776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109695.378731:0:198776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786109695.378733:0:198776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109695.378734:0:198776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786109695.378759:0:198776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1786109695.378778:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933351808:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1786109695.378845:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.378962:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8908b180 going to sleep for 11 seconds 00000100:00100000:2.0:1786109695.379009:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933351808 00000100:00100000:2.0:1786109695.379017:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933351808 00000100:00100000:2.0:1786109695.379074:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1786109695.379084:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:198776:x1872862933351808:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1786109695.379273:0:196397:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1786109695.379277:0:196397:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1786109695.379285:0:196397:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1786109695.379417:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:198776:x1872862933351808:12345-0@lo:253:mount.lustre.0 Request processed in 333us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.379426:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1786109695.379538:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933351808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1786109695.379548:0:198776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1786109695.379551:0:198776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786109695.379552:0:198776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1786109695.379553:0:198776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109695.379554:0:198776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109695.379555:0:198776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109695.379557:0:198776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109695.379558:0:198776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786109695.379559:0:198776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109695.379560:0:198776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1786109695.379578:0:198776:0:(tgt_mount.c:101:server_register_mount()) register mount ffff930ab1980800 from lustre-MDT0001 10000000:01000000:1.0:1786109695.379604:0:198776:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1786109695.379607:0:198776:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1786109695.379615:0:198776:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff930a8a73cd40 local copy 00010000:00010000:1.0:1786109695.379625:0:198776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374d8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109695.379702:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933351936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109695.379731:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.379770:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1300 going to sleep for 11 seconds 00000100:00100000:3.0:1786109695.379834:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933351936 00000100:00100000:3.0:1786109695.379839:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933351936 00000100:00100000:3.0:1786109695.379920:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1786109695.379928:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:198776:x1872862933351936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109695.379995:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:198776:x1872862933351936:12345-0@lo:501:mount.lustre.0 Request processed in 68us (263us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786109695.380003:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1786109695.380067:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933351936:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1786109695.380079:0:198776:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1786109695.380097:0:198776:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1786109695.380103:0:198776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374d8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.380182:0:198776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca374d8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109695.380212:0:198776:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff930ab1980800 10000000:01000000:1.0:1786109695.380218:0:198776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1786109695.380223:0:198776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff930ab1980800 10000000:01000000:1.0:1786109695.380226:0:198776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1786109695.380229:0:198776:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff930ab1980800 from 1 10000000:01000000:1.0:1786109695.380232:0:198776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1786109695.380254:0:198776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9453800/0xdb52b77d7ca37f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.380262:0:198776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9453800/0xdb52b77d7ca37f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.380271:0:198776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9453800/0xdb52b77d7ca37f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109695.380284:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933352064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109695.380310:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.380505:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1300 going to sleep for 11 seconds 00000100:00100000:2.0:1786109695.380597:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933352064 00000100:00100000:2.0:1786109695.380602:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933352064 00000100:00100000:2.0:1786109695.380639:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1786109695.380650:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:198776:x1872862933352064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109695.380660:0:196399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109695.380673:0:196399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930986424600/0xdb52b77d7ca37f5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37f58 expref: -99 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.380694:0:196399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930986424600/0xdb52b77d7ca37f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37f58 expref: 20 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.380704:0:196399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930986424600/0xdb52b77d7ca37f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37f58 expref: 20 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.380711:0:196399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986424600, rc 0) 00000100:00100000:2.0:1786109695.380746:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:198776:x1872862933352064:12345-0@lo:101:mount.lustre.0 Request processed in 98us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.380752:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1786109695.380831:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933352064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109695.380844:0:198776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9453800/0xdb52b77d7ca37f58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37f5f expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.380852:0:198776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9453800/0xdb52b77d7ca37f58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37f5f expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109695.380866:0:198776:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1786109695.380882:0:198776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9453800/0xdb52b77d7ca37f58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37f5f expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.380899:0:198776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9453800/0xdb52b77d7ca37f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37f5f expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109695.380906:0:198776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1786109695.380910:0:198776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786109695.380915:0:198776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff930ab1980800 10000000:01000000:1.0:1786109695.380917:0:198776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1786109695.380920:0:198776:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1786109695.380923:0:198776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1786109695.380936:0:198776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9453000/0xdb52b77d7ca37f66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.380944:0:198776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9453000/0xdb52b77d7ca37f66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.380952:0:198776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9453000/0xdb52b77d7ca37f66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109695.380969:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933352192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109695.380995:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.381018:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933352192 00000100:00100000:1.0:1786109695.381022:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933352192 00000100:00100000:1.0:1786109695.381043:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1786109695.381050:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:198776:x1872862933352192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109695.381067:0:196399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109695.381076:0:196399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9452600/0xdb52b77d7ca37f6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca37f66 expref: -99 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.381091:0:196399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9452600/0xdb52b77d7ca37f6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca37f66 expref: 21 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.381099:0:196399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9452600/0xdb52b77d7ca37f6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca37f66 expref: 21 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.381106:0:196399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9452600, rc 0) 00000100:00100000:1.0:1786109695.381196:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:198776:x1872862933352192:12345-0@lo:101:mount.lustre.0 Request processed in 146us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.381203:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1786109695.381229:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1300 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.381242:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933352192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109695.381252:0:198776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9453000/0xdb52b77d7ca37f66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37f6d expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.381259:0:198776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9453000/0xdb52b77d7ca37f66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37f6d expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109695.381420:0:198776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 46 count 46 00000040:00080000:1.0:1786109695.381729:0:198776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786109695.387350:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:1.0:1786109695.387407:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 136 off8552 00000040:00080000:1.0:1786109695.387427:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 176 off8728 00000040:00080000:1.0:1786109695.387485:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8952 00000040:00080000:1.0:1786109695.387501:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 224 off9176 00000040:00080000:1.0:1786109695.387516:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 120 off9296 00000040:00080000:1.0:1786109695.387531:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 112 off9408 00000040:00080000:1.0:1786109695.387547:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 160 off9568 00000040:00080000:1.0:1786109695.387562:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9792 00000040:00080000:1.0:1786109695.387578:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].10, 224 off10016 00000040:00080000:1.0:1786109695.387595:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].11, 88 off10104 00000040:00080000:1.0:1786109695.387611:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].12, 144 off10248 00000040:00080000:1.0:1786109695.387627:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].13, 152 off10400 00000040:00080000:1.0:1786109695.387642:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].14, 168 off10568 00000040:00080000:1.0:1786109695.387659:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].15, 224 off10792 00000040:00080000:1.0:1786109695.387674:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].16, 224 off11016 00000040:00080000:1.0:1786109695.387689:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].17, 80 off11096 00000040:00080000:1.0:1786109695.387704:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].18, 224 off11320 00000040:00080000:1.0:1786109695.387719:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].19, 224 off11544 00000040:00080000:1.0:1786109695.387734:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].20, 160 off11704 00000040:00080000:1.0:1786109695.387750:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].21, 224 off11928 00000040:00080000:1.0:1786109695.387765:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].22, 224 off12152 00000040:00080000:1.0:1786109695.387781:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].23, 80 off12232 00000040:00080000:1.0:1786109695.387797:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].24, 224 off12456 00000040:00080000:1.0:1786109695.387813:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].25, 224 off12680 00000040:00080000:1.0:1786109695.387828:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].26, 88 off12768 00000040:00080000:1.0:1786109695.387844:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].27, 144 off12912 00000040:00080000:1.0:1786109695.387859:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].28, 152 off13064 00000040:00080000:1.0:1786109695.387876:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].29, 136 off13200 00000040:00080000:1.0:1786109695.387907:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].30, 224 off13424 00000040:00080000:1.0:1786109695.387924:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].31, 224 off13648 00000040:00080000:1.0:1786109695.387938:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].32, 80 off13728 00000040:00080000:1.0:1786109695.387950:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].33, 224 off13952 00000040:00080000:1.0:1786109695.387963:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].34, 224 off14176 00000040:00080000:1.0:1786109695.387977:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].35, 88 off14264 00000040:00080000:1.0:1786109695.387991:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].36, 144 off14408 00000040:00080000:1.0:1786109695.388005:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].37, 152 off14560 00000040:00080000:1.0:1786109695.388020:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].38, 136 off14696 00000040:00080000:1.0:1786109695.388035:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].39, 224 off14920 00000040:00080000:1.0:1786109695.388050:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].40, 224 off15144 00000040:00080000:1.0:1786109695.388078:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].41, 80 off15224 00000040:00080000:1.0:1786109695.388093:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].42, 224 off15448 00000040:00080000:1.0:1786109695.388107:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].43, 224 off15672 00000040:00080000:1.0:1786109695.388291:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].44, 120 off15792 00000040:00080000:1.0:1786109695.388324:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].45, 224 off16016 00000040:00080000:1.0:1786109695.388330:0:198776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 45 count 46 00000100:00100000:1.0:1786109695.388484:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933352320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109695.388549:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.388588:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109695.388774:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933352320 00000100:00100000:3.0:1786109695.388782:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933352320 00000100:00100000:3.0:1786109695.388832:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786109695.388842:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:198776:x1872862933352320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109695.388993:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:198776:x1872862933352320:12345-0@lo:501:mount.lustre.0 Request processed in 152us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109695.389001:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786109695.389099:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933352320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109695.389253:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933352448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109695.389302:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109695.389335:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1786109695.389381:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933352448 00000100:00100000:3.0:1786109695.389385:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933352448 00000100:00100000:3.0:1786109695.389414:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786109695.389420:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:198776:x1872862933352448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109695.389522:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:198776:x1872862933352448:12345-0@lo:503:mount.lustre.0 Request processed in 101us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109695.389529:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1786109695.389631:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933352448:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1786109695.389993:0:198776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786109695.390051:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933352576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786109695.390099:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109695.390239:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0977840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.390354:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933352576 00000100:00100000:1.0:1786109695.390359:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933352576 00000100:00100000:1.0:1786109695.390579:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1786109695.390588:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:198776:x1872862933352576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786109695.391704:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:198776:x1872862933352576:12345-0@lo:502:mount.lustre.0 Request processed in 1111us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.391716:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1786109695.391861:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933352576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1786109695.392210:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:2.0:1786109695.392241:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 136 off8552 00000040:00080000:2.0:1786109695.392256:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 176 off8728 00000040:00080000:2.0:1786109695.392269:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8952 00000040:00080000:2.0:1786109695.392283:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 224 off9176 00000040:00080000:2.0:1786109695.392297:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 120 off9296 00000040:00080000:2.0:1786109695.392309:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 112 off9408 00000040:00080000:2.0:1786109695.392321:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 160 off9568 00000040:00080000:2.0:1786109695.392333:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9792 00000040:00080000:2.0:1786109695.392345:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].10, 224 off10016 00000040:00080000:2.0:1786109695.392358:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].11, 88 off10104 00000040:00080000:2.0:1786109695.392371:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].12, 144 off10248 00000040:00080000:2.0:1786109695.392384:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].13, 152 off10400 00000040:00080000:2.0:1786109695.392397:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].14, 168 off10568 00000040:00080000:2.0:1786109695.392409:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].15, 224 off10792 00000040:00080000:2.0:1786109695.392422:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].16, 224 off11016 00000040:00080000:2.0:1786109695.392653:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].17, 80 off11096 00000040:00080000:2.0:1786109695.392673:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].18, 224 off11320 00000040:00080000:2.0:1786109695.392688:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].19, 224 off11544 00000040:00080000:2.0:1786109695.392703:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].20, 160 off11704 00000040:00080000:2.0:1786109695.392717:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].21, 224 off11928 00000040:00080000:2.0:1786109695.392730:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].22, 224 off12152 00000040:00080000:2.0:1786109695.392744:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].23, 80 off12232 00000040:00080000:2.0:1786109695.392759:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].24, 224 off12456 00000040:00080000:2.0:1786109695.392772:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].25, 224 off12680 00000040:00080000:2.0:1786109695.392785:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].26, 88 off12768 00000040:00080000:2.0:1786109695.392798:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].27, 144 off12912 00000040:00080000:2.0:1786109695.392812:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].28, 152 off13064 00000040:00080000:2.0:1786109695.392826:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].29, 136 off13200 00000040:00080000:2.0:1786109695.392838:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].30, 224 off13424 00000040:00080000:2.0:1786109695.392850:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].31, 224 off13648 00000040:00080000:2.0:1786109695.392864:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].32, 80 off13728 00000040:00080000:2.0:1786109695.392877:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].33, 224 off13952 00000040:00080000:2.0:1786109695.392903:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].34, 224 off14176 00000040:00080000:2.0:1786109695.392920:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].35, 88 off14264 00000040:00080000:2.0:1786109695.392934:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].36, 144 off14408 00000040:00080000:2.0:1786109695.392947:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].37, 152 off14560 00000040:00080000:2.0:1786109695.392959:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].38, 136 off14696 00000040:00080000:2.0:1786109695.392972:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].39, 224 off14920 00000040:00080000:2.0:1786109695.392985:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].40, 224 off15144 00000040:00080000:2.0:1786109695.392998:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].41, 80 off15224 00000040:00080000:2.0:1786109695.393011:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].42, 224 off15448 00000040:00080000:2.0:1786109695.393024:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].43, 224 off15672 00000040:00080000:2.0:1786109695.393037:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].44, 120 off15792 00000100:00100000:2.0:1786109695.393087:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933352704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786109695.393270:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109695.393364:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1786109695.393407:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933352704 00000100:00100000:3.0:1786109695.393415:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933352704 00000100:00100000:3.0:1786109695.393605:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1786109695.393616:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:198776:x1872862933352704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109695.393746:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:198776:x1872862933352704:12345-0@lo:502:mount.lustre.0 Request processed in 132us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109695.393754:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1786109695.393844:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933352704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786109695.393916:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].45, 224 off16016 00000040:00080000:0.0:1786109695.393928:0:198776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1786109695.394693:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786109695.394704:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109695.394706:0:198780:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1786109695.394712:0:198780:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1786109695.394715:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786109695.394730:0:198780:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff930982728000) 00000020:00000080:0.0:1786109695.394751:0:198780:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:0.0:1786109695.394756:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1786109695.394830:0:198780:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1786109695.394837:0:198780:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdb52b77d7ca37f7b 00000020:00000080:0.0:1786109695.395041:0:198780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1786109695.395046:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786109695.395049:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109695.395050:0:198780:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1786109695.395053:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786109695.395068:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786109695.395069:0:198780:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1786109695.395073:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786109695.395079:0:198780:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9309827299c0) 00000020:00000080:0.0:1786109695.395092:0:198780:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:0.0:1786109695.395095:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1786109695.395097:0:198780:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1786109695.395101:0:198780:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1786109695.395107:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1786109695.395271:0:198780:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930ab1980800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1786109695.395285:0:198780:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff93098272b380) 00000020:00000080:0.0:1786109695.395295:0:198780:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:0.0:1786109695.395347:0:198780:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1786109695.395352:0:198780:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca37f90 00000020:00000080:0.0:1786109695.395506:0:198780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1786109695.395526:0:198780:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1786109695.395531:0:198780:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xdb52b77d7ca37f97 00080000:01000000:0.0:1786109695.395536:0:198780:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1786109695.395539:0:198780:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdb52b77d7ca37f9e 00010000:00010000:3.0:1786109695.474360:0:198780:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00080000:3.0:1786109695.474564:0:198780:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 25769804571 lx: 0 gen 85 00000001:00080000:3.0:1786109695.474602:0:198780:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: fac74500-4523-4794-af20-dfdcdfae19c1 idx: 1 lr: 0 srv lr: 25769804571 lx: 0 gen 84 00000001:00000004:3.0:1786109695.474623:0:198780:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 7, last_transno is 25769804571 00000001:00080000:3.0:1786109695.474701:0:198780:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1786109695.474830:0:198780:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff930ab7cc6300: xid 1872862922144768, transno 25769804642, client gen 84, slot idx 0 00000001:00080000:3.0:1786109695.474840:0:198780:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff930ab7cc66c0: xid 1872862922141056, transno 25769804641, client gen 84, slot idx 1 00000020:00000080:2.0:1786109695.479968:0:198780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1786109695.479982:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109695.479988:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.479991:0:198780:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1786109695.479994:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109695.480000:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.480002:0:198780:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1786109695.480005:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1786109695.480010:0:198780:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:2.0:1786109695.480035:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786109695.480050:0:198780:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9309835d19c0) 00000020:00000080:2.0:1786109695.480285:0:198780:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1786109695.480293:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1786109695.480362:0:198780:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1786109695.480368:0:198780:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1786109695.480374:0:198780:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdb52b77d7ca37fba 00010000:00080000:2.0:1786109695.480402:0:198780:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930a8a47d000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1786109695.484640:0:198780:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:2.0:1786109695.488645:0:198780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1786109695.488660:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1786109695.488699:0:198780:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1786109695.488719:0:198780:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca37fc1 00000100:00080000:2.0:1786109695.488729:0:198780:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786109695.488735:0:198780:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a8a47d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109695.488785:0:198780:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9674380 x1872862933352832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109695.488806:0:198780:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1786109695.488866:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109695.488871:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.488873:0:198780:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1786109695.488876:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1786109695.488879:0:198780:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1786109695.488881:0:198780:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786109695.488882:0:198780:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786109695.488884:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1786109695.488898:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.488900:0:198780:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1786109695.488903:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109695.488909:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.488910:0:198780:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1786109695.488914:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1786109695.488945:0:198780:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1786109695.488959:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109695.488962:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.488964:0:198780:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1786109695.488967:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1786109695.488968:0:198780:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1786109695.488970:0:198780:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786109695.488972:0:198780:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786109695.488974:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1786109695.488976:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.488978:0:198780:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1786109695.488980:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1786109695.488983:0:198780:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1786109695.488986:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.488987:0:198780:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1786109695.488990:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1786109695.488994:0:198780:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:2.0:1786109695.489017:0:198780:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1786109695.489019:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786109695.489031:0:198780:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff930ab1d48000) 00000020:00000080:2.0:1786109695.489047:0:198780:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1786109695.489052:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1786109695.489371:0:198780:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1786109695.489378:0:198780:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1786109695.489384:0:198780:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdb52b77d7ca37fcf 00010000:00080000:2.0:1786109695.489415:0:198780:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930a88c1b000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1786109695.489624:0:198780:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000100:00080000:0.0:1786109695.489907:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109695.489912:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1786109695.489915:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109695.489921:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8547 00000100:00080000:0.0:1786109695.489924:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109695.489928:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff930983499000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109695.489945:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1f52a00 x1872862933353088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109695.489971:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109695.489974:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1786109695.489975:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109695.489979:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8547 00000100:00080000:0.0:1786109695.489981:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109695.489985:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109695.489997:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1ff1880 x1872862933353344/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109695.490011:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109695.490013:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1786109695.490015:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109695.490019:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8547 00000100:00080000:0.0:1786109695.490021:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1786109695.490024:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930985f23800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109695.490034:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1ff2680 x1872862933353472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109695.490367:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933352960:0@lo:400:kworker.0 00000100:00100000:1.0:1786109695.490516:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933353728:0@lo:400:kworker.0 00000100:00100000:1.0:1786109695.490551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.490602:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933353728 00000100:00100000:1.0:1786109695.490609:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933353728 00000100:00100000:1.0:1786109695.490653:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7090 00000100:00100000:1.0:1786109695.490663:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933353728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109695.490714:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933353728:12345-0@lo:400:kworker.0 Request processed in 53us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.490721:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7090 00000100:00100000:1.0:1786109695.490772:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933353728:0@lo:400:kworker.0 00000100:00100000:0.0:1786109695.491853:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109695.491907:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933353856:0@lo:400:kworker.0 00000100:00100000:0.0:1786109695.491946:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109695.491979:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933353216:0@lo:400:kworker.0 00000100:00100000:0.0:1786109695.492001:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109695.492020:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109695.492025:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933353600:0@lo:400:kworker.0 00000100:00100000:0.0:1786109695.492047:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109695.492459:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933352832:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786109695.492501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109695.492544:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933353088:0@lo:38:kworker.0 00000100:00100000:2.0:1786109695.492568:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109695.492593:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933353344:0@lo:38:kworker.0 00000100:00100000:2.0:1786109695.492615:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109695.492632:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933353472:0@lo:38:kworker.0 00000100:00100000:2.0:1786109695.492671:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109695.492722:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933352960 00000100:00100000:2.0:1786109695.492729:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933352960 00000100:00100000:3.0:1786109695.493297:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933353856 00000100:00100000:3.0:1786109695.493302:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933353856 00000100:00100000:3.0:1786109695.493343:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933353216 00000100:00100000:3.0:1786109695.493346:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933353216 00000100:00100000:3.0:1786109695.493363:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933353088 00000100:00100000:3.0:1786109695.493365:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933353088 00000100:00100000:3.0:1786109695.493375:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933353344 00000100:00100000:3.0:1786109695.493377:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933353344 00000100:00100000:3.0:1786109695.493390:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1786109695.493398:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933353856:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109695.493422:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984cff800 x1872862933353856/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:166/0 lens 224/224 e 0 to 0 dl 1786109706 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109695.493488:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933353856:12345-0@lo:400:kworker.0 Request processed in 90us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109695.493495:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1786109695.493514:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1786109695.493521:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933353216:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109695.493532:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984cfdc00 x1872862933353216/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:166/0 lens 224/224 e 0 to 0 dl 1786109706 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109695.493564:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933353216:12345-0@lo:400:kworker.0 Request processed in 44us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109695.493570:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1786109695.493587:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1786109695.493591:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933353088:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1786109695.493637:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933353088:12345-0@lo:38:kworker.0 Request processed in 43us (1067us total) trans 0 rc -11/-11 00000100:00100000:3.0:1786109695.493643:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1786109695.493658:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1786109695.493662:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933353344:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1786109695.493691:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933353344:12345-0@lo:38:kworker.0 Request processed in 27us (1075us total) trans 0 rc -11/-11 00000100:00100000:3.0:1786109695.493700:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1786109695.493873:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933353600 00000100:00100000:0.0:1786109695.493878:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933353600 00000100:00100000:1.0:1786109695.493969:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933352832 00000100:00100000:1.0:1786109695.493973:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933352832 00000100:00100000:1.0:1786109695.493993:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933353472 00000100:00100000:1.0:1786109695.493996:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933353472 00000100:00100000:1.0:1786109695.494011:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12475 00000100:00100000:1.0:1786109695.494016:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933352832:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1786109695.494034:0:179257:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8552 last 0 00000100:00080000:3.0:1786109695.494344:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109695.494350:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1786109695.494354:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933353088:0@lo:38:kworker.0 00000100:00080000:3.0:1786109695.494366:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109695.494369:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1786109695.494372:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933353344:0@lo:38:kworker.0 00000100:00100000:0.0:1786109695.494482:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7091 00000100:00100000:0.0:1786109695.494490:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933353600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109695.494539:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933353600:12345-0@lo:400:kworker.0 Request processed in 50us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109695.494544:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7091 00000100:00100000:0.0:1786109695.494582:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12476 00000100:00100000:0.0:1786109695.494587:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933353472:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1786109695.494625:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933353472:12345-0@lo:38:kworker.0 Request processed in 37us (1954us total) trans 0 rc -11/-11 00000100:00100000:0.0:1786109695.494631:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12476 00000100:00100000:0.0:1786109695.494665:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933353856:0@lo:400:kworker.0 00000100:00100000:0.0:1786109695.494693:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933353600:0@lo:400:kworker.0 00000100:00100000:0.0:1786109695.494705:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933353216:0@lo:400:kworker.0 00000100:00080000:0.0:1786109695.494730:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109695.494734:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1786109695.494737:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933353472:0@lo:38:kworker.0 00000100:00100000:2.0:1786109695.494966:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1786109695.494975:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933352960:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109695.494990:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984cfc380 x1872862933352960/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:166/0 lens 224/224 e 0 to 0 dl 1786109706 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109695.495026:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933352960:12345-0@lo:400:kworker.0 Request processed in 54us (3178us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.495032:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000020:00000080:1.0:1786109695.495285:0:179257:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca37fd6 00000004:00100000:1.0:1786109695.495303:0:179257:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786109695.495403:0:179257:0:(import.c:65:import_set_state_nolock()) ffff93098650f800 : changing import state from RECOVER to FULL 00010000:00000080:1.0:1786109695.495417:0:179257:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9676d80 x1872862933352832/t0(0) o38->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1786109715 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109695.495476:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933352832:12345-0@lo:38:llog_process_th.0 Request processed in 1459us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.495483:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12475 00000100:00080000:1.0:1786109695.495502:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109695.496025:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933352960:0@lo:400:kworker.0 00000100:00100000:0.0:1786109695.496072:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786109695.496265:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 80 00000100:00080000:0.0:1786109695.496276:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1786109695.496282:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786109695.496286:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786109695.496297:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933352832:0@lo:38:llog_process_th.0 00000040:01000000:0.0:1786109695.496451:0:198780:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1786109695.496479:0:198780:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1786109695.496968:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933353984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109695.497027:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109695.497296:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933353984 00000100:00100000:2.0:1786109695.497304:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933353984 00000100:00100000:2.0:1786109695.497354:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12477 00000100:00100000:2.0:1786109695.497364:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933353984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109695.497394:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00010000:00000080:2.0:1786109695.497410:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9928e00 x1872862933353984/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 224/368 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109695.497477:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933353984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.497484:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12477 00000100:00100000:3.0:1786109695.498325:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933353984:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1786109695.498426:0:198780:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 5, last_idx 6 00000040:00080000:0.0:1786109695.501279:0:198780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786109695.501315:0:198780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].7, 64 off8640 00000040:00080000:0.0:1786109695.501496:0:198780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].1, 64 off8256 00000020:00000080:1.0:1786109695.503669:0:198780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1786109695.503685:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1786109695.503724:0:198780:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1786109695.503742:0:198780:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca37fdd 00000100:00080000:1.0:1786109695.503764:0:198780:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786109695.503771:0:198780:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930a88c1b000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109695.503806:0:198780:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930984ff0000 x1872862933354112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109695.503828:0:198780:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1786109695.503897:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109695.503902:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109695.503904:0:198780:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1786109695.503907:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1786109695.503910:0:198780:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1786109695.503912:0:198780:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786109695.503913:0:198780:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786109695.503915:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1786109695.503917:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109695.503918:0:198780:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1786109695.503921:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786109695.503925:0:198780:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1786109695.503928:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109695.503929:0:198780:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1786109695.503933:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1786109695.503936:0:198780:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:1.0:1786109695.503960:0:198780:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1786109695.503964:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786109695.503976:0:198780:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9309852119c0) 00000020:00000080:1.0:1786109695.503994:0:198780:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1786109695.503999:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1786109695.504300:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933354112:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1786109695.504367:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109695.504426:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933354112 00000100:00100000:2.0:1786109695.504454:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933354112 00000100:00100000:2.0:1786109695.504488:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23159 00000100:00100000:2.0:1786109695.504496:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:0+-99:3645:x1872862933354112:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1786109695.504523:0:179238:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8552 last 0 00000020:00000080:2.0:1786109695.504546:0:179238:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca37feb 00002000:00100000:2.0:1786109695.504559:0:179238:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff930a88c19800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1786109695.504563:0:179238:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1786109695.504566:0:179238:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1786109695.504636:0:179238:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1786109695.504658:0:179238:0:(import.c:65:import_set_state_nolock()) ffff930a88c1e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109695.504707:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933354112:12345-0@lo:8:llog_process_th.0 Request processed in 210us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.504715:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23159 00000100:00100000:2.0:1786109695.504824:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786109695.504834:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 9 00000100:00080000:2.0:1786109695.504841:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1786109695.504846:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1786109695.504849:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a88c1b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1786109695.504853:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1786109695.504857:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933354112:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1786109695.504949:0:198780:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1786109695.504955:0:198780:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1786109695.504962:0:198780:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdb52b77d7ca37ff2 00010000:00080000:1.0:1786109695.504990:0:198780:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930ac1259800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1786109695.505330:0:198780:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1786109695.505395:0:198780:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1786109695.505410:0:198780:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1786109695.505640:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109695.505653:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933354240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109695.505705:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.505747:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933354240 00000040:00080000:0.0:1786109695.505902:0:198785:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:0.0:1786109695.505908:0:198785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1786109695.506070:0:198785:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 6, last_idx 7 00000040:00080000:0.0:1786109695.506217:0:198785:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x18:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1786109695.506334:0:198785:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1786109695.506337:0:198785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1c:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1786109695.506352:0:198785:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1786109695.506375:0:198785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8552172944077ns, next at 0ns, rc = 0 00080000:00080000:0.0:1786109695.506381:0:198785:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1786109695.507295:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933354240 00000100:00100000:1.0:1786109695.507357:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5919 00000100:00100000:1.0:1786109695.507367:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933354240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109695.507395:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109695.507484:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933354240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.507491:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5919 00000100:00080000:1.0:1786109695.507514:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109695.507557:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933354240:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1786109695.510370:0:198777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000040:00080000:2.0:1786109695.510733:0:198780:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 5, last_idx 6 00000040:00080000:2.0:1786109695.511979:0:198780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786109695.512012:0:198780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].7, 64 off8640 00000040:00080000:2.0:1786109695.512332:0:198780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].1, 64 off8256 00000040:00080000:3.0:1786109695.513218:0:198787:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:3.0:1786109695.513223:0:198787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1786109695.513359:0:198787:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 6, last_idx 7 00000040:00080000:3.0:1786109695.513376:0:198787:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x1a:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1786109695.513572:0:198787:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1786109695.513576:0:198787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 7 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1786109695.514776:0:198780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1786109695.514790:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1786109695.514832:0:198780:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1786109695.514852:0:198780:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca37ff9 00000100:00080000:2.0:1786109695.514862:0:198780:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786109695.514869:0:198780:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff930ac1259800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109695.514919:0:198780:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a97809f80 x1872862933354368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109695.515052:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933354368:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1786109695.515307:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109695.515375:0:198780:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1786109695.515467:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109695.515471:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.515473:0:198780:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1786109695.515477:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109695.515482:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.515484:0:198780:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786109695.515487:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786109695.515489:0:198780:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1786109695.515492:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109695.515494:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.515496:0:198780:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1786109695.515498:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109695.515500:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.515502:0:198780:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1786109695.515506:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1786109695.515539:0:198780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109695.515543:0:198780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.515544:0:198780:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1786109695.515547:0:198780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 46 count 46 00000100:00100000:3.0:1786109695.515726:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933354368 00000100:00100000:3.0:1786109695.515734:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933354368 00000100:00100000:3.0:1786109695.515854:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23160 00000100:00100000:3.0:1786109695.515862:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:0+-99:3645:x1872862933354368:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1786109695.515904:0:179254:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8552 last 0 00000020:00000080:3.0:1786109695.515932:0:179254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca38000 00002000:00100000:3.0:1786109695.515944:0:179254:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff930a87b29000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1786109695.515948:0:179254:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1786109695.515951:0:179254:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1786109695.516022:0:179254:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1786109695.516047:0:179254:0:(import.c:65:import_set_state_nolock()) ffff930a87b2a000 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1786109695.516334:0:198776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1786109695.516371:0:198776:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1786109695.516389:0:198776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9453000/0xdb52b77d7ca37f66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37f6d expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.516400:0:198776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9453000/0xdb52b77d7ca37f66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37f6d expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109695.516408:0:198776:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930ab1980800 from 1 10000000:01000000:1.0:1786109695.516411:0:198776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786109695.516459:0:198776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.516466:0:198776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.516476:0:198776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109695.516493:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933354496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109695.516530:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.516560:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.516581:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933354496 00000100:00100000:1.0:1786109695.516584:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933354496 00000100:00100000:1.0:1786109695.516616:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786109695.516623:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:198776:x1872862933354496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109695.516632:0:196397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109695.516646:0:196397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9452800/0xdb52b77d7ca3800e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38007 expref: -99 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.516668:0:196397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9452800/0xdb52b77d7ca3800e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38007 expref: 22 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.516677:0:196397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9452800/0xdb52b77d7ca3800e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38007 expref: 22 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.516685:0:196397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9452800, rc 0) 00000100:00100000:1.0:1786109695.516715:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:198776:x1872862933354496:12345-0@lo:101:mount.lustre.0 Request processed in 91us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.516723:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786109695.516872:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933354496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109695.516885:0:198776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3800e expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.516907:0:198776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3800e expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109695.517690:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933354624:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1786109695.517741:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.517846:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109695.518027:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933354624 00000100:00100000:2.0:1786109695.518033:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933354624 00000100:00100000:2.0:1786109695.518265:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1786109695.518275:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:198776:x1872862933354624:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1786109695.518294:0:196399:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1786109695.518311:0:196399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1786109695.518315:0:196399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1786109695.518318:0:196399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1786109695.518322:0:196399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1786109695.518324:0:196399:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 333 00000100:00100000:2.0:1786109695.518413:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:198776:x1872862933354624:12345-0@lo:256:mount.lustre.0 Request processed in 139us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.518421:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1786109695.518541:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933354624:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1786109695.519590:0:198776:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786109695.519610:0:198776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3800e expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.519623:0:198776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3800e expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109695.519632:0:198776:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930ab1980800 from 1 10000000:01000000:1.0:1786109695.519635:0:198776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786109695.519665:0:198776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9452400/0xdb52b77d7ca38015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.519673:0:198776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9452400/0xdb52b77d7ca38015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.519689:0:198776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9452400/0xdb52b77d7ca38015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109695.519709:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933354752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109695.519931:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.519974:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109695.520040:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933354752 00000100:00100000:2.0:1786109695.520047:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933354752 00000100:00100000:2.0:1786109695.520289:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1786109695.520300:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:198776:x1872862933354752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109695.520313:0:196397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109695.520327:0:196397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930986425600/0xdb52b77d7ca3801c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38015 expref: -99 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.520351:0:196397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930986425600/0xdb52b77d7ca3801c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38015 expref: 23 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.520362:0:196397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930986425600/0xdb52b77d7ca3801c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38015 expref: 23 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.520371:0:196397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986425600, rc 0) 00000100:00100000:2.0:1786109695.520411:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:198776:x1872862933354752:12345-0@lo:101:mount.lustre.0 Request processed in 114us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.520418:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1786109695.520604:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933354368:12345-0@lo:8:llog_process_th.0 Request processed in 4739us (5295us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109695.520613:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23160 00000100:00100000:1.0:1786109695.520703:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933354752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109695.520717:0:198776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9452400/0xdb52b77d7ca38015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3801c expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.520726:0:198776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9452400/0xdb52b77d7ca38015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3801c expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109695.520966:0:198776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 7 count 7 00000040:00080000:1.0:1786109695.521531:0:198776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786109695.521717:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:1.0:1786109695.521743:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 112 off8528 00000040:00080000:1.0:1786109695.527525:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 224 off8752 00000040:00080000:1.0:1786109695.527559:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8976 00000040:00080000:1.0:1786109695.527578:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 112 off9088 00000040:00080000:1.0:1786109695.527611:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 224 off9312 00000040:00080000:1.0:1786109695.527618:0:198776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 6 count 7 00000100:00100000:1.0:1786109695.527748:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933354880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109695.527832:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.528604:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109695.528877:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786109695.528901:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1786109695.528912:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1786109695.528918:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1786109695.528921:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ac1259800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1786109695.528950:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1786109695.528958:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933354368:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1786109695.529529:0:198787:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1786109695.529603:0:198787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8552196171793ns, next at 0ns, rc = 0 00080000:00080000:3.0:1786109695.529610:0:198787:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1786109695.532708:0:198777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1786109695.533582:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933355008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109695.533655:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.533897:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933355008 00000100:00100000:1.0:1786109695.533905:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933355008 00000100:00100000:1.0:1786109695.533969:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5920 00000100:00100000:1.0:1786109695.533980:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933355008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109695.534011:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141760 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109695.534066:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933355008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.534073:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5920 00000100:00100000:2.0:1786109695.534241:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933354880 00000100:00100000:2.0:1786109695.534247:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933354880 00000100:00100000:2.0:1786109695.534291:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1786109695.534299:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:198776:x1872862933354880:12345-0@lo:501:mount.lustre.0 00000100:00080000:0.0:1786109695.534500:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109695.534540:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933355008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109695.534567:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:198776:x1872862933354880:12345-0@lo:501:mount.lustre.0 Request processed in 266us (6732us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.534577:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1786109695.535240:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933354880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109695.535285:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109695.535341:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.535376:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786109695.535573:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933355136 00000100:00100000:2.0:1786109695.535579:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933355136 00000100:00100000:2.0:1786109695.535616:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1786109695.535625:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:198776:x1872862933355136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109695.535734:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:198776:x1872862933355136:12345-0@lo:503:mount.lustre.0 Request processed in 109us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.535742:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1786109695.536331:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355136:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1786109695.536850:0:198776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786109695.537056:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109695.537393:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109695.538003:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab2a9c540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109695.538317:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933355264 00000100:00100000:2.0:1786109695.538325:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933355264 00000100:00100000:2.0:1786109695.538503:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1786109695.538514:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:198776:x1872862933355264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786109695.538659:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985cc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:198776:x1872862933355264:12345-0@lo:502:mount.lustre.0 Request processed in 147us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.538667:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1786109695.538882:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786109695.539559:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:3.0:1786109695.539594:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 112 off8528 00000040:00080000:3.0:1786109695.539609:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 224 off8752 00000040:00080000:3.0:1786109695.539624:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8976 00000040:00080000:3.0:1786109695.539637:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 112 off9088 00000100:00100000:3.0:1786109695.539673:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109695.539728:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109695.539761:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab2a9c540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109695.540045:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933355392 00000100:00100000:2.0:1786109695.540052:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933355392 00000100:00100000:2.0:1786109695.540214:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1786109695.540223:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930985cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:198776:x1872862933355392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786109695.540329:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930985cc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:198776:x1872862933355392:12345-0@lo:502:mount.lustre.0 Request processed in 107us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.540337:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1786109695.541169:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786109695.541244:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 224 off9312 00000040:00080000:3.0:1786109695.541257:0:198776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:2.0:1786109695.542241:0:198789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109695.542251:0:198789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.542253:0:198789:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1786109695.542261:0:198789:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff930ab1980800 00000020:00000080:2.0:1786109695.542264:0:198789:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786109695.542273:0:198789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109695.542275:0:198789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.542277:0:198789:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1786109695.542279:0:198789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109695.542282:0:198789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.542283:0:198789:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1786109695.542288:0:198789:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff930ab1980800 00000020:00000080:2.0:1786109695.542290:0:198789:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786109695.542356:0:198789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109695.542360:0:198789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109695.542362:0:198789:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1786109695.542365:0:198789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 7 count 7 00000020:01000000:1.0:1786109695.556571:0:198776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1786109695.556627:0:198776:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786109695.556657:0:198776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9452400/0xdb52b77d7ca38015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3801c expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.556671:0:198776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9452400/0xdb52b77d7ca38015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3801c expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109695.556734:0:198776:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1786109695.556738:0:198776:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff930ab1980800 10000000:01000000:1.0:1786109695.556740:0:198776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff930ab1980800 10000000:01000000:1.0:1786109695.556744:0:198776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786109695.556749:0:198776:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930ab1980800 from 1 10000000:01000000:1.0:1786109695.556752:0:198776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786109695.556789:0:198776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9453a00/0xdb52b77d7ca38023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.556798:0:198776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9453a00/0xdb52b77d7ca38023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.556810:0:198776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9453a00/0xdb52b77d7ca38023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109695.556834:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109695.556915:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.556959:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1300 going to sleep for 11 seconds 00000100:00100000:3.0:1786109695.579033:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933355520 00000100:00100000:3.0:1786109695.579047:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933355520 00000100:00100000:3.0:1786109695.579259:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1786109695.579271:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:198776:x1872862933355520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786109695.579290:0:196397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109695.579311:0:196397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f07200/0xdb52b77d7ca3802a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38023 expref: -99 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109695.579347:0:196397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f07200/0xdb52b77d7ca3802a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38023 expref: 24 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109695.579360:0:196397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f07200/0xdb52b77d7ca3802a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38023 expref: 24 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109695.579369:0:196397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07200, rc 0) 00000100:00100000:3.0:1786109695.582232:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933355520:12345-0@lo:101:mount.lustre.0 Request processed in 2953us (25306us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109695.582245:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1786109695.582505:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109695.582531:0:198776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9453a00/0xdb52b77d7ca38023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3802a expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.582544:0:198776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9453a00/0xdb52b77d7ca38023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3802a expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109695.582781:0:198776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 52 count 51 00000040:00080000:1.0:1786109695.583214:0:198776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786109695.583401:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].1, 224 off8416 00000040:00080000:1.0:1786109695.583426:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].2, 120 off8536 00000040:00080000:1.0:1786109695.583467:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].3, 168 off8704 00000040:00080000:1.0:1786109695.583478:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].4, 224 off8928 00000040:00080000:1.0:1786109695.583489:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].5, 224 off9152 00000040:00080000:1.0:1786109695.583500:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].6, 120 off9272 00000040:00080000:1.0:1786109695.583510:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].7, 168 off9440 00000040:00080000:1.0:1786109695.583520:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].8, 224 off9664 00000040:00080000:1.0:1786109695.583531:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].9, 224 off9888 00000040:00080000:1.0:1786109695.583543:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].10, 120 off10008 00000040:00080000:1.0:1786109695.583556:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].11, 224 off10232 00000040:00080000:1.0:1786109695.583567:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].12, 224 off10456 00000040:00080000:1.0:1786109695.583578:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].13, 88 off10544 00000040:00080000:1.0:1786109695.583590:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].14, 128 off10672 00000040:00080000:1.0:1786109695.583601:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].15, 144 off10816 00000040:00080000:1.0:1786109695.583613:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].16, 160 off10976 00000040:00080000:1.0:1786109695.583624:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].17, 224 off11200 00000040:00080000:1.0:1786109695.583636:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].18, 224 off11424 00000040:00080000:1.0:1786109695.583649:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].19, 80 off11504 00000040:00080000:1.0:1786109695.583660:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].20, 224 off11728 00000040:00080000:1.0:1786109695.583675:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].21, 224 off11952 00000040:00080000:1.0:1786109695.583688:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].22, 88 off12040 00000040:00080000:1.0:1786109695.583698:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].23, 128 off12168 00000040:00080000:1.0:1786109695.583710:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].24, 144 off12312 00000040:00080000:1.0:1786109695.583722:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].25, 160 off12472 00000040:00080000:1.0:1786109695.583734:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].26, 224 off12696 00000040:00080000:1.0:1786109695.583746:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].27, 224 off12920 00000040:00080000:1.0:1786109695.583758:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].28, 80 off13000 00000040:00080000:1.0:1786109695.583769:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].29, 224 off13224 00000040:00080000:1.0:1786109695.583782:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].30, 224 off13448 00000040:00080000:1.0:1786109695.583796:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].31, 88 off13536 00000040:00080000:1.0:1786109695.583809:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].32, 128 off13664 00000040:00080000:1.0:1786109695.583822:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].33, 144 off13808 00000040:00080000:1.0:1786109695.583836:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].34, 128 off13936 00000040:00080000:1.0:1786109695.583850:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].35, 224 off14160 00000040:00080000:1.0:1786109695.583864:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].36, 224 off14384 00000040:00080000:1.0:1786109695.583878:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].37, 80 off14464 00000040:00080000:1.0:1786109695.583907:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].38, 224 off14688 00000040:00080000:1.0:1786109695.583922:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].39, 224 off14912 00000040:00080000:1.0:1786109695.584509:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].40, 88 off15000 00000040:00080000:1.0:1786109695.584532:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].41, 128 off15128 00000040:00080000:1.0:1786109695.584546:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].42, 144 off15272 00000040:00080000:1.0:1786109695.584560:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].43, 128 off15400 00000040:00080000:1.0:1786109695.584574:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].44, 224 off15624 00000040:00080000:1.0:1786109695.584587:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].45, 224 off15848 00000040:00080000:1.0:1786109695.584599:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].46, 80 off15928 00000040:00080000:1.0:1786109695.584612:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].47, 224 off16152 00000040:00080000:1.0:1786109695.584625:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].48, 232 off16384 00000040:00080000:1.0:1786109695.584771:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].49, 224 off16608 00000040:00080000:1.0:1786109695.584793:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].50, 120 off16728 00000040:00080000:1.0:1786109695.584814:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x29:0x0].51, 224 off16952 00000040:00080000:1.0:1786109695.584820:0:198776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 51 count 51 00000100:00100000:1.0:1786109695.585003:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109695.585192:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109695.585332:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933355648 00000100:00100000:3.0:1786109695.585340:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933355648 00000100:00100000:1.0:1786109695.615818:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109695.659514:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1786109695.659537:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933355648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109695.659722:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933355648:12345-0@lo:501:mount.lustre.0 Request processed in 196us (74529us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109695.659733:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1786109695.660362:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109695.660413:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109695.661246:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109695.661289:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab2a9c240 going to sleep for 11 seconds 00000100:00100000:2.0:1786109695.661582:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933355776 00000100:00100000:2.0:1786109695.661589:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933355776 00000100:00100000:2.0:1786109695.661675:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1786109695.661685:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933355776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109695.662195:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933355776:12345-0@lo:503:mount.lustre.0 Request processed in 510us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.662204:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1786109695.662522:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355776:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1786109695.665217:0:198776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786109695.665312:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786109695.665400:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109695.665481:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933355904 00000100:00100000:0.0:1786109695.665489:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933355904 00000100:00100000:0.0:1786109695.665536:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1786109695.665546:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933355904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786109695.665656:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933355904:12345-0@lo:502:mount.lustre.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109695.665664:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1786109695.666535:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81377240 going to sleep for 11 seconds 00000100:00100000:2.0:1786109695.666564:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933355904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1786109695.667255:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].1, 224 off8416 00000040:00080000:2.0:1786109695.667293:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].2, 120 off8536 00000040:00080000:2.0:1786109695.667310:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].3, 168 off8704 00000040:00080000:2.0:1786109695.667324:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].4, 224 off8928 00000040:00080000:2.0:1786109695.667336:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].5, 224 off9152 00000040:00080000:2.0:1786109695.667347:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].6, 120 off9272 00000040:00080000:2.0:1786109695.667359:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].7, 168 off9440 00000040:00080000:2.0:1786109695.667372:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].8, 224 off9664 00000040:00080000:2.0:1786109695.667386:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].9, 224 off9888 00000040:00080000:2.0:1786109695.667399:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].10, 120 off10008 00000040:00080000:2.0:1786109695.667415:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].11, 224 off10232 00000040:00080000:2.0:1786109695.667459:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].12, 224 off10456 00000040:00080000:2.0:1786109695.667478:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].13, 88 off10544 00000040:00080000:2.0:1786109695.667493:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].14, 128 off10672 00000040:00080000:2.0:1786109695.667506:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].15, 144 off10816 00000040:00080000:2.0:1786109695.667520:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].16, 160 off10976 00000040:00080000:2.0:1786109695.667535:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].17, 224 off11200 00000040:00080000:2.0:1786109695.667550:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].18, 224 off11424 00000040:00080000:2.0:1786109695.667562:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].19, 80 off11504 00000040:00080000:2.0:1786109695.667573:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].20, 224 off11728 00000040:00080000:2.0:1786109695.667587:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].21, 224 off11952 00000040:00080000:2.0:1786109695.667601:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].22, 88 off12040 00000040:00080000:2.0:1786109695.667615:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].23, 128 off12168 00000040:00080000:2.0:1786109695.667629:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].24, 144 off12312 00000040:00080000:2.0:1786109695.667645:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].25, 160 off12472 00000040:00080000:2.0:1786109695.667657:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].26, 224 off12696 00000040:00080000:2.0:1786109695.667669:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].27, 224 off12920 00000040:00080000:2.0:1786109695.667680:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].28, 80 off13000 00000040:00080000:2.0:1786109695.667692:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].29, 224 off13224 00000040:00080000:2.0:1786109695.667705:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].30, 224 off13448 00000040:00080000:2.0:1786109695.667716:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].31, 88 off13536 00000040:00080000:2.0:1786109695.667729:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].32, 128 off13664 00000040:00080000:2.0:1786109695.667742:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].33, 144 off13808 00000040:00080000:2.0:1786109695.667772:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].34, 128 off13936 00000040:00080000:2.0:1786109695.667799:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].35, 224 off14160 00000040:00080000:2.0:1786109695.667815:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].36, 224 off14384 00000040:00080000:2.0:1786109695.667829:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].37, 80 off14464 00000040:00080000:2.0:1786109695.667843:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].38, 224 off14688 00000040:00080000:2.0:1786109695.667858:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].39, 224 off14912 00000040:00080000:2.0:1786109695.667872:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].40, 88 off15000 00000040:00080000:2.0:1786109695.667898:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].41, 128 off15128 00000040:00080000:2.0:1786109695.667915:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].42, 144 off15272 00000040:00080000:2.0:1786109695.667931:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].43, 128 off15400 00000040:00080000:2.0:1786109695.667946:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].44, 224 off15624 00000040:00080000:2.0:1786109695.667962:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].45, 224 off15848 00000040:00080000:2.0:1786109695.667974:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].46, 80 off15928 00000040:00080000:2.0:1786109695.667985:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].47, 224 off16152 00000040:00080000:2.0:1786109695.667999:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].48, 232 off16384 00000100:00100000:2.0:1786109695.668047:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933356032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786109695.669742:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109695.670221:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a81377240 going to sleep for 11 seconds 00000100:00100000:3.0:1786109695.670278:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933356032 00000100:00100000:3.0:1786109695.670286:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933356032 00000100:00100000:3.0:1786109695.670342:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1786109695.670351:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac10ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933356032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109695.670537:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac10ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933356032:12345-0@lo:502:mount.lustre.0 Request processed in 187us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109695.670546:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1786109695.670961:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933356032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786109695.671195:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].49, 224 off16608 00000040:00080000:1.0:1786109695.671223:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].50, 120 off16728 00000100:00100000:1.0:1786109695.671257:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933356160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786109695.671299:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109695.671353:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933356160 00000100:00100000:0.0:1786109695.671359:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933356160 00000100:00100000:0.0:1786109695.671405:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1786109695.671413:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933356160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786109695.671771:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933356160:12345-0@lo:502:mount.lustre.0 Request processed in 359us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109695.671779:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1786109695.671844:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.671858:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933356160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786109695.671913:0:198776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2a:0x0].51, 224 off16952 00000040:00080000:1.0:1786109695.671922:0:198776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1786109695.672795:0:198792:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1786109695.672811:0:198792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff930ab1d419c0) 00000020:00000080:3.0:1786109695.672835:0:198792:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1786109695.673037:0:198792:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930ab1980800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1786109695.673042:0:198792:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930ab1980800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1786109695.673045:0:198792:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab1980800 3 00010000:00080000:3.0:1786109695.673073:0:198792:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930ab8da3000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1786109695.683621:0:198792:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:2.0:1786109695.683729:0:198792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1786109695.683774:0:198792:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1786109695.683786:0:198792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xdb52b77d7ca38038 00000100:00080000:2.0:1786109695.683796:0:198792:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786109695.683802:0:198792:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da3000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109695.683838:0:198792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a97809500 x1872862933356288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109695.683871:0:198792:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1786109695.685207:0:198792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 52 count 51 00000100:00100000:1.0:1786109695.686265:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933356288:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1786109695.686342:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1786109695.686443:0:198776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1786109695.686482:0:198776:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786109695.686498:0:198776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9453a00/0xdb52b77d7ca38023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3802a expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109695.686509:0:198776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9453a00/0xdb52b77d7ca38023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3802a expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786109695.686564:0:198776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786109695.686566:0:198776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1786109695.686568:0:198776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109695.686569:0:198776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109695.686570:0:198776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109695.686572:0:198776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109695.686573:0:198776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786109695.686575:0:198776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109695.686576:0:198776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786109695.686580:0:198776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1786109695.686583:0:198776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786109695.686584:0:198776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1786109695.686585:0:198776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109695.686586:0:198776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109695.686587:0:198776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109695.686588:0:198776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109695.686589:0:198776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786109695.686590:0:198776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109695.686591:0:198776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786109695.686613:0:198776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1786109695.686627:0:198776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933356416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1786109695.686662:0:198776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.686677:0:198776:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97cf19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109695.687233:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933356288 00000100:00100000:2.0:1786109695.687241:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933356288 00000100:00100000:2.0:1786109695.687292:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1786109695.687300:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933356288:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1786109695.687328:0:187901:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 8552 last 0 00000020:00000080:2.0:1786109695.687367:0:187901:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdb52b77d7ca3803f 00000004:00100000:2.0:1786109695.687382:0:187901:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786109695.687414:0:187901:0:(import.c:65:import_set_state_nolock()) ffff930a87b2b800 : changing import state from RECOVER to FULL 00010000:00000080:2.0:1786109695.687459:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac173ed80 x1872862933356288/t0(0) o38->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1786109715 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109695.687519:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872862933356288:12345-0@lo:38:llog_process_th.0 Request processed in 218us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.687527:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1786109695.687613:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933356416 00000100:00100000:3.0:1786109695.687618:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933356416 00000100:00100000:3.0:1786109695.687660:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1786109695.687668:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933356416:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1786109695.687689:0:196399:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1786109695.687701:0:196399:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1786109695.688266:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786109695.688275:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 80 00000100:00080000:1.0:1786109695.688283:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1786109695.688288:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1786109695.688291:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1786109695.688297:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933356288:0@lo:38:llog_process_th.0 00000001:00100000:1.0:1786109695.690375:0:196392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1786109695.690703:0:196399:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786109695.690719:0:196399:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1786109695.690830:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:198776:x1872862933356416:12345-0@lo:253:mount.lustre.0 Request processed in 3160us (4165us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109695.690842:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1786109695.690962:0:198776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:198776:1872862933356416:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1786109695.690975:0:198776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1786109695.690978:0:198776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786109695.690979:0:198776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1786109695.690980:0:198776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109695.690981:0:198776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109695.690982:0:198776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109695.690983:0:198776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109695.690984:0:198776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786109695.690986:0:198776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109695.690987:0:198776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786109695.691004:0:198776:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1786109695.693003:0:196402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1786109695.693010:0:196402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786109695.693038:0:196402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.693059:0:196402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ac16c2e00/0xdb52b77d7ca37406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1674 expref: 9 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.693067:0:196402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ac1f38a00/0xdb52b77d7ca37422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3741b expref: 23 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.693074:0:196402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ab9452800/0xdb52b77d7ca3800e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38007 expref: 23 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.693081:0:196402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.693126:0:196402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ab9452800/0xdb52b77d7ca3800e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca38007 expref: 23 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.693143:0:196402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ab9452800/0xdb52b77d7ca3800e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb52b77d7ca38007 expref: 23 pid: 196397 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109695.693158:0:196402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196402:1872862933356544:0@lo:104: 00000100:00100000:2.0:1786109695.693227:0:196402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786109695.693286:0:196402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ac1f38a00/0xdb52b77d7ca37422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca3741b expref: 23 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.693294:0:196402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ac1f38a00/0xdb52b77d7ca37422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb52b77d7ca3741b expref: 23 pid: 196404 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109695.693302:0:196402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196402:1872862933356672:0@lo:104: 00000100:00100000:2.0:1786109695.693324:0:196402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786109695.693347:0:196402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ac16c2e00/0xdb52b77d7ca37406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1674 expref: 9 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.693355:0:196402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ac16c2e00/0xdb52b77d7ca37406 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1674 expref: 9 pid: 196404 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109695.693364:0:196402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196402:1872862933356800:192.168.203.38@tcp:104: 00000100:00100000:2.0:1786109695.693408:0:196402:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0876480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109695.693489:0:10344:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1786109695.693501:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933356544 00000100:00100000:2.0:1786109695.693507:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933356544 00000100:00100000:2.0:1786109695.693546:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933356672 00000100:00100000:2.0:1786109695.693548:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933356672 00000100:00100000:2.0:1786109695.693561:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5269 00000100:00100000:2.0:1786109695.693568:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+4:196402:x1872862933356544:12345-0@lo:104: 00010000:00010000:2.0:1786109695.693581:0:10344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca3800e expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.693626:0:10344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786109695.693631:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+4:196402:x1872862933356544:12345-0@lo:104: Request processed in 64us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.693638:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5269 00000100:00100000:2.0:1786109695.693653:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5270 00000100:00100000:2.0:1786109695.693660:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c21d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:196402:x1872862933356672:12345-0@lo:104: 00010000:00010000:2.0:1786109695.693666:0:10344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca37422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109695.693694:0:10344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786109695.693699:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c21d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:196402:x1872862933356672:12345-0@lo:104: Request processed in 40us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109695.693705:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5270 00000100:00100000:2.0:1786109695.693762:0:196402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196402:1872862933356544:0@lo:104: 00000100:00100000:2.0:1786109695.693771:0:196402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196402:1872862933356672:0@lo:104: 00010000:00010000:0.0:1786109695.693847:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109695.693855:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca3800e expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.693863:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452000 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:0.0:1786109695.693867:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb52b77d7ca3800e expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.693874:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca3800e expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786109695.693881:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca3800e expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109695.693902:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1786109695.693933:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca3800e expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.693940:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109695.693957:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca3800e expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.693964:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9452000/0xdb52b77d7ca38007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca3800e expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.693976:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109695.693980:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca37422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.693985:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d000 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:0.0:1786109695.693987:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb52b77d7ca37422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.693993:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca37422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786109695.693999:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca37422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109695.694004:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1786109695.694016:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca37422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.694021:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109695.694036:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca37422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.694043:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d000/0xdb52b77d7ca3741b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca37422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.694055:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109695.694057:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109695.694058:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109695.694064:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109695.694074:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933356928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109695.694106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109695.694151:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933357056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109695.694173:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109695.694205:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933356928 00000100:00100000:0.0:1786109695.694209:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933356928 00010000:00010000:0.0:1786109695.694229:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ab9452800/0xdb52b77d7ca3800e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca38007 expref: 24 pid: 196397 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109695.694247:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933357056 00000100:00100000:0.0:1786109695.694250:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933357056 00010000:00010000:0.0:1786109695.694261:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ac1f38a00/0xdb52b77d7ca37422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca3741b expref: 25 pid: 196404 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109695.694279:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12649 00000100:00100000:0.0:1786109695.694285:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+25:3647:x1872862933356928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109695.694295:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109695.694300:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930ab9452800/0xdb52b77d7ca3800e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca38007 expref: 25 pid: 196397 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.694315:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ab9452800/0xdb52b77d7ca3800e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb52b77d7ca38007 expref: 25 pid: 196397 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.694328:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9452800/0xdb52b77d7ca3800e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca38007 expref: 25 pid: 196397 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.696215:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109695.696292:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933356928:12345-0@lo:103:ldlm_bl.0 Request processed in 2002us (2181us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109695.696303:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12649 00000100:00100000:0.0:1786109695.696334:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12650 00000100:00100000:0.0:1786109695.696346:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3648:x1872862933357056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109695.696361:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109695.696367:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930ac1f38a00/0xdb52b77d7ca37422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca3741b expref: 23 pid: 196404 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.696379:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ac1f38a00/0xdb52b77d7ca37422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb52b77d7ca3741b expref: 23 pid: 196404 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.696396:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac1f38a00/0xdb52b77d7ca37422 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca3741b expref: 23 pid: 196404 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.696406:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109695.696448:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3648:x1872862933357056:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109695.696455:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12650 00000100:00100000:0.0:1786109695.696504:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933356928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109695.696536:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933357056:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1786109695.699213:0:198776:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 21474840726 00000040:01000000:1.0:1786109695.700595:0:198776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1786109695.700792:0:198798:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1786109695.701042:0:198776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1786109695.701735:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933357184:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.701810:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.701848:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098661ac00 going to sleep for 11 seconds 00000040:01000000:2.0:1786109695.702007:0:198776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1786109695.702052:0:198776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786109695.702411:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933357184 00000100:00100000:0.0:1786109695.702419:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933357184 00000100:00100000:0.0:1786109695.702477:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12478 00000100:00100000:0.0:1786109695.702485:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933357184:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1786109695.702524:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7d24000 x1872862933357184/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 304/4320 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109695.702566:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933357184:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 82us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109695.702573:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12478 00000100:00100000:1.0:1786109695.702787:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933357184:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1786109695.702814:0:198799:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1786109695.702839:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d27480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933357312:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.702865:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:2.0:1786109695.702951:0:198776:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1786109695.702958:0:198776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1786109695.703004:0:198776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786109695.703043:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5c900 going to sleep for 11 seconds 00000100:00100000:0.0:1786109695.703163:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933357312 00000100:00100000:0.0:1786109695.703168:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933357312 00000100:00100000:0.0:1786109695.703202:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12479 00000100:00100000:0.0:1786109695.703209:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933357312:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1786109695.703299:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7d24e00 x1872862933357312/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 336/4320 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109695.703327:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933357312:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109695.703333:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12479 00000100:00100000:0.0:1786109695.703360:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d27480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933357312:0@lo:1000:lod0001_rec0000.0 00000020:00080000:3.0:1786109695.703554:0:198797:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 21474840726 00000020:00080000:3.0:1786109695.703559:0:198797:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840726 00000100:00100000:0.0:1786109695.703933:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfdf80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:198799:1872862933357440:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1786109695.703970:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109695.703991:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a83969540 going to sleep for 11 seconds 00000100:00100000:0.0:1786109695.704007:0:187910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933357440 00000100:00100000:0.0:1786109695.704011:0:187910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933357440 00000040:00080000:1.0:1786109695.704369:0:198798:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000400:0x1:0x0] first idx 5, last_idx 6 00000040:00080000:1.0:1786109695.704459:0:198798:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1786109695.704463:0:198798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240002efa:0x1:0x0] at index 6 of catalog [0x240000400:0x1:0x0] 00000004:00080000:1.0:1786109695.704549:0:198798:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002efa:0x1:0x0].3 00000020:00080000:1.0:1786109695.704553:0:198798:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 21474840727 transno = 0 mdt_index 1 00000040:00080000:1.0:1786109695.704563:0:198798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x240002efa:0x1:0x0] index 4 count 2 00000040:00080000:1.0:1786109695.704582:0:198798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 7 count 2 00000004:00080000:1.0:1786109695.704627:0:198798:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1786109695.704804:0:198776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1786109695.705389:0:198776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1786109695.705418:0:198776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:0.0:1786109695.705553:0:187910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786109695.705570:0:187910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:198799:x1872862933357440:12345-0@lo:900:lod0001_rec0000.0 00010000:00000080:0.0:1786109695.705598:0:187910:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984cfe300 x1872862933357440/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:166/0 lens 264/248 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109695.705669:0:187910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:198799:x1872862933357440:12345-0@lo:900:lod0001_rec0000.0 Request processed in 104us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109695.705676:0:187910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:00080000:2.0:1786109695.705786:0:198776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1786109695.706238:0:198776:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x34:0x0] (8/32) registered 00000100:00100000:1.0:1786109695.706381:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfdf80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:198799:1872862933357440:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.706466:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d26680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933357568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.706501:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.706524:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c5cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109695.706855:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933357568 00000100:00100000:0.0:1786109695.706861:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933357568 00000100:00100000:0.0:1786109695.706943:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12480 00000100:00100000:0.0:1786109695.706952:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933357568:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:0.0:1786109695.706993:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7d25f80 x1872862933357568/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 304/4320 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109695.707039:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933357568:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 88us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109695.707051:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12480 00000100:00100000:2.0:1786109695.707148:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d26680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933357568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109695.707222:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933357696:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109695.707281:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109695.707300:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab2a9cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786109695.707872:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933357696 00000100:00100000:0.0:1786109695.707878:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933357696 00010000:00080000:2.0:1786109695.708355:0:198776:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-MDT0001, 2 recoverable clients, last_transno 25769804642 00000100:00100000:0.0:1786109695.708599:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12481 00000100:00100000:0.0:1786109695.708614:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933357696:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:2.0:1786109695.709548:0:198800:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 198800 00010000:02000000:2.0:1786109695.709569:0:198800:0:(ldlm_lib.c:2336:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1786109695.709574:0:198800:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1786109695.709577:0:198800:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1786109695.709672:0:198776:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1786109695.709703:0:198776:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1786109695.709720:0:198776:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1786109695.709743:0:198776:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1786109695.710567:0:198776:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1786109695.710796:0:198776:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00000080:3.0:1786109695.725853:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a9780ad80 x1872862933357696/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 336/33016 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109695.725977:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933357696:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 17368us (18693us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109695.725989:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12481 00000100:00100000:1.0:1786109695.726065:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933357696:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1786109695.726218:0:198799:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 10, last_idx 12 00000100:00100000:1.0:1786109695.726337:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933357824:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.726397:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.726799:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff930982d1ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109695.726841:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933357824 00000100:00100000:3.0:1786109695.726848:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933357824 00000100:00100000:3.0:1786109695.726939:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12482 00000100:00100000:3.0:1786109695.726949:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933357824:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:3.0:1786109695.727078:0:8452:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7d24700 x1872862933357824/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 336/33016 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109695.727137:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933357824:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 189us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109695.727145:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12482 00000100:00100000:1.0:1786109695.727264:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933357824:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1786109695.727316:0:198799:0:(llog.c:805:llog_process_thread()) index: 11, lh_last_idx: 12 synced_idx: 0 lgh_last_idx: 12 00000040:00080000:1.0:1786109695.727321:0:198799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200026d32:0x1:0x0] at index 11 of catalog [0x200000401:0x1:0x0] 00000100:00100000:1.0:1786109695.727379:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933357952:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.727410:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.727446:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab29e63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.727464:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933357952 00000100:00100000:1.0:1786109695.727468:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933357952 00000100:00100000:1.0:1786109695.727496:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12483 00000100:00100000:1.0:1786109695.727503:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933357952:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:1.0:1786109695.727532:0:179257:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7d24380 x1872862933357952/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 304/4320 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109695.727567:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933357952:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 65us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.727578:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12483 00000100:00100000:1.0:1786109695.727606:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933357952:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.727663:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933358080:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.727711:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.727727:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8e2f780 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.727739:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933358080 00000100:00100000:1.0:1786109695.727742:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933358080 00000100:00100000:1.0:1786109695.727764:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12484 00000100:00100000:1.0:1786109695.727771:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933358080:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:1.0:1786109695.727978:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7d26680 x1872862933358080/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 336/33016 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109695.728012:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933358080:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 242us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.728018:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12484 00000100:00100000:1.0:1786109695.728044:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933358080:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.728210:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933358208:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.728250:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.728266:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8e2f240 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.728278:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933358208 00000100:00100000:1.0:1786109695.728281:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933358208 00000100:00100000:1.0:1786109695.728306:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12485 00000100:00100000:1.0:1786109695.728313:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933358208:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:1.0:1786109695.728409:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7d27480 x1872862933358208/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 336/33016 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109695.728467:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933358208:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 154us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.728474:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12485 00000100:00100000:1.0:1786109695.728500:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933358208:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.728554:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933358336:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.728593:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.728608:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8e2ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.728620:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933358336 00000100:00100000:1.0:1786109695.728623:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933358336 00000100:00100000:1.0:1786109695.728644:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12486 00000100:00100000:1.0:1786109695.728651:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933358336:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:1.0:1786109695.728738:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984ff0000 x1872862933358336/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 336/33016 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109695.728768:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933358336:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 118us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.728775:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12486 00000100:00100000:1.0:1786109695.728800:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933358336:0@lo:1000:lod0001_rec0000.0 00000004:00080000:1.0:1786109695.728834:0:198799:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x200026d32:0x1:0x0].3 00000020:00080000:1.0:1786109695.728839:0:198799:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 21474840727 transno = 25769804642 mdt_index 0 00000040:00080000:1.0:1786109695.728846:0:198799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x200026d32:0x1:0x0] index 4 count 2 00000100:00100000:1.0:1786109695.728910:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933358464:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.728949:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.728964:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8e2f780 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.728976:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933358464 00000100:00100000:1.0:1786109695.728979:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933358464 00000100:00100000:1.0:1786109695.728999:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12487 00000100:00100000:1.0:1786109695.729006:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933358464:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:1.0:1786109695.729092:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7f17b80 x1872862933358464/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 336/33016 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109695.729202:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933358464:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 195us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.729209:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12487 00000100:00100000:1.0:1786109695.729237:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933358464:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1786109695.729268:0:198799:0:(llog.c:805:llog_process_thread()) index: 12, lh_last_idx: 12 synced_idx: 12 lgh_last_idx: 12 00000040:00080000:1.0:1786109695.729272:0:198799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200026d32:0x2:0x0] at index 12 of catalog [0x200000401:0x1:0x0] 00000100:00100000:1.0:1786109695.729336:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933358592:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.729361:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.729376:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8e2ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.729389:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933358592 00000100:00100000:1.0:1786109695.729392:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933358592 00000100:00100000:1.0:1786109695.729413:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12488 00000100:00100000:1.0:1786109695.729420:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933358592:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:1.0:1786109695.729468:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7f17800 x1872862933358592/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 304/4320 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109695.729500:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933358592:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 81us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.729507:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12488 00000100:00100000:1.0:1786109695.729532:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933358592:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1786109695.729563:0:198799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786109695.729604:0:198799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933358720:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109695.729628:0:198799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.729642:0:198799:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab29e63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.729654:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933358720 00000100:00100000:1.0:1786109695.729658:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933358720 00000100:00100000:1.0:1786109695.729679:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12489 00000100:00100000:1.0:1786109695.729686:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933358720:12345-0@lo:1000:lod0001_rec0000.0 00010000:00000080:1.0:1786109695.729708:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7f14000 x1872862933358720/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 304/4320 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109695.729739:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198799:x1872862933358720:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 54us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109695.729746:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12489 00000100:00100000:1.0:1786109695.729771:0:198799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:198799:1872862933358720:0@lo:1000:lod0001_rec0000.0 00000004:00080000:1.0:1786109695.729810:0:198799:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930ab8e2ff00 with version 1 00000040:00080000:1.0:1786109695.729831:0:198799:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 10, last_idx 12 00000004:00080000:1.0:1786109695.729843:0:198799:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930ab2a9cd80 with version 2 00000040:00080000:1.0:1786109695.729846:0:198799:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200026d32:0x2:0x0] at index 12 of catalog [0x200000401:0x1:0x0] 00000040:00080000:1.0:1786109695.729861:0:198799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 13 count 2 00000004:00080000:1.0:1786109695.729934:0:198799:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1786109695.729938:0:198799:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00080000:1.0:1786109695.730024:0:198783:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930ac0977840 version 1 rpc_version 1 00000020:00100000:1.0:1786109695.730041:0:198783:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109695.730047:0:198783:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab7f14380 x1872862933358976/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109695.730060:0:198783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198783:1872862933358976:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786109695.730085:0:198783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.730099:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab29e63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.730183:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933358976 00000100:00100000:1.0:1786109695.730187:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933358976 00000100:00100000:1.0:1786109695.730209:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12490 00000100:00100000:1.0:1786109695.730215:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:198783:x1872862933358976:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:1.0:1786109695.730369:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7f17480 x1872862933358976/t343597383701(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 416/4320 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109695.730405:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:198783:x1872862933358976:12345-0@lo:1000:osp_up0-1.0 Request processed in 190us (320us total) trans 343597383701 rc 0/0 00000100:00100000:1.0:1786109695.730412:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12490 00000100:00100000:1.0:1786109695.730461:0:198783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198783:1872862933358976:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1786109695.730469:0:198783:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930ac0977840 version 2 rpc_version 2 00000020:00100000:1.0:1786109695.730480:0:198783:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109695.730484:0:198783:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab7f14e00 x1872862933359232/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109695.730496:0:198783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198783:1872862933359232:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786109695.730520:0:198783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109695.730534:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd17e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109695.730545:0:179257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933359232 00000100:00100000:1.0:1786109695.730549:0:179257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933359232 00000100:00100000:1.0:1786109695.730571:0:179257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12491 00000100:00100000:1.0:1786109695.730577:0:179257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:198783:x1872862933359232:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:1.0:1786109695.730646:0:179257:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7f16300 x1872862933359232/t343597383702(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 744/4320 e 0 to 0 dl 1786109706 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109695.730685:0:179257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:198783:x1872862933359232:12345-0@lo:1000:osp_up0-1.0 Request processed in 108us (164us total) trans 343597383702 rc 0/0 00000100:00100000:1.0:1786109695.730691:0:179257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12491 00000100:00100000:1.0:1786109695.730720:0:198783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198783:1872862933359232:0@lo:1000:osp_up0-1.0 00010000:00080000:1.0:1786109695.731492:0:198800:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1786109695.767632:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109695.767695:0:196402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:196402:1872862933356800:192.168.203.38@tcp:104: 00010000:00010000:2.0:1786109695.767725:0:196402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109695.767812:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922152704 00000100:00100000:0.0:1786109695.767818:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922152704 00010000:00010000:0.0:1786109695.767850:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ac16c2e00/0xdb52b77d7ca37406 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1674 expref: 10 pid: 196404 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109695.767899:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12651 00000100:00100000:0.0:1786109695.767910:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922152704:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786109695.767924:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109695.767929:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930ac16c2e00/0xdb52b77d7ca37406 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1674 expref: 10 pid: 196404 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.767938:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ac16c2e00/0xdb52b77d7ca37406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1674 expref: 10 pid: 196404 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.767955:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c2e00/0xdb52b77d7ca37406 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1674 expref: 10 pid: 196404 timeout: 8652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.767967:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.767974:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786109695.767987:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.074978054s 00010000:00010000:0.0:1786109695.767992:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.767998:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.768004:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.768010:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.768017:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109695.768020:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.768027:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.768040:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.768048:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109695.768094:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:2403:x1872862922152704:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 186us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109695.768101:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12651 00010000:00010000:0.0:1786109695.768124:0:196402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.768131:0:196402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109695.768137:0:196402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930986425000/0xdb52b77d7ca38046 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 196402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109696.132801:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109697.156963:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109697.305054:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109697.308617:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922152832 00000100:00100000:1.0:1786109697.308629:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922152832 00000100:00100000:2.0:1786109697.308759:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:2.0:1786109697.308770:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922152832:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109697.308788:0:196404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109697.308808:0:196404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930986424200/0xdb52b77d7ca3804d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17bd expref: -99 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109697.308836:0:196404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930986424200/0xdb52b77d7ca3804d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17bd expref: 10 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109697.308849:0:196404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930986424200/0xdb52b77d7ca3804d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17bd expref: 10 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109697.308858:0:196404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986424200, rc 0) 00000100:00100000:2.0:1786109697.308932:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922152832:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 164us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109697.308939:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:0.0:1786109697.327791:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109697.331464:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922152960 00000100:00100000:3.0:1786109697.331478:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922152960 00000100:00100000:3.0:1786109697.331829:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:3.0:1786109697.331840:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922152960:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1786109697.331866:0:196397:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1786109697.331894:0:196397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786109697.331898:0:196397:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 334 00000100:00100000:1.0:1786109697.334203:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922152960:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 Request processed in 2355us (6412us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109697.334215:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:3.0:1786109697.344054:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109697.344144:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922153088 00000100:00100000:0.0:1786109697.344155:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922153088 00000100:00100000:0.0:1786109697.344306:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1187 00000100:00100000:0.0:1786109697.344315:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1872862922153088:12345-192.168.203.38@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1786109697.344346:0:196401:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'fac74500-4523-4794-af20-dfdcdfae19c1' at ffff930ab1994800, cookie 0xdb52b77d7ca37fac 00010000:00080000:0.0:1786109697.344352:0:196401:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp recovering/t25769804642 exp ffff930ab1994800 cur 8554 last 1786109695 00010000:02000400:0.0:1786109697.344360:0:196401:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1786109697.344366:0:196401:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 85 seconds 00000004:00100000:0.0:1786109697.344391:0:196401:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1786109697.344844:0:196401:0:(import.c:65:import_set_state_nolock()) ffff93098e2bb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109697.344927:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922153088:12345-192.168.203.38@tcp:38:ll_cfg_requeue.0 Request processed in 611us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109697.344936:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1187 00000100:00100000:3.0:1786109697.350266:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109697.350314:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922153216 00000100:00100000:3.0:1786109697.350323:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922153216 00000100:00100000:3.0:1786109697.350378:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 394 00000100:00100000:3.0:1786109697.350391:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922153216:12345-192.168.203.38@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1786109697.350416:0:187900:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ab992b100 x1872862922153216/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:182/0 lens 224/0 e 0 to 0 dl 1786109722 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109697.350459:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922153216:12345-192.168.203.38@tcp:400:ldlm_lock_repla.0 Request processed in 71us (204us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109697.350466:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 394 00010000:00080000:1.0:1786109697.351387:0:198800:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:2.0:1786109697.417456:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1786109697.417463:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930ab1980800 from 334 10000000:01000000:2.0:1786109697.417468:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1786109697.417509:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930986425200/0xdb52b77d7ca38054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109697.417522:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930986425200/0xdb52b77d7ca38054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109697.417534:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930986425200/0xdb52b77d7ca38054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109697.417559:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933359360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109697.417627:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109697.419475:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109697.419507:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933359360 00000100:00100000:2.0:1786109697.419515:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933359360 00000100:00100000:2.0:1786109697.419573:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1786109697.419584:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933359360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109697.419599:0:196404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109697.419616:0:196404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930986424a00/0xdb52b77d7ca3805b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38054 expref: -99 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109697.419641:0:196404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930986424a00/0xdb52b77d7ca3805b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38054 expref: 23 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109697.419652:0:196404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930986424a00/0xdb52b77d7ca3805b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38054 expref: 23 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109697.419672:0:196404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986424a00, rc 0) 00000100:00100000:2.0:1786109697.419741:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933359360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109697.419749:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1786109697.419776:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933359360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109697.419798:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930986425200/0xdb52b77d7ca38054 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3805b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109697.419810:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930986425200/0xdb52b77d7ca38054 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3805b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109697.419899:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933359488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1786109697.420057:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109697.420095:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a82b6e240 going to sleep for 11 seconds 00000100:00100000:2.0:1786109697.420157:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933359488 00000100:00100000:2.0:1786109697.420162:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933359488 00000100:00100000:2.0:1786109697.420195:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1786109697.420202:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933359488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1786109697.420384:0:196399:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1786109697.420400:0:196399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786109697.420403:0:196399:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 334 00000100:00100000:1.0:1786109697.420810:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933359488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 607us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109697.420819:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1786109697.420886:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933359488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1786109697.421015:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786109697.421023:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930986425200/0xdb52b77d7ca38054 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3805b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109697.421033:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930986425200/0xdb52b77d7ca38054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3805b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109697.421042:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1786109697.421045:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930ab282d000 from 334 10000000:01000000:2.0:1786109697.421048:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1786109697.421070:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109697.421077:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109697.421085:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109697.421168:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933359616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109697.421200:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109697.421411:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1786109697.421747:0:196404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933359616 00000100:00100000:3.0:1786109697.421753:0:196404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933359616 00000100:00100000:3.0:1786109697.421825:0:196404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1786109697.421834:0:196404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933359616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109697.421844:0:196404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109697.421856:0:196404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f07a00/0xdb52b77d7ca38069 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38062 expref: -99 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109697.421886:0:196404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f07a00/0xdb52b77d7ca38069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38062 expref: 24 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109697.421895:0:196404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f07a00/0xdb52b77d7ca38069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38062 expref: 24 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109697.421903:0:196404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07a00, rc 0) 00000100:00100000:3.0:1786109697.422046:0:196404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933359616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109697.422052:0:196404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1786109697.422134:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933359616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109697.422147:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109697.422155:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109697.422200:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933359744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1786109697.422485:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109697.422513:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098a9c1480 going to sleep for 11 seconds 00000100:00100000:1.0:1786109697.422583:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933359744 00000100:00100000:1.0:1786109697.422588:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933359744 00000100:00100000:1.0:1786109697.422695:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1786109697.422705:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933359744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1786109697.422718:0:196397:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1786109697.422733:0:196397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1786109697.422736:0:196397:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 334 00000100:00100000:1.0:1786109697.422812:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933359744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109697.422820:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1786109697.422855:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933359744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1786109697.422907:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786109697.422987:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109697.422995:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109698.181204:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109699.091688:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109699.091731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109699.091775:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922153472 00000100:00100000:2.0:1786109699.091784:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922153472 00000100:00100000:2.0:1786109699.091861:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 395 00000100:00100000:2.0:1786109699.091889:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2404:x1872862922153472:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:2.0:1786109699.091918:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a9780bb80 x1872862922153472/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:170/0 lens 224/224 e 0 to 0 dl 1786109710 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109699.091980:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2404:x1872862922153472:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 94us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109699.091988:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 395 00000100:00100000:2.0:1786109699.092016:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922153344 00000100:00100000:2.0:1786109699.092020:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922153344 00000100:00100000:2.0:1786109699.092048:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:2.0:1786109699.092055:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922153344:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109699.092085:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87bb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922153344:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109699.092092:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00080000:2.0:1786109699.092117:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786109699.204647:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109699.332716:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933360000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109699.332716:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933359872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109699.336036:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109699.336474:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109699.340348:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933359872 00000100:00100000:0.0:1786109699.340348:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933360000 00000100:00100000:1.0:1786109699.340365:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933359872 00000100:00100000:0.0:1786109699.340365:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933360000 00000100:00080000:3.0:1786109699.340455:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109699.340470:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5921 00000100:00100000:1.0:1786109699.340485:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933359872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109699.340528:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141760 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109699.341303:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933359872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 819us (4825us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109699.342097:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5921 00000100:00100000:1.0:1786109699.342197:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933359872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109699.349997:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5922 00000100:00100000:2.0:1786109699.350018:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab992a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933360000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109699.350069:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109699.350191:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab992a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933360000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (14167us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109699.350200:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5922 00000100:00100000:2.0:1786109699.350281:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933360000:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786109699.350367:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786109700.346036:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786109700.451307:0:199043:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1786109700.870960:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109700.870969:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1786109700.870974:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1786109700.871762:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933360128:0@lo:400:kworker.0 00000100:00100000:2.0:1786109700.872268:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109700.873528:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933360256:0@lo:400:kworker.0 00000100:00080000:1.0:1786109700.873731:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff930983499000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109700.874111:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7d26a00 x1872862933360384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109700.874164:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109700.874169:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1786109700.874172:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109700.874181:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109700.874193:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309852ba680 x1872862933360640/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109700.874203:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109700.874206:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1786109700.874208:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109700.874212:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930985f23800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109700.874224:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309852b8700 x1872862933360768/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109700.874303:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933360896:0@lo:400:kworker.0 00000100:00100000:3.0:1786109700.874949:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109700.876172:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933361152:0@lo:400:kworker.0 00000100:00100000:3.0:1786109700.876219:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109700.876247:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933361664:0@lo:400:kworker.0 00000100:00100000:3.0:1786109700.876277:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109700.876301:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1786109700.876396:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933360256 00000100:00100000:2.0:1786109700.876406:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933360256 00000100:00100000:2.0:1786109700.876490:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933361152 00000100:00100000:2.0:1786109700.876494:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933361152 00000100:00100000:2.0:1786109700.876517:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933361664 00000100:00100000:2.0:1786109700.876520:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933361664 00000100:00100000:2.0:1786109700.876544:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1786109700.876555:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933360256:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109700.876583:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9929f80 x1872862933360256/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:171/0 lens 224/224 e 0 to 0 dl 1786109711 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109700.876634:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933360256:12345-0@lo:400:kworker.0 Request processed in 81us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109700.877066:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109700.877109:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933361408:0@lo:400:kworker.0 00000100:00100000:1.0:1786109700.877134:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109700.877165:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786109700.877172:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933361024:0@lo:400:kworker.0 00000100:00100000:1.0:1786109700.877198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109700.877223:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933361536:0@lo:400:kworker.0 00000100:00100000:1.0:1786109700.877252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109700.877460:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1786109700.877496:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1786109700.877508:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933361152:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109700.877527:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1ff2680 x1872862933361152/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:171/0 lens 224/224 e 0 to 0 dl 1786109711 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109700.877565:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933361152:12345-0@lo:400:kworker.0 Request processed in 61us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109700.877572:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1786109700.877587:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1786109700.877594:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933361664:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109700.877606:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1ff1c00 x1872862933361664/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:171/0 lens 224/224 e 0 to 0 dl 1786109711 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109700.877633:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1872862933361664:12345-0@lo:400:kworker.0 Request processed in 40us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109700.877924:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933360896 00000100:00100000:0.0:1786109700.877933:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933360896 00000100:00100000:0.0:1786109700.877974:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933361408 00000100:00100000:0.0:1786109700.877978:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933361408 00000100:00100000:0.0:1786109700.878002:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933361024 00000100:00100000:0.0:1786109700.878006:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933361024 00000100:00100000:3.0:1786109700.878411:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933360512:0@lo:400:kworker.0 00000100:00100000:3.0:1786109700.878472:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109700.878504:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933361280:0@lo:400:kworker.0 00000100:00100000:2.0:1786109700.878522:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1786109700.878535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109700.878552:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933360512 00000100:00100000:2.0:1786109700.878557:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933360512 00000100:00100000:2.0:1786109700.878584:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1786109700.878592:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933360512:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109700.878609:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1ff1880 x1872862933360512/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:171/0 lens 224/224 e 0 to 0 dl 1786109711 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109700.879161:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933360128 00000100:00100000:1.0:1786109700.879168:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933360128 00000100:00100000:1.0:1786109700.879218:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1786109700.879227:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933360128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109700.879473:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933361536 00000100:00100000:0.0:1786109700.879478:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933361536 00000100:00100000:0.0:1786109700.879508:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7092 00000100:00100000:0.0:1786109700.879518:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933360896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109700.880671:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933360896:12345-0@lo:400:kworker.0 Request processed in 1146us (3596us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109700.880683:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7092 00000100:00100000:0.0:1786109700.880713:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7093 00000100:00100000:0.0:1786109700.880727:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933361408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109700.880745:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933360128:12345-0@lo:400:kworker.0 Request processed in 1515us (8475us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109700.880756:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1786109700.880801:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933361408:12345-0@lo:400:kworker.0 Request processed in 78us (3665us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109700.880808:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7093 00000100:00100000:0.0:1786109700.880820:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7094 00000100:00100000:0.0:1786109700.880828:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933361024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109700.880870:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933361024:12345-0@lo:400:kworker.0 Request processed in 43us (3671us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109700.880876:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7094 00000100:00100000:0.0:1786109700.880888:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7095 00000100:00100000:0.0:1786109700.880895:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933361536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109700.880926:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933361536:12345-0@lo:400:kworker.0 Request processed in 32us (3673us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109700.880931:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7095 00000100:00100000:0.0:1786109700.880975:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933360384:0@lo:38:kworker.0 00000100:00100000:1.0:1786109700.881117:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933361280 00000100:00100000:1.0:1786109700.881125:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933361280 00000100:00100000:1.0:1786109700.881168:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12492 00000100:00100000:1.0:1786109700.881176:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1872862933361280:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109700.881202:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1f52d80 x1872862933361280/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:171/0 lens 224/224 e 0 to 0 dl 1786109711 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109700.881239:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1872862933361280:12345-0@lo:400:kworker.0 Request processed in 64us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109700.881245:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12492 00000100:00100000:1.0:1786109700.881296:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933361024:0@lo:400:kworker.0 00000100:00100000:1.0:1786109700.882459:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933361536:0@lo:400:kworker.0 00000100:00100000:1.0:1786109700.882477:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933360896:0@lo:400:kworker.0 00000100:00100000:1.0:1786109700.882490:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933361408:0@lo:400:kworker.0 00000100:00100000:0.0:1786109700.883494:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109700.883573:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933360640:0@lo:38:kworker.0 00000100:00100000:0.0:1786109700.883637:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109700.883665:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933360768:0@lo:38:kworker.0 00000100:00100000:0.0:1786109700.883694:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109700.884386:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933361280:0@lo:400:kworker.0 00000100:00100000:3.0:1786109700.884400:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933361792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109700.884461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109700.884511:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933360384 00000100:00100000:0.0:1786109700.884520:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933360384 00000100:00100000:0.0:1786109700.884554:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933360640 00000100:00100000:0.0:1786109700.884557:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933360640 00000100:00100000:0.0:1786109700.884571:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1786109700.884579:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933360384:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109700.884617:0:188678:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8557 last 0 00000020:00000080:0.0:1786109700.884845:0:188678:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xdb52b77d7ca38070 00000004:00100000:0.0:1786109700.884877:0:188678:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109700.885268:0:188678:0:(import.c:65:import_set_state_nolock()) ffff93098e2ba800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109700.885425:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872862933360384:12345-0@lo:38:kworker.0 Request processed in 843us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109700.885464:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1786109700.885498:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1786109700.885505:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933360640:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109700.885522:0:188678:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8557 last 0 00000020:00000080:0.0:1786109700.885549:0:188678:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xdb52b77d7ca38077 00000004:00100000:0.0:1786109700.885558:0:188678:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109700.885579:0:188678:0:(import.c:65:import_set_state_nolock()) ffff93098e2be800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109700.885611:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872862933360640:12345-0@lo:38:kworker.0 Request processed in 105us (1973us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109700.885618:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00080000:0.0:1786109700.885665:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109700.885671:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109700.885675:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786109700.885708:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ab7d26a00 x1872862933360384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109700.885723:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 7 00000100:00100000:2.0:1786109700.886554:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933360512:12345-0@lo:400:kworker.0 Request processed in 7959us (8077us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109700.886565:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1786109700.887772:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933360128:0@lo:400:kworker.0 00000100:00100000:1.0:1786109700.887882:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933360768 00000100:00100000:1.0:1786109700.887892:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933360768 00000100:00100000:3.0:1786109700.887901:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933361152:0@lo:400:kworker.0 00000100:00100000:3.0:1786109700.887921:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933361664:0@lo:400:kworker.0 00000100:00100000:3.0:1786109700.887937:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933360256:0@lo:400:kworker.0 00000100:00100000:1.0:1786109700.887948:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933361792 00000100:00100000:1.0:1786109700.887952:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933361792 00000100:00100000:3.0:1786109700.887978:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933360512:0@lo:400:kworker.0 00000100:00100000:1.0:1786109700.887990:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12493 00000100:00100000:1.0:1786109700.888000:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1872862933360768:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1786109700.888036:0:8452:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff930ab1996800, cookie 0xdb52b77d7ca37fa5 00010000:00080000:1.0:1786109700.888041:0:8452:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff930ab1996800 cur 8557 last 1786109695 00000004:00100000:1.0:1786109700.888064:0:8452:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786109700.888103:0:8452:0:(import.c:65:import_set_state_nolock()) ffff930ac1364000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109700.888490:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12494 00000100:00100000:2.0:1786109700.888505:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1872862933361792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109700.888538:0:177399:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00010000:00000080:2.0:1786109700.888556:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1f53b80 x1872862933361792/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:171/0 lens 224/368 e 0 to 0 dl 1786109711 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109700.888840:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff930ab7d26a00 x1872862933360384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109725 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109700.888860:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109700.888865:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109700.888871:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109700.888877:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933360384:0@lo:38:kworker.0 00010000:00080000:0.0:1786109700.888901:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9309852ba680 x1872862933360640/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109700.888913:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 7 00000100:00080000:0.0:1786109700.889979:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff9309852ba680 x1872862933360640/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109725 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109700.889990:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109700.889994:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109700.889998:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109700.890004:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933360640:0@lo:38:kworker.0 00000100:00080000:0.0:1786109700.890036:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 7 00000100:00080000:0.0:1786109700.890045:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1786109700.890050:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0001_UUID 00000100:00080000:0.0:1786109700.890053:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930985f23800 from lustre-MDT0001_UUID committed 0 last 0 00000100:00080000:0.0:1786109700.890057:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1786109700.890391:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1872862933361792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1889us (5927us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109700.890402:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12494 00000100:00100000:0.0:1786109700.890549:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933361792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109700.894327:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933360768:12345-0@lo:38:kworker.0 Request processed in 6310us (10615us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109700.894345:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12493 00010000:00080000:1.0:1786109700.894392:0:198800:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1786109700.894399:0:198800:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 25769804643 00000020:00080000:1.0:1786109700.894406:0:198800:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 25769804642 00010000:00080000:1.0:1786109700.894410:0:198800:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 25769804643 00010000:00080000:1.0:1786109700.894413:0:198800:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (25769804643) 00000020:00080000:1.0:1786109700.894416:0:198800:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 25769804642 00000020:00080000:1.0:1786109700.894539:0:198800:0:(update_records.c:53:update_records_dump()) master transno = 25769804642 batchid = 21474840727 flags = 0 ops = 10 params = 16 00000020:00080000:1.0:1786109700.894544:0:198800:0:(update_records.c:72:update_records_dump()) update 0th [0x240002ef9:0x16:0x0] create params_count = 2 00000020:00080000:1.0:1786109700.894548:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366922 0th off = 0 size = 208 00000020:00080000:1.0:1786109700.894552:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac13669fa 1th off = 1 size = 16 00000020:00080000:1.0:1786109700.894554:0:198800:0:(update_records.c:72:update_records_dump()) update 1th [0x240002ef9:0x16:0x0] ref_add params_count = 0 00000020:00080000:1.0:1786109700.894557:0:198800:0:(update_records.c:72:update_records_dump()) update 2th [0x240002ef9:0x16:0x0] insert params_count = 3 00000020:00080000:1.0:1786109700.894560:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366a12 0th off = 2 size = 2 00000020:00080000:1.0:1786109700.894561:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366a22 1th off = 3 size = 16 00000020:00080000:1.0:1786109700.894563:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366a3a 2th off = 4 size = 4 00000020:00080000:1.0:1786109700.894565:0:198800:0:(update_records.c:72:update_records_dump()) update 3th [0x240002ef9:0x16:0x0] insert params_count = 3 00000020:00080000:1.0:1786109700.894568:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366a4a 0th off = 5 size = 3 00000020:00080000:1.0:1786109700.894570:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac13669fa 1th off = 1 size = 16 00000020:00080000:1.0:1786109700.894572:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366a3a 2th off = 4 size = 4 00000020:00080000:1.0:1786109700.894574:0:198800:0:(update_records.c:72:update_records_dump()) update 4th [0x240002ef9:0x16:0x0] xattr_set params_count = 3 00000020:00080000:1.0:1786109700.894576:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366a5a 0th off = 6 size = 12 00000020:00080000:1.0:1786109700.894578:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366a72 1th off = 7 size = 48 00000020:00080000:1.0:1786109700.894580:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366aaa 2th off = 8 size = 4 00000020:00080000:1.0:1786109700.894582:0:198800:0:(update_records.c:72:update_records_dump()) update 5th [0x240002ef9:0x16:0x0] xattr_set params_count = 3 00000020:00080000:1.0:1786109700.894584:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366aba 0th off = 9 size = 9 00000020:00080000:1.0:1786109700.894586:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366ad2 1th off = 10 size = 5 00000020:00080000:1.0:1786109700.894588:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366aaa 2th off = 8 size = 4 00000020:00080000:1.0:1786109700.894590:0:198800:0:(update_records.c:72:update_records_dump()) update 6th [0x200026d31:0x4:0x0] insert params_count = 3 00000020:00080000:1.0:1786109700.894592:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366ae2 0th off = 11 size = 11 00000020:00080000:1.0:1786109700.894595:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366a22 1th off = 3 size = 16 00000020:00080000:1.0:1786109700.894597:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366afa 2th off = 12 size = 4 00000020:00080000:1.0:1786109700.894599:0:198800:0:(update_records.c:72:update_records_dump()) update 7th [0x200026d31:0x4:0x0] ref_add params_count = 0 00000020:00080000:1.0:1786109700.894601:0:198800:0:(update_records.c:72:update_records_dump()) update 8th [0x240002ef9:0x16:0x0] xattr_set params_count = 3 00000020:00080000:1.0:1786109700.894603:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366b0a 0th off = 13 size = 13 00000020:00080000:1.0:1786109700.894605:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366b22 1th off = 14 size = 52 00000020:00080000:1.0:1786109700.894607:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366aaa 2th off = 8 size = 4 00000020:00080000:1.0:1786109700.894609:0:198800:0:(update_records.c:72:update_records_dump()) update 9th [0x200026d31:0x4:0x0] attr_set params_count = 1 00000020:00080000:1.0:1786109700.894612:0:198800:0:(update_records.c:87:update_records_dump()) param = ffff930ac1366b62 0th off = 15 size = 208 00000100:00100000:1.0:1786109700.894885:0:198800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b55f80 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:198800:1872862933361920:0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1786109700.894968:0:198800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109700.895012:0:198800:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786109700.895086:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933361920 00000100:00100000:3.0:1786109700.895096:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933361920 00000100:00100000:1.0:1786109700.895151:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933360768:0@lo:38:kworker.0 00000100:00100000:3.0:1786109700.895156:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12495 00000100:00100000:3.0:1786109700.895170:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:198800:x1872862933361920:12345-0@lo:1000:tgt_recover_1.0 00010000:00080000:1.0:1786109700.895198:0:199060:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0001-osp-MDT0000 to lustre-MDT0001_UUID@0@lo 00010000:00010000:1.0:1786109700.895204:0:199060:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0001-osp-MDT0000 (0) 00010000:00010000:1.0:1786109700.895212:0:199060:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0001-osp-MDT0000 00010000:00000080:3.0:1786109700.895233:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0b56680 x1872862933361920/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:171/0 lens 304/4320 e 0 to 0 dl 1786109711 ref 1 fl Interpret:/200/0 rc 0/0 job:'tgt_recover_1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109700.895298:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:198800:x1872862933361920:12345-0@lo:1000:tgt_recover_1.0 Request processed in 131us (330us total) trans 0 rc 0/0 00000100:00080000:1.0:1786109700.895676:0:199060:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1786109700.895713:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933362048:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1786109700.895745:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109700.896717:0:198800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b55f80 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:198800:1872862933361920:0@lo:1000:tgt_recover_1.0 00010000:00080000:2.0:1786109700.896842:0:198800:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 81 seconds 00000020:00080000:2.0:1786109700.896846:0:198800:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t25769804642 00000020:00080000:2.0:1786109700.896868:0:198800:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:2.0:1786109700.896871:0:198800:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 25769804643 00000020:00080000:2.0:1786109700.896876:0:198800:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:2.0:1786109700.896878:0:198800:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 25769804643 00000100:00100000:2.0:1786109700.896897:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933362048 00000100:00100000:2.0:1786109700.896904:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933362048 00000020:00080000:1.0:1786109700.896980:0:198797:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840726 00000100:00100000:3.0:1786109700.899901:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12495 00000100:00100000:2.0:1786109700.901203:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12496 00000100:00100000:2.0:1786109700.901234:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933362048:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1786109700.901267:0:8451:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ac0b56a00 x1872862933362048/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:171/0 lens 224/0 e 0 to 0 dl 1786109711 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109700.901292:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933362048:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 75us (5546us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109700.901300:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12496 00000020:00080000:2.0:1786109700.901325:0:198800:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:2.0:1786109700.901330:0:198800:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 25769804643 00010000:00080000:2.0:1786109700.901333:0:198800:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1786109700.901338:0:198800:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:2.0:1786109700.901345:0:198800:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1786109700.901348:0:198800:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1786109700.901547:0:198800:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 7, last_transno is 30064771072 00000001:00100000:1.0:1786109700.911428:0:198777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1786109700.911475:0:198777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00080000:3.0:1786109700.911743:0:198800:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1786109700.912242:0:198800:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-MDT0001: cancel recovery timer 00010000:00080000:3.0:1786109700.912270:0:198800:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.203.38@tcp: req@ffff930ab992b100 x1872862922153216/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:182/0 lens 224/0 e 0 to 0 dl 1786109722 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1786109700.912465:0:198800:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff930ac0b56a00 x1872862933362048/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:171/0 lens 224/0 e 0 to 0 dl 1786109711 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1786109700.915326:0:198800:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-MDT0001: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1786109700.918213:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1786109700.918236:0:3645:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff930ac0b55500 x1872862933362048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109716 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109700.918249:0:3645:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff930ac0b55500 x1872862933362048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109716 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109700.918257:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1786109700.918272:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1786109700.918280:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000015c5cfb9): req@ffff930ab7c51f80 x1872862933345408/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109689 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109700.918302:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933362048:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1786109700.918418:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109700.918657:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109700.918671:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933362176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109700.918705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109700.919512:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933345408 00000100:00100000:1.0:1786109700.919524:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933345408 00000100:00100000:1.0:1786109700.919633:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933362176 00000100:00100000:1.0:1786109700.919637:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933362176 00000100:00100000:2.0:1786109700.923031:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12497 00000100:00100000:2.0:1786109700.923061:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3646:x1872862933345408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109700.923181:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446068224 avail 1299828736 00000100:00100000:2.0:1786109700.923312:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3646:x1872862933345408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 264us (4893us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109700.923321:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12497 00000100:00100000:2.0:1786109700.923349:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12498 00000100:00100000:2.0:1786109700.923357:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933362176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109700.923368:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446068224 avail 1299828736 00000100:00100000:2.0:1786109700.923403:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933362176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (4698us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109700.923409:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12498 00000100:00100000:2.0:1786109700.923483:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933362176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109700.924322:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933345408:0@lo:41:osp-pre-1-0.0 00000004:00000080:2.0:1786109700.956192:0:198800:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa66f0870fe10 00100000:10000000:2.0:1786109700.956214:0:198800:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:3.0:1786109700.958185:0:198786:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000401:0x3eb:0x0] 00000100:00100000:3.0:1786109700.958252:0:198786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:198786:1872862933362304:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1786109700.958499:0:198786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109700.958540:0:198786:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab95ae300 going to sleep for 11 seconds 00000100:00100000:3.0:1786109700.958575:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933362304 00000100:00100000:3.0:1786109700.958584:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933362304 00000100:00100000:3.0:1786109700.958710:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23161 00000100:00100000:3.0:1786109700.958722:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:198786:x1872862933362304:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1786109700.958757:0:8442:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1025 -> diff = -22 00002000:02000040:3.0:1786109700.958762:0:8442:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000401:1004 to 0x280000401:1025) 00000004:00080000:1.0:1786109700.958999:0:198788:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x3eb:0x0] 00000100:00100000:1.0:1786109700.959055:0:198788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b56300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:198788:1872862933362432:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1786109700.959116:0:198788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109700.959149:0:198788:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6900 going to sleep for 11 seconds 00000100:00100000:1.0:1786109700.959173:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933362432 00000100:00100000:1.0:1786109700.959179:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933362432 00000100:00100000:1.0:1786109700.959225:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23162 00000100:00100000:1.0:1786109700.959234:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+6:198788:x1872862933362432:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1786109700.959258:0:43922:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1025 -> diff = -22 00002000:02000040:1.0:1786109700.959262:0:43922:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:1004 to 0x2c0000400:1025) 00002000:00010000:3.0:1786109700.988153:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x401:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109700.988168:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca3807e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.988188:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x401:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:3.0:1786109700.988192:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x401:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109700.988198:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca3807e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.988213:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca3807e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.988222:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca3807e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.988229:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca3807e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.988961:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109700.989747:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x400:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109700.989756:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca38085 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.989769:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x400:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:3.0:1786109700.989773:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x400:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109700.989779:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca38085 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.989791:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca38085 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.989804:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca38085 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.989811:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca38085 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.989871:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109700.989879:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca3807e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786109700.990194:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x401:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.990201:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca3808c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x401:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990211:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x401:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.990214:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x401:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.990218:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca3808c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990231:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca3808c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990238:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca3808c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990251:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca3808c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990266:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1786109700.990466:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x400:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.990472:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca38093 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x400:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990481:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x400:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.990484:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x400:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.990488:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca38093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990497:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca38093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990505:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca38093 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990512:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca38093 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990525:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1786109700.990532:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786109700.990537:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca38085 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990546:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.990551:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca38085 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990560:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca38085 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990576:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca38085 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990583:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786109700.990587:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca3808c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990593:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.990596:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca3808c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990604:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca3808c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990613:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca3808c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990621:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4be2016/0xdb52b77d7ca3808c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990639:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109700.990642:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca38093 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990648:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.990651:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca38093 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990658:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca38093 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990668:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca38093 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990675:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f27535b/0xdb52b77d7ca38093 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990687:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.990688:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.990690:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.990742:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.990747:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3809a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990755:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ff:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.990758:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.990762:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3809a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990771:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3809a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990778:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3809a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990785:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3809a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990798:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109700.990806:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109700.990810:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3809a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990817:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.990820:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3809a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990827:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3809a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990838:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3809a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990863:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee01f6e4/0xdb52b77d7ca3809a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.990876:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.990878:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.990879:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.991103:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.991109:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca380a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991117:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3fe:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.991121:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.991125:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca380a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991135:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca380a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991142:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca380a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991150:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca380a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991163:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109700.991171:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109700.991175:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca380a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991182:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.991185:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca380a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991192:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca380a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991202:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca380a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991209:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d047340/0xdb52b77d7ca380a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991221:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.991223:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.991224:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.991264:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.991269:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca380a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991278:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3fd:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.991281:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.991286:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca380a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991299:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca380a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991307:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca380a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991315:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca380a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991326:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109700.991332:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109700.991336:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca380a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991342:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.991345:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca380a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991353:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca380a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991363:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca380a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991370:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ef088c4/0xdb52b77d7ca380a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991382:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.991384:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.991386:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.991426:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.991453:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca380af lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991461:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3fc:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.991464:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.991468:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca380af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991477:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca380af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991485:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca380af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991492:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca380af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991505:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109700.991511:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109700.991515:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca380af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991526:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.991529:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca380af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991538:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca380af lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991548:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca380af lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991555:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce0cf6e3/0xdb52b77d7ca380af lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991568:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.991570:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.991571:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.991610:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.991616:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca380b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991623:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3fb:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.991626:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.991630:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca380b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991638:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca380b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991646:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca380b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991653:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca380b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991666:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109700.991672:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109700.991676:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca380b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991682:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.991686:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca380b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991693:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca380b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991702:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca380b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991709:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007643a5f9/0xdb52b77d7ca380b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991721:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.991723:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.991725:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.991764:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.991769:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca380bd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991777:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3fa:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.991780:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.991784:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca380bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991793:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca380bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991801:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca380bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991810:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca380bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991821:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109700.991827:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109700.991830:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca380bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991836:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.991839:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca380bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991862:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca380bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991873:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca380bd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.991881:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6ae04ef/0xdb52b77d7ca380bd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992020:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.992022:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.992023:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.992065:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109700.992164:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109700.992167:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca3807e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.992176:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca3807e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.992188:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca3807e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.992195:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae086d48/0xdb52b77d7ca3807e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.992210:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109700.992213:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109700.992215:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109700.992221:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.992283:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca380c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992291:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f9:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.992294:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.992298:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca380c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992307:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca380c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992315:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca380c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992323:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca380c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992345:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109700.992386:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.992391:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca380cb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992399:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f8:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.992402:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.992406:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca380cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992415:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca380cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992421:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca380cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992451:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca380cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992464:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786109700.992471:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786109700.992474:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca380c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992482:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9453c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.992485:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca380c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992492:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca380c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992503:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca380c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992509:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062e7a1bd/0xdb52b77d7ca380c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992524:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109700.992527:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca380cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992532:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9452200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.992536:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca380cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992543:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca380cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992553:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca380cb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992561:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000756025/0xdb52b77d7ca380cb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992571:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.992573:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.992574:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.992617:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.992622:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca380d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992630:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f7:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.992633:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.992637:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca380d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992646:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca380d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992653:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca380d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992659:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca380d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992671:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109700.992708:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.992712:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca380d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992720:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f6:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.992723:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.992726:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca380d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992735:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca380d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992743:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca380d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992750:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca380d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992759:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1786109700.992792:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.992797:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca380e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992804:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f5:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.992807:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.992810:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca380e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992822:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca380e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992830:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca380e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992837:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca380e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992863:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1786109700.992870:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786109700.992874:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca380d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.992880:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.992882:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca380d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.993153:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109700.993158:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca380d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.993165:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109700.993167:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca380d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.993174:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca380d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.993186:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca380d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.993194:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e724ac4/0xdb52b77d7ca380d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.993208:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109700.993211:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca380e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.993218:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109700.993221:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca380e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.993229:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca380e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.993239:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca380e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.993245:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044d1d18c/0xdb52b77d7ca380e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109700.993256:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109700.993258:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109700.993260:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109700.993265:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109700.993270:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.993519:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca380d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993530:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca380d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993537:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000435d3729/0xdb52b77d7ca380d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993553:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.993555:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.993557:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.993609:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.993615:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de8ad44f/0xdb52b77d7ca380e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993623:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f4:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.993626:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.993630:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de8ad44f/0xdb52b77d7ca380e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993638:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de8ad44f/0xdb52b77d7ca380e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993646:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de8ad44f/0xdb52b77d7ca380e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993653:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de8ad44f/0xdb52b77d7ca380e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993667:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109700.993703:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.993708:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca380ee lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993720:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f3:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.993723:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.993728:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca380ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993736:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca380ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993743:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca380ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993749:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca380ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993762:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1786109700.993799:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.993804:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca380f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993812:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f2:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.993815:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.993818:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca380f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993827:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca380f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993837:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca380f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.993843:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca380f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994011:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1786109700.994050:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.994055:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca380fc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994063:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f1:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.994066:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.994070:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca380fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994090:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca380fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994098:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca380fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994105:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca380fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994121:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1786109700.994129:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1786109700.994133:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de8ad44f/0xdb52b77d7ca380e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994139:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.994143:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de8ad44f/0xdb52b77d7ca380e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994149:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de8ad44f/0xdb52b77d7ca380e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994160:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de8ad44f/0xdb52b77d7ca380e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994167:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de8ad44f/0xdb52b77d7ca380e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994183:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786109700.994186:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca380ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994192:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.994196:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca380ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994208:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca380ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994218:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca380ee lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994225:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5a41752/0xdb52b77d7ca380ee lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994236:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786109700.994239:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca380f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994245:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.994247:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca380f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994254:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca380f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994263:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca380f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994271:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddffcfee/0xdb52b77d7ca380f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994287:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109700.994290:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca380fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994296:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.994299:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca380fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994306:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca380fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994315:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca380fc lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994322:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000102e3322/0xdb52b77d7ca380fc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994334:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.994335:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.994337:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.994377:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.994382:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca38103 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994390:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f0:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.994394:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.994398:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca38103 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994406:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca38103 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994413:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca38103 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994420:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca38103 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994450:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109700.994458:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109700.994462:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca38103 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994469:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.994472:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca38103 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994479:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca38103 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994489:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca38103 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994500:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003965eeb1/0xdb52b77d7ca38103 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994513:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.994515:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.994516:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.994560:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.994565:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca3810a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994573:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ef:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.994575:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.994579:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca3810a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994588:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca3810a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994596:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca3810a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994603:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca3810a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994615:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109700.994622:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109700.994625:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca3810a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994632:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.994635:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca3810a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994642:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca3810a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994653:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca3810a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994660:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000833a29e8/0xdb52b77d7ca3810a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994673:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.994675:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.994676:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.994718:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.994723:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca38111 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994732:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ee:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.994734:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.994739:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca38111 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994751:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca38111 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994759:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca38111 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994765:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca38111 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994777:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109700.994784:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109700.994787:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca38111 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994794:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109700.994797:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca38111 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994804:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca38111 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994814:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca38111 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994821:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca38111 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.994835:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.994836:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109700.994838:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109700.995083:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109700.995091:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca38085 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.995149:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.995504:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.995510:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000223bbbb9/0xdb52b77d7ca38118 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.995519:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ed:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.995522:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.995526:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000223bbbb9/0xdb52b77d7ca38118 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.995536:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000223bbbb9/0xdb52b77d7ca38118 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.995544:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000223bbbb9/0xdb52b77d7ca38118 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.995551:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000223bbbb9/0xdb52b77d7ca38118 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.995566:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109700.995605:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.995610:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f06bdd/0xdb52b77d7ca3811f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.995624:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ec:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.995627:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.995631:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f06bdd/0xdb52b77d7ca3811f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.995639:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7f06bdd/0xdb52b77d7ca3811f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.995645:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f06bdd/0xdb52b77d7ca3811f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.995652:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f06bdd/0xdb52b77d7ca3811f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.995660:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1786109700.995686:0:43922:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:1003 00000100:00100000:1.0:1786109700.995775:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+6:198788:x1872862933362432:12345-0@lo:5:osp-pre-1-1.0 Request processed in 36537us (36654us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109700.995784:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23162 00000100:00100000:1.0:1786109700.995835:0:198788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b56300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:198788:1872862933362432:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1786109700.995860:0:198788:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x401:0x0] from OST, last_created [0x2c0000400:0x401:0x0]last_used is [0x2c0000400:0x3eb:0x0] 00010000:00010000:3.0:1786109700.996062:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109700.996068:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000223bbbb9/0xdb52b77d7ca38118 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996082:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109700.996085:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000223bbbb9/0xdb52b77d7ca38118 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996094:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000223bbbb9/0xdb52b77d7ca38118 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996106:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000223bbbb9/0xdb52b77d7ca38118 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996118:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000223bbbb9/0xdb52b77d7ca38118 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996137:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109700.996140:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7f06bdd/0xdb52b77d7ca3811f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996147:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109700.996150:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f06bdd/0xdb52b77d7ca3811f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996157:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f06bdd/0xdb52b77d7ca3811f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996167:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7f06bdd/0xdb52b77d7ca3811f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996173:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f06bdd/0xdb52b77d7ca3811f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996188:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109700.996189:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109700.996190:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109700.996251:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109700.996257:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca38126 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996264:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ff:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:3.0:1786109700.996267:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109700.996271:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca38126 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996281:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca38126 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996288:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca38126 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996294:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca38126 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996308:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109700.996314:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109700.996317:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca38126 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996323:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109700.996326:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca38126 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996333:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca38126 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996348:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca38126 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996354:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca38126 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109700.996365:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109700.996366:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109700.996368:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109700.996828:0:198788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b57800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:198788:1872862933362688:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1786109700.996993:0:198788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109700.997021:0:198788:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6900 going to sleep for 11 seconds 00000100:00100000:1.0:1786109700.997041:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933362688 00000100:00100000:1.0:1786109700.997046:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933362688 00000100:00100000:1.0:1786109700.997090:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23163 00000100:00100000:1.0:1786109700.997098:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:198788:x1872862933362688:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1786109700.997135:0:43911:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 1026 00000100:00100000:0.0:1786109700.998748:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109700.998766:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933362560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109700.998817:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786109700.998864:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109700.998874:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109700.998886:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933362560 00000100:00100000:0.0:1786109700.998891:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933362560 00000100:00100000:0.0:1786109700.998929:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5923 00000100:00100000:0.0:1786109700.998937:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933362560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109700.998955:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 141760 pending 896 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109700.998997:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933362560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109700.999004:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5923 00000100:00100000:0.0:1786109700.999047:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933362560:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1786109700.999077:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109700.999406:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109700.999415:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca3812d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.999461:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fe:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109700.999465:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109700.999471:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca3812d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.999483:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca3812d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.999491:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca3812d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.999498:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca3812d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109700.999509:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109701.000051:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000001:00100000:0.0:1786109701.000076:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1786109701.000651:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca3812d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.000668:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.000675:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca3812d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.000687:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca3812d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.000715:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca3812d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.000723:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040eb3ba0/0xdb52b77d7ca3812d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.001160:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.001162:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.001164:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109701.005171:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109701.005186:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38134 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.005203:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fd:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:2.0:1786109701.005209:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109701.005215:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38134 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.005228:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38134 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.005238:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38134 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.005245:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38134 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.005272:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109701.005576:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109701.005584:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38134 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.005598:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109701.005603:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38134 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.005612:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38134 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.005631:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38134 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.005638:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38134 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.005655:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109701.005657:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109701.005659:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109701.006116:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109701.006123:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca3813b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.006133:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fc:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:2.0:1786109701.006136:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109701.006141:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca3813b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.006151:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca3813b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.006160:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca3813b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.006167:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca3813b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.006192:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109701.006322:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109701.006329:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca3813b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.006337:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.006341:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca3813b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.006349:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca3813b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.006361:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca3813b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.006369:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca3813b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.006384:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.006386:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.006387:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109701.017164:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109701.017177:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38142 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.017195:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fb:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:2.0:1786109701.017200:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109701.017206:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38142 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.017219:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38142 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.017229:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38142 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.017238:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38142 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.017261:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109701.017591:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109701.017598:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38142 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.017612:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.017616:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38142 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.017625:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38142 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.017643:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38142 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.017650:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38142 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.017673:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.017675:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.017677:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109701.017841:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109701.017848:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38149 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.017941:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fa:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:2.0:1786109701.017945:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109701.017949:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38149 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.017959:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38149 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.017968:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38149 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.017975:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38149 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.017999:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109701.018248:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109701.018254:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38149 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.018262:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.018266:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38149 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.018275:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38149 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.018286:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38149 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.018294:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38149 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.018308:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.018310:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.018311:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109701.018397:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109701.018404:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38150 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.018411:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f9:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:2.0:1786109701.018414:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109701.018418:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38150 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.018426:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38150 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.018467:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38150 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.018474:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38150 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.018492:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109701.018609:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109701.018614:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38150 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.018623:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.018625:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38150 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.018633:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38150 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.018644:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38150 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.018650:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38150 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.018670:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.018672:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.018674:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109701.019135:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109701.019141:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38157 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.019150:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f8:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:2.0:1786109701.019153:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109701.019157:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38157 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.019168:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38157 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.019175:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38157 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.019183:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38157 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.019210:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109701.019511:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109701.019518:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38157 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.019527:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109701.019531:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38157 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.019540:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38157 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.019554:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38157 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.019563:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38157 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.019578:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109701.019580:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109701.019582:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786109701.019675:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00002000:00010000:1.0:1786109701.021211:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109701.021222:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca3815e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.021234:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f7:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109701.021238:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109701.021243:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca3815e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.021257:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca3815e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.021267:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca3815e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.021275:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca3815e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.021306:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109701.021793:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109701.021800:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca38165 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.021809:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f6:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109701.021812:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109701.021816:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca38165 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.021825:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca38165 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.021831:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca38165 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.021837:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca38165 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.021865:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1786109701.022251:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109701.022259:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca3815e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022268:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.022272:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca3815e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022280:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca3815e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022296:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca3815e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022304:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd60dd0b/0xdb52b77d7ca3815e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022322:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109701.022326:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca38165 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022333:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.022337:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca38165 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022343:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca38165 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022353:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca38165 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022359:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099d299b2/0xdb52b77d7ca38165 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022369:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.022371:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.022372:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109701.022754:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109701.022760:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3816c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022768:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f5:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:3.0:1786109701.022771:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109701.022775:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3816c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022784:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3816c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022791:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3816c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022798:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3816c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.022814:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109701.023137:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109701.023144:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3816c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.023152:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109701.023155:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3816c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.023162:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3816c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.023175:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3816c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.023181:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb10969b/0xdb52b77d7ca3816c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.023195:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109701.023197:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109701.023198:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109701.023272:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109701.023829:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109701.023836:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca38173 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.023846:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f4:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109701.023860:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109701.023866:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca38173 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.023877:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca38173 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.023885:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca38173 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.023892:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca38173 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.023914:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109701.024065:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109701.024071:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca38173 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.024084:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.024087:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca38173 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.024094:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca38173 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.024109:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca38173 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.024117:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edfbc100/0xdb52b77d7ca38173 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.024135:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.024136:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.024138:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786109701.024492:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975837 is committed 00000100:00100000:2.0:1786109701.024706:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:198788:x1872862933362688:12345-0@lo:5:osp-pre-1-1.0 Request processed in 27604us (27815us total) trans 4294975837 rc 0/0 00000100:00100000:2.0:1786109701.024716:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23163 00002000:00010000:3.0:1786109701.024826:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109701.024835:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca3817a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.024845:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f3:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:3.0:1786109701.024860:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109701.024866:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca3817a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.024876:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca3817a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.024884:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca3817a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.024892:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca3817a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.024915:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109701.025206:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109701.025213:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca3817a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.025221:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109701.025225:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca3817a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.025234:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca3817a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.025247:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca3817a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.025254:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ccbe017/0xdb52b77d7ca3817a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.025270:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109701.025273:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109701.025274:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109701.025335:0:198788:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975837 gen 2 00000100:00100000:1.0:1786109701.025343:0:198788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b57800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:198788:1872862933362688:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1786109701.025358:0:198788:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x401:0x0]-[0x2c0000400:0x421:0x0] 00000100:00100000:1.0:1786109701.025407:0:198788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b57800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:198788:1872862933362816:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1786109701.025479:0:198788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109701.025504:0:198788:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6900 going to sleep for 11 seconds 00000100:00100000:3.0:1786109701.025594:0:187911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933362816 00000100:00100000:3.0:1786109701.025601:0:187911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933362816 00000100:00100000:3.0:1786109701.025645:0:187911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786109701.025654:0:187911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:198788:x1872862933362816:12345-0@lo:900:osp-pre-1-1.0 00010000:00000080:3.0:1786109701.025681:0:187911:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0b55880 x1872862933362816/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:172/0 lens 264/248 e 0 to 0 dl 1786109712 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109701.025721:0:187911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:198788:x1872862933362816:12345-0@lo:900:osp-pre-1-1.0 Request processed in 68us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109701.025727:0:187911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786109701.025755:0:198788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b57800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:198788:1872862933362816:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1786109701.025858:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109701.025864:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b245ac61/0xdb52b77d7ca38181 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.025872:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f2:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109701.025877:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109701.025881:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b245ac61/0xdb52b77d7ca38181 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.025891:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b245ac61/0xdb52b77d7ca38181 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.025898:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b245ac61/0xdb52b77d7ca38181 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.025905:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b245ac61/0xdb52b77d7ca38181 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.025927:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109701.026249:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109701.026256:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b245ac61/0xdb52b77d7ca38181 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.026265:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.026269:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b245ac61/0xdb52b77d7ca38181 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.026277:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b245ac61/0xdb52b77d7ca38181 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.026290:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b245ac61/0xdb52b77d7ca38181 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.026298:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b245ac61/0xdb52b77d7ca38181 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.026316:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.026318:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.026320:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109701.026393:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109701.026399:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000602b26cc/0xdb52b77d7ca38188 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.026407:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f1:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109701.026411:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109701.026415:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000602b26cc/0xdb52b77d7ca38188 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.026425:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000602b26cc/0xdb52b77d7ca38188 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.026522:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000602b26cc/0xdb52b77d7ca38188 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.026531:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000602b26cc/0xdb52b77d7ca38188 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.026583:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109701.027169:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109701.027177:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3818f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.027187:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f0:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109701.027190:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109701.027194:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3818f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.027203:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3818f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.027211:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3818f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.027217:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3818f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.027752:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109701.027759:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000602b26cc/0xdb52b77d7ca38188 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.027767:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.027770:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000602b26cc/0xdb52b77d7ca38188 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.027779:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000602b26cc/0xdb52b77d7ca38188 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.027793:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000602b26cc/0xdb52b77d7ca38188 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.027800:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000602b26cc/0xdb52b77d7ca38188 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.027814:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109701.027817:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3818f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.027824:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.027827:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3818f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.027834:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3818f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.027844:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3818f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.027864:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.027866:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.027869:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109701.028036:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786109701.028041:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c55b54a3/0xdb52b77d7ca3818f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.028140:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109701.028630:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109701.028636:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca38196 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.028646:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ef:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109701.028649:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109701.028653:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca38196 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.028665:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca38196 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.028674:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca38196 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.028681:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca38196 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.028705:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109701.028887:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109701.028894:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca38196 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.028903:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109701.028906:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca38196 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.028919:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca38196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.028933:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca38196 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.028941:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca38196 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109701.028958:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109701.028959:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109701.028961:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786109701.029129:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109701.029134:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5cfb7f/0xdb52b77d7ca3819d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.029143:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ee:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109701.029146:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109701.029151:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5cfb7f/0xdb52b77d7ca3819d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.029162:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff5cfb7f/0xdb52b77d7ca3819d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.029170:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff5cfb7f/0xdb52b77d7ca3819d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.029178:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff5cfb7f/0xdb52b77d7ca3819d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.029240:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786109701.029571:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109701.029577:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c7481a/0xdb52b77d7ca381a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.029585:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ed:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109701.029588:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109701.029592:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c7481a/0xdb52b77d7ca381a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.029601:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c7481a/0xdb52b77d7ca381a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.029609:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c7481a/0xdb52b77d7ca381a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.029620:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c7481a/0xdb52b77d7ca381a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.033182:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109701.033194:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff5cfb7f/0xdb52b77d7ca3819d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.033209:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.033213:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5cfb7f/0xdb52b77d7ca3819d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.033225:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff5cfb7f/0xdb52b77d7ca3819d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.033247:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff5cfb7f/0xdb52b77d7ca3819d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.033254:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff5cfb7f/0xdb52b77d7ca3819d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.033282:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109701.033286:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c7481a/0xdb52b77d7ca381a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.033293:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.033296:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c7481a/0xdb52b77d7ca381a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.033308:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c7481a/0xdb52b77d7ca381a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.033318:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c7481a/0xdb52b77d7ca381a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.033325:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.033327:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.033329:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109701.034233:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786109701.034242:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c7481a/0xdb52b77d7ca381a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786109701.035908:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109701.035921:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca381ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.035936:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ec:0x0].0x0 since=8557s v=(0 0) 00010000:00010000:1.0:1786109701.035941:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109701.035947:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca381ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.035960:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca381ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.035971:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca381ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109701.035979:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca381ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.038203:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109701.038217:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca381ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.038231:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109701.038235:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca381ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.038246:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca381ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.038270:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca381ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109701.038282:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.038284:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109701.038286:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109701.039233:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786109701.039245:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012467855/0xdb52b77d7ca381ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1786109701.039368:0:8442:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1003 00000100:00100000:1.0:1786109701.039483:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:198786:x1872862933362304:12345-0@lo:5:osp-pre-0-1.0 Request processed in 80759us (80984us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109701.039493:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23161 00000100:00100000:2.0:1786109701.040185:0:198786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:198786:1872862933362304:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1786109701.040201:0:198786:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000401:0x401:0x0] from OST, last_created [0x280000401:0x401:0x0]last_used is [0x280000401:0x3eb:0x0] 00000100:00100000:2.0:1786109701.040271:0:198786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:198786:1872862933363072:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1786109701.040309:0:198786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109701.040336:0:198786:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab29e63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109701.040351:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933362944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109701.040374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109701.040412:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933363072 00000100:00100000:2.0:1786109701.040419:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933363072 00000100:00100000:2.0:1786109701.040482:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23164 00000100:00100000:2.0:1786109701.040492:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:198786:x1872862933363072:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1786109701.040529:0:179242:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1026 00000100:00100000:2.0:1786109701.042186:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+6:198786:x1872862933363072:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1690us (1871us total) trans 38654705679 rc 0/0 00000100:00100000:2.0:1786109701.042196:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23164 00000100:00100000:2.0:1786109701.042238:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933362944 00000100:00100000:2.0:1786109701.042244:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933362944 00000100:00100000:2.0:1786109701.042275:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5924 00000100:00100000:2.0:1786109701.042283:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933362944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109701.042304:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109701.042338:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933362944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109701.042344:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5924 00000100:00100000:2.0:1786109701.042396:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933362944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109701.042449:0:198786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:198786:1872862933363072:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1786109701.042460:0:198786:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000401:0x401:0x0]-[0x280000401:0x421:0x0] 00000100:00100000:2.0:1786109701.042495:0:198786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:198786:1872862933363200:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1786109701.042534:0:198786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109701.042562:0:198786:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab29e63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109701.042723:0:187911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933363200 00000100:00100000:2.0:1786109701.042727:0:187911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933363200 00000100:00100000:2.0:1786109701.042797:0:187911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786109701.042806:0:187911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:198786:x1872862933363200:12345-0@lo:900:osp-pre-0-1.0 00010000:00000080:2.0:1786109701.042824:0:187911:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098ba4ea00 x1872862933363200/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:172/0 lens 264/248 e 0 to 0 dl 1786109712 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109701.042874:0:187911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:198786:x1872862933363200:12345-0@lo:900:osp-pre-0-1.0 Request processed in 69us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109701.042884:0:187911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1786109701.045034:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109701.045415:0:198786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:198786:1872862933363200:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1786109701.384970:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786109701.385619:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383702 is committed 00000020:00000004:2.0:1786109701.837986:0:199097:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1786109701.838237:0:199097:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1786109702.096398:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109702.096479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109702.096940:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922153600 00000100:00100000:1.0:1786109702.096955:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922153600 00000100:00100000:1.0:1786109702.097026:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:1.0:1786109702.097039:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922153600:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109702.100231:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109702.100395:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922153600:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 3355us (4009us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109702.100411:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:1.0:1786109702.117624:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922153728 00000100:00100000:0.0:1786109702.117624:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922153856 00000100:00100000:1.0:1786109702.117642:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922153728 00000100:00100000:0.0:1786109702.117642:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922153856 00000100:00100000:1.0:1786109702.117976:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 400 00000100:00100000:1.0:1786109702.117993:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922153728:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:1.0:1786109702.118034:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0fdd500 x1872862922153728/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:187/0 lens 224/224 e 0 to 0 dl 1786109727 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109702.118136:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922153728:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 148us (17983us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109702.118145:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 400 00000100:00080000:2.0:1786109702.118307:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109702.118313:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109702.118494:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 401 00000100:00100000:1.0:1786109702.118503:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2405:x1872862922153856:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109702.118537:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2405:x1872862922153856:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (22059us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109702.118543:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 401 00010000:00010000:3.0:1786109702.404655:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1786109702.896017:0:199147:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1786109702.896334:0:199147:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1786109703.428597:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109704.452610:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109704.452725:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109704.452745:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933363328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109704.452836:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109704.453173:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933363328 00000100:00100000:1.0:1786109704.453181:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933363328 00000100:00100000:0.0:1786109704.453368:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109704.453377:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933363456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109704.453408:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109704.453454:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933363456 00000100:00100000:0.0:1786109704.453458:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933363456 00000100:00100000:1.0:1786109704.453544:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5925 00000100:00100000:1.0:1786109704.453556:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933363328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109704.453584:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140864 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109704.453641:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933363328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109704.453648:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5925 00000100:00100000:3.0:1786109704.453704:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933363328:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1786109704.453727:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109704.453732:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109704.453876:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5926 00000100:00100000:0.0:1786109704.453885:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933363456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109704.453901:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109704.453946:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933363456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109704.453952:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5926 00000100:00100000:3.0:1786109704.454009:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933363456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109704.928584:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109704.928743:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922153984 00000100:00100000:2.0:1786109704.928754:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922153984 00000100:00080000:0.0:1786109704.928863:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109704.928894:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1190 00000100:00100000:2.0:1786109704.928907:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:164694:x1872862922153984:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109704.928927:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109704.928951:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca381b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17c4 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109704.929101:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca381b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109704.929117:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca381b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109704.929130:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca381b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109704.929185:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:2.0:1786109704.929189:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:2.0:1786109704.929209:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca381b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109704.929233:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca381b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17c4 expref: 9 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109704.929251:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca381b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17c4 expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109704.929260:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:2.0:1786109704.929263:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109704.929267:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986424e00, rc 0) 00010000:00000080:2.0:1786109704.929275:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c51f80 x1872862922153984/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:189/0 lens 576/688 e 0 to 0 dl 1786109729 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1786109704.929342:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+8:164694:x1872862922153984:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 439us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109704.929349:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1190 00000100:00100000:2.0:1786109704.935898:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109704.936150:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922154112 00000100:00100000:1.0:1786109704.936160:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922154112 00000100:00100000:1.0:1786109704.936240:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1191 00000100:00100000:1.0:1786109704.936250:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:164694:x1872862922154112:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:1.0:1786109704.936290:0:187901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00010000:00000080:1.0:1786109704.936312:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7e5ea00 x1872862922154112/t0(0) o41->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:189/0 lens 224/368 e 0 to 0 dl 1786109729 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109704.936426:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:164694:x1872862922154112:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 177us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109704.936460:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1191 00000100:00100000:0.0:1786109704.939692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109704.939859:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922154240 00000100:00100000:2.0:1786109704.939869:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922154240 00000100:00100000:2.0:1786109704.940139:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1192 00000100:00100000:2.0:1786109704.940151:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:164694:x1872862922154240:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1786109704.940188:0:187899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446068224 avail 1299828736 00000100:00100000:2.0:1786109704.940281:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:164694:x1872862922154240:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 132us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109704.940289:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1192 00000100:00080000:0.0:1786109704.940845:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109704.951416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109704.951564:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922154368 00000100:00100000:2.0:1786109704.951575:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922154368 00000100:00100000:2.0:1786109704.951659:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23165 00000100:00100000:2.0:1786109704.951667:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2401:x1872862922154368:12345-192.168.203.38@tcp:8:lfs.0 00010000:00080000:2.0:1786109704.951703:0:43920:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp t0 exp 0000000000000000 cur 8561 last 0 00000020:00000080:2.0:1786109704.951731:0:43920:0:(genops.c:1406:class_connect()) connect: client fac74500-4523-4794-af20-dfdcdfae19c1, cookie 0xdb52b77d7ca381c0 00002000:00100000:2.0:1786109704.951742:0:43920:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fac74500-4523-4794-af20-dfdcdfae19c1/ffff930986508800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786109704.951752:0:43920:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786109704.951818:0:43920:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786109704.951906:0:43920:0:(import.c:65:import_set_state_nolock()) ffff93098650a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109704.952023:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922154368:12345-192.168.203.38@tcp:8:lfs.0 Request processed in 353us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109704.952032:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23165 00000100:00100000:3.0:1786109704.953934:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109704.954042:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922154496 00000100:00100000:2.0:1786109704.954051:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922154496 00000100:00100000:2.0:1786109704.954213:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5927 00000100:00100000:2.0:1786109704.954223:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:164694:x1872862922154496:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1786109704.954246:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109704.954314:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:164694:x1872862922154496:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 91us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109704.954320:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5927 00000100:00080000:0.0:1786109704.954780:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109704.956392:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109704.956607:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922154624 00000100:00100000:3.0:1786109704.956616:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922154624 00000100:00100000:3.0:1786109704.956699:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23166 00000100:00100000:3.0:1786109704.956708:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:0+-99:2401:x1872862922154624:12345-192.168.203.38@tcp:8:lfs.0 00010000:00080000:3.0:1786109704.956741:0:179240:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp t0 exp 0000000000000000 cur 8561 last 0 00000020:00000080:3.0:1786109704.956771:0:179240:0:(genops.c:1406:class_connect()) connect: client fac74500-4523-4794-af20-dfdcdfae19c1, cookie 0xdb52b77d7ca381c7 00002000:00100000:3.0:1786109704.956781:0:179240:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fac74500-4523-4794-af20-dfdcdfae19c1/ffff930ab8da0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786109704.956792:0:179240:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786109704.956877:0:179240:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786109704.956919:0:179240:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786109704.957006:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922154624:12345-192.168.203.38@tcp:8:lfs.0 Request processed in 298us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109704.957014:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23166 00000100:00100000:3.0:1786109704.958506:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109704.958614:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922154752 00000100:00100000:1.0:1786109704.958623:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922154752 00000100:00100000:1.0:1786109704.958738:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5928 00000100:00100000:1.0:1786109704.958748:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:164694:x1872862922154752:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109704.958773:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109704.958848:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:164694:x1872862922154752:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 100us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109704.958855:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5928 00000100:00080000:0.0:1786109704.959288:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786109705.476648:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109705.989913:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933363584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109705.990247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109705.990909:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933363584 00000100:00100000:1.0:1786109705.990920:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933363584 00000100:00100000:1.0:1786109705.991003:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12499 00000100:00100000:1.0:1786109705.991015:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933363584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109705.991064:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446068224 avail 1299828736 00000100:00100000:1.0:1786109705.991137:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933363584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109705.991145:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12499 00000100:00100000:3.0:1786109705.992114:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933363584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109705.992911:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109705.992928:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933363712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109705.993073:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109705.993130:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933363712 00000100:00100000:1.0:1786109705.993137:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933363712 00000100:00100000:1.0:1786109705.993189:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12500 00000100:00100000:1.0:1786109705.993199:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933363712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109705.993237:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00010000:00000080:1.0:1786109705.993255:0:8452:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0b55180 x1872862933363712/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:176/0 lens 224/368 e 0 to 0 dl 1786109716 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109705.993298:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933363712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109705.993307:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12500 00000100:00100000:1.0:1786109705.993356:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933363712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109705.996772:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933364224:0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.997025:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109705.997082:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933364736:0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.997109:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109705.997141:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1786109705.997148:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933363840:0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.997184:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109705.997218:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933364352:0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.997243:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109705.997260:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933364864:0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.997285:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109705.997319:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933364224 00000100:00100000:2.0:1786109705.997329:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933364224 00000100:00100000:2.0:1786109705.997392:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933364736 00000100:00100000:2.0:1786109705.997396:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933364736 00000100:00100000:2.0:1786109705.997417:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933364352 00000100:00100000:2.0:1786109705.997420:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933364352 00000100:00100000:2.0:1786109705.997478:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1786109705.997490:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933364224:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109705.997536:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97c4f100 x1872862933364224/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:190/0 lens 224/224 e 0 to 0 dl 1786109730 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109705.997585:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933364224:12345-0@lo:400:kworker.0 Request processed in 96us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109705.997592:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1786109705.997611:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1786109705.997618:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933364736:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109705.997630:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309854f9f80 x1872862933364736/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:190/0 lens 224/224 e 0 to 0 dl 1786109730 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109705.997658:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933364736:12345-0@lo:400:kworker.0 Request processed in 40us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109705.997677:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1786109705.997690:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1786109705.997697:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933364352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.997728:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933364352:12345-0@lo:400:kworker.0 Request processed in 31us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109705.997734:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1786109705.997754:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933363840 00000100:00100000:2.0:1786109705.997758:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933363840 00000100:00100000:2.0:1786109705.997787:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1786109705.997809:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933363840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.997853:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933363840:12345-0@lo:400:kworker.0 Request processed in 46us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109705.997860:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1786109705.997915:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933364096:0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.997944:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109705.997979:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933364608:0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.998007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109705.998025:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933365120:0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.998047:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109705.998068:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1786109705.998075:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933363968:0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.998097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109705.998116:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab928ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933364480:0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.998136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109705.998164:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933364992:0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.998191:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109705.998220:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933364864 00000100:00100000:2.0:1786109705.998224:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933364864 00000100:00100000:2.0:1786109705.998254:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933364608 00000100:00100000:2.0:1786109705.998256:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933364608 00000100:00100000:2.0:1786109705.998274:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933364480 00000100:00100000:2.0:1786109705.998276:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933364480 00000100:00100000:2.0:1786109705.998295:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933364992 00000100:00100000:2.0:1786109705.998298:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933364992 00000100:00100000:2.0:1786109705.998318:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7096 00000100:00100000:2.0:1786109705.998324:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933364864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.998358:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933364864:12345-0@lo:400:kworker.0 Request processed in 34us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109705.998365:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7096 00000100:00100000:2.0:1786109705.998377:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7097 00000100:00100000:2.0:1786109705.998383:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933364608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.998416:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933364608:12345-0@lo:400:kworker.0 Request processed in 33us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109705.998422:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7097 00000100:00100000:2.0:1786109705.998461:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7098 00000100:00100000:2.0:1786109705.998468:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933364480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.998496:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933364480:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109705.998502:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7098 00000100:00100000:2.0:1786109705.998514:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7099 00000100:00100000:2.0:1786109705.998522:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933364992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.998547:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933364992:12345-0@lo:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109705.998555:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7099 00000100:00100000:2.0:1786109705.998583:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933364096 00000100:00100000:2.0:1786109705.998586:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933364096 00000100:00100000:2.0:1786109705.998612:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933365120 00000100:00100000:2.0:1786109705.998615:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933365120 00000100:00100000:2.0:1786109705.998623:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933363968 00000100:00100000:2.0:1786109705.998625:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933363968 00000100:00100000:2.0:1786109705.998637:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1786109705.998643:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933364096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109705.998673:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933364096:12345-0@lo:400:kworker.0 Request processed in 30us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109705.998678:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1786109705.998689:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1786109705.998695:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933365120:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109705.998707:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9119f80 x1872862933365120/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:190/0 lens 224/224 e 0 to 0 dl 1786109730 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109705.998732:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933365120:12345-0@lo:400:kworker.0 Request processed in 37us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109705.998738:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1786109705.998748:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1786109705.998754:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933363968:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109705.998765:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9118380 x1872862933363968/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:190/0 lens 224/224 e 0 to 0 dl 1786109730 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109705.998792:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933363968:12345-0@lo:400:kworker.0 Request processed in 38us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109705.998799:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00080000:0.0:1786109705.999243:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109705.999249:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109705.999252:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109705.999255:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109706.007861:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933363840:0@lo:400:kworker.0 00010000:00080000:2.0:1786109706.007894:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ab9288700 x1872862933364352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109706.007907:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933364352:0@lo:400:kworker.0 00000100:00100000:2.0:1786109706.007926:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933364864:0@lo:400:kworker.0 00000100:00100000:2.0:1786109706.007940:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933364224:0@lo:400:kworker.0 00000100:00100000:2.0:1786109706.007952:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933364736:0@lo:400:kworker.0 00000100:00100000:2.0:1786109706.008016:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933363968:0@lo:400:kworker.0 00000100:00100000:2.0:1786109706.008031:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab928ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933364480:0@lo:400:kworker.0 00000100:00100000:2.0:1786109706.008044:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933364992:0@lo:400:kworker.0 00010000:00080000:2.0:1786109706.008059:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac0fb9f80 x1872862933364096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109706.008069:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933364096:0@lo:400:kworker.0 00000100:00100000:2.0:1786109706.008083:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933364608:0@lo:400:kworker.0 00000100:00100000:2.0:1786109706.008096:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933365120:0@lo:400:kworker.0 00000100:00100000:2.0:1786109706.501006:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933365248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109706.501090:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786109706.501583:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109706.503908:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933365248 00000100:00100000:2.0:1786109706.503922:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933365248 00000100:00100000:2.0:1786109706.503971:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5929 00000100:00100000:2.0:1786109706.503982:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933365248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109706.504016:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109706.504153:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933365376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109706.504215:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109706.504256:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933365376 00000100:00100000:1.0:1786109706.504261:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933365376 00000100:00100000:1.0:1786109706.504285:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5930 00000100:00100000:1.0:1786109706.504292:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933365376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109706.504308:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109706.504343:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933365376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109706.504350:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5930 00000100:00100000:1.0:1786109706.504388:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933365376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109706.504480:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933365248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 500us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109706.504487:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5929 00000001:00100000:1.0:1786109706.506509:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00080000:1.0:1786109706.506525:0:194579:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705679 is committed 00000100:00100000:2.0:1786109706.509782:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933365248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109707.297362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109707.297481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109707.297930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109707.297951:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109707.298009:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109707.298051:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922155008 00000100:00100000:2.0:1786109707.298060:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922155008 00000100:00100000:2.0:1786109707.298121:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922155136 00000100:00100000:2.0:1786109707.298125:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922155136 00000100:00100000:2.0:1786109707.298153:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 408 00000100:00100000:2.0:1786109707.298162:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:2405:x1872862922155008:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:2.0:1786109707.298192:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9118700 x1872862922155008/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:192/0 lens 224/224 e 0 to 0 dl 1786109732 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109707.298250:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:2405:x1872862922155008:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 89us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109707.298258:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 408 00000100:00100000:2.0:1786109707.298279:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 409 00000100:00100000:2.0:1786109707.298285:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922155136:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109707.298312:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922155136:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109707.298321:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 409 00000100:00100000:2.0:1786109707.298341:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922155264 00000100:00100000:2.0:1786109707.298345:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922155264 00000100:00100000:2.0:1786109707.298369:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922155392 00000100:00100000:2.0:1786109707.298372:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922155392 00000100:00100000:2.0:1786109707.298392:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7100 00000100:00100000:2.0:1786109707.298399:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922155264:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109707.298453:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922155264:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109707.298460:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7100 00000100:00100000:2.0:1786109707.298473:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7101 00000100:00100000:2.0:1786109707.298480:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922155392:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109707.298504:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922155392:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109707.298510:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7101 00000100:00080000:2.0:1786109707.298526:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109707.298530:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109707.298533:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109707.298535:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109707.298678:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922154880 00000100:00100000:1.0:1786109707.298683:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922154880 00000100:00100000:1.0:1786109707.298832:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:1.0:1786109707.298841:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2404:x1872862922154880:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109707.298874:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2404:x1872862922154880:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109707.298880:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 132 00010000:00010000:3.0:1786109707.529020:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786109707.532268:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00010000:00010000:1.0:1786109708.549935:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109709.572667:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109709.572783:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933365504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109709.572845:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933365632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109709.572913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109709.572978:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933365632 00000100:00100000:1.0:1786109709.572990:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933365632 00000100:00100000:1.0:1786109709.573050:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5931 00000100:00100000:1.0:1786109709.573067:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933365632:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786109709.573101:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1786109709.573103:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109709.573171:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109709.573172:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933365632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109709.573193:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5931 00000100:00100000:2.0:1786109709.573277:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933365632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109709.573339:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933365504 00000100:00100000:1.0:1786109709.573343:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933365504 00000100:00080000:2.0:1786109709.573393:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109709.573466:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5932 00000100:00100000:1.0:1786109709.573474:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933365504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109709.573491:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109709.573538:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933365504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109709.573546:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5932 00000100:00100000:3.0:1786109709.573564:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933365504:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786109710.596614:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786109710.852267:0:199340:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 00000100:00100000:2.0:1786109711.110553:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933365760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109711.110625:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109711.110711:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933365760 00000100:00100000:2.0:1786109711.110718:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933365760 00000100:00100000:2.0:1786109711.110759:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12501 00000100:00100000:2.0:1786109711.110768:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933365760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109711.110816:0:8451:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446068224 avail 1299828736 00000100:00100000:2.0:1786109711.110860:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933365760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109711.110867:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12501 00000100:00100000:2.0:1786109711.110917:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933365760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109711.111087:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933365888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109711.111118:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109711.111149:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933365888 00000100:00100000:1.0:1786109711.111153:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933365888 00000100:00100000:1.0:1786109711.111180:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12502 00000100:00100000:1.0:1786109711.111187:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933365888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109711.111206:0:8452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00010000:00000080:1.0:1786109711.111219:0:8452:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0b54000 x1872862933365888/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:182/0 lens 224/368 e 0 to 0 dl 1786109722 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109711.111252:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933365888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109711.111261:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12502 00000100:00100000:1.0:1786109711.111294:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933365888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109711.114997:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933366016:0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.115068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109711.115108:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933366528:0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.115136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109711.115161:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933367040:0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.115186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109711.115207:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1786109711.115213:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933366144:0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.115234:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109711.115251:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933366656:0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.115269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109711.115285:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933367168:0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.115306:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109711.115335:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933367040 00000100:00100000:3.0:1786109711.115341:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933367040 00000100:00100000:3.0:1786109711.115391:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933366656 00000100:00100000:3.0:1786109711.115394:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933366656 00000100:00100000:3.0:1786109711.115413:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7102 00000100:00100000:3.0:1786109711.115422:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933367040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.115487:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933367040:12345-0@lo:400:kworker.0 Request processed in 66us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109711.115495:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7102 00000100:00100000:3.0:1786109711.115508:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933367168 00000100:00100000:3.0:1786109711.115512:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933367168 00000100:00100000:3.0:1786109711.115531:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7103 00000100:00100000:3.0:1786109711.115536:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933366656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.115562:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933366656:12345-0@lo:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109711.115567:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7103 00000100:00100000:3.0:1786109711.115576:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7104 00000100:00100000:3.0:1786109711.115585:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933367168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.115605:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933367168:12345-0@lo:400:kworker.0 Request processed in 25us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109711.115610:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7104 00000100:00100000:3.0:1786109711.115640:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933366656:0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.115649:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933367168:0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.115655:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705679 gen 2 00000100:00100000:3.0:1786109711.115666:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933367040:0@lo:400:kworker.0 00000100:00100000:0.0:1786109711.115774:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933366528 00000100:00100000:0.0:1786109711.115778:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933366528 00000100:00100000:0.0:1786109711.115820:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933366144 00000100:00100000:0.0:1786109711.115823:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933366144 00000100:00100000:0.0:1786109711.115848:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1786109711.115856:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933366528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109711.115896:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933366528:12345-0@lo:400:kworker.0 Request processed in 42us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109711.115901:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1786109711.115916:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1786109711.115921:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933366144:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109711.115934:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa66ef480 x1872862933366144/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:182/0 lens 224/224 e 0 to 0 dl 1786109722 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109711.115957:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933366144:12345-0@lo:400:kworker.0 Request processed in 36us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109711.115962:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1786109711.115990:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933366144:0@lo:400:kworker.0 00010000:00080000:0.0:1786109711.116002:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930aa66eca80 x1872862933366528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109711.116010:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933366528:0@lo:400:kworker.0 00000100:00100000:1.0:1786109711.116921:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933366400:0@lo:400:kworker.0 00000100:00100000:1.0:1786109711.116964:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109711.117008:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933366912:0@lo:400:kworker.0 00000100:00100000:1.0:1786109711.117027:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109711.117044:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1786109711.117050:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933366272:0@lo:400:kworker.0 00000100:00100000:1.0:1786109711.117070:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109711.117090:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933366784:0@lo:400:kworker.0 00000100:00100000:1.0:1786109711.117108:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109711.117122:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933367296:0@lo:400:kworker.0 00000100:00100000:1.0:1786109711.117140:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109711.117166:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933366784 00000100:00100000:1.0:1786109711.117171:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933366784 00000100:00100000:1.0:1786109711.117207:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7105 00000100:00100000:1.0:1786109711.117216:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933366784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109711.117256:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933366784:12345-0@lo:400:kworker.0 Request processed in 42us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109711.117263:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7105 00000100:00100000:1.0:1786109711.117297:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933366784:0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.117365:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933366400 00000100:00100000:3.0:1786109711.117369:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933366400 00000100:00100000:3.0:1786109711.117390:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933366912 00000100:00100000:3.0:1786109711.117392:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933366912 00000100:00100000:3.0:1786109711.117400:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933366272 00000100:00100000:3.0:1786109711.117402:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933366272 00000100:00100000:3.0:1786109711.117411:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933367296 00000100:00100000:3.0:1786109711.117413:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933367296 00000100:00100000:3.0:1786109711.117423:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1786109711.117458:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933366400:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109711.117472:0:196401:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0b54a80 x1872862933366400/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:182/0 lens 224/224 e 0 to 0 dl 1786109722 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109711.117507:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933366400:12345-0@lo:400:kworker.0 Request processed in 78us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109711.117514:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1786109711.117526:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1786109711.117531:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933366912:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109711.117542:0:196401:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0b57100 x1872862933366912/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:182/0 lens 224/224 e 0 to 0 dl 1786109722 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109711.117565:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933366912:12345-0@lo:400:kworker.0 Request processed in 34us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109711.117571:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1786109711.117581:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1786109711.117586:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933366272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.117608:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933366272:12345-0@lo:400:kworker.0 Request processed in 23us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109711.117613:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1786109711.117621:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1786109711.117627:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933367296:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109711.117637:0:196401:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0b56300 x1872862933367296/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:182/0 lens 224/224 e 0 to 0 dl 1786109722 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109711.117660:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933367296:12345-0@lo:400:kworker.0 Request processed in 34us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109711.117666:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00010000:00080000:1.0:1786109711.117781:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a97809f80 x1872862933366272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109711.117803:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933366272:0@lo:400:kworker.0 00000100:00100000:1.0:1786109711.117815:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933367296:0@lo:400:kworker.0 00000100:00100000:1.0:1786109711.117824:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933366400:0@lo:400:kworker.0 00000100:00100000:1.0:1786109711.117833:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933366912:0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.118049:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933366016 00000100:00100000:3.0:1786109711.118054:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933366016 00000100:00100000:3.0:1786109711.118097:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1786109711.118105:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933366016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109711.118145:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933366016:12345-0@lo:400:kworker.0 Request processed in 41us (3077us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109711.118152:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1786109711.118908:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933366016:0@lo:400:kworker.0 00000100:00080000:2.0:1786109711.120141:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786109711.120148:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109711.120151:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109711.120154:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109711.620867:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933367424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109711.620942:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109711.620999:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933367424 00000100:00100000:2.0:1786109711.621007:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933367424 00000100:00100000:2.0:1786109711.621054:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5933 00000100:00100000:2.0:1786109711.621064:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933367424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109711.621094:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109711.621139:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933367424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109711.621147:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5933 00000100:00100000:2.0:1786109711.621354:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933367424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109711.621723:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933367552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109711.621756:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109711.621855:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933367552 00000100:00100000:0.0:1786109711.621860:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933367552 00000100:00100000:0.0:1786109711.621904:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5934 00000100:00100000:0.0:1786109711.621912:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933367552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109711.621931:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109711.621966:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933367552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109711.621974:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5934 00010000:00010000:1.0:1786109711.622033:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109711.622100:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933367552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109712.415545:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109712.415587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109712.415604:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922155520 00000100:00100000:3.0:1786109712.415615:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922155520 00000100:00100000:2.0:1786109712.415619:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109712.415643:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109712.415672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109712.415679:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:3.0:1786109712.415691:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922155520:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109712.415715:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922155776 00000100:00100000:2.0:1786109712.415721:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922155776 00000100:00100000:2.0:1786109712.415759:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922155648 00000100:00100000:2.0:1786109712.415761:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922155648 00000100:00100000:2.0:1786109712.415796:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 416 00000100:00100000:2.0:1786109712.415804:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2403:x1872862922155776:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109712.415862:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922155520:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 172us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109712.415871:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:1.0:1786109712.415887:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 417 00000100:00100000:1.0:1786109712.415900:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+8:2403:x1872862922155648:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:1.0:1786109712.415916:0:196401:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab911a680 x1872862922155648/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:183/0 lens 224/224 e 0 to 0 dl 1786109723 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109712.416293:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2403:x1872862922155776:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 489us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109712.416301:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 416 00000100:00100000:2.0:1786109712.416323:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922156032 00000100:00100000:2.0:1786109712.416327:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922156032 00000100:00100000:2.0:1786109712.416353:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922155904 00000100:00100000:2.0:1786109712.416356:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922155904 00000100:00100000:2.0:1786109712.416378:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7106 00000100:00100000:2.0:1786109712.416385:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922156032:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109712.416413:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922156032:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109712.416419:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7106 00000100:00100000:2.0:1786109712.416450:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7107 00000100:00100000:2.0:1786109712.416457:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922155904:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109712.416483:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922155904:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109712.416490:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7107 00000100:00080000:2.0:1786109712.416506:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109712.416510:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109712.416513:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786109712.416515:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109712.416982:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+8:2403:x1872862922155648:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1084us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109712.416990:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 417 00010000:00010000:1.0:1786109712.644943:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786109713.152125:0:199388:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1786109713.669004:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109714.692947:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109714.693961:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933367808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109714.694038:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109714.694138:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933367680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109714.694820:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933367808 00000100:00100000:2.0:1786109714.694828:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933367808 00000100:00100000:2.0:1786109714.694890:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5935 00000100:00100000:2.0:1786109714.694904:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933367808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786109714.694934:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00080000:1.0:1786109714.695096:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109714.695628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109714.695795:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933367680 00000100:00100000:1.0:1786109714.695800:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933367680 00000100:00100000:1.0:1786109714.697879:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5936 00000100:00100000:1.0:1786109714.697893:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933367680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786109714.697924:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109714.697988:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933367680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109714.697995:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5936 00000100:00080000:1.0:1786109714.698017:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109714.698137:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933367680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109714.698261:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933367808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3361us (4222us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109714.698268:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5935 00000100:00100000:0.0:1786109714.698447:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933367808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109715.107000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.107325:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922156160 00000100:00100000:0.0:1786109715.107336:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922156160 00000100:00100000:0.0:1786109715.107418:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1193 00000100:00100000:0.0:1786109715.107472:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+8:165161:x1872862922156160:12345-192.168.203.38@tcp:41:lfs.0 00000100:00080000:1.0:1786109715.107504:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1786109715.107510:0:189813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00010000:00000080:0.0:1786109715.107531:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309854f8e00 x1872862922156160/t0(0) o41->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:186/0 lens 224/368 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109715.107606:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+8:165161:x1872862922156160:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 180us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109715.107614:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1193 00000100:00100000:2.0:1786109715.111833:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.111942:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922156288 00000100:00100000:3.0:1786109715.111953:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922156288 00000100:00080000:1.0:1786109715.112027:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109715.112081:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1194 00000100:00100000:3.0:1786109715.112092:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:165161:x1872862922156288:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:3.0:1786109715.112131:0:188678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446068224 avail 1299828736 00000100:00100000:3.0:1786109715.112942:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:165161:x1872862922156288:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 847us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109715.112951:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1194 00000100:00100000:3.0:1786109715.119091:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.119165:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922156416 00000100:00100000:1.0:1786109715.119175:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922156416 00000100:00100000:1.0:1786109715.119482:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5937 00000100:00100000:1.0:1786109715.119494:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:165161:x1872862922156416:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109715.119522:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109715.119598:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:165161:x1872862922156416:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 106us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109715.119606:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5937 00000100:00080000:2.0:1786109715.119940:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109715.133246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.135040:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922156544 00000100:00100000:1.0:1786109715.135052:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922156544 00000100:00100000:1.0:1786109715.135195:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5938 00000100:00100000:1.0:1786109715.135208:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:165161:x1872862922156544:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109715.135235:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109715.135311:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:165161:x1872862922156544:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 105us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109715.135319:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5938 00000100:00080000:2.0:1786109715.135377:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109715.281023:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.281274:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922156800 00000100:00100000:2.0:1786109715.281284:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922156800 00000100:00100000:2.0:1786109715.281351:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1195 00000100:00100000:2.0:1786109715.281362:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+8:165180:x1872862922156800:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109715.281383:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109715.281403:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca381ce lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17cb expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.283457:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca381d5 lrc: 3/1,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.283479:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca381d5 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.283490:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca381d5 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.283507:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425c00/0xdb52b77d7ca381dc lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.283515:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986425c00/0xdb52b77d7ca381dc lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.283521:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425c00/0xdb52b77d7ca381dc lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109715.283634:0:187900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c28000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187900:1872862933367936:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786109715.283696:0:187900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109715.283826:0:187900:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a83969540 going to sleep for 11 seconds 00000100:00100000:1.0:1786109715.283881:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933367936 00000100:00100000:1.0:1786109715.283888:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933367936 00000100:00100000:1.0:1786109715.284217:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12503 00000100:00100000:1.0:1786109715.284228:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187900:x1872862933367936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786109715.284470:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:187900:x1872862933367936:12345-0@lo:1000:mdt00_001.0 Request processed in 243us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109715.284477:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12503 00000100:00100000:0.0:1786109715.284562:0:187900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c28000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:187900:1872862933367936:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1786109715.284909:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca381e3 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.284923:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca381e3 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.284931:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca381e3 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.284943:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca381d5 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.284948:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca381d5 lrc: 2/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.284954:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca381d5 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.284959:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.284963:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca381d5 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.284969:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca381d5 lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.284979:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:0.0:1786109715.284982:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.284986:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca381d5 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.284991:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca381d5 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.285005:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425c00/0xdb52b77d7ca381dc lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.285011:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986425c00/0xdb52b77d7ca381dc lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.285017:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986425c00/0xdb52b77d7ca381dc lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.285022:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.285025:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425c00/0xdb52b77d7ca381dc lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.285031:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425c00/0xdb52b77d7ca381dc lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.285038:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0xf7117594 (ffff930ab2894f00) 00010000:00010000:0.0:1786109715.285041:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.285736:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986425c00/0xdb52b77d7ca381dc lrc: 2/0,0 mode: --/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.285746:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425c00/0xdb52b77d7ca381dc lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.285821:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca381ce lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17cb expref: 10 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.285835:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca381e3 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17cb expref: 9 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.285842:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a92c11300) 00010000:00010000:0.0:1786109715.285845:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786109715.285847:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9c00, rc 0) 00010000:00000080:0.0:1786109715.285855:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa66eed80 x1872862922156800/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:186/0 lens 656/608 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1786109715.285921:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+9:165180:x1872862922156800:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 4562us (4908us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109715.285929:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1195 00000100:00100000:0.0:1786109715.296984:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.297165:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922157056 00000100:00100000:3.0:1786109715.297175:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922157056 00000100:00100000:3.0:1786109715.297282:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1196 00000100:00100000:3.0:1786109715.297294:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:165180:x1872862922157056:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109715.297314:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109715.297609:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca381ea lrc: 2/0,0 mode: --/CR res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17d2 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109715.307258:0:187899:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9464us 00000004:00200000:3.0:1786109715.322699:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x16:0x0]: returning size 4096 00010000:00010000:3.0:1786109715.322935:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca381ea lrc: 1/0,0 mode: --/CR res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17d2 expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.323031:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930aa0615800) 00010000:00010000:3.0:1786109715.323035:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786109715.323041:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06a00/0xdb52b77d7ca381ea lrc: 0/0,0 mode: --/CR res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17d2 expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.323311:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f06a00, rc 0) 00000100:00100000:3.0:1786109715.323378:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:165180:x1872862922157056:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 26086us (26403us total) trans 30064771073 rc 301/301 00000100:00100000:3.0:1786109715.323387:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1196 00000100:00100000:1.0:1786109715.335814:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.335932:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922157312 00000100:00100000:0.0:1786109715.335957:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922157312 00000100:00100000:0.0:1786109715.336045:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:0.0:1786109715.336057:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b63450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:165180:x1872862922157312:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1786109715.336481:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b63450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+8:165180:x1872862922157312:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 425us (679us total) trans 30064771074 rc 0/0 00000100:00100000:0.0:1786109715.336490:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:0.0:1786109715.364643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.364776:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922157568 00000100:00100000:2.0:1786109715.364786:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922157568 00000100:00100000:2.0:1786109715.364928:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1197 00000100:00100000:2.0:1786109715.364939:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:165186:x1872862922157568:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:2.0:1786109715.364962:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109715.364985:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca381f8 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17d9 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109715.365092:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID:187901:1872862933368064:0@lo:900:mdt00_002.0 00000100:00100000:2.0:1786109715.365142:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109715.365180:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a83969000 going to sleep for 11 seconds 00000100:00100000:0.0:1786109715.365291:0:187911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933368064 00000100:00100000:0.0:1786109715.365295:0:187911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933368064 00000100:00100000:0.0:1786109715.365335:0:187911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786109715.365343:0:187911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:187901:x1872862933368064:12345-0@lo:900:mdt00_002.0 00010000:00000080:0.0:1786109715.365361:0:187911:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1ff2d80 x1872862933368064/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:186/0 lens 264/248 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109715.365409:0:187911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:187901:x1872862933368064:12345-0@lo:900:mdt00_002.0 Request processed in 67us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109715.365417:0:187911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786109715.365589:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID:187901:1872862933368064:0@lo:900:mdt00_002.0 00000100:00100000:2.0:1786109715.365642:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187901:1872862933368192:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786109715.365672:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109715.365698:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a83969a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786109715.365789:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933368192 00000100:00100000:1.0:1786109715.365794:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933368192 00000100:00100000:1.0:1786109715.365900:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12504 00000100:00100000:1.0:1786109715.365908:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:187901:x1872862933368192:12345-0@lo:1000:mdt00_002.0 00010000:00000080:1.0:1786109715.365942:0:8452:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098ba4f480 x1872862933368192/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 304/4320 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109715.366030:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:187901:x1872862933368192:12345-0@lo:1000:mdt00_002.0 Request processed in 123us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109715.366038:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12504 00000100:00100000:3.0:1786109715.366125:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187901:1872862933368192:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1786109715.366176:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.366185:0:187901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.366194:0:187901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109715.366350:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187901:1872862933368320:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1786109715.366379:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109715.366464:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9689840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109715.366557:0:177399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933368320 00000100:00100000:2.0:1786109715.366562:0:177399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933368320 00000100:00100000:2.0:1786109715.366631:0:177399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12505 00000100:00100000:2.0:1786109715.366640:0:177399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:187901:x1872862933368320:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786109715.366650:0:177399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109715.366664:0:177399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38206 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca381ff expref: -99 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.366687:0:177399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38206 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca381ff expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.366703:0:177399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38206 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca381ff expref: 6 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.366713:0:177399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:2.0:1786109715.366716:0:177399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786109715.366720:0:177399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986424800, rc 0) 00010000:00000080:2.0:1786109715.366725:0:177399:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa66eea00 x1872862933368320/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 328/344 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109715.366780:0:177399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187901:x1872862933368320:12345-0@lo:101:mdt00_002.0 Request processed in 141us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109715.366786:0:177399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12505 00000100:00100000:3.0:1786109715.366902:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187901:1872862933368320:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1786109715.366915:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38206 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.366928:0:187901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38206 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109715.366950:0:187901:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1786109715.366957:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38206 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.366965:0:187901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38206 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.367042:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3820d lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.367051:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3820d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.367062:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3820d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.367077:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca38214 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.367084:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca38214 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.367091:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca38214 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109715.367197:0:187901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187901:1872862933368448:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786109715.367422:0:187901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109715.367566:0:187901:0:(client.c:2702:ptlrpc_set_wait()) set ffff930aafd176c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109715.367660:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933368448 00000100:00100000:1.0:1786109715.367666:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933368448 00000100:00100000:1.0:1786109715.367708:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12506 00000100:00100000:1.0:1786109715.367717:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab5389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187901:x1872862933368448:12345-0@lo:1000:mdt00_002.0 00010000:00000080:1.0:1786109715.367748:0:8451:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab5389050 x1872862933368448/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 328/4320 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109715.367800:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab5389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:187901:x1872862933368448:12345-0@lo:1000:mdt00_002.0 Request processed in 84us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109715.367921:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12506 00000100:00100000:1.0:1786109715.368181:0:187901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:187901:1872862933368448:0@lo:1000:mdt00_002.0 00000004:00080000:1.0:1786109715.368566:0:187901:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x3ec:0x0], count =22 00000004:00080000:1.0:1786109715.368575:0:187901:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x3ec:0x0]+22 in llog 00000004:00080000:1.0:1786109715.368588:0:187901:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x402:0x0], index 0: 0 00010000:00010000:1.0:1786109715.368746:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3821b lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.368772:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3821b lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.368788:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3821b lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.368927:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3820d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.368936:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3820d lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.368944:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3820d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.368950:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.368955:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3820d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.368963:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3820d lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.368976:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930ab2894700) 00010000:00010000:1.0:1786109715.368979:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.368982:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3820d lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.368988:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3820d lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.369012:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e020d0f reply state 00000000cc43de9c transno 30064771075 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca38214 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.369024:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca38214 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.369032:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x679fc7b1 (ffff930aa0615700) 00010000:00010000:1.0:1786109715.369034:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.369037:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109715.369070:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca381f8 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17d9 expref: 11 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.369088:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3821b lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17d9 expref: 10 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.369096:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x17:0x0].0x0 (ffff930a90808100) 00010000:00010000:1.0:1786109715.369098:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786109715.369100:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9361e00, rc 0) 00000100:00100000:1.0:1786109715.369223:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+11:165186:x1872862922157568:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 4284us (4588us total) trans 30064771075 rc 0/0 00000100:00100000:1.0:1786109715.369231:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1197 00000100:00100000:1.0:1786109715.375787:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.375879:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922157824 00000100:00100000:3.0:1786109715.375889:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922157824 00000100:00100000:3.0:1786109715.376003:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:3.0:1786109715.376014:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+11:165186:x1872862922157824:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:3.0:1786109715.376360:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+12:165186:x1872862922157824:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 347us (581us total) trans 30064771076 rc 0/0 00000100:00100000:3.0:1786109715.376368:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:3.0:1786109715.384654:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.384752:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922158080 00000100:00100000:1.0:1786109715.384776:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922158080 00000100:00100000:1.0:1786109715.384840:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1198 00000100:00100000:1.0:1786109715.384851:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+12:165186:x1872862922158080:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:1.0:1786109715.384874:0:196401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109715.384898:0:196401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38229 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17e0 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.384997:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca38230 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385015:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca38230 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385027:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca38230 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385039:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360600/0xdb52b77d7ca38237 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385047:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360600/0xdb52b77d7ca38237 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385054:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360600/0xdb52b77d7ca38237 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109715.385319:0:196401:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x3ec:0x0], count =22 00000004:00080000:1.0:1786109715.385325:0:196401:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x3ec:0x0]+22 in llog 00000004:00080000:1.0:1786109715.385332:0:196401:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x402:0x0], index 1: 0 00010000:00010000:1.0:1786109715.385611:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3823e lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385621:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3823e lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385627:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3823e lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385660:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca38230 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385667:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca38230 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385674:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca38230 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385680:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.385684:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca38230 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385691:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca38230 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385702:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a90808300) 00010000:00010000:1.0:1786109715.385705:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.385709:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca38230 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385715:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca38230 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.385730:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000076ce177 reply state 000000000b061eb7 transno 30064771077 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360600/0xdb52b77d7ca38237 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385740:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360600/0xdb52b77d7ca38237 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385746:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x94c295fa (ffff930a90808000) 00010000:00010000:1.0:1786109715.385748:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.385750:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786109715.385789:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38229 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17e0 expref: 15 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385812:0:196401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3823e lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17e0 expref: 14 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.385819:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x18:0x0].0x0 (ffff930a90808200) 00010000:00010000:1.0:1786109715.385822:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786109715.385824:0:196401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360800, rc 0) 00000100:00100000:1.0:1786109715.385929:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+15:165186:x1872862922158080:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1080us (1285us total) trans 30064771077 rc 0/0 00000100:00100000:1.0:1786109715.385937:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1198 00000100:00100000:1.0:1786109715.405698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.405875:0:195049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922158336 00000100:00100000:3.0:1786109715.405886:0:195049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922158336 00000100:00100000:3.0:1786109715.406007:0:195049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:3.0:1786109715.406019:0:195049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+15:165186:x1872862922158336:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:3.0:1786109715.406297:0:195049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+16:165186:x1872862922158336:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 280us (607us total) trans 30064771078 rc 0/0 00000100:00100000:3.0:1786109715.406305:0:195049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:0.0:1786109715.413142:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.413311:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922158592 00000100:00100000:2.0:1786109715.413323:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922158592 00000100:00100000:2.0:1786109715.413950:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1199 00000100:00100000:2.0:1786109715.413963:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+16:165186:x1872862922158592:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:2.0:1786109715.413998:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109715.414020:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca3824c lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17e7 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.414134:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca38253 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.414147:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca38253 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.414160:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca38253 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.414176:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca3825a lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.414182:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca3825a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.414188:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca3825a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109715.414503:0:189813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x403:0x0], index 0: 0 00010000:00010000:2.0:1786109715.414631:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca38261 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.414640:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca38261 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.414647:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca38261 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.414677:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca38253 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.414685:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca38253 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.414690:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca38253 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.414696:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca38253 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.415366:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.415374:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca38253 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.415383:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca38253 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.415396:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930ab2894c00) 00010000:00010000:2.0:1786109715.415399:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.415403:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca38253 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.415411:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca38253 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.415426:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb8e8954 reply state 000000009d98d81a transno 30064771079 ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca3825a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.415487:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca3825a lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.415493:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xc1e56442 (ffff930ab2894b00) 00010000:00010000:2.0:1786109715.415496:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.415499:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109715.415533:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca3824c lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17e7 expref: 19 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.415557:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca38261 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17e7 expref: 18 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.415564:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x19:0x0].0x0 (ffff930ab2894900) 00010000:00010000:2.0:1786109715.416053:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786109715.416060:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986425000, rc 0) 00000100:00100000:2.0:1786109715.416917:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+19:165186:x1872862922158592:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 2952us (3779us total) trans 30064771079 rc 0/0 00000100:00100000:2.0:1786109715.416927:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1199 00000100:00100000:1.0:1786109715.421968:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.422658:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922158848 00000100:00100000:3.0:1786109715.422671:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922158848 00000100:00100000:3.0:1786109715.422751:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:3.0:1786109715.422775:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+19:165186:x1872862922158848:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:3.0:1786109715.423139:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+20:165186:x1872862922158848:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 366us (1179us total) trans 30064771080 rc 0/0 00000100:00100000:3.0:1786109715.423147:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:1.0:1786109715.427951:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.428351:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922159104 00000100:00100000:3.0:1786109715.428361:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922159104 00000100:00100000:3.0:1786109715.428659:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1200 00000100:00100000:3.0:1786109715.428671:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+20:165186:x1872862922159104:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:3.0:1786109715.428697:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109715.428719:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca3826f lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17ee expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.428957:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca38276 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.428971:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca38276 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.428983:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca38276 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.428996:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3827d lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.429003:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3827d lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.429010:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3827d lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109715.430136:0:188678:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x403:0x0], index 1: 0 00010000:00010000:3.0:1786109715.430278:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca38284 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.430291:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca38284 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.430300:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca38284 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.430336:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca38276 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.430343:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca38276 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.430365:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca38276 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.430374:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca38276 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.430380:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109715.430384:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca38276 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.430391:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca38276 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.430402:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930aa0615b00) 00010000:00010000:3.0:1786109715.430405:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109715.430409:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca38276 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.430416:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca38276 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109715.430464:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e6b670e reply state 00000000bfc56b04 transno 30064771081 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3827d lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.430475:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3827d lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.430481:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xef08328a (ffff930aa0615c00) 00010000:00010000:3.0:1786109715.430483:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109715.430486:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109715.430519:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca3826f lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17ee expref: 23 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.431863:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca38284 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17ee expref: 22 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.431872:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1a:0x0].0x0 (ffff930aa0615f00) 00010000:00010000:3.0:1786109715.431875:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109715.431878:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07400, rc 0) 00000100:00100000:3.0:1786109715.431961:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+23:165186:x1872862922159104:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 3290us (4016us total) trans 30064771081 rc 0/0 00000100:00100000:3.0:1786109715.431970:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1200 00000100:00100000:1.0:1786109715.436745:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.437175:0:195049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922159360 00000100:00100000:3.0:1786109715.437186:0:195049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922159360 00000100:00100000:3.0:1786109715.437291:0:195049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:3.0:1786109715.437302:0:195049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+23:165186:x1872862922159360:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:3.0:1786109715.438015:0:195049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+24:165186:x1872862922159360:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 712us (1276us total) trans 30064771082 rc 0/0 00000100:00100000:3.0:1786109715.438024:0:195049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:2.0:1786109715.443903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.444087:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922159616 00000100:00100000:0.0:1786109715.444096:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922159616 00000100:00100000:0.0:1786109715.444207:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1201 00000100:00100000:0.0:1786109715.444218:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+24:165186:x1872862922159616:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109715.444245:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109715.444269:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca38292 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17f5 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.444370:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38299 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.444384:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38299 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.444397:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38299 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.444409:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca382a0 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.444415:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca382a0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.444421:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca382a0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109715.444743:0:187900:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x404:0x0], index 0: 0 00010000:00010000:0.0:1786109715.444931:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca382a7 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.444941:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca382a7 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.444948:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca382a7 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.444998:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38299 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.445005:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38299 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.445011:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38299 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.445017:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.445021:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38299 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.445027:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38299 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.445043:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a92c11100) 00010000:00010000:0.0:1786109715.445045:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.445050:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38299 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.445055:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38299 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109715.445068:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095cfae5e reply state 000000003b5ef024 transno 30064771083 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca382a0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.445078:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca382a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.445084:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x1c2b00d3 (ffff930a92c11e00) 00010000:00010000:0.0:1786109715.445086:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109715.445089:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109715.445117:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca38292 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17f5 expref: 27 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.445136:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca382a7 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17f5 expref: 26 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.445143:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1b:0x0].0x0 (ffff930a92c11b00) 00010000:00010000:0.0:1786109715.445146:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109715.445148:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8400, rc 0) 00000100:00100000:0.0:1786109715.445261:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+27:165186:x1872862922159616:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1043us (1364us total) trans 30064771083 rc 0/0 00000100:00100000:0.0:1786109715.445268:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1201 00000100:00100000:1.0:1786109715.449381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.449582:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922159872 00000100:00100000:0.0:1786109715.449593:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922159872 00000100:00100000:0.0:1786109715.449711:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:0.0:1786109715.449723:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+27:165186:x1872862922159872:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:0.0:1786109715.450017:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+28:165186:x1872862922159872:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 296us (645us total) trans 30064771084 rc 0/0 00000100:00100000:0.0:1786109715.450024:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:2.0:1786109715.452825:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.452927:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922160128 00000100:00100000:3.0:1786109715.452936:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922160128 00000100:00100000:3.0:1786109715.452994:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1202 00000100:00100000:3.0:1786109715.453004:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+28:165186:x1872862922160128:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:3.0:1786109715.453028:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109715.453051:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca382b5 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a17fc expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453150:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382bc lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453165:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382bc lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453176:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382bc lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453189:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca382c3 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453196:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca382c3 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453202:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca382c3 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109715.453528:0:187899:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x404:0x0], index 1: 0 00010000:00010000:3.0:1786109715.453652:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca382ca lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453661:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca382ca lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453669:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca382ca lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453704:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382bc lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453711:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382bc lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453717:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382bc lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453723:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382bc lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453729:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109715.453733:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382bc lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453740:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382bc lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453751:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930aa0615b00) 00010000:00010000:3.0:1786109715.453767:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109715.453772:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382bc lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453779:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382bc lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109715.453804:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000975174b6 reply state 00000000baaa8592 transno 30064771085 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca382c3 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453814:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca382c3 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453821:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x494dcf1b (ffff930aa0615d00) 00010000:00010000:3.0:1786109715.453824:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109715.453826:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109715.453852:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca382b5 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17fc expref: 31 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453872:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca382ca lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17fc expref: 30 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.453880:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1c:0x0].0x0 (ffff930aa0615900) 00010000:00010000:3.0:1786109715.453882:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109715.453884:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f06000, rc 0) 00000100:00100000:3.0:1786109715.454057:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+31:165186:x1872862922160128:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1053us (1239us total) trans 30064771085 rc 0/0 00000100:00100000:3.0:1786109715.454065:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1202 00000100:00100000:1.0:1786109715.457530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.457627:0:195049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922160384 00000100:00100000:3.0:1786109715.457636:0:195049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922160384 00000100:00100000:3.0:1786109715.457714:0:195049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1786109715.457725:0:195049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b60850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+31:165186:x1872862922160384:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:3.0:1786109715.458019:0:195049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b60850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+32:165186:x1872862922160384:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 294us (496us total) trans 30064771086 rc 0/0 00000100:00100000:3.0:1786109715.458028:0:195049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1786109715.461187:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.461316:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922160640 00000100:00100000:3.0:1786109715.461325:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922160640 00000100:00100000:3.0:1786109715.461378:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1203 00000100:00100000:3.0:1786109715.461388:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+32:165186:x1872862922160640:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:3.0:1786109715.461412:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109715.461458:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca382d8 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1803 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.461571:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382df lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.461584:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382df lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.461595:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382df lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.461609:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca382e6 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.461616:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca382e6 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.461623:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca382e6 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109715.461914:0:187901:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x405:0x0], index 0: 0 00010000:00010000:3.0:1786109715.462334:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca382ed lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462346:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca382ed lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462354:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca382ed lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462388:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382df lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462395:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382df lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462402:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382df lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462408:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109715.462412:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382df lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462420:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382df lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462465:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930aa0615b00) 00010000:00010000:3.0:1786109715.462468:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109715.462473:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382df lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462480:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06800/0xdb52b77d7ca382df lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109715.462557:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7a58756 reply state 00000000569ae013 transno 30064771087 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca382e6 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462569:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca382e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462575:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x76709d63 (ffff930a8607d400) 00010000:00010000:3.0:1786109715.462577:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109715.462580:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109715.462609:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06c00/0xdb52b77d7ca382d8 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1803 expref: 35 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462629:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca382ed lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1803 expref: 34 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.462636:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1d:0x0].0x0 (ffff930a8607d800) 00010000:00010000:3.0:1786109715.462639:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109715.462641:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07800, rc 0) 00000100:00100000:3.0:1786109715.463282:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+35:165186:x1872862922160640:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1891us (2100us total) trans 30064771087 rc 0/0 00000100:00100000:3.0:1786109715.463291:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1203 00000100:00100000:1.0:1786109715.467232:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.467335:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922160896 00000100:00100000:0.0:1786109715.467345:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922160896 00000100:00100000:0.0:1786109715.467460:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:0.0:1786109715.467472:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+35:165186:x1872862922160896:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:0.0:1786109715.468234:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+36:165186:x1872862922160896:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 761us (1006us total) trans 30064771088 rc 0/0 00000100:00100000:0.0:1786109715.468243:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:1.0:1786109715.471225:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.471314:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922161152 00000100:00100000:3.0:1786109715.471324:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922161152 00000100:00100000:3.0:1786109715.471415:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1204 00000100:00100000:3.0:1786109715.471425:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+36:165186:x1872862922161152:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:3.0:1786109715.471470:0:196401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109715.471566:0:196401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca382fb lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a180a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.471674:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca38302 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.471770:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca38302 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.471781:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca38302 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.471795:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38309 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.471802:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38309 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.471807:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38309 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109715.472088:0:196401:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x405:0x0], index 1: 0 00010000:00010000:3.0:1786109715.472217:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca38310 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472226:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca38310 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472233:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca38310 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472268:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca38302 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472276:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca38302 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472282:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca38302 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472288:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109715.472292:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca38302 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472302:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca38302 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472313:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a8607d500) 00010000:00010000:3.0:1786109715.472316:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109715.472320:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca38302 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472325:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06200/0xdb52b77d7ca38302 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109715.472338:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020812d3c reply state 000000001433caa8 transno 30064771089 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38309 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472347:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38309 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472352:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xa3936bac (ffff930a8607d200) 00010000:00010000:3.0:1786109715.472354:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109715.472357:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109715.472386:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07e00/0xdb52b77d7ca382fb lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a180a expref: 39 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472404:0:196401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca38310 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a180a expref: 38 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.472411:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1e:0x0].0x0 (ffff930a8607dc00) 00010000:00010000:3.0:1786109715.472413:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109715.472415:0:196401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628aa00, rc 0) 00000100:00100000:3.0:1786109715.472587:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+39:165186:x1872862922161152:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1163us (1370us total) trans 30064771089 rc 0/0 00000100:00100000:3.0:1786109715.472595:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1204 00000100:00100000:1.0:1786109715.476249:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.476346:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922161408 00000100:00100000:2.0:1786109715.476355:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922161408 00000100:00100000:2.0:1786109715.476583:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:2.0:1786109715.476594:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+39:165186:x1872862922161408:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:2.0:1786109715.477035:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+40:165186:x1872862922161408:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 442us (793us total) trans 30064771090 rc 0/0 00000100:00100000:2.0:1786109715.477043:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:1.0:1786109715.483371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.483660:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922161664 00000100:00100000:2.0:1786109715.483669:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922161664 00000100:00100000:2.0:1786109715.483898:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1205 00000100:00100000:2.0:1786109715.483910:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+40:165186:x1872862922161664:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:2.0:1786109715.483941:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109715.483967:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca3831e lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1811 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.484137:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca38325 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.484152:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca38325 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.484163:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca38325 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.484176:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca3832c lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.484183:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca3832c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.484189:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca3832c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109715.484617:0:189813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x406:0x0], index 0: 0 00010000:00010000:2.0:1786109715.484961:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38333 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.484972:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38333 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485170:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38333 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485212:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca38325 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485220:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca38325 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485226:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca38325 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485233:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca38325 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485239:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.485243:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca38325 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485251:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca38325 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485264:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930ab2894c00) 00010000:00010000:2.0:1786109715.485267:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.485272:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca38325 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485278:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca38325 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.485293:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004502ee0f reply state 0000000013f09e08 transno 30064771091 ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca3832c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485303:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca3832c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485310:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xd0b639f4 (ffff930ab2894400) 00010000:00010000:2.0:1786109715.485312:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.485314:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109715.485345:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca3831e lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1811 expref: 43 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485364:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38333 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1811 expref: 42 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.485372:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1f:0x0].0x0 (ffff930ab2894600) 00010000:00010000:2.0:1786109715.485374:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786109715.485377:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986424c00, rc 0) 00000100:00100000:2.0:1786109715.485571:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+43:165186:x1872862922161664:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1663us (2208us total) trans 30064771091 rc 0/0 00000100:00100000:2.0:1786109715.485580:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1205 00000100:00100000:1.0:1786109715.489272:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.489347:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922161920 00000100:00100000:3.0:1786109715.489357:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922161920 00000100:00100000:3.0:1786109715.489482:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1786109715.489564:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+43:165186:x1872862922161920:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:3.0:1786109715.490051:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+44:165186:x1872862922161920:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 560us (787us total) trans 30064771092 rc 0/0 00000100:00100000:3.0:1786109715.490059:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:1.0:1786109715.497336:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.497425:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922162176 00000100:00100000:0.0:1786109715.497626:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922162176 00000100:00100000:0.0:1786109715.497723:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1206 00000100:00100000:0.0:1786109715.497734:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+44:165186:x1872862922162176:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109715.497770:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109715.497792:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca38341 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1818 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.498187:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38348 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.498202:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38348 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.498214:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38348 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.498227:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca3834f lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.498233:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca3834f lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.498239:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca3834f lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109715.499078:0:188678:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x406:0x0], index 1: 0 00010000:00010000:0.0:1786109715.499214:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca38356 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499225:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca38356 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499233:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca38356 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499266:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38348 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499273:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38348 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499280:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38348 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499286:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38348 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499292:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.499296:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38348 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499303:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38348 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499315:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a92c11100) 00010000:00010000:0.0:1786109715.499318:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.499322:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38348 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499328:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca38348 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109715.499340:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fff3d57a reply state 000000002b1be9ad transno 30064771093 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca3834f lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499350:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca3834f lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499356:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xfdd9083c (ffff930a92c11500) 00010000:00010000:0.0:1786109715.499359:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109715.499361:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109715.499391:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca38341 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1818 expref: 47 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499410:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca38356 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1818 expref: 46 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.499423:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x20:0x0].0x0 (ffff930a92c11900) 00010000:00010000:0.0:1786109715.499426:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109715.499604:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8200, rc 0) 00000100:00100000:0.0:1786109715.499718:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+47:165186:x1872862922162176:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1985us (2390us total) trans 30064771093 rc 0/0 00000100:00100000:0.0:1786109715.499727:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1206 00000100:00100000:1.0:1786109715.503957:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.504098:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922162432 00000100:00100000:2.0:1786109715.504108:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922162432 00000100:00100000:2.0:1786109715.504209:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:2.0:1786109715.504221:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+47:165186:x1872862922162432:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:0.0:1786109715.505055:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+48:165186:x1872862922162432:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 833us (1104us total) trans 30064771094 rc 0/0 00000100:00100000:0.0:1786109715.505065:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:2.0:1786109715.510378:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.510672:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922162688 00000100:00100000:0.0:1786109715.510746:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922162688 00000100:00100000:0.0:1786109715.510909:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1207 00000100:00100000:0.0:1786109715.510920:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098ba4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+48:165186:x1872862922162688:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109715.510947:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109715.510969:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca38364 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a181f expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.511139:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3836b lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.511154:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3836b lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.511165:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3836b lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.511178:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca38372 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.511185:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca38372 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.511192:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca38372 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109715.511617:0:187900:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x407:0x0], index 0: 0 00010000:00010000:0.0:1786109715.511953:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca38379 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.511964:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca38379 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.511972:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca38379 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.512092:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3836b lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.512100:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3836b lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.512107:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3836b lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.512113:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.512117:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3836b lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.512124:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3836b lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.512139:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a92c11600) 00010000:00010000:0.0:1786109715.512142:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.512146:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3836b lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.512152:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3836b lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109715.512164:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cf9e26a reply state 00000000b26655eb transno 30064771095 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca38372 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.512173:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca38372 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.512178:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x1b7026cc (ffff930a92c11f00) 00010000:00010000:0.0:1786109715.512181:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109715.512183:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109715.512213:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca38364 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a181f expref: 51 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.512233:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca38379 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a181f expref: 50 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.512241:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x21:0x0].0x0 (ffff930a92c11200) 00010000:00010000:0.0:1786109715.512243:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109715.512245:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9600, rc 0) 00000100:00100000:0.0:1786109715.512362:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098ba4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+51:165186:x1872862922162688:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1443us (1993us total) trans 30064771095 rc 0/0 00000100:00100000:0.0:1786109715.512370:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1207 00000100:00100000:1.0:1786109715.517352:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.517648:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922162944 00000100:00100000:3.0:1786109715.517657:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922162944 00000100:00100000:0.0:1786109715.517969:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:0.0:1786109715.517992:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+51:165186:x1872862922162944:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:0.0:1786109715.518274:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+52:165186:x1872862922162944:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 293us (930us total) trans 30064771096 rc 0/0 00000100:00100000:0.0:1786109715.518282:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:1.0:1786109715.523059:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.523291:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922163200 00000100:00100000:3.0:1786109715.523300:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922163200 00000100:00100000:3.0:1786109715.523362:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1208 00000100:00100000:3.0:1786109715.523372:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+52:165186:x1872862922163200:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:3.0:1786109715.523397:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109715.523418:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca38387 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1826 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.524130:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca3838e lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.524145:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca3838e lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.524155:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca3838e lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.524174:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38395 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.524181:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38395 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.524188:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38395 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109715.525317:0:187899:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x407:0x0], index 1: 0 00010000:00010000:2.0:1786109715.525744:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca3839c lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.525769:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca3839c lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.525784:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca3839c lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.525883:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca3838e lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.525891:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca3838e lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.525897:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca3838e lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.525904:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca3838e lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.525911:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ac00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.525914:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca3838e lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.525923:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca3838e lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.525935:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a8607d500) 00010000:00010000:2.0:1786109715.525938:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.525943:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca3838e lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.525950:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ac00/0xdb52b77d7ca3838e lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.525963:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008505b0b5 reply state 00000000c1594818 transno 30064771097 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38395 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.525973:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38395 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.526143:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x3e3e6f26 (ffff930a8607dd00) 00010000:00010000:2.0:1786109715.526146:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.526149:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109715.526185:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b600/0xdb52b77d7ca38387 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1826 expref: 55 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.526205:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca3839c lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1826 expref: 54 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.526213:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x22:0x0].0x0 (ffff930ab2894c00) 00010000:00010000:2.0:1786109715.526215:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786109715.526217:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930986424000, rc 0) 00000100:00100000:2.0:1786109715.526335:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+55:165186:x1872862922163200:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 2964us (3284us total) trans 30064771097 rc 0/0 00000100:00100000:2.0:1786109715.526343:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1208 00000100:00100000:2.0:1786109715.534964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.535128:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922163456 00000100:00100000:0.0:1786109715.535138:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922163456 00000100:00100000:0.0:1786109715.535956:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:0.0:1786109715.535970:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982d22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+55:165186:x1872862922163456:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:0.0:1786109715.536252:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982d22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+56:165186:x1872862922163456:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 286us (1452us total) trans 30064771098 rc 0/0 00000100:00100000:0.0:1786109715.536259:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:1.0:1786109715.540733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.540930:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922163712 00000100:00100000:0.0:1786109715.540940:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922163712 00000100:00100000:0.0:1786109715.541100:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1209 00000100:00100000:0.0:1786109715.541111:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+56:165186:x1872862922163712:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109715.541134:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109715.541156:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca383aa lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a182d expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.541257:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca383b1 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.541270:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca383b1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.541281:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca383b1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.541294:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca383b8 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.541301:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca383b8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.541308:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca383b8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109715.541637:0:187901:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x408:0x0], index 0: 0 00010000:00010000:0.0:1786109715.542051:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca383bf lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542063:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca383bf lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542071:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca383bf lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542107:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca383b1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542115:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca383b1 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542123:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca383b1 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542130:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.542134:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca383b1 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542146:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca383b1 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542158:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a92c11600) 00010000:00010000:0.0:1786109715.542161:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.542166:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca383b1 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542172:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca383b1 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109715.542185:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fd2ad3d reply state 00000000b0ed6183 transno 30064771099 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca383b8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542195:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca383b8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542202:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x610cb780 (ffff930a92c11100) 00010000:00010000:0.0:1786109715.542204:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109715.542207:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109715.542235:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca383aa lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a182d expref: 59 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542254:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca383bf lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a182d expref: 58 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.542261:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x23:0x0].0x0 (ffff930a92c11800) 00010000:00010000:0.0:1786109715.542264:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109715.542266:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8800, rc 0) 00000100:00100000:0.0:1786109715.542338:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+59:165186:x1872862922163712:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1228us (1614us total) trans 30064771099 rc 0/0 00000100:00100000:0.0:1786109715.542346:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1209 00000100:00100000:3.0:1786109715.547424:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.547665:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922163968 00000100:00100000:0.0:1786109715.547675:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922163968 00000100:00100000:0.0:1786109715.548142:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:0.0:1786109715.548153:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+59:165186:x1872862922163968:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:0.0:1786109715.548617:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+60:165186:x1872862922163968:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 464us (1203us total) trans 30064771100 rc 0/0 00000100:00100000:0.0:1786109715.548625:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1786109715.552338:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.552652:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922164224 00000100:00100000:3.0:1786109715.552663:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922164224 00000100:00100000:0.0:1786109715.553098:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1210 00000100:00100000:0.0:1786109715.553111:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+60:165186:x1872862922164224:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109715.553137:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109715.553159:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca383cd lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1834 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.553257:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca383d4 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.553269:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca383d4 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.553280:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca383d4 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.553292:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca383db lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.553303:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca383db lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.553309:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca383db lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109715.555079:0:187900:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x408:0x0], index 1: 0 00010000:00010000:0.0:1786109715.555223:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca383e2 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555237:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca383e2 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555246:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca383e2 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555275:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca383d4 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555281:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca383d4 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555288:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca383d4 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555294:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.555298:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca383d4 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555304:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca383d4 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555318:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a92c11c00) 00010000:00010000:0.0:1786109715.555321:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.555325:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca383d4 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555331:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca383d4 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109715.555342:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005258c700 reply state 0000000022d97859 transno 30064771101 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca383db lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555351:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca383db lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555357:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x83daffd9 (ffff930a92c11a00) 00010000:00010000:0.0:1786109715.555360:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109715.555362:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109715.555391:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca383cd lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1834 expref: 63 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555407:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca383e2 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1834 expref: 62 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.555415:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x24:0x0].0x0 (ffff930a92c11600) 00010000:00010000:0.0:1786109715.555417:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109715.555419:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9e00, rc 0) 00000100:00100000:0.0:1786109715.555672:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+63:165186:x1872862922164224:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 2562us (3341us total) trans 30064771101 rc 0/0 00000100:00100000:0.0:1786109715.555735:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1210 00000100:00100000:1.0:1786109715.559666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.560006:0:195049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922164480 00000100:00100000:3.0:1786109715.560016:0:195049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922164480 00000100:00100000:3.0:1786109715.560078:0:195049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:3.0:1786109715.560087:0:195049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+63:165186:x1872862922164480:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:3.0:1786109715.560367:0:195049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+64:165186:x1872862922164480:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 280us (709us total) trans 30064771102 rc 0/0 00000100:00100000:3.0:1786109715.560376:0:195049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:1.0:1786109715.567672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.567906:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922164736 00000100:00100000:2.0:1786109715.567916:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922164736 00000100:00100000:2.0:1786109715.568137:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1211 00000100:00100000:2.0:1786109715.568149:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+64:165186:x1872862922164736:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:2.0:1786109715.568173:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109715.568196:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca383f0 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a183b expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.568292:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca383f7 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.568306:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca383f7 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.568316:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca383f7 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.568328:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca383fe lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.568334:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca383fe lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.568341:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca383fe lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109715.568785:0:189813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x409:0x0], index 0: 0 00010000:00010000:2.0:1786109715.569057:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca38405 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569068:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca38405 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569077:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca38405 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569109:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca383f7 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569121:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca383f7 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569127:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca383f7 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569134:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca383f7 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569140:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.569144:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca383f7 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569150:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca383f7 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569162:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930ab2894500) 00010000:00010000:2.0:1786109715.569165:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.569169:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca383f7 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569175:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca383f7 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.569188:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060a8f980 reply state 0000000002bd7c9a transno 30064771103 ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca383fe lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569197:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca383fe lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569203:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xa6a94833 (ffff930ab2894e00) 00010000:00010000:2.0:1786109715.569206:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.569209:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109715.569236:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca383f0 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a183b expref: 67 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569254:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca38405 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a183b expref: 66 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.569261:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x25:0x0].0x0 (ffff930ab2894000) 00010000:00010000:2.0:1786109715.569263:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786109715.569265:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412400, rc 0) 00000100:00100000:2.0:1786109715.569378:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+67:165186:x1872862922164736:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1231us (1713us total) trans 30064771103 rc 0/0 00000100:00100000:2.0:1786109715.569385:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1211 00000100:00100000:2.0:1786109715.573929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.574070:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922164992 00000100:00100000:0.0:1786109715.574079:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922164992 00000100:00100000:0.0:1786109715.574186:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:0.0:1786109715.574197:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+67:165186:x1872862922164992:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:0.0:1786109715.574880:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+68:165186:x1872862922164992:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 681us (958us total) trans 30064771104 rc 0/0 00000100:00100000:0.0:1786109715.574889:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:1.0:1786109715.578320:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.578412:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922165248 00000100:00100000:3.0:1786109715.578422:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922165248 00000100:00100000:2.0:1786109715.578939:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1212 00000100:00100000:2.0:1786109715.578951:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+68:165186:x1872862922165248:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:2.0:1786109715.578985:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109715.579008:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38413 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1842 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.579110:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3841a lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.579124:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3841a lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.579134:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3841a lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.579146:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412c00/0xdb52b77d7ca38421 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.579154:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412c00/0xdb52b77d7ca38421 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.579160:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412c00/0xdb52b77d7ca38421 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109715.579700:0:188678:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x409:0x0], index 1: 0 00010000:00010000:2.0:1786109715.580225:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38428 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580238:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38428 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580248:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38428 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580283:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3841a lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580289:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3841a lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580295:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3841a lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580302:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3841a lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580312:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.580316:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3841a lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580323:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3841a lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580334:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930ab2894800) 00010000:00010000:2.0:1786109715.580336:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.580341:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3841a lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580347:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3841a lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.580359:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002b0d183 reply state 0000000057b2a408 transno 30064771105 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412c00/0xdb52b77d7ca38421 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580368:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412c00/0xdb52b77d7ca38421 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580373:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xc977908d (ffff930ab2894200) 00010000:00010000:2.0:1786109715.580375:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.580377:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109715.580405:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38413 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1842 expref: 71 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580420:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38428 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1842 expref: 70 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.580477:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x26:0x0].0x0 (ffff930ab2894500) 00010000:00010000:2.0:1786109715.580479:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786109715.580482:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413c00, rc 0) 00000100:00100000:2.0:1786109715.580611:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+71:165186:x1872862922165248:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1661us (2298us total) trans 30064771105 rc 0/0 00000100:00100000:2.0:1786109715.580619:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1212 00000100:00100000:2.0:1786109715.585261:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.585360:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922165504 00000100:00100000:0.0:1786109715.585371:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922165504 00000100:00100000:0.0:1786109715.585485:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:0.0:1786109715.585504:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+71:165186:x1872862922165504:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:0.0:1786109715.586080:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+72:165186:x1872862922165504:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 585us (828us total) trans 30064771106 rc 0/0 00000100:00100000:0.0:1786109715.586088:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:3.0:1786109715.589968:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.590071:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922165760 00000100:00100000:2.0:1786109715.590081:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922165760 00000100:00100000:2.0:1786109715.590151:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1213 00000100:00100000:2.0:1786109715.590162:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+72:165186:x1872862922165760:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:2.0:1786109715.590186:0:196401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109715.590208:0:196401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38436 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1849 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.590314:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3843d lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.590327:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3843d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.590339:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3843d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.590351:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413800/0xdb52b77d7ca38444 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.590364:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413800/0xdb52b77d7ca38444 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.590371:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413800/0xdb52b77d7ca38444 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109715.591181:0:196401:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x40a:0x0], index 0: 0 00010000:00010000:2.0:1786109715.591323:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3844b lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591335:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3844b lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591344:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3844b lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591375:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3843d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591383:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3843d lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591390:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3843d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591395:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.591400:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3843d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591407:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3843d lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591422:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930ab2894800) 00010000:00010000:2.0:1786109715.591425:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.591570:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3843d lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591579:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca3843d lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.591593:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000167dc349 reply state 00000000180e1a34 transno 30064771107 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413800/0xdb52b77d7ca38444 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591604:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413800/0xdb52b77d7ca38444 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591610:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xec45d8e7 (ffff930ab2894a00) 00010000:00010000:2.0:1786109715.591613:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.591616:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786109715.591650:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38436 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1849 expref: 75 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591668:0:196401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3844b lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1849 expref: 74 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.591767:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x27:0x0].0x0 (ffff930ab2894300) 00010000:00010000:2.0:1786109715.591771:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786109715.591774:0:196401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413600, rc 0) 00000100:00100000:2.0:1786109715.591948:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+75:165186:x1872862922165760:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1787us (1989us total) trans 30064771107 rc 0/0 00000100:00100000:2.0:1786109715.591956:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1213 00000100:00100000:1.0:1786109715.595970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.596500:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922166016 00000100:00100000:0.0:1786109715.596511:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922166016 00000100:00100000:0.0:1786109715.596629:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:0.0:1786109715.596642:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+75:165186:x1872862922166016:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:1.0:1786109715.598010:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+76:165186:x1872862922166016:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 1365us (2043us total) trans 30064771108 rc 0/0 00000100:00100000:1.0:1786109715.598021:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:1.0:1786109715.602047:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.602205:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922166272 00000100:00100000:3.0:1786109715.602216:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922166272 00000100:00100000:3.0:1786109715.602322:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1214 00000100:00100000:3.0:1786109715.602333:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+76:165186:x1872862922166272:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:3.0:1786109715.602355:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109715.602378:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca38459 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1850 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.602524:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38460 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.602538:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38460 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.602548:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38460 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.602561:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca38467 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.602568:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca38467 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.602575:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca38467 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109715.603245:0:187899:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x40a:0x0], index 1: 0 00010000:00010000:3.0:1786109715.603389:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b800/0xdb52b77d7ca3846e lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603401:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b800/0xdb52b77d7ca3846e lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603409:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b800/0xdb52b77d7ca3846e lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603519:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38460 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603531:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38460 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603537:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38460 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603543:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38460 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603549:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109715.603553:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38460 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603560:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38460 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603571:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a8607d700) 00010000:00010000:3.0:1786109715.603574:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109715.603579:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38460 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603584:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38460 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109715.603597:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7c91bfb reply state 000000000c68abb3 transno 30064771109 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca38467 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603609:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca38467 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603615:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xf142140 (ffff930a8607d500) 00010000:00010000:3.0:1786109715.603618:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109715.603620:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109715.603649:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca38459 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1850 expref: 79 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603668:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b800/0xdb52b77d7ca3846e lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1850 expref: 78 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.603867:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x28:0x0].0x0 (ffff930aa0615b00) 00010000:00010000:3.0:1786109715.603871:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109715.603874:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628b800, rc 0) 00000100:00100000:3.0:1786109715.604046:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+79:165186:x1872862922166272:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1714us (2007us total) trans 30064771109 rc 0/0 00000100:00100000:3.0:1786109715.604054:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1214 00000100:00100000:2.0:1786109715.611675:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.612027:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922166528 00000100:00100000:0.0:1786109715.612037:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922166528 00000100:00100000:0.0:1786109715.612112:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:0.0:1786109715.612122:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982d22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+79:165186:x1872862922166528:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:0.0:1786109715.612638:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982d22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+80:165186:x1872862922166528:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 516us (973us total) trans 30064771110 rc 0/0 00000100:00100000:0.0:1786109715.612646:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:1.0:1786109715.616990:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.617108:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922166784 00000100:00100000:0.0:1786109715.617121:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922166784 00000100:00100000:0.0:1786109715.617245:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1215 00000100:00100000:0.0:1786109715.617255:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+80:165186:x1872862922166784:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109715.617281:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109715.617307:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3847c lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1857 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.617417:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38483 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.617472:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38483 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.617485:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38483 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.617500:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3848a lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.617507:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3848a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.617513:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3848a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109715.617838:0:187901:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000401:0x40b:0x0], index 0: 0 00010000:00010000:0.0:1786109715.617975:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca38491 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.617986:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca38491 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.617994:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca38491 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.618025:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38483 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.618032:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38483 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.618038:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38483 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.618043:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.618047:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38483 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.618054:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38483 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.618064:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a92c11c00) 00010000:00010000:0.0:1786109715.618068:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.618073:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38483 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.618079:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38483 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109715.618092:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007374f58b reply state 0000000038328b6d transno 30064771111 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3848a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.618103:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3848a lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.618110:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x31e2699a (ffff930a92c11000) 00010000:00010000:0.0:1786109715.618112:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109715.618115:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109715.618145:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3847c lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1857 expref: 83 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.618165:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca38491 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1857 expref: 82 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.618172:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x29:0x0].0x0 (ffff930a83e02000) 00010000:00010000:0.0:1786109715.618175:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109715.618177:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf8000, rc 0) 00000100:00100000:0.0:1786109715.618294:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+83:165186:x1872862922166784:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1040us (1315us total) trans 30064771111 rc 0/0 00000100:00100000:0.0:1786109715.618303:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1215 00000100:00100000:1.0:1786109715.623022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.623096:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922167040 00000100:00100000:0.0:1786109715.623107:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922167040 00000100:00100000:0.0:1786109715.623249:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:0.0:1786109715.623262:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+83:165186:x1872862922167040:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:0.0:1786109715.623621:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+84:165186:x1872862922167040:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 361us (609us total) trans 30064771112 rc 0/0 00000100:00100000:0.0:1786109715.623630:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:3.0:1786109715.627631:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.627743:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922167296 00000100:00100000:0.0:1786109715.627763:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922167296 00000100:00100000:0.0:1786109715.627871:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1216 00000100:00100000:0.0:1786109715.627882:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+84:165186:x1872862922167296:12345-192.168.203.38@tcp:101:createmany.0 00010000:00010000:0.0:1786109715.627909:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109715.627931:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3849f lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a185e expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628030:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca384a6 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628043:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca384a6 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628054:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca384a6 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628070:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166c400/0xdb52b77d7ca384ad lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628077:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166c400/0xdb52b77d7ca384ad lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628083:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166c400/0xdb52b77d7ca384ad lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786109715.628381:0:187900:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x40b:0x0], index 1: 0 00010000:00010000:0.0:1786109715.628621:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166ce00/0xdb52b77d7ca384b4 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628631:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166ce00/0xdb52b77d7ca384b4 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628640:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166ce00/0xdb52b77d7ca384b4 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628677:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca384a6 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628684:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca384a6 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628691:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca384a6 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628698:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.628703:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca384a6 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628710:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca384a6 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628722:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02300) 00010000:00010000:0.0:1786109715.628725:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.628729:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca384a6 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628735:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca384a6 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109715.628748:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000faf53974 reply state 000000003be459d8 transno 30064771113 ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166c400/0xdb52b77d7ca384ad lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628797:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166c400/0xdb52b77d7ca384ad lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628804:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x54b0b1f4 (ffff930a83e02900) 00010000:00010000:0.0:1786109715.628808:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109715.628810:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786109715.628839:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca3849f lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a185e expref: 87 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628859:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166ce00/0xdb52b77d7ca384b4 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a185e expref: 86 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.628867:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x2a:0x0].0x0 (ffff930a83e02f00) 00010000:00010000:0.0:1786109715.628870:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109715.628872:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a8166ce00, rc 0) 00000100:00100000:0.0:1786109715.629025:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+87:165186:x1872862922167296:12345-192.168.203.38@tcp:101:createmany.0 Request processed in 1143us (1402us total) trans 30064771113 rc 0/0 00000100:00100000:0.0:1786109715.629033:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1216 00000100:00100000:1.0:1786109715.633734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.633995:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922167552 00000100:00100000:0.0:1786109715.634006:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922167552 00000100:00100000:0.0:1786109715.634115:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:0.0:1786109715.634127:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+87:165186:x1872862922167552:12345-192.168.203.38@tcp:35:createmany.0 00000100:00100000:0.0:1786109715.634576:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+88:165186:x1872862922167552:12345-192.168.203.38@tcp:35:createmany.0 Request processed in 450us (852us total) trans 30064771114 rc 0/0 00000100:00100000:0.0:1786109715.634583:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:1.0:1786109715.661839:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.661937:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922167808 00000100:00100000:2.0:1786109715.661946:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922167808 00000100:00100000:2.0:1786109715.662018:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1217 00000100:00100000:2.0:1786109715.662030:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+88:165189:x1872862922167808:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109715.662058:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109715.662083:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca384c2 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1865 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109715.662220:0:189813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x16:0x0]: returning size 4096 00010000:00010000:2.0:1786109715.662327:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca384c2 lrc: 1/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1865 expref: 90 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.662342:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930ab2894800) 00010000:00010000:2.0:1786109715.662346:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786109715.662351:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca384c2 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1865 expref: 90 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.662369:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412000, rc 0) 00000100:00100000:2.0:1786109715.662487:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+89:165189:x1872862922167808:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 459us (657us total) trans 30064771115 rc 301/301 00000100:00100000:2.0:1786109715.662495:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1217 00000100:00100000:2.0:1786109715.666813:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.666886:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922168064 00000100:00100000:0.0:1786109715.666898:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922168064 00000100:00100000:0.0:1786109715.666965:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1218 00000100:00100000:0.0:1786109715.666975:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+89:165189:x1872862922168064:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109715.667001:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109715.667025:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca384d0 lrc: 2/0,0 mode: --/CR res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a186c expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.667141:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca384d7 lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.667154:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca384d7 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.667165:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca384d7 lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109715.667176:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x18:0x0]: returning size 0 00010000:00010000:0.0:1786109715.667283:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca384d0 lrc: 0/0,0 mode: --/CR res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a186c expref: 92 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.667306:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca384d7 lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a186c expref: 91 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.667314:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x18:0x0].0x0 (ffff930a90808200) 00010000:00010000:0.0:1786109715.667316:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786109715.667319:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9200, rc 0) 00000100:00100000:0.0:1786109715.667381:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+91:165189:x1872862922168064:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 408us (590us total) trans 30064771116 rc 0/0 00000100:00100000:0.0:1786109715.667387:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1218 00000100:00100000:1.0:1786109715.673632:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.673720:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.673888:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922168448 00000100:00100000:2.0:1786109715.673898:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922168448 00000100:00100000:2.0:1786109715.674015:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4536 00000100:00100000:2.0:1786109715.674027:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fac74500-4523-4794-af20-dfdcdfae19c1+91:2403:x1872862922168448:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786109715.674047:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.674076:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca384d7 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a186c expref: 91 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.674099:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x18:0x0].0x0 (ffff930a90808200) 00010000:00010000:2.0:1786109715.674104:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109715.674173:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fac74500-4523-4794-af20-dfdcdfae19c1+90:2403:x1872862922168448:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 149us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109715.674182:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4536 00000100:00100000:0.0:1786109715.675175:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922168320 00000100:00100000:0.0:1786109715.675184:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922168320 00000100:00100000:0.0:1786109715.675236:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:0.0:1786109715.675246:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+90:165189:x1872862922168320:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1786109715.676287:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+91:165189:x1872862922168320:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 1034us (2658us total) trans 30064771117 rc 0/0 00000100:00100000:0.0:1786109715.676300:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:1.0:1786109715.682150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.682262:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922168704 00000100:00100000:0.0:1786109715.682273:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922168704 00000100:00100000:0.0:1786109715.682380:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1786109715.682393:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+91:165189:x1872862922168704:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1786109715.683120:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+92:165189:x1872862922168704:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 725us (1151us total) trans 30064771118 rc 0/0 00000100:00100000:0.0:1786109715.683130:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1786109715.715007:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.715235:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922168832 00000100:00100000:2.0:1786109715.715246:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922168832 00000100:00100000:2.0:1786109715.715308:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1219 00000100:00100000:2.0:1786109715.715318:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+9:165190:x1872862922168832:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1786109715.715339:0:196401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109715.715363:0:196401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca384e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1873 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.715900:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca384ec lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.715915:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca384ec lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.715926:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca384ec lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109715.716775:0:196401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1786109715.716781:0:196401:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:2.0:1786109715.716886:0:196401:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca384ec lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.716927:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca384e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1873 expref: 11 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.716950:0:196401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca384ec lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1873 expref: 10 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.716959:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:2.0:1786109715.716962:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109715.716966:0:196401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413a00, rc 0) 00010000:00000080:2.0:1786109715.716983:0:196401:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a9780ea00 x1872862922168832/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:186/0 lens 576/688 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1786109715.717053:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+10:165190:x1872862922168832:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1736us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109715.717060:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1219 00010000:00010000:1.0:1786109715.719241:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109715.727389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.727509:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922169088 00000100:00100000:2.0:1786109715.727519:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922169088 00000100:00100000:2.0:1786109715.727625:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1220 00000100:00100000:2.0:1786109715.727636:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+10:165190:x1872862922169088:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1786109715.727657:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109715.727680:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca384f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a187a expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109715.727795:0:189813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1786109715.727969:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca384f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a187a expref: 12 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.727987:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:2.0:1786109715.727991:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786109715.727996:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca384f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a187a expref: 12 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.728010:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412000, rc 0) 00010000:00000080:2.0:1786109715.728019:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309852b8380 x1872862922169088/t343597383703(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:186/0 lens 648/664 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/600/0 rc 301/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1786109715.728099:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+11:165190:x1872862922169088:12345-192.168.203.38@tcp:101:rm.0 Request processed in 465us (720us total) trans 343597383703 rc 301/301 00000100:00100000:2.0:1786109715.728116:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1220 00000100:00100000:3.0:1786109715.732664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.735288:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922169216 00000100:00100000:0.0:1786109715.735304:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922169216 00000100:00100000:0.0:1786109715.735399:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:0.0:1786109715.735411:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+11:165190:x1872862922169216:12345-192.168.203.38@tcp:37:rm.0 00010000:00000080:1.0:1786109715.744841:0:187903:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa66edf80 x1872862922169216/t0(0) o37->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:186/0 lens 448/440 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1786109715.747249:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+11:165190:x1872862922169216:12345-192.168.203.38@tcp:37:rm.0 Request processed in 11830us (14584us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109715.747265:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:1.0:1786109715.754680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.755213:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922169472 00000100:00100000:0.0:1786109715.755224:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922169472 00000100:00100000:0.0:1786109715.755394:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:0.0:1786109715.755406:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982d22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+11:165190:x1872862922169472:12345-192.168.203.38@tcp:35:rm.0 00010000:00000080:0.0:1786109715.755643:0:187902:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930982d22850 x1872862922169472/t343597383704(0) o35->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:186/0 lens 392/456 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1786109715.755712:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982d22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+12:165190:x1872862922169472:12345-192.168.203.38@tcp:35:rm.0 Request processed in 308us (1040us total) trans 343597383704 rc 0/0 00000100:00100000:0.0:1786109715.755721:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:3.0:1786109715.759728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.759911:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922169728 00000100:00100000:0.0:1786109715.759920:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922169728 00000100:00100000:0.0:1786109715.760024:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1221 00000100:00100000:0.0:1786109715.760035:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+12:165190:x1872862922169728:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1786109715.760059:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109715.760078:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38501 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1881 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.760306:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca38508 lrc: 3/1,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.760322:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca38508 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.760332:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca38508 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109715.760342:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1786109715.760577:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1881 expref: 15 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.760596:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca38508 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1881 expref: 14 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.760605:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:0.0:1786109715.760608:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786109715.760611:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8cf9200, rc 0) 00010000:00000080:0.0:1786109715.760619:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa66ed500 x1872862922169728/t343597383705(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:186/0 lens 648/664 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1786109715.760723:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+14:165190:x1872862922169728:12345-192.168.203.38@tcp:101:rm.0 Request processed in 690us (1004us total) trans 343597383705 rc 0/0 00000100:00100000:0.0:1786109715.760734:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1221 00000100:00100000:2.0:1786109715.771099:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.771259:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922169856 00000100:00100000:0.0:1786109715.771267:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922169856 00000100:00100000:0.0:1786109715.771336:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1222 00000100:00100000:0.0:1786109715.771344:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+92:165190:x1872862922169856:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1786109715.771364:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109715.771381:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38516 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1888 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.771477:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3851d lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.771501:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3851d lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.771512:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3851d lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109715.771553:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x16:0x0]: returning size 4096 00000004:00200000:0.0:1786109715.771557:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786109715.771583:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3851d lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.771607:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8e00/0xdb52b77d7ca38516 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1888 expref: 94 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.771629:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3851d lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1888 expref: 93 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.771643:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:0.0:1786109715.771647:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786109715.771650:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a8166de00, rc 0) 00000100:00100000:0.0:1786109715.771887:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+93:165190:x1872862922169856:12345-192.168.203.38@tcp:101:rm.0 Request processed in 541us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109715.771894:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1222 00000100:00100000:2.0:1786109715.775039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.775225:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922170112 00000100:00100000:3.0:1786109715.775235:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922170112 00000100:00100000:3.0:1786109715.775304:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1223 00000100:00100000:3.0:1786109715.775315:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+93:165190:x1872862922170112:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1786109715.775339:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109715.775364:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca38524 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a188f expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.776030:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412600/0xdb52b77d7ca3852b lrc: 3/1,0 mode: --/CR res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.776050:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412600/0xdb52b77d7ca3852b lrc: 3/1,0 mode: CR/CR res: [0x240002ef9:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.776063:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412600/0xdb52b77d7ca3852b lrc: 3/1,0 mode: CR/CR res: [0x240002ef9:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109715.776075:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x16:0x0]: returning size 4096 00010000:00010000:2.0:1786109715.776280:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a600/0xdb52b77d7ca38524 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a188f expref: 96 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.776308:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412600/0xdb52b77d7ca3852b lrc: 3/0,0 mode: CR/CR res: [0x240002ef9:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a188f expref: 95 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.776315:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:2.0:1786109715.776317:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786109715.776319:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412600, rc 0) 00000100:00100000:2.0:1786109715.776370:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+95:165190:x1872862922170112:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1056us (1339us total) trans 30064771119 rc 0/0 00000100:00100000:2.0:1786109715.776377:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1223 00000100:00100000:3.0:1786109715.780097:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.780271:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922170240 00000100:00100000:1.0:1786109715.780279:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922170240 00000100:00100000:1.0:1786109715.780353:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:1.0:1786109715.780363:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+95:165190:x1872862922170240:12345-192.168.203.38@tcp:37:rm.0 00000100:00100000:1.0:1786109715.787985:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+95:165190:x1872862922170240:12345-192.168.203.38@tcp:37:rm.0 Request processed in 7600us (7873us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109715.787998:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1786109715.795650:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.796038:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922170496 00000100:00100000:1.0:1786109715.796060:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922170496 00000100:00100000:1.0:1786109715.796358:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1224 00000100:00100000:1.0:1786109715.796369:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+95:165190:x1872862922170496:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109715.796552:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1786109715.796578:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9600/0xdb52b77d7ca38379 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a181f expref: 95 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.796600:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x21:0x0].0x0 (ffff930a92c11200) 00010000:00010000:1.0:1786109715.796615:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166de00/0xdb52b77d7ca3851d lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1888 expref: 94 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.796626:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:1.0:1786109715.796629:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109715.796649:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38539 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.796660:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38539 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.796669:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38539 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.796677:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360000/0xdb52b77d7ca38540 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.796690:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360000/0xdb52b77d7ca38540 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.796696:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360000/0xdb52b77d7ca38540 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.796861:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca38547 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.796869:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca38547 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.796998:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca38547 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109715.797301:0:187901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].2, 64 off8320 00000004:00080000:1.0:1786109715.797313:0:187901:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8572463881150ns, next at 8573463877667ns, rc = 0 00010000:00010000:1.0:1786109715.797362:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca3854e lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797372:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca3854e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797381:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca3854e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797388:0:187901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca3854e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797394:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca3854e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797405:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca3854e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797580:0:187901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109715.797603:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca38547 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797610:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca38547 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797617:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca38547 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797623:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.797627:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca38547 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797634:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca38547 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797645:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x21:0x0].0x0 (ffff930a90808300) 00010000:00010000:1.0:1786109715.797648:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109715.797652:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca38547 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797658:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca38547 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797676:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38539 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797686:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38539 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797692:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38539 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797697:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.797700:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38539 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.797707:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38539 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.798141:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109715.798149:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca3854e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.798157:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.798161:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca3854e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.798167:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca3854e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.798179:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x21:0x0].0x0 (ffff930a90808300) 00010000:00010000:3.0:1786109715.798181:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.798184:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca3854e lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.798189:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca3854e lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.798204:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.798206:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.798208:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109715.798369:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:1.0:1786109715.798373:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.798378:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38539 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.798383:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38539 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.798395:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000339e5375 reply state 00000000199f4fd2 transno 30064771120 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360000/0xdb52b77d7ca38540 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.798407:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360000/0xdb52b77d7ca38540 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.798413:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x1b7026cc (ffff930a92c11f00) 00010000:00010000:1.0:1786109715.798415:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.798418:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109715.800081:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+95:165190:x1872862922170496:12345-192.168.203.38@tcp:36:rm.0 Request processed in 3703us (4431us total) trans 30064771120 rc 0/0 00000100:00100000:1.0:1786109715.800093:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1224 00000100:00100000:3.0:1786109715.805093:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.805183:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922170752 00000100:00100000:2.0:1786109715.805195:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922170752 00000100:00100000:2.0:1786109715.805296:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1225 00000100:00100000:2.0:1786109715.805306:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+95:165190:x1872862922170752:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109715.805360:0:196401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.805385:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38333 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1811 expref: 95 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805405:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1f:0x0].0x0 (ffff930ab2894600) 00010000:00010000:2.0:1786109715.805416:0:196401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109715.805483:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38555 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805497:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38555 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805508:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38555 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805520:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412800/0xdb52b77d7ca3855c lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805528:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412800/0xdb52b77d7ca3855c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805535:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412800/0xdb52b77d7ca3855c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805612:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38563 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805621:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38563 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805629:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38563 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109715.805851:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].3, 64 off8384 00010000:00010000:2.0:1786109715.805894:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca3856a lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805903:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca3856a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805911:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca3856a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805918:0:196401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca3856a lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805925:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca3856a lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805931:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca3856a lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805954:0:196401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109715.805970:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38563 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805977:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38563 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805983:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38563 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.805989:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.805993:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38563 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.806000:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38563 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.806008:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1f:0x0].0x0 (ffff930ab2894800) 00010000:00010000:2.0:1786109715.806010:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109715.806015:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38563 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.806022:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38563 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.806036:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38555 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.806041:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38555 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.806050:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38555 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.806055:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.806058:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38555 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.806064:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38555 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.806072:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:2.0:1786109715.806074:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.806077:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38555 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.806083:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38555 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.806092:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057dc97de reply state 000000006784a65b transno 30064771121 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412800/0xdb52b77d7ca3855c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.806102:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412800/0xdb52b77d7ca3855c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.806108:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xd0b639f4 (ffff930ab2894400) 00010000:00010000:2.0:1786109715.806110:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.806113:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109715.806178:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+96:165190:x1872862922170752:12345-192.168.203.38@tcp:36:rm.0 Request processed in 872us (1093us total) trans 30064771121 rc 0/0 00000100:00100000:2.0:1786109715.806185:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1225 00010000:00010000:3.0:1786109715.806252:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109715.806258:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca3856a lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.806265:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.806268:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca3856a lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.806275:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca3856a lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.806284:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1f:0x0].0x0 (ffff930ab2894800) 00010000:00010000:3.0:1786109715.806287:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.806290:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca3856a lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.806296:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca3856a lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.806308:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.806310:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.806312:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109715.812545:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.812635:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922171008 00000100:00100000:2.0:1786109715.812643:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922171008 00000100:00100000:2.0:1786109715.812697:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1226 00000100:00100000:2.0:1786109715.812707:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+96:165190:x1872862922171008:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109715.812775:0:189813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.812812:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca3839c lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1826 expref: 96 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.812833:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x22:0x0].0x0 (ffff930ab2894c00) 00010000:00010000:2.0:1786109715.812844:0:189813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109715.812863:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca38571 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.812887:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca38571 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.812898:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca38571 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.812909:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413000/0xdb52b77d7ca38578 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.812916:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413000/0xdb52b77d7ca38578 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.812923:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413000/0xdb52b77d7ca38578 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813003:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca3857f lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813017:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca3857f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813024:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca3857f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109715.813228:0:189813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].2, 64 off8320 00000004:00080000:2.0:1786109715.813237:0:189813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8572479805838ns, next at 8573479803384ns, rc = 0 00010000:00010000:2.0:1786109715.813275:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca38586 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813284:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca38586 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813292:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca38586 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813299:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca38586 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813305:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca38586 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813312:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca38586 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813334:0:189813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109715.813349:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca3857f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813356:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca3857f lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813363:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca3857f lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813370:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.813374:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca3857f lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813382:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca3857f lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813389:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x22:0x0].0x0 (ffff930ab2894700) 00010000:00010000:2.0:1786109715.813393:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109715.813396:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca3857f lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813402:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca3857f lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813416:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca38571 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813422:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca38571 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.813427:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca38571 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.813469:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109715.813476:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca38586 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.813483:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.813495:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca38586 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.813502:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca38586 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.813512:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x22:0x0].0x0 (ffff930ab2894700) 00010000:00010000:3.0:1786109715.813514:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.813517:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca38586 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.813522:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca38586 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.813534:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.813536:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.813538:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109715.815959:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca38571 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.815966:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.815972:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca38571 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.815981:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca38571 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.815997:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:2.0:1786109715.816000:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.816004:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca38571 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.816011:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca38571 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.816029:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001be3de18 reply state 0000000063d91b0c transno 30064771122 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413000/0xdb52b77d7ca38578 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.816042:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413000/0xdb52b77d7ca38578 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.816049:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x3e3e6f26 (ffff930a8607dd00) 00010000:00010000:2.0:1786109715.816051:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.816055:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109715.816159:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+97:165190:x1872862922171008:12345-192.168.203.38@tcp:36:rm.0 Request processed in 3449us (3620us total) trans 30064771122 rc 0/0 00000100:00100000:2.0:1786109715.816168:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1226 00000100:00100000:0.0:1786109715.819349:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.819508:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922171264 00000100:00100000:2.0:1786109715.819517:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922171264 00000100:00100000:2.0:1786109715.819570:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1227 00000100:00100000:2.0:1786109715.819581:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+97:165190:x1872862922171264:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109715.819637:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.819665:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8200/0xdb52b77d7ca38356 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1818 expref: 97 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.819683:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x20:0x0].0x0 (ffff930a92c11900) 00010000:00010000:2.0:1786109715.819693:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109715.819712:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3858d lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.819724:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3858d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.819733:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3858d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.819744:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38594 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.819942:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38594 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.819952:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38594 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820032:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca3859b lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820040:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca3859b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820047:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca3859b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109715.820231:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].3, 64 off8384 00010000:00010000:2.0:1786109715.820272:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca385a2 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820280:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca385a2 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820287:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca385a2 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820294:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca385a2 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820300:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca385a2 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820307:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca385a2 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820369:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109715.820387:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca3859b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820394:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca3859b lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820400:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca3859b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820406:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.820411:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca3859b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820418:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca3859b lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820426:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x20:0x0].0x0 (ffff930ab2894600) 00010000:00010000:2.0:1786109715.820469:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109715.820474:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca3859b lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820481:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425c00/0xdb52b77d7ca3859b lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820497:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3858d lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820503:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3858d lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820508:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3858d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820514:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3858d lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820518:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.820521:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3858d lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820526:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3858d lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820534:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:2.0:1786109715.820537:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.820540:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3858d lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820550:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3858d lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.820560:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000926a1468 reply state 0000000058e31a91 transno 30064771123 ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38594 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820570:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38594 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.820576:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xfdd9083c (ffff930a92c11500) 00010000:00010000:2.0:1786109715.820578:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.820581:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109715.820641:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+98:165190:x1872862922171264:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1061us (1299us total) trans 30064771123 rc 0/0 00000100:00100000:2.0:1786109715.820649:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1227 00010000:00010000:1.0:1786109715.821142:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109715.821150:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca385a2 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.821158:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109715.821161:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca385a2 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.821169:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca385a2 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.821179:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x20:0x0].0x0 (ffff930ab2894600) 00010000:00010000:1.0:1786109715.821182:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109715.821185:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca385a2 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.821190:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425e00/0xdb52b77d7ca385a2 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.821203:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109715.821205:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109715.821206:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109715.823213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.823300:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922171520 00000100:00100000:1.0:1786109715.823309:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922171520 00000100:00100000:1.0:1786109715.823375:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1228 00000100:00100000:1.0:1786109715.823384:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+98:165190:x1872862922171520:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109715.823597:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109715.823636:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca38405 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a183b expref: 98 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.823653:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x25:0x0].0x0 (ffff930ab2894000) 00010000:00010000:1.0:1786109715.823663:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109715.823683:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385a9 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.823694:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385a9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.823704:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385a9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.823714:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca385b0 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.823722:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca385b0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.823728:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca385b0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.823854:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385b7 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.823863:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385b7 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.823869:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385b7 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109715.824061:0:187900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].4, 64 off8448 00010000:00010000:1.0:1786109715.824107:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca385be lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824118:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca385be lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824125:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca385be lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824131:0:187900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca385be lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824137:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca385be lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824143:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca385be lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824201:0:187900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109715.824219:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385b7 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824225:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385b7 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824231:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385b7 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824238:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.824242:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385b7 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824249:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385b7 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824262:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x25:0x0].0x0 (ffff930a90808800) 00010000:00010000:1.0:1786109715.824265:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109715.824269:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385b7 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824274:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385b7 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x25:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824290:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385a9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824295:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385a9 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824301:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385a9 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824306:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.824309:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385a9 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824315:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385a9 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824321:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:1.0:1786109715.824323:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.824326:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385a9 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824332:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385a9 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.824344:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a36ad693 reply state 00000000e583a047 transno 30064771124 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca385b0 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824354:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca385b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.824360:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xa6a94833 (ffff930ab2894e00) 00010000:00010000:1.0:1786109715.824362:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.824365:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109715.824454:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+99:165190:x1872862922171520:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1070us (1249us total) trans 30064771124 rc 0/0 00000100:00100000:1.0:1786109715.824463:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1228 00010000:00010000:3.0:1786109715.825081:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109715.825088:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca385be lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.825096:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.825099:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca385be lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.825105:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca385be lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.825117:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x25:0x0].0x0 (ffff930a90808800) 00010000:00010000:3.0:1786109715.825120:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.825123:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca385be lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.825129:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca385be lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.825142:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.825145:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.825147:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109715.829129:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.829289:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922171776 00000100:00100000:2.0:1786109715.829299:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922171776 00000100:00100000:2.0:1786109715.829394:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1229 00000100:00100000:2.0:1786109715.829405:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+99:165190:x1872862922171776:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109715.829504:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.829527:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3823e lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17e0 expref: 99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.829544:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x18:0x0].0x0 (ffff930a90808200) 00010000:00010000:2.0:1786109715.829555:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109715.829572:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca385c5 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.829589:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca385c5 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.829598:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca385c5 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.829609:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca385cc lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.829616:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca385cc lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.829623:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca385cc lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.829698:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca385d3 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.829706:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca385d3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.829714:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca385d3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109715.830191:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].4, 64 off8448 00010000:00010000:1.0:1786109715.830244:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca385da lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830255:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca385da lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830263:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca385da lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830270:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca385da lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830276:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca385da lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830281:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca385da lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830340:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109715.830358:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca385d3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830365:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca385d3 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830372:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca385d3 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830377:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.830381:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca385d3 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830387:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca385d3 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830396:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x18:0x0].0x0 (ffff930ab2894c00) 00010000:00010000:1.0:1786109715.830399:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109715.830403:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca385d3 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830409:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca385d3 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830424:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca385c5 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830541:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca385c5 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830551:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca385c5 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830556:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca385c5 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830561:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.830564:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca385c5 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830569:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca385c5 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830578:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:1.0:1786109715.830580:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.830583:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca385c5 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830589:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424000/0xdb52b77d7ca385c5 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.830600:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd5ecb8a reply state 000000005dbc709a transno 30064771125 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca385cc lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830611:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca385cc lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.830617:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x94c295fa (ffff930a90808000) 00010000:00010000:1.0:1786109715.830619:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.830621:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109715.830736:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+100:165190:x1872862922171776:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1331us (1614us total) trans 30064771125 rc 0/0 00000100:00100000:1.0:1786109715.830744:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1229 00010000:00010000:3.0:1786109715.830825:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109715.830831:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca385da lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.830837:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.830841:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca385da lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.830847:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca385da lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.830857:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x18:0x0].0x0 (ffff930ab2894c00) 00010000:00010000:3.0:1786109715.830859:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.830862:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca385da lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.830868:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca385da lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.830882:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.830883:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.830885:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109715.834585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.834729:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922172032 00000100:00100000:1.0:1786109715.834739:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922172032 00000100:00100000:1.0:1786109715.834850:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1230 00000100:00100000:1.0:1786109715.834862:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+100:165190:x1872862922172032:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109715.834918:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109715.834942:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628aa00/0xdb52b77d7ca38310 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a180a expref: 100 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.834959:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1e:0x0].0x0 (ffff930a8607dc00) 00010000:00010000:1.0:1786109715.834970:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109715.834990:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385e1 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835002:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385e1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835011:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385e1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835022:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385e8 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835029:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385e8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835035:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385e8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835117:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca385ef lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835125:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca385ef lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835131:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca385ef lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109715.835325:0:187901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].5, 64 off8512 00010000:00010000:1.0:1786109715.835371:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca385f6 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835380:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca385f6 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835388:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca385f6 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835394:0:187901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca385f6 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835400:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca385f6 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835405:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca385f6 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835459:0:187901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109715.835475:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca385ef lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835486:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca385ef lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835493:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca385ef lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835499:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.835503:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca385ef lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835510:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca385ef lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835517:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1e:0x0].0x0 (ffff930a90808e00) 00010000:00010000:1.0:1786109715.835520:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109715.835524:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca385ef lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835530:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca385ef lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835546:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385e1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835552:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385e1 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835558:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385e1 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835563:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.835566:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385e1 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835572:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385e1 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835579:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:1.0:1786109715.835581:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.835583:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385e1 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835588:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca385e1 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.835597:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034a4b605 reply state 0000000032c4cfce transno 30064771126 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385e8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835607:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.835613:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xa3936bac (ffff930a8607d200) 00010000:00010000:1.0:1786109715.835615:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.835618:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109715.835683:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+101:165190:x1872862922172032:12345-192.168.203.38@tcp:36:rm.0 Request processed in 822us (1105us total) trans 30064771126 rc 0/0 00000100:00100000:1.0:1786109715.835690:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1230 00010000:00010000:3.0:1786109715.836203:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109715.836210:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca385f6 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.836217:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.836220:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca385f6 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.836227:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca385f6 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.836237:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1e:0x0].0x0 (ffff930a90808e00) 00010000:00010000:3.0:1786109715.836240:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.836243:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca385f6 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.836248:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca385f6 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.836263:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.836265:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.836267:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109715.839698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.839816:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922172288 00000100:00100000:2.0:1786109715.839826:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922172288 00000100:00100000:2.0:1786109715.839912:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1231 00000100:00100000:2.0:1786109715.839924:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+101:165190:x1872862922172288:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109715.839993:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.840019:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38428 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1842 expref: 101 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.840038:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x26:0x0].0x0 (ffff930ab2894500) 00010000:00010000:2.0:1786109715.840048:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109715.840067:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca385fd lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.840080:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca385fd lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.840089:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca385fd lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.840099:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca38604 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.840106:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca38604 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.840112:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca38604 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.840184:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca3860b lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.840193:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca3860b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.840200:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca3860b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109715.840369:0:187900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].6, 64 off8576 00010000:00010000:2.0:1786109715.841950:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38612 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.841969:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38612 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.841979:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38612 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.841988:0:187900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38612 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.841994:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38612 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842000:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38612 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842057:0:187900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109715.842079:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca3860b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842086:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca3860b lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842093:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca3860b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842099:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.842103:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca3860b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842111:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca3860b lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842122:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x26:0x0].0x0 (ffff930ab2894f00) 00010000:00010000:2.0:1786109715.842125:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109715.842129:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca3860b lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842134:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca3860b lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842151:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca385fd lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842157:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca385fd lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842163:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca385fd lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842169:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.842171:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca385fd lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842178:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca385fd lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842185:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:2.0:1786109715.842187:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.842190:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca385fd lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842196:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca385fd lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.842212:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ee2c493 reply state 000000002eb58d7f transno 30064771127 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca38604 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842222:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca38604 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.842229:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xc977908d (ffff930ab2894200) 00010000:00010000:2.0:1786109715.842231:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.842234:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109715.842311:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+102:165190:x1872862922172288:12345-192.168.203.38@tcp:36:rm.0 Request processed in 2387us (2619us total) trans 30064771127 rc 0/0 00000100:00100000:2.0:1786109715.842319:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1231 00010000:00010000:3.0:1786109715.842926:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109715.842935:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38612 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.842942:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.842946:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38612 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.842952:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38612 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.842964:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x26:0x0].0x0 (ffff930ab2894f00) 00010000:00010000:3.0:1786109715.842967:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.842970:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38612 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.843031:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca38612 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.843047:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.843049:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.843050:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109715.853368:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.853736:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922172544 00000100:00100000:2.0:1786109715.853747:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922172544 00000100:00100000:2.0:1786109715.853933:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1232 00000100:00100000:2.0:1786109715.853945:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+102:165190:x1872862922172544:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109715.854021:0:189813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.854048:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07400/0xdb52b77d7ca38284 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17ee expref: 102 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.854094:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1a:0x0].0x0 (ffff930aa0615f00) 00010000:00010000:2.0:1786109715.854105:0:189813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109715.854126:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38619 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.854139:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38619 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.854153:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38619 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.854163:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38620 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.854171:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38620 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.854178:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38620 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.854256:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38627 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.854264:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38627 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.854272:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38627 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109715.854698:0:189813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].7, 64 off8640 00010000:00010000:0.0:1786109715.854749:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3862e lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854771:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3862e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854780:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3862e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854787:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3862e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854793:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3862e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854810:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3862e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854838:0:189813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109715.854858:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38627 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854864:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38627 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854870:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38627 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854888:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.854892:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38627 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854900:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38627 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854908:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1a:0x0].0x0 (ffff930ab2894500) 00010000:00010000:0.0:1786109715.854911:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786109715.854914:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38627 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854920:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38627 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854935:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38619 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854941:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38619 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854950:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38619 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854954:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38619 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854958:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.854961:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38619 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854966:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38619 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854974:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:0.0:1786109715.854976:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.854979:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38619 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.854985:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38619 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109715.854994:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e0a989c reply state 00000000777ec432 transno 30064771128 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38620 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.855004:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38620 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.855010:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xef08328a (ffff930aa0615c00) 00010000:00010000:0.0:1786109715.855012:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109715.855015:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786109715.855090:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+103:165190:x1872862922172544:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1146us (1730us total) trans 30064771128 rc 0/0 00000100:00100000:0.0:1786109715.855098:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1232 00010000:00010000:2.0:1786109715.855151:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109715.855157:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3862e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.855164:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109715.855167:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3862e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.855173:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3862e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.855186:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1a:0x0].0x0 (ffff930ab2894500) 00010000:00010000:2.0:1786109715.855189:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786109715.855191:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3862e lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.855196:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3862e lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.855208:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109715.855210:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109715.855212:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109715.859128:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.859229:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922172800 00000100:00100000:2.0:1786109715.859240:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922172800 00000100:00100000:2.0:1786109715.859397:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1233 00000100:00100000:2.0:1786109715.859407:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+103:165190:x1872862922172800:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:3.0:1786109715.859706:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109715.859733:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166ce00/0xdb52b77d7ca384b4 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a185e expref: 103 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.859762:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x2a:0x0].0x0 (ffff930a83e02f00) 00010000:00010000:3.0:1786109715.859772:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109715.859793:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38635 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.859817:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38635 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.859827:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38635 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.859838:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca3863c lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.859845:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca3863c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.859852:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca3863c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.859930:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca38643 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.859937:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca38643 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.859944:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca38643 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786109715.860208:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].8, 64 off8704 00010000:00010000:3.0:1786109715.860254:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca3864a lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860262:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca3864a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860271:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca3864a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860279:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca3864a lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860285:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca3864a lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860291:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca3864a lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860358:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109715.860379:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca38643 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860386:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca38643 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860392:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca38643 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860399:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109715.860403:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca38643 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860410:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca38643 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860419:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x2a:0x0].0x0 (ffff930a8607dc00) 00010000:00010000:3.0:1786109715.860422:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109715.860426:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca38643 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860518:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca38643 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860536:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38635 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860543:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38635 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860549:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38635 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860555:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38635 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860560:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109715.860563:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38635 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860570:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38635 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860578:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:3.0:1786109715.860580:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109715.860583:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38635 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860589:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca38635 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109715.860599:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063162c5d reply state 00000000262f097d transno 30064771129 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca3863c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860610:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca3863c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.860617:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x54b0b1f4 (ffff930a83e02900) 00010000:00010000:3.0:1786109715.860620:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109715.860622:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786109715.860764:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309854fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+104:165190:x1872862922172800:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1348us (1632us total) trans 30064771129 rc 0/0 00000100:00100000:3.0:1786109715.860773:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1233 00010000:00010000:1.0:1786109715.861220:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109715.861228:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca3864a lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.861235:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109715.861239:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca3864a lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.861246:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca3864a lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.861257:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x2a:0x0].0x0 (ffff930a8607dc00) 00010000:00010000:1.0:1786109715.861260:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109715.861263:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca3864a lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.861269:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b400/0xdb52b77d7ca3864a lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.861286:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109715.861288:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109715.861290:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109715.865217:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.865328:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922173056 00000100:00100000:2.0:1786109715.865338:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922173056 00000100:00100000:2.0:1786109715.865424:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1234 00000100:00100000:2.0:1786109715.865479:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+104:165190:x1872862922173056:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109715.865538:0:196401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.865566:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8000/0xdb52b77d7ca38491 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1857 expref: 104 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.865585:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x29:0x0].0x0 (ffff930a83e02000) 00010000:00010000:2.0:1786109715.865596:0:196401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109715.865620:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38651 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.865637:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38651 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.865646:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38651 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.865657:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38658 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.865664:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38658 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.865671:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38658 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.865778:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca3865f lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.865786:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca3865f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.865793:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca3865f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109715.866135:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].5, 64 off8512 00010000:00010000:2.0:1786109715.866186:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38666 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866196:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38666 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866204:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38666 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866212:0:196401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38666 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866218:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38666 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866224:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38666 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866286:0:196401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109715.866304:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca3865f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866310:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca3865f lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866316:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca3865f lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866322:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.866325:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca3865f lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866332:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca3865f lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866340:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x29:0x0].0x0 (ffff930ab2894500) 00010000:00010000:2.0:1786109715.866343:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109715.866346:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca3865f lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866355:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca3865f lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866369:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38651 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866375:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38651 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866380:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38651 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866385:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.866388:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38651 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866393:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38651 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866399:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:2.0:1786109715.866401:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.866404:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38651 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866408:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38651 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.866417:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2c22481 reply state 00000000351cc940 transno 30064771130 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38658 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866427:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38658 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.866455:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x31e2699a (ffff930a92c11000) 00010000:00010000:2.0:1786109715.866457:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.866460:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109715.866535:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+105:165190:x1872862922173056:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1101us (1327us total) trans 30064771130 rc 0/0 00000100:00100000:2.0:1786109715.866543:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1234 00010000:00010000:3.0:1786109715.867082:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109715.867090:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38666 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.867098:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.867101:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38666 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.867108:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38666 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.867119:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x29:0x0].0x0 (ffff930ab2894500) 00010000:00010000:3.0:1786109715.867122:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.867126:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38666 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.867131:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38666 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.867147:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.867149:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.867152:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109715.870909:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.871078:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922173312 00000100:00100000:1.0:1786109715.871089:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922173312 00000100:00100000:1.0:1786109715.871170:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1235 00000100:00100000:1.0:1786109715.871181:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+105:165190:x1872862922173312:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109715.871234:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109715.871257:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8800/0xdb52b77d7ca383bf lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a182d expref: 105 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871273:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x23:0x0].0x0 (ffff930a92c11800) 00010000:00010000:1.0:1786109715.871281:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109715.871300:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca3866d lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871316:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca3866d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871324:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca3866d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871332:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361600/0xdb52b77d7ca38674 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871339:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361600/0xdb52b77d7ca38674 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871345:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361600/0xdb52b77d7ca38674 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871413:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca3867b lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871420:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca3867b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871427:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca3867b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109715.871626:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].6, 64 off8576 00010000:00010000:1.0:1786109715.871665:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38682 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871674:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38682 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871682:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38682 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871689:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38682 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871696:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38682 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871702:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38682 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871717:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109715.871733:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca3867b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871738:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca3867b lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871743:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca3867b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871761:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.871765:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca3867b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871773:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca3867b lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871781:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x23:0x0].0x0 (ffff930a90808900) 00010000:00010000:1.0:1786109715.871783:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109715.871787:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca3867b lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871796:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca3867b lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871812:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca3866d lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871818:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca3866d lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871824:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca3866d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871829:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca3866d lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871834:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.871836:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca3866d lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871842:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca3866d lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871849:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:1.0:1786109715.871851:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.871854:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca3866d lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871860:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca3866d lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.871870:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077da16a4 reply state 00000000b5206e3e transno 30064771131 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361600/0xdb52b77d7ca38674 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871881:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361600/0xdb52b77d7ca38674 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.871887:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x610cb780 (ffff930a92c11100) 00010000:00010000:1.0:1786109715.871890:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.871892:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109715.871959:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+106:165190:x1872862922173312:12345-192.168.203.38@tcp:36:rm.0 Request processed in 778us (1058us total) trans 30064771131 rc 0/0 00000100:00100000:1.0:1786109715.871966:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1235 00010000:00010000:3.0:1786109715.872189:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109715.872195:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38682 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.872202:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.872204:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38682 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.872210:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38682 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.872221:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x23:0x0].0x0 (ffff930a90808900) 00010000:00010000:3.0:1786109715.872224:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.872227:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38682 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.872233:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38682 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.872246:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.872248:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.872250:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109715.878274:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.878371:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922173568 00000100:00100000:1.0:1786109715.878380:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922173568 00000100:00100000:1.0:1786109715.878526:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1236 00000100:00100000:1.0:1786109715.878537:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+106:165190:x1872862922173568:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109715.878590:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109715.878614:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9e00/0xdb52b77d7ca383e2 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1834 expref: 106 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.878631:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x24:0x0].0x0 (ffff930a92c11600) 00010000:00010000:1.0:1786109715.878640:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109715.878658:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38689 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.878669:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38689 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.878679:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38689 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.878691:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38690 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.878699:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38690 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.878705:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38690 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.878792:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca38697 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.878812:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca38697 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.878820:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca38697 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109715.879001:0:187901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].9, 64 off8768 00010000:00010000:1.0:1786109715.879042:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3869e lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879050:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3869e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879058:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3869e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879077:0:187901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3869e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879083:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3869e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879091:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3869e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879171:0:187901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109715.879189:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca38697 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879195:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca38697 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879201:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca38697 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879207:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.879212:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca38697 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879218:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca38697 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879227:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x24:0x0].0x0 (ffff930a90808700) 00010000:00010000:1.0:1786109715.879229:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109715.879233:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca38697 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879239:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca38697 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879256:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38689 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879266:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38689 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879272:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38689 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879276:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.879279:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38689 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879284:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38689 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879291:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:1.0:1786109715.879293:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.879296:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38689 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879301:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38689 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.879311:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006209f830 reply state 0000000079453016 transno 30064771132 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38690 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879322:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38690 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.879328:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x83daffd9 (ffff930a92c11a00) 00010000:00010000:1.0:1786109715.879330:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.879333:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109715.879478:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+107:165190:x1872862922173568:12345-192.168.203.38@tcp:36:rm.0 Request processed in 941us (1210us total) trans 30064771132 rc 0/0 00000100:00100000:1.0:1786109715.879485:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1236 00010000:00010000:2.0:1786109715.879544:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109715.879551:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3869e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.879558:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109715.879562:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3869e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.879569:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3869e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.879578:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x24:0x0].0x0 (ffff930a90808700) 00010000:00010000:2.0:1786109715.879581:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786109715.879584:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3869e lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.879589:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360c00/0xdb52b77d7ca3869e lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.879602:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109715.879604:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109715.879606:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109715.883607:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.883776:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922173824 00000100:00100000:1.0:1786109715.883786:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922173824 00000100:00100000:1.0:1786109715.883890:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1237 00000100:00100000:1.0:1786109715.883901:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+107:165190:x1872862922173824:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109715.883956:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109715.883981:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3844b lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1849 expref: 107 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.883998:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x27:0x0].0x0 (ffff930ab2894300) 00010000:00010000:1.0:1786109715.884007:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109715.884026:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca386a5 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884038:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca386a5 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884046:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca386a5 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884056:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca386ac lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884079:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca386ac lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884086:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca386ac lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884170:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca386b3 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884178:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca386b3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884185:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca386b3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109715.884361:0:187900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].7, 64 off8640 00010000:00010000:1.0:1786109715.884421:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca386ba lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884458:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca386ba lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884466:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca386ba lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884472:0:187900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca386ba lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884478:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca386ba lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884485:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca386ba lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884502:0:187900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109715.884516:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca386b3 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884526:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca386b3 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884531:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca386b3 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884536:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.884539:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca386b3 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884546:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca386b3 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884554:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x27:0x0].0x0 (ffff930a90808400) 00010000:00010000:1.0:1786109715.884556:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109715.884559:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca386b3 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884565:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca386b3 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884578:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca386a5 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884583:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca386a5 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884588:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca386a5 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884593:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.884597:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca386a5 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884602:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca386a5 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884608:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:1.0:1786109715.884610:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.884613:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca386a5 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884617:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca386a5 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.884624:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001ad485d reply state 00000000f12f22fb transno 30064771133 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca386ac lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884633:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca386ac lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.884638:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xec45d8e7 (ffff930ab2894a00) 00010000:00010000:1.0:1786109715.884640:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.884642:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109715.884762:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+108:165190:x1872862922173824:12345-192.168.203.38@tcp:36:rm.0 Request processed in 853us (1155us total) trans 30064771133 rc 0/0 00000100:00100000:1.0:1786109715.884768:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1237 00010000:00010000:3.0:1786109715.884850:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109715.884856:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca386ba lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.884862:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.884865:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca386ba lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.884871:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca386ba lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.884880:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x27:0x0].0x0 (ffff930a90808400) 00010000:00010000:3.0:1786109715.884883:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.884886:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca386ba lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.884891:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca386ba lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.884902:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.884903:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.884905:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109715.889146:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.889250:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922174080 00000100:00100000:2.0:1786109715.889260:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922174080 00000100:00100000:2.0:1786109715.889354:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1238 00000100:00100000:2.0:1786109715.889365:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+108:165190:x1872862922174080:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109715.889425:0:189813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.889495:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06000/0xdb52b77d7ca382ca lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17fc expref: 108 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889514:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1c:0x0].0x0 (ffff930aa0615900) 00010000:00010000:2.0:1786109715.889523:0:189813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109715.889544:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca386c1 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889556:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca386c1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889565:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca386c1 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889575:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca386c8 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889583:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca386c8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889590:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca386c8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889669:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386cf lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889677:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386cf lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889685:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386cf lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109715.889910:0:189813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].10, 64 off8832 00010000:00010000:2.0:1786109715.889956:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca386d6 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889966:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca386d6 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889985:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca386d6 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889993:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca386d6 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.889999:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca386d6 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890005:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca386d6 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890022:0:189813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109715.890040:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386cf lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890046:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386cf lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890061:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386cf lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890072:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.890077:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386cf lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890084:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386cf lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890093:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1c:0x0].0x0 (ffff930ab2894100) 00010000:00010000:2.0:1786109715.890096:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109715.890100:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386cf lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890106:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386cf lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890121:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca386c1 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890128:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca386c1 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890134:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca386c1 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890140:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca386c1 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890146:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.890149:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca386c1 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890159:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca386c1 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890167:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:2.0:1786109715.890169:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.890172:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca386c1 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890177:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca386c1 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.890186:0:189813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000013737a3 reply state 000000001bd8c948 transno 30064771134 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca386c8 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890197:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca386c8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.890203:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x494dcf1b (ffff930aa0615d00) 00010000:00010000:2.0:1786109715.890205:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.890208:0:189813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109715.890282:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+109:165190:x1872862922174080:12345-192.168.203.38@tcp:36:rm.0 Request processed in 918us (1144us total) trans 30064771134 rc 0/0 00000100:00100000:2.0:1786109715.890290:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1238 00010000:00010000:0.0:1786109715.890579:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109715.890586:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca386d6 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.890593:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109715.890596:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca386d6 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.890602:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca386d6 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.890612:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1c:0x0].0x0 (ffff930ab2894100) 00010000:00010000:0.0:1786109715.890614:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109715.890617:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca386d6 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.890622:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca386d6 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.890634:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109715.890636:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109715.890637:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109715.897348:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.897559:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922174336 00000100:00100000:3.0:1786109715.897570:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922174336 00000100:00100000:3.0:1786109715.897680:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1239 00000100:00100000:3.0:1786109715.897692:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+109:165190:x1872862922174336:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:3.0:1786109715.897811:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109715.897837:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425000/0xdb52b77d7ca38261 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17e7 expref: 109 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.897856:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x19:0x0].0x0 (ffff930ab2894900) 00010000:00010000:3.0:1786109715.897867:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109715.897888:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca386dd lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.897901:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca386dd lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.897911:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca386dd lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.897926:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca386e4 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.897934:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca386e4 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.897940:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca386e4 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898080:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca386eb lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898090:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca386eb lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898097:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca386eb lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786109715.898299:0:188678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].8, 64 off8704 00010000:00010000:3.0:1786109715.898342:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca386f2 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898350:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca386f2 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898358:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca386f2 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898365:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca386f2 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898372:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca386f2 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898379:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca386f2 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898494:0:188678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109715.898512:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca386eb lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898518:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca386eb lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898523:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca386eb lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898528:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ae00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109715.898532:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca386eb lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898538:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca386eb lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898546:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x19:0x0].0x0 (ffff930a8607d700) 00010000:00010000:3.0:1786109715.898549:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109715.898552:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca386eb lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898558:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ae00/0xdb52b77d7ca386eb lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898574:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca386dd lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898583:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca386dd lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898588:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca386dd lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898592:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca386dd lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898596:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109715.898598:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca386dd lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898603:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca386dd lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898609:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:3.0:1786109715.898611:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109715.898613:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca386dd lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898618:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a400/0xdb52b77d7ca386dd lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109715.898625:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a67b25d3 reply state 00000000da5befb6 transno 30064771135 ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca386e4 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898635:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca386e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.898640:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xc1e56442 (ffff930ab2894b00) 00010000:00010000:3.0:1786109715.898643:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109715.898645:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786109715.898718:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+110:165190:x1872862922174336:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1028us (1379us total) trans 30064771135 rc 0/0 00000100:00100000:3.0:1786109715.898725:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1239 00010000:00010000:1.0:1786109715.899165:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109715.899172:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca386f2 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.899179:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628bc00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109715.899183:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca386f2 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.899189:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca386f2 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.899200:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x19:0x0].0x0 (ffff930a8607d700) 00010000:00010000:1.0:1786109715.899202:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109715.899206:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca386f2 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.899211:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628bc00/0xdb52b77d7ca386f2 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.899226:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109715.899228:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109715.899229:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109715.904533:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.904813:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922174592 00000100:00100000:2.0:1786109715.904823:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922174592 00000100:00100000:2.0:1786109715.904886:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1240 00000100:00100000:2.0:1786109715.904896:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+110:165190:x1872862922174592:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109715.904955:0:196401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.904981:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8400/0xdb52b77d7ca382a7 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17f5 expref: 110 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.904999:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1b:0x0].0x0 (ffff930a92c11b00) 00010000:00010000:2.0:1786109715.905010:0:196401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109715.905032:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386f9 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905046:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386f9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905056:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386f9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905189:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38700 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905199:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38700 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905205:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38700 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905285:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38707 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905293:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38707 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905300:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38707 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786109715.905564:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].9, 64 off8768 00010000:00010000:2.0:1786109715.905605:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3870e lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905614:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3870e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905622:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3870e lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905629:0:196401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3870e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905636:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3870e lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905642:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3870e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905666:0:196401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109715.905692:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38707 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905698:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38707 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905705:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38707 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.905709:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109715.905712:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.905717:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38707 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905724:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38707 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905733:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1b:0x0].0x0 (ffff930ab2894900) 00010000:00010000:2.0:1786109715.905736:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109715.905739:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38707 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905745:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38707 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905772:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386f9 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905778:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386f9 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905784:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386f9 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905789:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.905792:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386f9 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905856:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386f9 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905865:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:2.0:1786109715.905867:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.905871:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386f9 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905876:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413200/0xdb52b77d7ca386f9 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.905890:0:196401:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca4a10ac reply state 000000006e85d4af transno 30064771136 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38700 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905901:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38700 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.905906:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x1c2b00d3 (ffff930a92c11e00) 00010000:00010000:2.0:1786109715.905909:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109715.905911:0:196401:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786109715.905987:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+111:165190:x1872862922174592:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1091us (1461us total) trans 30064771136 rc 0/0 00010000:00010000:3.0:1786109715.905996:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3870e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109715.905996:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1240 00010000:00010000:3.0:1786109715.906008:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.906013:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3870e lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.906021:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3870e lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.906032:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1b:0x0].0x0 (ffff930ab2894900) 00010000:00010000:3.0:1786109715.906035:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.906038:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3870e lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.906045:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413600/0xdb52b77d7ca3870e lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.906060:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.906062:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.906064:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109715.912285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.912423:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922174848 00000100:00100000:1.0:1786109715.912541:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922174848 00000100:00100000:1.0:1786109715.912642:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1241 00000100:00100000:1.0:1786109715.912653:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+111:165190:x1872862922174848:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109715.912770:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109715.912796:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3821b lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17d9 expref: 111 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.912815:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x17:0x0].0x0 (ffff930a90808100) 00010000:00010000:1.0:1786109715.912824:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109715.912843:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38715 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.912857:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38715 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.912871:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38715 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.912882:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3871c lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.912890:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3871c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.912897:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3871c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913132:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38723 lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913143:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38723 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913151:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38723 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109715.913337:0:187899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].10, 64 off8832 00010000:00010000:1.0:1786109715.913383:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3872a lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913393:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3872a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913401:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3872a lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913408:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3872a lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913415:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3872a lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913420:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3872a lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913472:0:187899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109715.913490:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38723 lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913498:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38723 lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913505:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38723 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913511:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.913516:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38723 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913523:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38723 lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913532:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x17:0x0].0x0 (ffff930a90808600) 00010000:00010000:1.0:1786109715.913535:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109715.913539:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38723 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913545:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38723 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913568:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38715 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913574:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38715 lrc: 4/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913581:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38715 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913587:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38715 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913593:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.913596:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38715 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913602:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38715 lrc: 5/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913610:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:1.0:1786109715.913612:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.913615:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38715 lrc: 3/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913621:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38715 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.913631:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000023110ab reply state 00000000711c356e transno 30064771137 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3871c lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913641:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3871c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.913648:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x679fc7b1 (ffff930aa0615700) 00010000:00010000:1.0:1786109715.913650:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.913653:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786109715.915651:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109715.915664:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3872a lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.915675:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.915949:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3872a lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.915960:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3872a lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.915991:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x17:0x0].0x0 (ffff930a90808600) 00010000:00010000:3.0:1786109715.915995:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.916000:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3872a lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.916007:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3872a lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.916037:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.916039:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.916042:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109715.916404:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+112:165190:x1872862922174848:12345-192.168.203.38@tcp:36:rm.0 Request processed in 3747us (4122us total) trans 30064771137 rc 0/0 00000100:00100000:1.0:1786109715.916415:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1241 00000100:00100000:0.0:1786109715.923595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.923738:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922175104 00000100:00100000:1.0:1786109715.923748:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922175104 00000100:00100000:1.0:1786109715.923853:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1242 00000100:00100000:1.0:1786109715.923864:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+112:165190:x1872862922175104:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109715.923920:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109715.923947:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07800/0xdb52b77d7ca382ed lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1803 expref: 112 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.923965:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1d:0x0].0x0 (ffff930a8607d800) 00010000:00010000:1.0:1786109715.923976:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109715.924091:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38731 lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924105:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38731 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924115:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38731 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924126:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38738 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924138:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38738 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924144:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38738 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924218:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3873f lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924227:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3873f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924234:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3873f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109715.924787:0:187901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].11, 64 off8896 00010000:00010000:1.0:1786109715.924841:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38746 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924851:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38746 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924860:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38746 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924868:0:187901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38746 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924875:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38746 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924882:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38746 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.924971:0:187901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109715.925000:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3873f lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925007:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3873f lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925014:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3873f lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925020:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.925023:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3873f lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925030:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3873f lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925039:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1d:0x0].0x0 (ffff930a90808100) 00010000:00010000:1.0:1786109715.925042:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109715.925045:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3873f lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925049:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361e00/0xdb52b77d7ca3873f lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925065:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38731 lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925070:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38731 lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925079:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38731 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925084:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.925086:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38731 lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925091:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38731 lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925098:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:1.0:1786109715.925100:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.925103:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38731 lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925108:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca38731 lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.925118:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d34c8c5 reply state 000000006b5ae168 transno 30064771138 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38738 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925129:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38738 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.925136:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x76709d63 (ffff930a8607d400) 00010000:00010000:1.0:1786109715.925138:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.925141:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109715.925227:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+113:165190:x1872862922175104:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1362us (1638us total) trans 30064771138 rc 0/0 00000100:00100000:1.0:1786109715.925235:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1242 00010000:00010000:0.0:1786109715.925784:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109715.925792:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38746 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.925801:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109715.925805:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38746 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.925813:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38746 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.925824:0:29734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x1d:0x0].0x0 (ffff930a90808100) 00010000:00010000:0.0:1786109715.925827:0:29734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109715.925830:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38746 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.925836:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38746 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.925852:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109715.925854:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109715.925856:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109715.932256:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.932367:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922175360 00000100:00100000:1.0:1786109715.932377:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922175360 00000100:00100000:1.0:1786109715.932526:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1243 00000100:00100000:1.0:1786109715.932538:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+113:165190:x1872862922175360:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109715.932597:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786109715.932623:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b800/0xdb52b77d7ca3846e lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1850 expref: 113 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.932641:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x28:0x0].0x0 (ffff930aa0615b00) 00010000:00010000:1.0:1786109715.932651:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109715.932669:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca3874d lrc: 3/0,1 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.932699:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca3874d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.932709:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca3874d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.932730:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38754 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.932739:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38754 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.932747:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38754 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.932833:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3875b lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.932846:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3875b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.932853:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3875b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786109715.933059:0:187900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].11, 64 off8896 00010000:00010000:1.0:1786109715.933107:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca38762 lrc: 3/0,1 mode: --/PW res: [0x240002ef9:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933117:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca38762 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933126:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca38762 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933133:0:187900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca38762 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933140:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca38762 lrc: 4/0,1 mode: PW/PW res: [0x240002ef9:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933147:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca38762 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933220:0:187900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109715.933237:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3875b lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933244:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3875b lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933256:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3875b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933263:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.933267:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3875b lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933276:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3875b lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933284:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x28:0x0].0x0 (ffff930a90808f00) 00010000:00010000:1.0:1786109715.933288:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109715.933291:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3875b lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933298:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361200/0xdb52b77d7ca3875b lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933315:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca3874d lrc: 3/0,1 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933322:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca3874d lrc: 2/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933328:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca3874d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933334:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.933337:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca3874d lrc: 3/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933347:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca3874d lrc: 4/0,0 mode: CW/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933354:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:1.0:1786109715.933356:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.933359:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca3874d lrc: 2/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933365:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361000/0xdb52b77d7ca3874d lrc: 0/0,0 mode: --/CW res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.933374:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecc9c066 reply state 00000000e441f7b9 transno 30064771139 ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38754 lrc: 3/0,1 mode: PW/PW res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933386:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38754 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.933392:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xf142140 (ffff930a8607d500) 00010000:00010000:1.0:1786109715.933395:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.933397:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786109715.933491:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+114:165190:x1872862922175360:12345-192.168.203.38@tcp:36:rm.0 Request processed in 954us (1242us total) trans 30064771139 rc 0/0 00000100:00100000:1.0:1786109715.933499:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1243 00010000:00010000:3.0:1786109715.933962:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109715.933970:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca38762 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.934034:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109715.934038:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca38762 lrc: 2/0,0 mode: PW/PW res: [0x240002ef9:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.934045:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca38762 lrc: 3/0,0 mode: PW/PW res: [0x240002ef9:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.934057:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x28:0x0].0x0 (ffff930a90808f00) 00010000:00010000:3.0:1786109715.934060:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786109715.934064:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca38762 lrc: 1/0,0 mode: --/PW res: [0x240002ef9:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.934075:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360a00/0xdb52b77d7ca38762 lrc: 0/0,0 mode: --/PW res: [0x240002ef9:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.934091:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.934093:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109715.934095:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109715.937673:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.937824:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922175488 00000100:00100000:0.0:1786109715.937833:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922175488 00000100:00100000:0.0:1786109715.937926:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1244 00000100:00100000:0.0:1786109715.937937:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+14:165190:x1872862922175488:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1786109715.937964:0:189813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109715.937997:0:189813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca38769 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1896 expref: -99 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938064:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38770 lrc: 3/1,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938080:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38770 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938093:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38770 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938108:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca38777 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938116:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca38777 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938123:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca38777 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938171:0:189813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3877e lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938180:0:189813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3877e lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938187:0:189813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3877e lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109715.938206:0:189813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3877e lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938221:0:189813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38770 lrc: 4/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938229:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38770 lrc: 4/1,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938236:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38770 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938243:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38770 lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938249:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.938254:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38770 lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938262:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38770 lrc: 5/0,0 mode: CR/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938274:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:0.0:1786109715.938278:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.938283:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38770 lrc: 3/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938290:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38770 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938303:0:189813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca38777 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938310:0:189813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca38777 lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938316:0:189813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca38777 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938321:0:189813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109715.938325:0:189813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca38777 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938331:0:189813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca38777 lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938338:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0xf7117594 (ffff930a83e02300) 00010000:00010000:0.0:1786109715.938340:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.938343:0:189813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca38777 lrc: 2/0,0 mode: --/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938349:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca38777 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938379:0:189813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca38769 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1896 expref: 16 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938393:0:189813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3877e lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1896 expref: 15 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.938401:0:189813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a92c11300) 00010000:00010000:0.0:1786109715.938403:0:189813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786109715.938407:0:189813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2600, rc 0) 00010000:00000080:0.0:1786109715.938415:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9631880 x1872862922175488/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:186/0 lens 584/584 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1786109715.938522:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+15:165190:x1872862922175488:12345-192.168.203.38@tcp:101:rm.0 Request processed in 586us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109715.938534:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1244 00000100:00100000:0.0:1786109715.944779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.944993:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.945056:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922175744 00000100:00100000:2.0:1786109715.945065:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922175744 00000100:00100000:2.0:1786109715.945130:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4537 00000100:00100000:2.0:1786109715.945141:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a90737050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fac74500-4523-4794-af20-dfdcdfae19c1+15:2405:x1872862922175744:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786109715.945156:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.945179:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2600/0xdb52b77d7ca3877e lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1896 expref: 15 pid: 189813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.945197:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a92c11300) 00010000:00010000:2.0:1786109715.945202:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109715.945262:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a90737050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fac74500-4523-4794-af20-dfdcdfae19c1+14:2405:x1872862922175744:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 123us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109715.945270:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4537 00000100:00100000:3.0:1786109715.945789:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922175616 00000100:00100000:3.0:1786109715.945795:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922175616 00000100:00100000:2.0:1786109715.945952:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1245 00000100:00100000:2.0:1786109715.945961:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+114:165190:x1872862922175616:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1786109715.945993:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109715.946010:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca38785 lrc: 2/0,0 mode: --/CR res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a189d expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.946062:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3878c lrc: 3/1,0 mode: --/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.946076:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3878c lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.946087:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3878c lrc: 3/1,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109715.946127:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x16:0x0]: returning size 4096 00000004:00200000:2.0:1786109715.946131:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1786109715.946162:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412400/0xdb52b77d7ca38785 lrc: 0/0,0 mode: --/CR res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a189d expref: 116 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.946177:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3878c lrc: 3/0,0 mode: PR/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a189d expref: 115 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.946185:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:2.0:1786109715.946188:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786109715.946191:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413e00, rc 0) 00000100:00100000:2.0:1786109715.946269:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+115:165190:x1872862922175616:12345-192.168.203.38@tcp:101:rm.0 Request processed in 309us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109715.946277:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1245 00000100:00100000:0.0:1786109715.951291:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109715.951366:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.951505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922175872 00000100:00100000:2.0:1786109715.951513:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922175872 00000100:00100000:2.0:1786109715.951609:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4538 00000100:00100000:2.0:1786109715.951620:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fac74500-4523-4794-af20-dfdcdfae19c1+14:2403:x1872862922175872:12345-192.168.203.38@tcp:103:rm.0 00010000:00010000:2.0:1786109715.951635:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.951660:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9c00/0xdb52b77d7ca381e3 lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17cb expref: 14 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.951693:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a92c11300) 00010000:00010000:2.0:1786109715.951703:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109715.951780:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fac74500-4523-4794-af20-dfdcdfae19c1+13:2403:x1872862922175872:12345-192.168.203.38@tcp:103:rm.0 Request processed in 162us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109715.951789:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4538 00000100:00100000:3.0:1786109715.952146:0:187902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922176128 00000100:00100000:3.0:1786109715.952152:0:187902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922176128 00000100:00100000:3.0:1786109715.952245:0:187902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:3.0:1786109715.952254:0:187902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+115:165190:x1872862922176128:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:3.0:1786109715.952486:0:187902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fac74500-4523-4794-af20-dfdcdfae19c1+116:165190:x1872862922176128:12345-192.168.203.38@tcp:35:rm.0 Request processed in 232us (1204us total) trans 30064771140 rc 0/0 00000100:00100000:3.0:1786109715.952493:0:187902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1786109715.956731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109715.956820:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922176384 00000100:00100000:2.0:1786109715.956831:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922176384 00000100:00100000:2.0:1786109715.956938:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1246 00000100:00100000:2.0:1786109715.956950:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+116:165190:x1872862922176384:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109715.957018:0:196401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786109715.957043:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413e00/0xdb52b77d7ca3878c lrc: 0/0,0 mode: --/PR res: [0x240002ef9:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a189d expref: 116 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.957065:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412600/0xdb52b77d7ca3852b lrc: 0/0,0 mode: --/CR res: [0x240002ef9:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a188f expref: 115 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.957075:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a83e02e00) 00010000:00010000:2.0:1786109715.957085:0:196401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109715.957133:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.957142:0:196401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.957153:0:196401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109715.957172:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9630700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933368576:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1786109715.958616:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109715.958660:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c0a59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109715.958801:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933368576 00000100:00100000:0.0:1786109715.958809:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933368576 00000100:00100000:0.0:1786109715.958854:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786109715.958864:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:196401:x1872862933368576:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1786109715.958881:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109715.958899:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3879a lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38793 expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.958927:0:187904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca384ec lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1873 expref: 12 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.958937:0:187904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3879a lrc: 4/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38793 expref: 7 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.958965:0:187904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca384ec lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1873 expref: 12 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.959088:0:187904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca384ec lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1873 expref: 12 pid: 196401 timeout: 8672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109715.959103:0:187904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:187904:1872862933368704:192.168.203.38@tcp:104: 00000100:00100000:0.0:1786109715.959216:0:187904:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098661a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109715.962691:0:187904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:187904:1872862933368704:192.168.203.38@tcp:104: 00010000:00010000:0.0:1786109715.962742:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3879a lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38793 expref: 7 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.962767:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:0.0:1786109715.962770:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109715.962775:0:187904:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3879a lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38793 expref: 7 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.962787:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c3400, rc 0) 00010000:00000080:0.0:1786109715.962795:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9631f80 x1872862933368576/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 328/344 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109715.962892:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:196401:x1872862933368576:12345-0@lo:101:mdt00_005.0 Request processed in 4029us (4281us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109715.962902:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786109715.962986:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9630700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933368576:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1786109715.963005:0:196401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 4/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.963017:0:196401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 4/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109715.965302:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109715.965389:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922176512 00000100:00100000:3.0:1786109715.965399:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922176512 00010000:00010000:3.0:1786109715.965513:0:43921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca384ec lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1873 expref: 13 pid: 196401 timeout: 8672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109715.965591:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12652 00000100:00100000:3.0:1786109715.965602:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fac74500-4523-4794-af20-dfdcdfae19c1+13:2402:x1872862922176512:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109715.965617:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109715.965623:0:43921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca384ec lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1873 expref: 13 pid: 196401 timeout: 8672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.965636:0:43921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca384ec lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1873 expref: 13 pid: 196401 timeout: 8672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.965658:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca384ec lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1873 expref: 13 pid: 196401 timeout: 8672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.965674:0:43921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:3.0:1786109715.965680:0:43921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3879a lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38793 expref: 6 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.965692:0:43921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3879a lrc: 2/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca38793 expref: 6 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.965702:0:43921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3879a lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca38793 expref: 6 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109715.965732:0:43921:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3879a lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38793 expref: 6 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109715.965747:0:43921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c57800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:43921:1872862933368832:0@lo:105: 00000100:00100000:3.0:1786109715.965842:0:43921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109715.965915:0:43921:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786109715.965954:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933368832 00000100:00100000:2.0:1786109715.965959:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933368832 00000100:00100000:2.0:1786109715.966093:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5271 00000100:00100000:2.0:1786109715.966102:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:43921:x1872862933368832:12345-0@lo:105: 00010000:00010000:2.0:1786109715.966114:0:6510:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 5/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.966125:0:6510:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 5/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.966135:0:6510:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 5/0,1 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.966144:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 5/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.966153:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 6/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.966163:0:6510:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 6/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.966196:0:6510:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930ab9412400) 00000100:00100000:2.0:1786109715.966246:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:43921:x1872862933368832:12345-0@lo:105: Request processed in 146us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109715.966254:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5271 00010000:00010000:1.0:1786109715.966315:0:196401:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.966326:0:196401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109715.966356:0:196401:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x4:0x0] 00010000:00010000:1.0:1786109715.966395:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361e00/0xdb52b77d7ca387a1 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.966402:0:196401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361e00/0xdb52b77d7ca387a1 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.966412:0:196401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361e00/0xdb52b77d7ca387a1 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109715.966426:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933368960:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1786109715.966482:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109715.966517:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933368960 00000100:00100000:1.0:1786109715.966521:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933368960 00000100:00100000:1.0:1786109715.966548:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786109715.966554:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:196401:x1872862933368960:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1786109715.966569:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109715.966582:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca387a8 lrc: 2/0,0 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca387a1 expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.966603:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca387a8 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca387a1 expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.966615:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca387a8 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca387a1 expref: 8 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.966623:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0xf7117594 (ffff930a90808500) 00010000:00010000:1.0:1786109715.966627:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.966629:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360c00, rc 0) 00010000:00000080:1.0:1786109715.966636:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309852bb800 x1872862933368960/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 328/344 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109715.966667:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933368960:12345-0@lo:101:mdt00_005.0 Request processed in 113us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109715.966673:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786109715.966691:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098469f300 going to sleep for 11 seconds 00000100:00100000:1.0:1786109715.966712:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933368960:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1786109715.966723:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361e00/0xdb52b77d7ca387a1 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca387a8 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.966734:0:196401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361e00/0xdb52b77d7ca387a1 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca387a8 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109715.966746:0:196401:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x4:0x0] 00000100:00100000:1.0:1786109715.966791:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933369088:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1786109715.966815:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109715.966834:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933369088 00000100:00100000:1.0:1786109715.966837:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933369088 00000100:00100000:1.0:1786109715.966854:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786109715.966859:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933369088:12345-0@lo:1000:mdt00_005.0 00010000:00000080:1.0:1786109715.966892:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309852b8a80 x1872862933369088/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 304/4320 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109715.966919:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933369088:12345-0@lo:1000:mdt00_005.0 Request processed in 60us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109715.966926:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786109715.966941:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098469fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109715.966953:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933369088:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1786109715.967009:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933369216:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1786109715.967031:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109715.967049:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933369216 00000100:00100000:1.0:1786109715.967053:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933369216 00000100:00100000:1.0:1786109715.967068:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786109715.967074:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933369216:12345-0@lo:1000:mdt00_005.0 00010000:00000080:1.0:1786109715.967110:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309852bb100 x1872862933369216/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 328/4320 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109715.967137:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933369216:12345-0@lo:1000:mdt00_005.0 Request processed in 64us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109715.967143:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786109715.967158:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098469fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109715.967169:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933369216:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1786109715.967202:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933369344:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1786109715.967221:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109715.967238:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933369344 00000100:00100000:1.0:1786109715.967241:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933369344 00000100:00100000:1.0:1786109715.967257:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786109715.967263:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933369344:12345-0@lo:1000:mdt00_005.0 00010000:00000080:1.0:1786109715.967305:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309852bbb80 x1872862933369344/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 328/4320 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 1/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109715.967332:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933369344:12345-0@lo:1000:mdt00_005.0 Request processed in 69us (110us total) trans 0 rc 1/1 00000100:00100000:1.0:1786109715.967342:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786109715.967357:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098469fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109715.967368:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933369344:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1786109715.967404:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.967412:0:196401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.967420:0:196401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109715.967450:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933369472:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1786109715.967472:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109715.967490:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933369472 00000100:00100000:1.0:1786109715.967494:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933369472 00000100:00100000:1.0:1786109715.967509:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786109715.967515:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933369472:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1786109715.967522:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109715.967535:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387b6 lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca387af expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.967552:0:187905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387b6 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca387af expref: 9 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.967563:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387b6 lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca387af expref: 9 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.967576:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a90808f00) 00010000:00010000:1.0:1786109715.967578:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786109715.967581:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9361000, rc 0) 00010000:00000080:1.0:1786109715.967586:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309852baa00 x1872862933369472/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 328/344 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109715.967612:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:196401:x1872862933369472:12345-0@lo:101:mdt00_005.0 Request processed in 97us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109715.967618:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786109715.967632:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098469f300 going to sleep for 11 seconds 00000100:00100000:1.0:1786109715.967643:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933369472:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1786109715.967652:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 4/0,1 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca387b6 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.967662:0:196401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 4/0,1 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca387b6 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.967682:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca387bd lrc: 3/0,1 mode: --/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.967690:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca387bd lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.967698:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca387bd lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109715.967842:0:43921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c57800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:43921:1872862933368832:0@lo:105: 00010000:00010000:3.0:1786109715.967855:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109715.967901:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fac74500-4523-4794-af20-dfdcdfae19c1+12:2402:x1872862922176512:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 2299us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109715.967910:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12652 00000100:00100000:1.0:1786109715.968160:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933369600:0@lo:700:mdt00_005.0 00000100:00100000:1.0:1786109715.968187:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109715.968249:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098469fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786109715.968587:0:187909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933369600 00000100:00100000:3.0:1786109715.968592:0:187909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933369600 00000100:00100000:3.0:1786109715.968619:0:187909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786109715.968626:0:187909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+9:196401:x1872862933369600:12345-0@lo:700:mdt00_005.0 00010000:00000080:3.0:1786109715.968650:0:187909:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309852b9f80 x1872862933369600/t0(0) o700->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 264/248 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109715.968697:0:187909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+9:196401:x1872862933369600:12345-0@lo:700:mdt00_005.0 Request processed in 71us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109715.968704:0:187909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786109715.968785:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933369600:0@lo:700:mdt00_005.0 00000040:00080000:1.0:1786109715.968881:0:196401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786109715.968898:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].13, 64 off33600 00000004:00080000:1.0:1786109715.968906:0:196401:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff93098469fd80 with version 3 00000040:00080000:1.0:1786109715.968969:0:196401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786109715.969043:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].14, 64 off33664 00000004:00080000:1.0:1786109715.969048:0:196401:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff93098469f000 with version 4 00000004:00080000:3.0:1786109715.969657:0:198783:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930ac0977840 version 3 rpc_version 3 00000020:00100000:3.0:1786109715.969685:0:198783:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109715.969693:0:198783:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab7c57800 x1872862933369856/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109715.969711:0:198783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c57800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198783:1872862933369856:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786109715.969769:0:198783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109715.969790:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97f06f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109715.969845:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933369856 00000100:00100000:0.0:1786109715.969850:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933369856 00000100:00100000:0.0:1786109715.969898:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786109715.969907:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198783:x1872862933369856:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:0.0:1786109715.970411:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383706 is committed 00000001:00080000:0.0:1786109715.970419:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383705 is committed 00010000:00000080:0.0:1786109715.970478:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c21180 x1872862933369856/t343597383706(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 1312/4320 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109715.970527:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198783:x1872862933369856:12345-0@lo:1000:osp_up0-1.0 Request processed in 621us (758us total) trans 343597383706 rc 0/0 00000100:00100000:0.0:1786109715.970536:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786109715.970590:0:198783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c57800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198783:1872862933369856:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1786109715.970603:0:198783:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930ac0977840 version 4 rpc_version 4 00000020:00100000:0.0:1786109715.970618:0:198783:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109715.970624:0:198783:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a97809500 x1872862933370112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109715.970638:0:198783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198783:1872862933370112:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109715.970664:0:198783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109715.970678:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a82b6e840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109715.970691:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933370112 00000100:00100000:0.0:1786109715.970694:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933370112 00000100:00100000:0.0:1786109715.970713:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786109715.970719:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198783:x1872862933370112:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:1.0:1786109715.970900:0:196401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786109715.970936:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].7, 64 off33216 00000040:00080000:1.0:1786109715.971380:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400036c8:0x1:0x0].1, 424 off33192 00000100:00100000:1.0:1786109715.971847:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933370240:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1786109715.971897:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109715.971930:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098469fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109715.972012:0:187904:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1786109715.972021:0:187904:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1786109715.972350:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933370240 00000100:00100000:1.0:1786109715.972356:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933370240 00000100:00100000:3.0:1786109715.972549:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786109715.972560:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:196401:x1872862933370240:12345-0@lo:1000:mdt00_005.0 00010000:00000080:3.0:1786109715.972601:0:199402:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309852bad80 x1872862933370240/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 304/4320 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109715.972648:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:196401:x1872862933370240:12345-0@lo:1000:mdt00_005.0 Request processed in 89us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109715.972655:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786109715.972735:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933370240:0@lo:1000:mdt00_005.0 00000040:00080000:1.0:1786109715.972816:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200027501:0x1:0x0].1, 504 off33272 00000004:00080000:1.0:1786109715.972826:0:196401:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff93098469f300 with version 5 00000001:00080000:2.0:1786109715.973144:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383707 is committed 00010000:00000080:0.0:1786109715.973263:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a9780b800 x1872862933370112/t343597383707(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 1312/4320 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109715.973359:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:198783:x1872862933370112:12345-0@lo:1000:osp_up0-1.0 Request processed in 2639us (2694us total) trans 343597383707 rc 0/0 00000100:00100000:0.0:1786109715.973367:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786109715.973478:0:198783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198783:1872862933370112:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1786109715.973489:0:198783:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930ac0977840 version 5 rpc_version 5 00000020:00100000:3.0:1786109715.973514:0:198783:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786109715.973521:0:198783:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab1c20000 x1872862933370496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109715.973537:0:198783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c20000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198783:1872862933370496:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786109715.973573:0:198783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109715.973642:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a82b6e840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109715.973709:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933370496 00000100:00100000:1.0:1786109715.973714:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933370496 00000100:00100000:1.0:1786109715.973786:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786109715.973794:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:198783:x1872862933370496:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:1.0:1786109715.974710:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c23b80 x1872862933370496/t343597383708(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:186/0 lens 264/4320 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109715.974838:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:198783:x1872862933370496:12345-0@lo:1000:osp_up0-1.0 Request processed in 1044us (1263us total) trans 343597383708 rc 0/0 00000100:00100000:1.0:1786109715.974846:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786109715.974943:0:198783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c20000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198783:1872862933370496:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1786109715.975018:0:196401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240002ef9:0x16:0x0]: returning size 4096 00010000:00010000:2.0:1786109715.975040:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca387bd lrc: 3/0,1 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975050:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca387bd lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975058:0:196401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca387bd lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975064:0:196401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109715.975069:0:196401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca387bd lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975080:0:196401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca387bd lrc: 4/0,0 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975095:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a90808100) 00010000:00010000:2.0:1786109715.975098:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109715.975103:0:196401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca387bd lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975109:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361400/0xdb52b77d7ca387bd lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975128:0:196401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 4/0,1 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca387b6 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975137:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 4/0,1 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca387b6 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975145:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca387b6 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975176:0:196401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786109715.975188:0:196401:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x4:0x0] 00010000:00010000:2.0:1786109715.975195:0:196401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975203:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975210:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975225:0:196401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1786109715.975230:0:196401:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x4:0x0] 00010000:00010000:2.0:1786109715.975238:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786109715.975243:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 2/0,0 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca387b6 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975250:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361200 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:2.0:1786109715.975255:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca387b6 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.975262:0:10402:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 3/0,0 mode: EX/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca387b6 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975290:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 2/0,0 mode: --/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca387b6 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975297:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786109715.975315:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 1/0,0 mode: --/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca387b6 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975322:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361200/0xdb52b77d7ca387af lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca387b6 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975336:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109715.975339:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 2/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975345:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412400 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:2.0:1786109715.975349:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109715.975357:0:10402:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975374:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975381:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786109715.975396:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 1/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975404:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9412400/0xdb52b77d7ca38793 lrc: 0/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca3879a expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975416:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109715.975417:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109715.975419:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109715.975457:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933370752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109715.975496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109715.975548:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933370752 00000100:00100000:2.0:1786109715.975555:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933370752 00000100:00100000:2.0:1786109715.975592:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4539 00000100:00100000:2.0:1786109715.975600:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3646:x1872862933370752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109715.975610:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109715.975625:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3400/0xdb52b77d7ca3879a lrc: 0/0,0 mode: --/CW res: [0x200026d31:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca38793 expref: 10 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975642:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:2.0:1786109715.975647:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109715.975680:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933370752:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109715.975685:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4539 00000100:00100000:2.0:1786109715.975712:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933370752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109715.975731:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361e00/0xdb52b77d7ca387a1 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca387a8 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109715.975738:0:196401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361e00/0xdb52b77d7ca387a1 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca387a8 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.975796:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109715.975803:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109715.975812:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933370624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109715.975844:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109715.975869:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933370624 00000100:00100000:0.0:1786109715.975872:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933370624 00000100:00100000:0.0:1786109715.975901:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4540 00000100:00100000:0.0:1786109715.975907:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933370624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109715.975914:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109715.975925:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387b6 lrc: 0/0,0 mode: --/EX res: [0x240002ef9:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca387af expref: 9 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109715.975937:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x0 (ffff930a90808f00) 00010000:00010000:0.0:1786109715.975943:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109715.975968:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933370624:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109715.975974:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4540 00000100:00100000:0.0:1786109715.976004:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933370624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109715.976169:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+115:165190:x1872862922176384:12345-192.168.203.38@tcp:36:rm.0 Request processed in 19220us (19456us total) trans 30064771141 rc 0/0 00000100:00100000:2.0:1786109715.976176:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1246 00000100:00100000:0.0:1786109715.981059:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.981172:0:187903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922176768 00000100:00100000:1.0:1786109715.981182:0:187903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922176768 00000100:00100000:1.0:1786109715.981335:0:187903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:1.0:1786109715.981346:0:187903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+9:165190:x1872862922176768:12345-192.168.203.38@tcp:35:rm.0 00010000:00000080:1.0:1786109715.981545:0:187903:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a9780a300 x1872862922176768/t343597383709(0) o35->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:186/0 lens 392/456 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1786109715.981620:0:187903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fac74500-4523-4794-af20-dfdcdfae19c1+10:165190:x1872862922176768:12345-192.168.203.38@tcp:35:rm.0 Request processed in 276us (569us total) trans 343597383709 rc 0/0 00000100:00100000:1.0:1786109715.981627:0:187903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:0.0:1786109715.984575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109715.984690:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922177024 00000100:00100000:1.0:1786109715.984699:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922177024 00000100:00100000:1.0:1786109715.984823:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1247 00000100:00100000:1.0:1786109715.984834:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+10:165190:x1872862922177024:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109715.984887:0:187899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786109715.984912:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8cf9200/0xdb52b77d7ca38508 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1881 expref: 10 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.984934:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f06400/0xdb52b77d7ca37de5 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1777 expref: 9 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.984945:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90aba900) 00010000:00010000:1.0:1786109715.984959:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca381b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17c4 expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.984969:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:1.0:1786109715.984973:0:187899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109715.984992:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985005:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985015:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985028:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca387cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985035:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca387cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985043:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca387cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985130:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387d2 lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985139:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387d2 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985147:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387d2 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109715.985350:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1786109715.985365:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387d2 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985374:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387d2 lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985402:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387d2 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985409:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.985414:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387d2 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985421:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387d2 lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985481:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a90808400) 00010000:00010000:1.0:1786109715.985484:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109715.985488:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387d2 lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985496:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387d2 lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985516:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985523:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985530:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985536:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985542:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109715.985545:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985552:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387c4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985560:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:1.0:1786109715.985562:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109715.985565:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387c4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985572:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca387c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109715.985581:0:187899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd0b129a reply state 00000000228fa5a8 transno 343597383710 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca387cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985591:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca387cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109715.985597:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff930a90808600) 00010000:00010000:1.0:1786109715.985600:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109715.985602:0:187899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1786109715.985618:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97809f80 x1872862922177024/t343597383710(0) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:186/0 lens 512/456 e 0 to 0 dl 1786109726 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109715.985692:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+9:165190:x1872862922177024:12345-192.168.203.38@tcp:36:rm.0 Request processed in 860us (1126us total) trans 343597383710 rc 0/0 00000100:00100000:1.0:1786109715.985701:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1247 00000100:00100000:0.0:1786109716.229068:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933371136:0@lo:400:kworker.0 00000100:00100000:0.0:1786109716.229161:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109716.229195:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933371648:0@lo:400:kworker.0 00000100:00100000:0.0:1786109716.229222:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109716.229237:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933372160:0@lo:400:kworker.0 00000100:00100000:0.0:1786109716.229255:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109716.229273:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1786109716.229278:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933371008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109716.229298:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109716.229313:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933371520:0@lo:400:kworker.0 00000100:00100000:0.0:1786109716.229331:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109716.229344:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933372032:0@lo:400:kworker.0 00000100:00100000:0.0:1786109716.229363:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109716.229389:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933371008 00000100:00100000:0.0:1786109716.229396:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933371008 00000100:00100000:0.0:1786109716.229474:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786109716.229483:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933371008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1786109716.229515:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446023168 avail 1299783680 00000100:00100000:0.0:1786109716.229558:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933371008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109716.229565:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786109716.229622:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933371008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109716.229708:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933370880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109716.229741:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109716.229781:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933371392:0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.229803:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109716.229821:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933371904:0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.229841:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109716.229859:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933372416:0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.229879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109716.229895:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1786109716.229901:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933371264:0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.229922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109716.229935:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933371776:0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.229952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109716.229967:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933372288:0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.229985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109716.230015:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933372032 00000100:00100000:2.0:1786109716.230019:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933372032 00000100:00100000:2.0:1786109716.230056:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933371904 00000100:00100000:2.0:1786109716.230059:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933371904 00000100:00100000:2.0:1786109716.230077:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933372416 00000100:00100000:2.0:1786109716.230080:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933372416 00000100:00100000:2.0:1786109716.230096:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933372288 00000100:00100000:2.0:1786109716.230098:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933372288 00000100:00100000:2.0:1786109716.230115:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7108 00000100:00100000:2.0:1786109716.230122:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933372032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.230158:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933372032:12345-0@lo:400:kworker.0 Request processed in 37us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109716.230165:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7108 00000100:00100000:2.0:1786109716.230177:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7109 00000100:00100000:2.0:1786109716.230183:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933371904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.230212:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933371904:12345-0@lo:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109716.230218:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7109 00000100:00100000:2.0:1786109716.230228:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7110 00000100:00100000:2.0:1786109716.230234:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933372416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.230259:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933372416:12345-0@lo:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109716.230265:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7110 00000100:00100000:2.0:1786109716.230274:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7111 00000100:00100000:2.0:1786109716.230279:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933372288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.230303:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933372288:12345-0@lo:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109716.230308:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7111 00000100:00080000:2.0:1786109716.230330:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109716.230333:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109716.230364:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933372288:0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.230374:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933371904:0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.230383:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933372416:0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.230407:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933370880 00000100:00100000:2.0:1786109716.230410:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933370880 00000100:00100000:2.0:1786109716.230426:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933371776 00000100:00100000:2.0:1786109716.230428:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933371776 00000100:00100000:2.0:1786109716.230465:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786109716.230470:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3647:x1872862933370880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109716.230492:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445609472 avail 1299369984 00010000:00000080:2.0:1786109716.230504:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9630700 x1872862933370880/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:187/0 lens 224/368 e 0 to 0 dl 1786109727 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109716.230538:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3647:x1872862933370880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109716.230545:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786109716.230556:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786109716.230562:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933371776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.230590:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933371776:12345-0@lo:400:kworker.0 Request processed in 28us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109716.230596:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786109716.230618:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933371776:0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.230632:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933370880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109716.230652:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933371648 00000100:00100000:2.0:1786109716.230656:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933371648 00000100:00080000:2.0:1786109716.230670:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109716.230690:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933372160 00000100:00100000:2.0:1786109716.230693:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933372160 00000100:00100000:2.0:1786109716.230703:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1786109716.230709:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933371648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.230739:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933371648:12345-0@lo:400:kworker.0 Request processed in 31us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109716.230746:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1786109716.230772:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933371520 00000100:00100000:2.0:1786109716.230775:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933371520 00000100:00080000:2.0:1786109716.230789:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109716.230801:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933371392 00000100:00100000:2.0:1786109716.230804:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933371392 00000100:00080000:2.0:1786109716.230815:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109716.230826:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933371264 00000100:00100000:2.0:1786109716.230828:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933371264 00000100:00080000:2.0:1786109716.230837:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109716.230850:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1786109716.230856:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933372160:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109716.230867:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97fd4e00 x1872862933372160/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:187/0 lens 224/224 e 0 to 0 dl 1786109727 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109716.230904:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933372160:12345-0@lo:400:kworker.0 Request processed in 48us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109716.230911:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1786109716.230923:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1786109716.230928:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933371520:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109716.230938:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97fd4380 x1872862933371520/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:187/0 lens 224/224 e 0 to 0 dl 1786109727 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109716.230961:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933371520:12345-0@lo:400:kworker.0 Request processed in 34us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109716.230967:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1786109716.230977:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1786109716.230983:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933371392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.231012:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933371392:12345-0@lo:400:kworker.0 Request processed in 29us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109716.231018:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1786109716.231042:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933371392:0@lo:400:kworker.0 00000100:00100000:2.0:1786109716.231060:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1786109716.231067:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933371264:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109716.231078:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309825ac000 x1872862933371264/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:187/0 lens 224/224 e 0 to 0 dl 1786109727 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109716.231110:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933371264:12345-0@lo:400:kworker.0 Request processed in 44us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109716.231116:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1786109716.231138:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933371264:0@lo:400:kworker.0 00000100:00100000:3.0:1786109716.231304:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933371136 00000100:00100000:3.0:1786109716.231309:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933371136 00000100:00100000:3.0:1786109716.231347:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1786109716.231355:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933371136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109716.231388:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933371136:12345-0@lo:400:kworker.0 Request processed in 35us (2227us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109716.231394:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1786109716.231661:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933371520:0@lo:400:kworker.0 00000100:00100000:0.0:1786109716.231671:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933372032:0@lo:400:kworker.0 00000100:00100000:0.0:1786109716.231680:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933371136:0@lo:400:kworker.0 00000100:00100000:0.0:1786109716.231689:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933371648:0@lo:400:kworker.0 00000100:00100000:0.0:1786109716.231699:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933372160:0@lo:400:kworker.0 00000100:00100000:3.0:1786109716.740740:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933372544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109716.740864:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786109716.740950:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109716.741075:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933372672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109716.741102:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109716.741134:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933372544 00000100:00100000:0.0:1786109716.741140:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933372544 00000100:00100000:0.0:1786109716.741172:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933372672 00000100:00100000:0.0:1786109716.741174:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933372672 00000100:00100000:0.0:1786109716.741192:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5939 00000100:00100000:0.0:1786109716.741199:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933372544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109716.741228:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109716.741261:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933372544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109716.741268:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5939 00000100:00100000:0.0:1786109716.741282:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5940 00000100:00100000:0.0:1786109716.741287:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933372672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109716.741302:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109716.741332:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933372672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109716.741337:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5940 00000100:00100000:0.0:1786109716.741376:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933372672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109716.742926:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933372544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109717.525817:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109717.525869:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109717.525896:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109717.525917:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109717.525941:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109717.525969:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922177408 00000100:00100000:2.0:1786109717.525979:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922177408 00000100:00100000:2.0:1786109717.526035:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922177280 00000100:00100000:2.0:1786109717.526038:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922177280 00000100:00100000:2.0:1786109717.526208:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 423 00000100:00100000:2.0:1786109717.526220:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+115:2403:x1872862922177408:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109717.526301:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+115:2403:x1872862922177408:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 84us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109717.526308:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 423 00000100:00100000:2.0:1786109717.526325:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 424 00000100:00100000:2.0:1786109717.526331:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+9:2403:x1872862922177280:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:2.0:1786109717.526348:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309825ad180 x1872862922177280/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:188/0 lens 224/224 e 0 to 0 dl 1786109728 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109717.526373:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+9:2403:x1872862922177280:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 42us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109717.526378:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 424 00000100:00100000:2.0:1786109717.526400:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922177664 00000100:00100000:2.0:1786109717.526404:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922177664 00000100:00100000:2.0:1786109717.526454:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922177536 00000100:00100000:2.0:1786109717.526457:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922177536 00000100:00100000:2.0:1786109717.526481:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7112 00000100:00100000:2.0:1786109717.526488:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922177664:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109717.526515:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922177664:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109717.526521:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7112 00000100:00100000:2.0:1786109717.526532:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7113 00000100:00100000:2.0:1786109717.526538:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922177536:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109717.527134:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922177536:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 20us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109717.527145:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7113 00000100:00080000:2.0:1786109717.527179:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109717.527183:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109717.527185:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786109717.527187:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109717.527686:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922177152 00000100:00100000:0.0:1786109717.527693:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922177152 00000100:00100000:0.0:1786109717.527737:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:0.0:1786109717.527756:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922177152:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109717.527814:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922177152:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 60us (2007us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109717.527821:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 136 00010000:00010000:3.0:1786109717.765237:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109718.794485:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109719.813005:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109719.813075:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109719.813233:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109719.813246:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933372928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109719.813308:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933372800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109719.813640:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109719.813711:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933372928 00000100:00100000:2.0:1786109719.813719:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933372928 00000100:00100000:2.0:1786109719.813795:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5941 00000100:00100000:2.0:1786109719.813806:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933372928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786109719.813832:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109719.813878:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933372928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109719.813885:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5941 00000100:00100000:2.0:1786109719.813924:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933372928:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1786109719.814290:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109719.814470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109719.814989:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933372800 00000100:00100000:3.0:1786109719.814996:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933372800 00000100:00100000:3.0:1786109719.815111:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5942 00000100:00100000:3.0:1786109719.815120:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933372800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786109719.815144:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109719.815205:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933372800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109719.815213:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5942 00000100:00100000:1.0:1786109719.815371:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933372800:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786109719.816065:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786109720.840965:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109721.350211:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933373056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109721.350308:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109721.350388:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109721.350396:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933373184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109721.350424:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109721.351151:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933373056 00000100:00100000:2.0:1786109721.351163:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933373056 00000100:00100000:2.0:1786109721.351221:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933373184 00000100:00100000:2.0:1786109721.351225:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933373184 00000100:00100000:2.0:1786109721.351243:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786109721.351253:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933373056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109721.351296:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446023168 avail 1299783680 00000100:00100000:2.0:1786109721.351352:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933373056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109721.351360:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786109721.351380:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786109721.351387:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933373184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109721.351404:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445609472 avail 1299369984 00010000:00000080:2.0:1786109721.351416:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309825ae680 x1872862933373184/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:192/0 lens 224/368 e 0 to 0 dl 1786109732 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109721.352092:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933373184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 702us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109721.352102:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786109721.352170:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933373184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109721.352185:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933373056:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1786109721.353067:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383710 is committed 00000001:00080000:1.0:1786109721.353085:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383708 is committed 00010000:00010000:1.0:1786109721.353108:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca387cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.353119:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca387cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.353127:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca387cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.353134:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109721.353140:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca387cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.353148:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca387cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.353170:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff930a90808600) 00010000:00010000:1.0:1786109721.353173:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109721.353179:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca387cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.353184:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca387cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109721.357090:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933373312:0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.357193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109721.357250:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933373824:0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.357281:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109721.357305:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933374336:0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.357330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109721.357359:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1786109721.357366:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933373440:0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.357389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109721.357415:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933373952:0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.357552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109721.357577:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933374464:0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.357600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109721.357635:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933373696:0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.357663:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109721.357683:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933374208:0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.357707:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109721.357742:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1786109721.357748:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933373568:0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.357772:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109721.357789:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933374080:0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.357810:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109721.357828:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933374592:0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.357845:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109721.357875:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933373312 00000100:00100000:1.0:1786109721.357884:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933373312 00000100:00100000:1.0:1786109721.357937:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1786109721.357947:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933373312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.358304:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933373824 00000100:00100000:0.0:1786109721.358310:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933373824 00000100:00100000:0.0:1786109721.358352:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933373440 00000100:00100000:0.0:1786109721.358355:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933373440 00000100:00100000:0.0:1786109721.358369:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933373696 00000100:00100000:0.0:1786109721.358371:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933373696 00000100:00100000:0.0:1786109721.358386:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933374208 00000100:00100000:0.0:1786109721.358389:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933374208 00000100:00100000:0.0:1786109721.358399:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933373568 00000100:00100000:0.0:1786109721.358401:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933373568 00000100:00100000:0.0:1786109721.358411:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933374592 00000100:00100000:0.0:1786109721.358413:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933374592 00000100:00100000:0.0:1786109721.358427:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1786109721.358671:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933373824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.358754:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933373824:12345-0@lo:400:kworker.0 Request processed in 86us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109721.358762:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1786109721.358784:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1786109721.358791:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933373440:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109721.358805:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab950df80 x1872862933373440/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:192/0 lens 224/224 e 0 to 0 dl 1786109732 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109721.358837:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933373440:12345-0@lo:400:kworker.0 Request processed in 46us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109721.358843:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1786109721.358855:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1786109721.358861:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933373696:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109721.358871:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d887800 x1872862933373696/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:192/0 lens 224/224 e 0 to 0 dl 1786109732 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109721.358904:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933373696:12345-0@lo:400:kworker.0 Request processed in 44us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109721.358911:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1786109721.358922:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1786109721.358928:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933374208:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109721.358939:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d885880 x1872862933374208/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:192/0 lens 224/224 e 0 to 0 dl 1786109732 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109721.358964:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933374208:12345-0@lo:400:kworker.0 Request processed in 37us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109721.358981:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1786109721.358993:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1786109721.359000:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933373568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.359030:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933373568:12345-0@lo:400:kworker.0 Request processed in 31us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109721.359036:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1786109721.359047:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1786109721.359053:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933374592:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109721.359065:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930986551500 x1872862933374592/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:192/0 lens 224/224 e 0 to 0 dl 1786109732 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109721.359090:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933374592:12345-0@lo:400:kworker.0 Request processed in 38us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109721.359095:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00080000:0.0:1786109721.359116:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786109721.359121:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109721.359572:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933373312:12345-0@lo:400:kworker.0 Request processed in 1622us (2376us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109721.359582:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1786109721.359634:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933374336 00000100:00100000:1.0:1786109721.359642:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933374336 00000100:00100000:1.0:1786109721.359691:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933373952 00000100:00100000:1.0:1786109721.359695:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933373952 00000100:00100000:1.0:1786109721.359727:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933374464 00000100:00100000:1.0:1786109721.359730:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933374464 00000100:00100000:1.0:1786109721.359752:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933374080 00000100:00100000:1.0:1786109721.359755:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933374080 00000100:00100000:1.0:1786109721.359779:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7114 00000100:00100000:1.0:1786109721.359786:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933374336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.359825:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933374336:12345-0@lo:400:kworker.0 Request processed in 40us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109721.359831:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7114 00000100:00100000:1.0:1786109721.359843:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7115 00000100:00100000:1.0:1786109721.359849:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933373952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.359880:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933373952:12345-0@lo:400:kworker.0 Request processed in 32us (2329us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109721.359886:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7115 00000100:00100000:1.0:1786109721.359897:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7116 00000100:00100000:1.0:1786109721.359904:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933374464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.359934:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933374464:12345-0@lo:400:kworker.0 Request processed in 32us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109721.359940:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7116 00000100:00100000:1.0:1786109721.359951:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7117 00000100:00100000:1.0:1786109721.359957:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933374080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109721.360100:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933374080:12345-0@lo:400:kworker.0 Request processed in 142us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109721.360106:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7117 00000100:00080000:0.0:1786109721.365213:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109721.365227:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109721.365308:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933373568:0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.365327:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933374080:0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.365343:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933374592:0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.365355:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933373696:0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.365366:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933374208:0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.365424:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933373440:0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.365999:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933373952:0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.366015:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933374464:0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.366028:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933373312:0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.366042:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933373824:0@lo:400:kworker.0 00000100:00100000:0.0:1786109721.366064:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933374336:0@lo:400:kworker.0 00010000:00010000:1.0:1786109721.366487:0:198777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361e00/0xdb52b77d7ca387a1 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca387a8 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109721.366505:0:198777:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361e00/0xdb52b77d7ca387a1 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca387a8 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.366558:0:198777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361e00/0xdb52b77d7ca387a1 lrc: 2/0,0 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca387a8 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.366565:0:198777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109721.366595:0:198777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab9361e00/0xdb52b77d7ca387a1 lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca387a8 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786109721.366617:0:198777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 30064771141 is committed 00000004:00080000:1.0:1786109721.366670:0:198777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000004:00080000:1.0:1786109721.366683:0:198777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000100:00100000:1.0:1786109721.366778:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109721.366794:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933374720:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1786109721.366879:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786109721.367005:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca38214 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367016:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca38214 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367024:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca38214 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367031:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367036:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca38214 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367043:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca38214 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367065:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x679fc7b1 (ffff930aa0615700) 00010000:00010000:0.0:1786109721.367068:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367073:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca38214 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367079:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06600/0xdb52b77d7ca38214 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367114:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360600/0xdb52b77d7ca38237 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367120:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360600/0xdb52b77d7ca38237 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367126:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360600/0xdb52b77d7ca38237 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367132:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367135:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360600/0xdb52b77d7ca38237 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367141:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360600/0xdb52b77d7ca38237 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367150:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x94c295fa (ffff930a90808000) 00010000:00010000:0.0:1786109721.367152:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367155:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360600/0xdb52b77d7ca38237 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367162:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360600/0xdb52b77d7ca38237 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367176:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca3825a lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367182:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca3825a lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367188:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca3825a lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367193:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367196:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca3825a lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367203:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca3825a lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367210:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xc1e56442 (ffff930ab2894b00) 00010000:00010000:0.0:1786109721.367213:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367215:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca3825a lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367221:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425a00/0xdb52b77d7ca3825a lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367233:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3827d lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367239:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3827d lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367245:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3827d lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367251:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367254:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3827d lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367260:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3827d lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367268:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xef08328a (ffff930aa0615c00) 00010000:00010000:0.0:1786109721.367270:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367273:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3827d lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367278:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f06e00/0xdb52b77d7ca3827d lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367292:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca382a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367299:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca382a0 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367304:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca382a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367309:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367311:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca382a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367317:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca382a0 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367329:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x1c2b00d3 (ffff930a92c11e00) 00010000:00010000:0.0:1786109721.367331:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367334:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca382a0 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367339:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9000/0xdb52b77d7ca382a0 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367352:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca382c3 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367357:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca382c3 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367362:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca382c3 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367366:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367369:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca382c3 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367375:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca382c3 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367382:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x494dcf1b (ffff930aa0615d00) 00010000:00010000:0.0:1786109721.367384:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367387:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca382c3 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367392:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07000/0xdb52b77d7ca382c3 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367405:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca382e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367410:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca382e6 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367414:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca382e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367419:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367422:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca382e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367427:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca382e6 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367452:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x76709d63 (ffff930a8607d400) 00010000:00010000:0.0:1786109721.367454:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367457:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca382e6 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367462:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07600/0xdb52b77d7ca382e6 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367473:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38309 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367478:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38309 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367484:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38309 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367489:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367492:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38309 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367497:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38309 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367503:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xa3936bac (ffff930a8607d200) 00010000:00010000:0.0:1786109721.367505:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367507:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38309 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367512:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38309 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367521:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca3832c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367526:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca3832c lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367532:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca3832c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367537:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367540:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca3832c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367546:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca3832c lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367557:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xd0b639f4 (ffff930ab2894400) 00010000:00010000:0.0:1786109721.367560:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367562:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca3832c lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367567:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425800/0xdb52b77d7ca3832c lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367578:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca3834f lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367584:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca3834f lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367590:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca3834f lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367595:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367597:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca3834f lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367603:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca3834f lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367610:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xfdd9083c (ffff930a92c11500) 00010000:00010000:0.0:1786109721.367612:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367615:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca3834f lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367620:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8600/0xdb52b77d7ca3834f lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367632:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca38372 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367638:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca38372 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367644:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca38372 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367650:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367652:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca38372 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367657:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca38372 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367664:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x1b7026cc (ffff930a92c11f00) 00010000:00010000:0.0:1786109721.367667:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367669:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca38372 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367675:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9a00/0xdb52b77d7ca38372 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367686:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38395 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367693:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38395 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367698:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38395 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367703:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ba00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367706:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38395 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367711:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38395 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367734:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x3e3e6f26 (ffff930a8607dd00) 00010000:00010000:0.0:1786109721.367737:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367740:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38395 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367747:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38395 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367760:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca383b8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367766:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca383b8 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367773:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca383b8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367778:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367781:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca383b8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367787:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca383b8 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367798:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x610cb780 (ffff930a92c11100) 00010000:00010000:0.0:1786109721.367800:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367803:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca383b8 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367809:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf9800/0xdb52b77d7ca383b8 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367821:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca383db lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367827:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca383db lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367833:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca383db lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367837:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367840:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca383db lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367846:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca383db lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367854:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x83daffd9 (ffff930a92c11a00) 00010000:00010000:0.0:1786109721.367856:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367859:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca383db lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367864:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8c00/0xdb52b77d7ca383db lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367875:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca383fe lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367882:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca383fe lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367887:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca383fe lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367892:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367895:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca383fe lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367901:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca383fe lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367908:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xa6a94833 (ffff930ab2894e00) 00010000:00010000:0.0:1786109721.367910:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367913:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca383fe lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367919:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986425400/0xdb52b77d7ca383fe lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367931:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412c00/0xdb52b77d7ca38421 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367936:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412c00/0xdb52b77d7ca38421 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367942:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412c00/0xdb52b77d7ca38421 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367948:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.367951:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412c00/0xdb52b77d7ca38421 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367957:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412c00/0xdb52b77d7ca38421 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367964:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xc977908d (ffff930ab2894200) 00010000:00010000:0.0:1786109721.367967:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.367970:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412c00/0xdb52b77d7ca38421 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367975:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412c00/0xdb52b77d7ca38421 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367987:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413800/0xdb52b77d7ca38444 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367993:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413800/0xdb52b77d7ca38444 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.367999:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413800/0xdb52b77d7ca38444 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368004:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.368007:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413800/0xdb52b77d7ca38444 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368012:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413800/0xdb52b77d7ca38444 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368024:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xec45d8e7 (ffff930ab2894a00) 00010000:00010000:0.0:1786109721.368026:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.368029:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413800/0xdb52b77d7ca38444 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368035:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413800/0xdb52b77d7ca38444 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368045:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca38467 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368051:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca38467 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368057:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca38467 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368061:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.368064:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca38467 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368070:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca38467 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368076:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xf142140 (ffff930a8607d500) 00010000:00010000:0.0:1786109721.368078:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.368081:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca38467 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368087:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a800/0xdb52b77d7ca38467 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368099:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3848a lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368105:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3848a lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368110:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3848a lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368116:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.368118:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3848a lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368124:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3848a lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368131:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x31e2699a (ffff930a92c11000) 00010000:00010000:0.0:1786109721.368134:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.368136:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3848a lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368142:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab8cf8a00/0xdb52b77d7ca3848a lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368152:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166c400/0xdb52b77d7ca384ad lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368157:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166c400/0xdb52b77d7ca384ad lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368164:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166c400/0xdb52b77d7ca384ad lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368170:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a8166c400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.368172:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166c400/0xdb52b77d7ca384ad lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368178:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166c400/0xdb52b77d7ca384ad lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368186:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x54b0b1f4 (ffff930a83e02900) 00010000:00010000:0.0:1786109721.368188:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.368191:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166c400/0xdb52b77d7ca384ad lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368197:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930a8166c400/0xdb52b77d7ca384ad lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368209:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360000/0xdb52b77d7ca38540 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368215:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360000/0xdb52b77d7ca38540 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368221:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360000/0xdb52b77d7ca38540 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368226:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.368229:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360000/0xdb52b77d7ca38540 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368235:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360000/0xdb52b77d7ca38540 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368247:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x1b7026cc (ffff930a92c11f00) 00010000:00010000:0.0:1786109721.368250:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.368252:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360000/0xdb52b77d7ca38540 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368258:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360000/0xdb52b77d7ca38540 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x1b7026cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368278:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412800/0xdb52b77d7ca3855c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368283:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412800/0xdb52b77d7ca3855c lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368288:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412800/0xdb52b77d7ca3855c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368293:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.368296:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412800/0xdb52b77d7ca3855c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368302:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412800/0xdb52b77d7ca3855c lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368309:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xd0b639f4 (ffff930ab2894400) 00010000:00010000:0.0:1786109721.368312:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.368314:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412800/0xdb52b77d7ca3855c lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368319:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412800/0xdb52b77d7ca3855c lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xd0b639f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368333:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413000/0xdb52b77d7ca38578 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368340:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413000/0xdb52b77d7ca38578 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368346:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413000/0xdb52b77d7ca38578 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368351:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.368354:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413000/0xdb52b77d7ca38578 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368359:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413000/0xdb52b77d7ca38578 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368366:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x3e3e6f26 (ffff930a8607dd00) 00010000:00010000:0.0:1786109721.368369:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.368371:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413000/0xdb52b77d7ca38578 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368377:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413000/0xdb52b77d7ca38578 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x3e3e6f26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368391:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38594 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368397:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38594 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368403:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38594 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368409:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.368412:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38594 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368418:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38594 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368425:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xfdd9083c (ffff930a92c11500) 00010000:00010000:0.0:1786109721.368427:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.368462:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38594 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368469:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930986424c00/0xdb52b77d7ca38594 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xfdd9083c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368485:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca385b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368491:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca385b0 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368496:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca385b0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368502:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.368504:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca385b0 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368511:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca385b0 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368523:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xa6a94833 (ffff930ab2894e00) 00010000:00010000:0.0:1786109721.368525:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.368528:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca385b0 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368533:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361800/0xdb52b77d7ca385b0 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xa6a94833 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368549:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca385cc lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368555:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca385cc lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368562:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca385cc lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368566:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.368568:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca385cc lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368575:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca385cc lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368583:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x94c295fa (ffff930a90808000) 00010000:00010000:0.0:1786109721.368586:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.368589:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca385cc lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368594:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412000/0xdb52b77d7ca385cc lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x94c295fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368611:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368618:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385e8 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368624:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368629:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.368631:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368637:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385e8 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368645:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xa3936bac (ffff930a8607d200) 00010000:00010000:0.0:1786109721.368648:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.368651:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385e8 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368656:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361a00/0xdb52b77d7ca385e8 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xa3936bac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368671:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca38604 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368676:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca38604 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368683:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca38604 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368689:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.368692:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca38604 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368698:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca38604 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.368705:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xc977908d (ffff930ab2894200) 00010000:00010000:0.0:1786109721.368707:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.368709:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca38604 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109721.369241:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786109721.369263:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933374848:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1786109721.369347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109721.369410:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933374848 00000100:00100000:3.0:1786109721.369419:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933374848 00000100:00100000:3.0:1786109721.369495:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23167 00000100:00100000:3.0:1786109721.369504:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933374848:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1786109721.369538:0:43919:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1031 count 1 00002000:00010000:3.0:1786109721.369579:0:43919:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x407:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109721.369587:0:43919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7804840/0xdb52b77d7ca387d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109721.369604:0:43919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x407:0x0].0x0 since=8578s v=(0 0) 00010000:00010000:3.0:1786109721.369609:0:43919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x407:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109721.369616:0:43919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7804840/0xdb52b77d7ca387d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109721.369633:0:43919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7804840/0xdb52b77d7ca387d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109721.369644:0:43919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7804840/0xdb52b77d7ca387d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109721.369650:0:43919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7804840/0xdb52b77d7ca387d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109721.369668:0:43919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786109721.369872:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933374848:12345-0@lo:6:osp-syn-1-1.0 Request processed in 367us (523us total) trans 4294975838 rc 0/0 00000100:00100000:3.0:1786109721.369880:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23167 00010000:00010000:3.0:1786109721.369908:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109721.369914:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7804840/0xdb52b77d7ca387d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109721.369923:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109721.369927:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7804840/0xdb52b77d7ca387d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109721.369949:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7804840/0xdb52b77d7ca387d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109721.369966:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7804840/0xdb52b77d7ca387d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109721.369973:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7804840/0xdb52b77d7ca387d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109721.369992:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109721.369994:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109721.369995:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786109721.370031:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab1c22680/2, rc 0, transno 4294975838 00000100:00100000:3.0:1786109721.370044:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933374848:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1786109721.370264:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412e00/0xdb52b77d7ca38604 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xc977908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370292:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38620 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370299:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38620 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370306:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38620 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370312:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.370316:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38620 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370323:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38620 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370337:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xef08328a (ffff930aa0615c00) 00010000:00010000:0.0:1786109721.370340:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.370344:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38620 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370350:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412200/0xdb52b77d7ca38620 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xef08328a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370363:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca3863c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370370:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca3863c lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370376:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca3863c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370381:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.370383:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca3863c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370389:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca3863c lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370397:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x54b0b1f4 (ffff930a83e02900) 00010000:00010000:0.0:1786109721.370399:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.370401:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca3863c lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370406:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628b200/0xdb52b77d7ca3863c lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x54b0b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370424:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38658 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109721.370559:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109721.370570:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933374976:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1786109721.370614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786109721.370763:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38658 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370769:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38658 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370775:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.370778:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38658 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370785:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38658 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370795:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x31e2699a (ffff930a92c11000) 00010000:00010000:0.0:1786109721.370797:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.370800:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38658 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370806:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413c00/0xdb52b77d7ca38658 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x31e2699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370824:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361600/0xdb52b77d7ca38674 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370830:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361600/0xdb52b77d7ca38674 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370837:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361600/0xdb52b77d7ca38674 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370843:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.370845:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361600/0xdb52b77d7ca38674 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370851:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361600/0xdb52b77d7ca38674 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370861:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x610cb780 (ffff930a92c11100) 00010000:00010000:0.0:1786109721.370863:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.370866:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361600/0xdb52b77d7ca38674 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370872:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361600/0xdb52b77d7ca38674 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x610cb780 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370888:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38690 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370894:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38690 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370900:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38690 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370906:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.370909:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38690 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370915:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38690 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.370927:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x83daffd9 (ffff930a92c11a00) 00010000:00010000:0.0:1786109721.370929:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.370932:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38690 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371371:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9361c00/0xdb52b77d7ca38690 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x83daffd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371394:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca386ac lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371401:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca386ac lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371407:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca386ac lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371413:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.371417:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca386ac lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371424:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca386ac lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371463:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xec45d8e7 (ffff930ab2894a00) 00010000:00010000:0.0:1786109721.371465:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.371469:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca386ac lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371474:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360200/0xdb52b77d7ca386ac lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xec45d8e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371493:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca386c8 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371500:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca386c8 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371506:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca386c8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371512:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.371514:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca386c8 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371521:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca386c8 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371529:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x494dcf1b (ffff930aa0615d00) 00010000:00010000:0.0:1786109721.371531:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.371534:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca386c8 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371539:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9413400/0xdb52b77d7ca386c8 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x494dcf1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 189813 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371553:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca386e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371560:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca386e4 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371566:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca386e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371572:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.371575:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca386e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371582:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca386e4 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371590:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xc1e56442 (ffff930ab2894b00) 00010000:00010000:0.0:1786109721.371594:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.371597:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca386e4 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371603:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930aa628a200/0xdb52b77d7ca386e4 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xc1e56442 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371619:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38700 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371625:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38700 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371632:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38700 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371637:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.371640:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38700 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371646:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38700 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371657:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x1c2b00d3 (ffff930a92c11e00) 00010000:00010000:0.0:1786109721.371660:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.371663:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38700 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371669:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9412a00/0xdb52b77d7ca38700 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x1c2b00d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371684:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3871c lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371691:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3871c lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371696:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3871c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371701:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.371704:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3871c lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371709:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3871c lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371730:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x679fc7b1 (ffff930aa0615700) 00010000:00010000:0.0:1786109721.371733:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.371736:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3871c lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371742:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360800/0xdb52b77d7ca3871c lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x679fc7b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371760:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38738 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371767:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38738 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371773:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38738 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371778:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.371781:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38738 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371787:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38738 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371794:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0x76709d63 (ffff930a8607d400) 00010000:00010000:0.0:1786109721.371796:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.371799:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38738 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371805:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38738 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0x76709d63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371820:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38754 lrc: 3/0,1 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371826:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38754 lrc: 2/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371833:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38754 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371839:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109721.371842:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38754 lrc: 3/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371847:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38754 lrc: 4/0,0 mode: TXN/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371855:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240002ef9:0x16:0x0].0xf142140 (ffff930a8607d500) 00010000:00010000:0.0:1786109721.371857:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109721.371860:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38754 lrc: 2/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109721.371866:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff930ab9360400/0xdb52b77d7ca38754 lrc: 0/0,0 mode: --/TXN res: [0x240002ef9:0x16:0x0].0xf142140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109721.371965:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933374976 00000100:00100000:2.0:1786109721.371976:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933374976 00000100:00100000:2.0:1786109721.372050:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23168 00000100:00100000:2.0:1786109721.372063:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933374976:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1786109721.372099:0:43911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1031 count 1 00002000:00010000:2.0:1786109721.372134:0:43911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x407:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109721.372141:0:43911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000625308e2/0xdb52b77d7ca387e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x407:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109721.372157:0:43911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x407:0x0].0x0 since=8578s v=(0 0) 00010000:00010000:2.0:1786109721.372161:0:43911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x407:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109721.372168:0:43911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000625308e2/0xdb52b77d7ca387e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109721.372185:0:43911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000625308e2/0xdb52b77d7ca387e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109721.372194:0:43911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000625308e2/0xdb52b77d7ca387e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109721.372202:0:43911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000625308e2/0xdb52b77d7ca387e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109721.372223:0:43911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786109721.372472:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933374976:12345-0@lo:6:osp-syn-0-1.0 Request processed in 412us (1856us total) trans 38654705680 rc 0/0 00000100:00100000:2.0:1786109721.372480:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23168 00000100:00100000:2.0:1786109721.372508:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933374720 00000100:00100000:2.0:1786109721.372513:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933374720 00000100:00100000:2.0:1786109721.372550:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4541 00000100:00100000:2.0:1786109721.372557:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3648:x1872862933374720:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1786109721.372568:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109721.372588:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca387a8 lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x4:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca387a1 expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109721.372601:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0xf7117594 (ffff930a90808500) 00010000:00010000:2.0:1786109721.372610:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109721.372644:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933374720:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 87us (5766us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109721.372651:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4541 00000100:00100000:2.0:1786109721.372708:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933374720:0@lo:103:jbd2/dm-1-8.0 00000004:00080000:2.0:1786109721.372763:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930986551f80/2, rc 0, transno 38654705680 00000100:00100000:2.0:1786109721.372775:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933374976:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1786109721.373118:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109721.373128:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000625308e2/0xdb52b77d7ca387e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.373139:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109721.373144:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000625308e2/0xdb52b77d7ca387e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.373154:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000625308e2/0xdb52b77d7ca387e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.373169:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000625308e2/0xdb52b77d7ca387e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.373177:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000625308e2/0xdb52b77d7ca387e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109721.373197:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109721.373199:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109721.373200:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786109721.861485:0:198786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8578528051533ns, next at 8579528048578ns, rc = 0 00000100:00100000:0.0:1786109721.861507:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786109721.861531:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933375104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109721.861600:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1786109721.861824:0:198788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8578528391968ns, next at 8579528390612ns, rc = 0 00010000:00010000:1.0:1786109721.861856:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109721.861866:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933375232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109721.861895:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109721.861952:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933375104 00000100:00100000:1.0:1786109721.861960:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933375104 00000100:00100000:1.0:1786109721.862001:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933375232 00000100:00100000:1.0:1786109721.862004:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933375232 00000100:00100000:1.0:1786109721.862022:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5943 00000100:00100000:1.0:1786109721.862032:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933375104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109721.862061:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109721.862108:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933375104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109721.862115:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5943 00000100:00100000:1.0:1786109721.862130:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5944 00000100:00100000:1.0:1786109721.862137:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933375232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109721.862151:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109721.862180:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933375232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109721.862186:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5944 00000100:00100000:1.0:1786109721.862230:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933375232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109721.862244:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933375104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109722.642479:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109722.642530:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109722.644820:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922177792 00000100:00100000:0.0:1786109722.644835:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922177792 00000100:00100000:0.0:1786109722.644913:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:0.0:1786109722.644924:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922177792:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109722.645002:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922177792:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 80us (2532us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109722.645010:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:2.0:1786109722.645323:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109722.645347:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109722.645387:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922178304 00000100:00100000:0.0:1786109722.645391:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922178304 00000100:00100000:0.0:1786109722.645451:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7118 00000100:00100000:0.0:1786109722.645459:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922178304:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109722.645493:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922178304:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109722.645499:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7118 00000100:00080000:0.0:1786109722.645513:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109722.646245:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109722.646328:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922178048 00000100:00100000:1.0:1786109722.646333:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922178048 00000100:00080000:2.0:1786109722.646405:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109722.646465:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922177920 00000100:00100000:0.0:1786109722.646469:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922177920 00000100:00100000:0.0:1786109722.646517:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 431 00000100:00100000:0.0:1786109722.646526:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922178048:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109722.646570:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922178048:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 45us (4039us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109722.646577:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 431 00000100:00100000:0.0:1786109722.646595:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 432 00000100:00100000:0.0:1786109722.646601:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922177920:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:0.0:1786109722.646618:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309825adc00 x1872862922177920/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:193/0 lens 224/224 e 0 to 0 dl 1786109733 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109722.646641:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922177920:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 41us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109722.646647:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 432 00000100:00080000:2.0:1786109722.646881:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786109722.646979:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922178176 00000100:00100000:3.0:1786109722.646984:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922178176 00000100:00100000:3.0:1786109722.647074:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7119 00000100:00100000:3.0:1786109722.647083:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922178176:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109722.647117:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922178176:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109722.647124:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7119 00000100:00080000:2.0:1786109722.647392:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786109722.893793:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786109723.439358:0:199586:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 80c: DNE: create remote dir, drop update rep from MDT1, fail MDT[0,1] ========================================================== 09:35:21 (1786109721) 00000100:00100000:2.0:1786109723.602373:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109723.602577:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922178432 00000100:00100000:3.0:1786109723.602586:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922178432 00000100:00100000:3.0:1786109723.602645:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1248 00000100:00100000:3.0:1786109723.602656:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+6:165762:x1872862922178432:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109723.602674:0:196401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109723.602692:0:196401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca387e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109723.602770:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca387ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109723.602783:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca387ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109723.602796:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca387ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109723.602840:0:196401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:3.0:1786109723.602844:0:196401:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1786109723.602862:0:196401:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca387ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109723.602884:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628be00/0xdb52b77d7ca387e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18a4 expref: 8 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109723.602899:0:196401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca387ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18a4 expref: 7 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109723.602907:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:3.0:1786109723.602910:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109723.602914:0:196401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628ae00, rc 0) 00010000:00000080:3.0:1786109723.603038:0:196401:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309825afb80 x1872862922178432/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:194/0 lens 576/688 e 0 to 0 dl 1786109734 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1786109723.603108:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+7:165762:x1872862922178432:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 454us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109723.603115:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1248 00000100:00100000:3.0:1786109723.621873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109723.621973:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922178560 00000100:00100000:1.0:1786109723.621984:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922178560 00000100:00100000:1.0:1786109723.622051:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1249 00000100:00100000:1.0:1786109723.622061:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:165762:x1872862922178560:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109723.622082:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109723.622103:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360a00/0xdb52b77d7ca387f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18ab expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.622159:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.622174:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.622184:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.622196:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca38803 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.622203:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca38803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.622208:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca38803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623663:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623677:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623684:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623692:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623698:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109723.623711:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623719:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387fc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623735:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:1.0:1786109723.623738:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109723.623743:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387fc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623748:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361400/0xdb52b77d7ca387fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623763:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca38803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623768:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca38803 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623773:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca38803 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623777:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109723.623780:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca38803 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623786:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca38803 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623792:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff930a9a33e600) 00010000:00010000:1.0:1786109723.623794:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109723.623797:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca38803 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623801:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361200/0xdb52b77d7ca38803 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623909:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360a00/0xdb52b77d7ca387f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ab expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623930:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:1.0:1786109723.623933:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109723.623937:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360a00/0xdb52b77d7ca387f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ab expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109723.623948:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360a00, rc 0) 00010000:00000080:1.0:1786109723.623957:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c20e00 x1872862922178560/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:194/0 lens 592/584 e 0 to 0 dl 1786109734 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1786109723.624033:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:165762:x1872862922178560:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1973us (2168us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109723.624042:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1249 00000100:00100000:3.0:1786109723.639133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109723.639239:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922178816 00000100:00100000:0.0:1786109723.639249:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922178816 00000100:00100000:0.0:1786109723.639315:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1250 00000100:00100000:0.0:1786109723.639325:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:165762:x1872862922178816:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:0.0:1786109723.639383:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109723.639411:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca387ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18a4 expref: 7 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.639452:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:0.0:1786109723.639457:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786109723.639531:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3880a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.639544:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3880a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.639553:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3880a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.639567:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca38811 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.639573:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca38811 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.639579:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca38811 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640031:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640041:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640049:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109723.640063:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070cbe633 reply state 00000000dd41919a transno 343597383711 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640072:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640078:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a83e02700) 00010000:00010000:0.0:1786109723.640081:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109723.640084:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1786109723.640088:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x7:0x0]: returning size 4096 00010000:00010000:0.0:1786109723.640095:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3880a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640101:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3880a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640108:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3880a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640114:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109723.640118:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3880a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640126:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3880a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640133:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:0.0:1786109723.640135:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109723.640138:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3880a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640147:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3000/0xdb52b77d7ca3880a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109723.640157:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070cbe633 reply state 00000000dd41919a transno 343597383711 ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca38811 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640164:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca38811 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109723.640168:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff930a83e02300) 00010000:00010000:0.0:1786109723.640171:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786109723.640172:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00010000:00000080:0.0:1786109723.640195:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c21c00 x1872862922178816/t343597383711(0) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:194/0 lens 568/448 e 0 to 0 dl 1786109734 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109723.640255:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:165762:x1872862922178816:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 931us (1131us total) trans 343597383711 rc 0/0 00000100:00100000:0.0:1786109723.640263:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1250 00010000:00010000:3.0:1786109723.915139:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109724.932891:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109724.932914:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933375360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109724.932982:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109724.933052:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933375360 00000100:00100000:2.0:1786109724.933060:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933375360 00000100:00100000:2.0:1786109724.933115:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5945 00000100:00100000:2.0:1786109724.933126:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933375360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109724.933157:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109724.933203:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933375360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109724.933210:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5945 00000100:00080000:2.0:1786109724.933230:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109724.933267:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933375360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786109724.934301:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109724.934572:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109724.934586:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933375488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109724.934633:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109724.934673:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933375488 00000100:00100000:3.0:1786109724.934679:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933375488 00000100:00100000:3.0:1786109724.934728:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5946 00000100:00100000:3.0:1786109724.934737:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933375488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109724.934759:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109724.934799:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933375488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109724.934806:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5946 00000100:00100000:3.0:1786109724.934847:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933375488:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1786109724.936145:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109724.937659:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109724.938149:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922178944 00000100:00100000:2.0:1786109724.938158:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922178944 00000100:00100000:2.0:1786109724.938217:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1251 00000100:00100000:2.0:1786109724.938227:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+8:165779:x1872862922178944:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1786109724.938248:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109724.938265:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca3881f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18b2 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109724.938322:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413000/0xdb52b77d7ca38826 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109724.938335:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413000/0xdb52b77d7ca38826 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109724.938345:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413000/0xdb52b77d7ca38826 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786109724.938391:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:2.0:1786109724.938395:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:2.0:1786109724.938410:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413000/0xdb52b77d7ca38826 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109724.938449:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca3881f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18b2 expref: 10 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109724.939098:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413000/0xdb52b77d7ca38826 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18b2 expref: 9 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109724.939112:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:2.0:1786109724.939115:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786109724.939118:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413000, rc 0) 00010000:00000080:2.0:1786109724.939126:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c20380 x1872862922178944/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:195/0 lens 576/688 e 0 to 0 dl 1786109735 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1786109724.939189:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+9:165779:x1872862922178944:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 965us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109724.939196:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1251 00000100:00080000:2.0:1786109724.939311:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109724.952628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109724.952890:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922179072 00000100:00100000:0.0:1786109724.952900:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922179072 00000100:00100000:0.0:1786109724.954066:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1252 00000100:00100000:0.0:1786109724.954079:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+9:165779:x1872862922179072:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109724.954099:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109724.954119:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3882d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18b9 expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954181:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38834 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954200:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38834 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954210:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38834 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954220:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca3883b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954226:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca3883b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954232:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca3883b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954315:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca38842 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954324:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca38842 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954331:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca38842 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109724.954363:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1786109724.954367:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:0.0:1786109724.954387:0:188678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca38842 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954400:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38834 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954411:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38834 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954417:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38834 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954424:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38834 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954444:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109724.954448:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38834 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954455:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38834 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954467:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:0.0:1786109724.954470:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109724.954475:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38834 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954481:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca38834 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954495:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca3883b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954500:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca3883b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954506:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca3883b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954511:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:0.0:1786109724.954514:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca3883b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954519:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca3883b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954526:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff930a83e02300) 00010000:00010000:0.0:1786109724.954529:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786109724.954532:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca3883b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954538:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca3883b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954562:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2400/0xdb52b77d7ca3882d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18b9 expref: 11 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954574:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca38842 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18b9 expref: 10 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109724.954581:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a83e02700) 00010000:00010000:0.0:1786109724.954583:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786109724.954585:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2200, rc 0) 00010000:00000080:0.0:1786109724.954593:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930986553100 x1872862922179072/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:195/0 lens 592/688 e 0 to 0 dl 1786109735 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1786109724.954657:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+10:165779:x1872862922179072:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 582us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109724.954668:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1252 00000100:00100000:0.0:1786109724.978541:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109724.978664:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922179200 00000100:00100000:1.0:1786109724.978673:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922179200 00000100:00100000:1.0:1786109724.978738:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1253 00000100:00100000:1.0:1786109724.978748:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+10:165779:x1872862922179200:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109724.978768:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109724.978789:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360400/0xdb52b77d7ca38849 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18c0 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978852:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38850 lrc: 3/1,0 mode: --/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978869:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38850 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978878:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38850 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978891:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38857 lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978898:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38857 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978903:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38857 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978942:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38850 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978949:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38850 lrc: 2/0,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978955:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38850 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978961:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109724.978965:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38850 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978971:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38850 lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978981:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a83e02700) 00010000:00010000:1.0:1786109724.978984:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109724.978989:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38850 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.978995:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38850 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.979006:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38857 lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.979012:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38857 lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.979017:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38857 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.979022:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109724.979024:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38857 lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.979029:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38857 lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.979035:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0xf7117594 (ffff930a9a33eb00) 00010000:00010000:1.0:1786109724.979037:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109724.979039:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38857 lrc: 2/0,0 mode: --/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.979044:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38857 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.979074:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360400/0xdb52b77d7ca38849 lrc: 1/0,0 mode: --/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18c0 expref: 11 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.979100:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a83e02700) 00010000:00010000:1.0:1786109724.979103:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109724.979106:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360400/0xdb52b77d7ca38849 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18c0 expref: 11 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.979116:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360400, rc 0) 00010000:00000080:1.0:1786109724.979123:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97fd6300 x1872862922179200/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:195/0 lens 584/584 e 0 to 0 dl 1786109735 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1786109724.979182:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+10:165779:x1872862922179200:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 436us (650us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109724.979190:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1253 00000100:00100000:0.0:1786109724.998876:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109724.999146:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922179328 00000100:00100000:1.0:1786109724.999155:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922179328 00000100:00100000:1.0:1786109724.999218:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1254 00000100:00100000:1.0:1786109724.999228:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+10:165779:x1872862922179328:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109724.999248:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109724.999267:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360400/0xdb52b77d7ca3885e lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18c7 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999325:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38865 lrc: 3/1,0 mode: --/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999338:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38865 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999349:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38865 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999363:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca3886c lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999370:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca3886c lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999376:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca3886c lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999411:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38865 lrc: 3/1,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999418:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38865 lrc: 2/0,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999425:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38865 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999450:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109724.999453:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38865 lrc: 3/0,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999460:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38865 lrc: 4/0,0 mode: CR/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999748:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a83e02700) 00010000:00010000:1.0:1786109724.999752:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109724.999757:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38865 lrc: 2/0,0 mode: --/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999764:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360800/0xdb52b77d7ca38865 lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999779:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca3886c lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999785:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca3886c lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999791:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca3886c lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999796:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109724.999799:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca3886c lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999804:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca3886c lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999811:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0xf7117594 (ffff930a9a33eb00) 00010000:00010000:1.0:1786109724.999813:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109724.999816:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca3886c lrc: 2/0,0 mode: --/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999821:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca3886c lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999854:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360400/0xdb52b77d7ca3885e lrc: 1/0,0 mode: --/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18c7 expref: 11 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999864:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a83e02700) 00010000:00010000:1.0:1786109724.999866:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109724.999870:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360400/0xdb52b77d7ca3885e lrc: 0/0,0 mode: --/CR res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18c7 expref: 11 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109724.999879:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360400, rc 0) 00010000:00000080:1.0:1786109724.999886:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97fd7b80 x1872862922179328/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:195/0 lens 584/584 e 0 to 0 dl 1786109735 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1786109724.999953:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+10:165779:x1872862922179328:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 726us (1087us total) trans 0 rc 301/301 00000100:00100000:1.0:1786109724.999960:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1254 00000100:00100000:2.0:1786109725.028182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109725.029118:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922179456 00000100:00100000:0.0:1786109725.029129:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922179456 00000100:00100000:0.0:1786109725.029187:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1255 00000100:00100000:0.0:1786109725.029197:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+10:165779:x1872862922179456:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1786109725.029220:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109725.029239:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca38873 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18ce expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.029304:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3887a lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.029318:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3887a lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.029329:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3887a lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786109725.029369:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1786109725.029373:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:0.0:1786109725.029392:0:188678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3887a lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.029417:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2c00/0xdb52b77d7ca38873 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ce expref: 12 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.029457:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3887a lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ce expref: 11 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.029477:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a83e02700) 00010000:00010000:0.0:1786109725.029480:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786109725.029484:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2000, rc 0) 00010000:00000080:0.0:1786109725.029491:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa5c09500 x1872862922179456/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:196/0 lens 576/688 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1786109725.029557:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+11:165779:x1872862922179456:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 361us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109725.029564:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1255 00000100:00100000:3.0:1786109725.039611:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109725.039881:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922179712 00000100:00100000:1.0:1786109725.039890:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922179712 00000100:00100000:1.0:1786109725.039953:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1256 00000100:00100000:1.0:1786109725.039963:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+11:165779:x1872862922179712:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1786109725.039982:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109725.040003:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38881 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18d5 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786109725.040119:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x7:0x0]: returning size 4096 00010000:00010000:1.0:1786109725.040213:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38881 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18d5 expref: 13 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.040227:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:1.0:1786109725.040230:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786109725.040235:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360e00/0xdb52b77d7ca38881 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18d5 expref: 13 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.040249:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360e00, rc 0) 00010000:00000080:1.0:1786109725.040257:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c23800 x1872862922179712/t343597383712(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:196/0 lens 648/664 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1786109725.040313:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+12:165779:x1872862922179712:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 352us (712us total) trans 343597383712 rc 301/301 00000100:00100000:1.0:1786109725.040321:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1256 00000100:00100000:1.0:1786109725.044119:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109725.044203:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922179968 00000100:00100000:3.0:1786109725.044212:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922179968 00000100:00100000:3.0:1786109725.044303:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1257 00000100:00100000:3.0:1786109725.044314:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+6:165779:x1872862922179968:12345-192.168.203.38@tcp:36:lfs.0 00000100:00100000:3.0:1786109725.044467:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933375616:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1786109725.044520:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.044563:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4300 going to sleep for 11 seconds 00000100:00100000:3.0:1786109725.044580:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933375616 00000100:00100000:3.0:1786109725.044584:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933375616 00000100:00100000:3.0:1786109725.044611:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786109725.044617:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:196401:x1872862933375616:12345-0@lo:1000:mdt00_005.0 00010000:00000080:3.0:1786109725.044647:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c20700 x1872862933375616/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 304/4320 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109725.044888:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:196401:x1872862933375616:12345-0@lo:1000:mdt00_005.0 Request processed in 269us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109725.044896:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786109725.045006:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933375616:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1786109725.045056:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933375744:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1786109725.045077:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.045092:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4300 going to sleep for 11 seconds 00000100:00100000:3.0:1786109725.045107:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933375744 00000100:00100000:3.0:1786109725.045111:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933375744 00000100:00100000:3.0:1786109725.045134:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786109725.045140:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:196401:x1872862933375744:12345-0@lo:1000:mdt00_005.0 00010000:00000080:3.0:1786109725.045182:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c23480 x1872862933375744/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 328/4320 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109725.045215:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:196401:x1872862933375744:12345-0@lo:1000:mdt00_005.0 Request processed in 75us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109725.045222:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786109725.045247:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933375744:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1786109725.045280:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933375872:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1786109725.045301:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.045314:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4300 going to sleep for 11 seconds 00000100:00100000:3.0:1786109725.045325:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933375872 00000100:00100000:3.0:1786109725.045329:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933375872 00000100:00100000:3.0:1786109725.045349:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786109725.045354:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:196401:x1872862933375872:12345-0@lo:1000:mdt00_005.0 00010000:00000080:3.0:1786109725.045394:0:199402:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c21500 x1872862933375872/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 328/4320 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc -2/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109725.045516:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:196401:x1872862933375872:12345-0@lo:1000:mdt00_005.0 Request processed in 70us (123us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786109725.045524:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786109725.045554:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933375872:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1786109725.045601:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.045609:0:196401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.045622:0:196401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 3/0,1 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109725.045631:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933376000:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1786109725.045653:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.045670:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4780 going to sleep for 11 seconds 00000100:00100000:3.0:1786109725.046032:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933376000 00000100:00100000:3.0:1786109725.046037:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933376000 00000100:00100000:3.0:1786109725.046060:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786109725.046065:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:196401:x1872862933376000:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1786109725.046074:0:187905:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109725.046088:0:187905:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca38896 lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3888f expref: -99 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.046110:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 2/0,1 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.046120:0:187905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3887a lrc: 2/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ce expref: 11 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.046129:0:187905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca38896 lrc: 5/0,0 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3888f expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.046154:0:187905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3887a lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ce expref: 11 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.046167:0:187905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3887a lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ce expref: 11 pid: 188678 timeout: 8681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109725.046183:0:187905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:187905:1872862933376128:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109725.046238:0:187905:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1786109725.046265:0:187905:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1786109725.046296:0:187905:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4300 going to sleep for 11 seconds 00000001:00080000:3.0:1786109725.047579:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383712 is committed 00010000:00010000:3.0:1786109725.047608:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca38811 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.047618:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca38811 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.047625:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca38811 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.047630:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109725.047634:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca38811 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.047642:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca38811 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.047658:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff930a83e02300) 00010000:00010000:3.0:1786109725.047661:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109725.047666:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca38811 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.047672:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2800/0xdb52b77d7ca38811 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786109725.048252:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1786109725.048348:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.048356:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 2/0,0 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.048363:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 3/0,0 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.048368:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109725.048372:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 3/0,0 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.048379:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 4/0,0 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.048388:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a83e02700) 00010000:00010000:3.0:1786109725.048391:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109725.048397:0:3633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca38896 lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3888f expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.048407:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 2/0,0 mode: --/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.048413:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c3200/0xdb52b77d7ca38818 lrc: 0/0,0 mode: --/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109725.051027:0:187905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:187905:1872862933376128:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109725.051061:0:187905:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca38896 lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3888f expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.051074:0:187905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a83e02700) 00010000:00010000:3.0:1786109725.051077:0:187905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109725.051081:0:187905:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca38896 lrc: 3/0,0 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3888f expref: 7 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.051091:0:187905:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628a400, rc 0) 00010000:00000080:3.0:1786109725.051098:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1f3ea00 x1872862933376000/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 328/344 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109725.051797:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:196401:x1872862933376000:12345-0@lo:101:mdt00_005.0 Request processed in 5728us (6139us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109725.051805:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786109725.052175:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933376000:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1786109725.052193:0:196401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 4/0,1 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.052205:0:196401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 4/0,1 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109725.055610:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109725.055970:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922180096 00000100:00100000:3.0:1786109725.055980:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922180096 00010000:00010000:3.0:1786109725.056016:0:177416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3887a lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ce expref: 9 pid: 188678 timeout: 8681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109725.056056:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12653 00000100:00100000:3.0:1786109725.056066:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fac74500-4523-4794-af20-dfdcdfae19c1+9:2403:x1872862922180096:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109725.056080:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109725.056086:0:177416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3887a lrc: 4/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ce expref: 9 pid: 188678 timeout: 8681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.056099:0:177416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3887a lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ce expref: 9 pid: 188678 timeout: 8681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.056120:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2000/0xdb52b77d7ca3887a lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ce expref: 9 pid: 188678 timeout: 8681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.056137:0:177416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a83e02700) 00010000:00010000:3.0:1786109725.056144:0:177416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca38896 lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3888f expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.056155:0:177416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca38896 lrc: 2/0,0 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca3888f expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.056165:0:177416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca38896 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xdb52b77d7ca3888f expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.056197:0:177416:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca38896 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3888f expref: 6 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109725.056212:0:177416:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:177416:1872862933376256:0@lo:105: 00000100:00100000:3.0:1786109725.056253:0:177416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.056285:0:177416:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4300 going to sleep for 11 seconds 00000100:00100000:3.0:1786109725.056312:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933376256 00000100:00100000:3.0:1786109725.056315:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933376256 00000100:00100000:3.0:1786109725.056344:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5272 00000100:00100000:3.0:1786109725.056351:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:177416:x1872862933376256:12345-0@lo:105: 00010000:00010000:3.0:1786109725.056361:0:6509:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 5/0,1 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.056370:0:6509:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 5/0,1 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.056383:0:6509:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 5/0,1 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.056391:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 5/0,1 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.056399:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 6/0,1 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.056408:0:6509:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 6/0,1 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.056459:0:6509:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff930aa628be00) 00000100:00100000:3.0:1786109725.056497:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:177416:x1872862933376256:12345-0@lo:105: Request processed in 146us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109725.056504:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5272 00000100:00100000:3.0:1786109725.056546:0:177416:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:177416:1872862933376256:0@lo:105: 00010000:00010000:3.0:1786109725.056561:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109725.056596:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fac74500-4523-4794-af20-dfdcdfae19c1+8:2403:x1872862922180096:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 531us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109725.056603:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12653 00010000:00010000:3.0:1786109725.058153:0:196401:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.058168:0:196401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 4/0,1 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786109725.058197:0:196401:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x7:0x0] 00010000:00010000:3.0:1786109725.058238:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.058244:0:196401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.058256:0:196401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 196401 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109725.058278:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933376384:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1786109725.058324:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.058538:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc4300 going to sleep for 11 seconds 00000100:00100000:2.0:1786109725.059136:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933376384 00000100:00100000:2.0:1786109725.059144:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933376384 00000100:00100000:2.0:1786109725.059199:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786109725.059209:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:196401:x1872862933376384:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1786109725.059226:0:187904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109725.059244:0:187904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca388a4 lrc: 2/0,0 mode: --/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3889d expref: -99 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109725.059269:0:187904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca388a4 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3889d expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109725.059282:0:187904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca388a4 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3889d expref: 8 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109725.059291:0:187904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0xf7117594 (ffff930ab2894500) 00010000:00010000:2.0:1786109725.059294:0:187904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109725.059298:0:187904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412000, rc 0) 00010000:00000080:2.0:1786109725.059304:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1f3ce00 x1872862933376384/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 328/344 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109725.059358:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933376384:12345-0@lo:101:mdt00_005.0 Request processed in 150us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109725.059364:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786109725.059402:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933376384:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1786109725.059417:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca388a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109725.059427:0:196401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca388a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786109725.059458:0:196401:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x7:0x0] 00000100:00100000:2.0:1786109725.061177:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933376512:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1786109725.061233:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109725.061261:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9689840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109725.061735:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933376512 00000100:00100000:2.0:1786109725.061741:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933376512 00000100:00100000:2.0:1786109725.061792:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786109725.061801:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933376512:12345-0@lo:1000:mdt00_005.0 00010000:00000080:2.0:1786109725.061845:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa5c08700 x1872862933376512/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 304/4320 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109725.061898:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933376512:12345-0@lo:1000:mdt00_005.0 Request processed in 98us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109725.061905:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786109725.061966:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933376512:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1786109725.062011:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933376640:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1786109725.062035:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109725.062058:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97916840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109725.064583:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933376640 00000100:00100000:2.0:1786109725.064596:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933376640 00000100:00100000:2.0:1786109725.064653:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786109725.064663:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933376640:12345-0@lo:1000:mdt00_005.0 00010000:00000080:2.0:1786109725.064741:0:199402:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930986550e00 x1872862933376640/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 328/4320 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc -2/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109725.064817:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933376640:12345-0@lo:1000:mdt00_005.0 Request processed in 156us (2780us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786109725.064825:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786109725.065008:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933376640:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1786109725.065106:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933376768:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1786109725.065138:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109725.065167:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97916840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109725.065567:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933376768 00000100:00100000:2.0:1786109725.065572:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933376768 00000100:00100000:2.0:1786109725.065607:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786109725.065615:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933376768:12345-0@lo:1000:mdt00_005.0 00010000:00000080:2.0:1786109725.065659:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930986551c00 x1872862933376768/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 328/4320 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc -2/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109725.065714:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933376768:12345-0@lo:1000:mdt00_005.0 Request processed in 99us (574us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786109725.067571:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786109725.067629:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986552300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933376768:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1786109725.067912:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933376896:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1786109725.067965:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109725.068002:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c0a5840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109725.068089:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933376896 00000100:00100000:3.0:1786109725.068094:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933376896 00000100:00100000:3.0:1786109725.068131:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786109725.068140:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933376896:12345-0@lo:1000:mdt00_005.0 00010000:00000080:3.0:1786109725.068178:0:199402:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa5c08380 x1872862933376896/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 344/4320 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109725.068218:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933376896:12345-0@lo:1000:mdt00_005.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109725.068223:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786109725.068251:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933376896:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1786109725.068289:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933377024:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1786109725.068310:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.068322:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109725.068332:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933377024 00000100:00100000:3.0:1786109725.068335:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933377024 00000100:00100000:3.0:1786109725.068353:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786109725.068358:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933377024:12345-0@lo:1000:mdt00_005.0 00010000:00000080:3.0:1786109725.068386:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1f3dc00 x1872862933377024/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 328/4320 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109725.068416:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933377024:12345-0@lo:1000:mdt00_005.0 Request processed in 57us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109725.068422:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786109725.068553:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933377024:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1786109725.068589:0:196401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933377152:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1786109725.068610:0:196401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.068622:0:196401:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109725.068633:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933377152 00000100:00100000:3.0:1786109725.068636:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933377152 00000100:00100000:3.0:1786109725.068656:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786109725.068661:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933377152:12345-0@lo:1000:mdt00_005.0 00010000:00000080:3.0:1786109725.068722:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1f3f100 x1872862933377152/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 328/4320 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_005.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109725.068766:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:196401:x1872862933377152:12345-0@lo:1000:mdt00_005.0 Request processed in 103us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109725.068772:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786109725.068799:0:196401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:196401:1872862933377152:0@lo:1000:mdt00_005.0 00000040:00080000:3.0:1786109725.069248:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400036c8:0x1:0x0].2, 1096 off34288 00000040:00080000:3.0:1786109725.069306:0:196401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200027501:0x1:0x0].2, 1240 off34512 00000004:00080000:3.0:1786109725.069312:0:196401:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930ab7cc4180 with version 6 00000004:00080000:0.0:1786109725.069335:0:198783:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930ac0977840 version 6 rpc_version 6 00000020:00100000:0.0:1786109725.069355:0:198783:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109725.069362:0:198783:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930a97fd5180 x1872862933377408/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109725.069377:0:198783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd5180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198783:1872862933377408:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109725.069409:0:198783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109725.069455:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109725.069469:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933377408 00000100:00100000:3.0:1786109725.069473:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933377408 00000100:00100000:3.0:1786109725.069498:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786109725.069505:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:198783:x1872862933377408:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:3.0:1786109725.069857:0:199402:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97fd7800 x1872862933377408/t343597383713(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 2520/4320 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1786109725.069866:0:199402:0:(ldlm_lib.c:3345:target_send_reply_msg()) *** cfs_fail_loc=1701, val=2147483648*** 00010000:00020000:3.0:1786109725.069871:0:199402:0:(ldlm_lib.c:3346:target_send_reply_msg()) @@@ dropping reply req@ffff930a97fd7800 x1872862933377408/t343597383713(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 2520/4320 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109725.088643:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:198783:x1872862933377408:12345-0@lo:1000:osp_up0-1.0 Request processed in 19129us (19224us total) trans 343597383713 rc 0/0 00000100:00100000:3.0:1786109725.088658:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000001:00080000:2.0:1786109725.668720:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383713 is committed 00000001:00080000:3.0:1786109725.671702:0:194579:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705680 is committed 00000001:00080000:2.0:1786109725.673986:0:198777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 30064771142 is committed 00000004:00080000:2.0:1786109725.674003:0:198777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000004:00080000:2.0:1786109725.674025:0:198777:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000100:00100000:2.0:1786109725.674161:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933377536:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1786109725.674647:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109725.674678:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933378048:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1786109725.674711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109725.674751:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933378560:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1786109725.674772:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109725.674786:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933379072:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1786109725.674801:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109725.674815:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1786109725.674819:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933377664:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1786109725.674834:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109725.674845:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933378176:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1786109725.674861:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109725.674871:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933378688:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1786109725.674887:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109725.674898:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933379200:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1786109725.675029:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933377536 00000100:00100000:0.0:1786109725.675037:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933377536 00000100:00100000:0.0:1786109725.675103:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933378048 00000100:00100000:0.0:1786109725.675106:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933378048 00000100:00100000:0.0:1786109725.675119:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933378560 00000100:00100000:0.0:1786109725.675121:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933378560 00000100:00100000:0.0:1786109725.675135:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933379072 00000100:00100000:0.0:1786109725.675137:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933379072 00000100:00100000:0.0:1786109725.675148:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933377664 00000100:00100000:0.0:1786109725.675150:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933377664 00000100:00100000:0.0:1786109725.675161:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933378176 00000100:00100000:0.0:1786109725.675163:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933378176 00000100:00100000:0.0:1786109725.675299:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933378688 00000100:00100000:0.0:1786109725.675303:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933378688 00000100:00100000:0.0:1786109725.675325:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23169 00000100:00100000:0.0:1786109725.675335:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933377536:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1786109725.675362:0:9990:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1030 count 1 00002000:00010000:0.0:1786109725.675394:0:9990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x406:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109725.675401:0:9990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4943fe6/0xdb52b77d7ca388ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x406:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675415:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x406:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:0.0:1786109725.675420:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x406:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109725.675452:0:9990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4943fe6/0xdb52b77d7ca388ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675475:0:9990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4943fe6/0xdb52b77d7ca388ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675485:0:9990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4943fe6/0xdb52b77d7ca388ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675492:0:9990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4943fe6/0xdb52b77d7ca388ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675509:0:9990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786109725.675646:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933377536:12345-0@lo:6:osp-syn-0-1.0 Request processed in 312us (1000us total) trans 38654705681 rc 0/0 00000100:00100000:0.0:1786109725.675654:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23169 00000100:00100000:0.0:1786109725.675669:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23170 00000100:00100000:0.0:1786109725.675674:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933378048:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1786109725.675699:0:9990:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1034 count 1 00002000:00010000:0.0:1786109725.675713:0:9990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109725.675718:0:9990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bcd60a1/0xdb52b77d7ca388b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675737:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40a:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:0.0:1786109725.675740:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109725.675744:0:9990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bcd60a1/0xdb52b77d7ca388b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675754:0:9990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bcd60a1/0xdb52b77d7ca388b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675762:0:9990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bcd60a1/0xdb52b77d7ca388b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675770:0:9990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bcd60a1/0xdb52b77d7ca388b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675783:0:9990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1786109725.675839:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933378048:12345-0@lo:6:osp-syn-0-1.0 Request processed in 164us (1127us total) trans 38654705682 rc 0/0 00000100:00100000:0.0:1786109725.675845:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23170 00000100:00100000:0.0:1786109725.675857:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23171 00000100:00100000:0.0:1786109725.675863:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933378560:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1786109725.675875:0:9990:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1030 count 1 00002000:00010000:0.0:1786109725.675890:0:9990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x406:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109725.675895:0:9990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca388b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x406:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675902:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x406:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:0.0:1786109725.675906:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x406:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109725.675924:0:9990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca388b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675935:0:9990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca388b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675944:0:9990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca388b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675951:0:9990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca388b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.675962:0:9990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1786109725.676034:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933378560:12345-0@lo:6:osp-syn-1-1.0 Request processed in 170us (1260us total) trans 4294975839 rc 0/0 00000100:00100000:0.0:1786109725.676040:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23171 00000100:00100000:0.0:1786109725.676051:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23172 00000100:00100000:0.0:1786109725.676057:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933379072:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1786109725.676068:0:9990:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1027 count 1 00002000:00010000:0.0:1786109725.676094:0:9990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x403:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109725.676098:0:9990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca388c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x403:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676106:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x403:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:0.0:1786109725.676110:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x403:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109725.676114:0:9990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca388c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676124:0:9990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca388c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676132:0:9990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca388c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676140:0:9990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca388c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676154:0:9990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1786109725.676222:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933379072:12345-0@lo:6:osp-syn-1-1.0 Request processed in 165us (1419us total) trans 4294975840 rc 0/0 00000100:00100000:0.0:1786109725.676228:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23172 00000100:00100000:0.0:1786109725.676241:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23173 00000100:00100000:0.0:1786109725.676248:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933377664:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1786109725.676260:0:9990:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1033 count 1 00002000:00010000:0.0:1786109725.676274:0:9990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x409:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109725.676279:0:9990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f1aedcf/0xdb52b77d7ca388c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x409:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676288:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x409:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:0.0:1786109725.676291:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x409:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109725.676295:0:9990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f1aedcf/0xdb52b77d7ca388c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676304:0:9990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f1aedcf/0xdb52b77d7ca388c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676312:0:9990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f1aedcf/0xdb52b77d7ca388c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676320:0:9990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f1aedcf/0xdb52b77d7ca388c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676329:0:9990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1786109725.676386:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933377664:12345-0@lo:6:osp-syn-0-1.0 Request processed in 138us (1550us total) trans 38654705683 rc 0/0 00000100:00100000:0.0:1786109725.676391:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23173 00000100:00100000:0.0:1786109725.676402:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23174 00000100:00100000:0.0:1786109725.676407:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933378176:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1786109725.676417:0:9990:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1027 count 1 00002000:00010000:0.0:1786109725.676450:0:9990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x403:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109725.676455:0:9990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca0cb658/0xdb52b77d7ca388ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x403:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676466:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x403:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:0.0:1786109725.676469:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x403:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109725.676472:0:9990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca0cb658/0xdb52b77d7ca388ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676480:0:9990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca0cb658/0xdb52b77d7ca388ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676487:0:9990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca0cb658/0xdb52b77d7ca388ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676493:0:9990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca0cb658/0xdb52b77d7ca388ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676500:0:9990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1786109725.676560:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933378176:12345-0@lo:6:osp-syn-0-1.0 Request processed in 151us (1697us total) trans 38654705684 rc 0/0 00000100:00100000:0.0:1786109725.676566:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23174 00000100:00100000:0.0:1786109725.676578:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23175 00000100:00100000:0.0:1786109725.676584:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3648:x1872862933378688:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1786109725.676595:0:9990:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1026 count 1 00002000:00010000:0.0:1786109725.676606:0:9990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x402:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109725.676611:0:9990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca388d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676625:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x402:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:0.0:1786109725.676628:0:9990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x402:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109725.676632:0:9990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca388d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676641:0:9990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca388d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676649:0:9990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca388d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676656:0:9990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca388d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.676665:0:9990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:0.0:1786109725.676737:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933378688:12345-0@lo:6:osp-syn-1-1.0 Request processed in 152us (1848us total) trans 4294975841 rc 0/0 00000100:00100000:0.0:1786109725.676743:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23175 00000100:00100000:2.0:1786109725.677281:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1786109725.677335:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930a97fd7100/2, rc 0, transno 4294975839 00000100:00100000:2.0:1786109725.677351:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933378560:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1786109725.677363:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab950c380/2, rc 0, transno 4294975840 00000100:00100000:2.0:1786109725.677368:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933379072:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1786109725.677379:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705680 gen 2 00000004:00080000:2.0:1786109725.678247:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930986551f80, transno 38654705680 00000100:00100000:2.0:1786109725.678268:0:3648:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff930aa5c0a300 x1872862933377536/t38654705681(38654705681) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786109741 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1786109725.678280:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930aa5c0a300/2, rc 0, transno 38654705681 00000100:00100000:2.0:1786109725.678284:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933377536:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1786109725.678307:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9309859e8380/2, rc 0, transno 38654705682 00000100:00100000:2.0:1786109725.678310:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933378048:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1786109725.678323:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930aa5c0b480/2, rc 0, transno 38654705683 00000100:00100000:2.0:1786109725.678327:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933377664:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1786109725.678336:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9309859e8700/2, rc 0, transno 38654705684 00000100:00100000:2.0:1786109725.678340:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933378176:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1786109725.678349:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930a97fd6680/2, rc 0, transno 4294975841 00000100:00100000:2.0:1786109725.678353:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933378688:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1786109725.678381:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933377920:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786109725.678567:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933377792:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1786109725.678642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109725.678711:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933379200 00000100:00100000:0.0:1786109725.678718:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933379200 00000100:00100000:0.0:1786109725.678937:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933377920 00000100:00100000:0.0:1786109725.678942:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933377920 00000100:00100000:0.0:1786109725.678967:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23176 00000100:00100000:0.0:1786109725.678976:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933379200:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1786109725.679003:0:179253:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1035 count 1 00002000:00010000:0.0:1786109725.679034:0:179253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x40b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109725.679042:0:179253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca388dc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x40b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.679054:0:179253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x40b:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:0.0:1786109725.679058:0:179253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x40b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109725.679063:0:179253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca388dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.679074:0:179253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca388dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.679354:0:179253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca388dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.679362:0:179253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca388dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.679376:0:179253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00080000:1.0:1786109725.679870:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109725.679876:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109725.679895:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23177 00000100:00100000:1.0:1786109725.679908:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+9:3647:x1872862933377920:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1786109725.679930:0:179237:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1032 count 1 00002000:00010000:1.0:1786109725.679952:0:179237:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x408:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786109725.679957:0:179237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca388e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x408:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.679965:0:179237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x408:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:1.0:1786109725.679969:0:179237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x408:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786109725.679973:0:179237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca388e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.679983:0:179237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca388e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.679989:0:179237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca388e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.679995:0:179237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca388e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.680002:0:179237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1786109725.680390:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1786109725.680398:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4943fe6/0xdb52b77d7ca388ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680408:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.680412:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4943fe6/0xdb52b77d7ca388ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680561:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4943fe6/0xdb52b77d7ca388ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680579:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4943fe6/0xdb52b77d7ca388ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680588:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4943fe6/0xdb52b77d7ca388ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680609:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1786109725.680613:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bcd60a1/0xdb52b77d7ca388b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680620:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.680623:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bcd60a1/0xdb52b77d7ca388b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680631:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bcd60a1/0xdb52b77d7ca388b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680641:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bcd60a1/0xdb52b77d7ca388b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680649:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bcd60a1/0xdb52b77d7ca388b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680659:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1786109725.680663:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca388b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680670:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.680674:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca388b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680682:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca388b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680705:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca388b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.680712:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deb141e8/0xdb52b77d7ca388b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x406:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681068:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786109725.681146:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca388c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681156:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.681160:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca388c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681169:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca388c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681249:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca388c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681255:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d42d58db/0xdb52b77d7ca388c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681268:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786109725.681272:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f1aedcf/0xdb52b77d7ca388c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681277:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.681280:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f1aedcf/0xdb52b77d7ca388c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681286:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f1aedcf/0xdb52b77d7ca388c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681293:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f1aedcf/0xdb52b77d7ca388c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681299:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f1aedcf/0xdb52b77d7ca388c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681307:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786109725.681310:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca0cb658/0xdb52b77d7ca388ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681314:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.681317:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca0cb658/0xdb52b77d7ca388ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681327:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca0cb658/0xdb52b77d7ca388ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681333:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca0cb658/0xdb52b77d7ca388ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681546:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca0cb658/0xdb52b77d7ca388ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x403:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681563:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109725.681567:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca388d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681573:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.681577:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca388d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681585:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca388d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681596:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca388d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681603:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000202a278/0xdb52b77d7ca388d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681619:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109725.681623:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca388dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681630:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.681633:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca388dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681641:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca388dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681650:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca388dc lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681657:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba38889f/0xdb52b77d7ca388dc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681668:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109725.681672:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca388e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681678:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.681681:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca388e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681706:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca388e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.681716:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca388e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.682059:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ec4c1d3/0xdb52b77d7ca388e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.682154:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109725.682156:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109725.682159:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109725.682392:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933378432:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786109725.682620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.682833:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309859e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933378304:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786109725.682859:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.682876:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933378816:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1786109725.682893:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.682919:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933379328:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1786109725.682937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.682977:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933377792 00000100:00100000:3.0:1786109725.682985:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933377792 00000100:00100000:3.0:1786109725.683020:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933378304 00000100:00100000:3.0:1786109725.683022:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933378304 00000100:00100000:3.0:1786109725.683033:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933378816 00000100:00100000:3.0:1786109725.683035:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933378816 00000100:00100000:3.0:1786109725.683047:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933379328 00000100:00100000:3.0:1786109725.683049:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933379328 00000100:00100000:3.0:1786109725.683063:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23178 00000100:00100000:3.0:1786109725.683070:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3646:x1872862933377792:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1786109725.683297:0:43913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1035 count 1 00002000:00010000:3.0:1786109725.683332:0:43913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109725.683340:0:43913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca388ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.683354:0:43913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40b:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:3.0:1786109725.683358:0:43913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109725.683364:0:43913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca388ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.683377:0:43913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca388ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.683387:0:43913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca388ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.683394:0:43913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca388ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.683412:0:43913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786109725.683845:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3646:x1872862933377792:12345-0@lo:6:osp-syn-0-1.0 Request processed in 773us (1224us total) trans 38654705686 rc 0/0 00000100:00100000:3.0:1786109725.683853:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23178 00000100:00100000:3.0:1786109725.683877:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23179 00000100:00100000:3.0:1786109725.683886:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3646:x1872862933378304:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1786109725.683899:0:43913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1028 count 1 00002000:00010000:3.0:1786109725.683983:0:43913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x404:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109725.683989:0:43913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca388f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x404:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.683999:0:43913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x404:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:3.0:1786109725.684002:0:43913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x404:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109725.684006:0:43913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca388f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.684015:0:43913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca388f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.684022:0:43913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca388f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.684029:0:43913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca388f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.684037:0:43913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1786109725.684261:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3646:x1872862933378304:12345-0@lo:6:osp-syn-0-1.0 Request processed in 375us (1400us total) trans 38654705687 rc 0/0 00000100:00100000:3.0:1786109725.684267:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23179 00000100:00100000:3.0:1786109725.684281:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23180 00000100:00100000:3.0:1786109725.684288:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3646:x1872862933378816:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1786109725.684303:0:43913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1029 count 1 00002000:00010000:3.0:1786109725.684319:0:43913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x405:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109725.684324:0:43913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002960332/0xdb52b77d7ca388f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.684333:0:43913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x405:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:3.0:1786109725.684336:0:43913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x405:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109725.684340:0:43913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002960332/0xdb52b77d7ca388f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.684349:0:43913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002960332/0xdb52b77d7ca388f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.684357:0:43913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002960332/0xdb52b77d7ca388f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.684364:0:43913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002960332/0xdb52b77d7ca388f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.684373:0:43913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1786109725.684652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.684951:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3646:x1872862933378816:12345-0@lo:6:osp-syn-1-1.0 Request processed in 663us (2055us total) trans 4294975843 rc 0/0 00000100:00100000:3.0:1786109725.684958:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23180 00000100:00100000:1.0:1786109725.685307:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+12:3647:x1872862933377920:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5402us (6663us total) trans 38654705685 rc 0/0 00000100:00100000:1.0:1786109725.685315:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23177 00000100:00100000:2.0:1786109725.685383:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933378944:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1786109725.685413:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.685605:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933378432 00000100:00100000:3.0:1786109725.685612:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933378432 00000100:00100000:3.0:1786109725.685643:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23181 00000100:00100000:3.0:1786109725.685650:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3646:x1872862933379328:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1786109725.685671:0:43913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1032 count 1 00002000:00010000:3.0:1786109725.685703:0:43913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x408:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109725.685710:0:43913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000513cd566/0xdb52b77d7ca388ff lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x408:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.685790:0:43913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x408:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:3.0:1786109725.685796:0:43913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x408:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109725.685802:0:43913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000513cd566/0xdb52b77d7ca388ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.685814:0:43913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000513cd566/0xdb52b77d7ca388ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.685823:0:43913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000513cd566/0xdb52b77d7ca388ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.685829:0:43913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000513cd566/0xdb52b77d7ca388ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.685838:0:43913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1786109725.685940:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3646:x1872862933379328:12345-0@lo:6:osp-syn-1-1.0 Request processed in 290us (3001us total) trans 4294975844 rc 0/0 00000100:00100000:3.0:1786109725.685947:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23181 00000100:00100000:3.0:1786109725.685959:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23182 00000100:00100000:3.0:1786109725.685966:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3647:x1872862933378432:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1786109725.685978:0:43913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1026 count 1 00002000:00010000:3.0:1786109725.685994:0:43913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x402:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109725.685999:0:43913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca38906 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x402:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.686007:0:43913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x402:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:3.0:1786109725.686010:0:43913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x402:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109725.686014:0:43913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca38906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.686024:0:43913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca38906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.686031:0:43913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca38906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.686038:0:43913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca38906 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.686047:0:43913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1786109725.686579:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3647:x1872862933378432:12345-0@lo:6:osp-syn-0-1.0 Request processed in 612us (1926us total) trans 38654705688 rc 0/0 00000100:00100000:3.0:1786109725.686586:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23182 00000004:00080000:3.0:1786109725.686660:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9309859e9180/2, rc 0, transno 38654705686 00000100:00100000:3.0:1786109725.686666:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933377792:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1786109725.686675:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9309859e9c00/2, rc 0, transno 38654705687 00000100:00100000:3.0:1786109725.686679:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933378304:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1786109725.686701:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930a97fd5c00/2, rc 0, transno 4294975843 00000100:00100000:3.0:1786109725.686706:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933378816:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1786109725.686715:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab950ce00/2, rc 0, transno 4294975844 00000100:00100000:3.0:1786109725.686718:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933379328:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1786109725.686904:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786109725.686967:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca388ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.686977:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ae00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.686982:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca388ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.686991:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca388ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687008:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca388ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687016:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f1f77f/0xdb52b77d7ca388ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687037:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786109725.687040:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca388f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687046:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.687049:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca388f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687057:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca388f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687065:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca388f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687073:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001369ba1/0xdb52b77d7ca388f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687165:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109725.687236:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002960332/0xdb52b77d7ca388f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687244:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.687247:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002960332/0xdb52b77d7ca388f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687253:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002960332/0xdb52b77d7ca388f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687263:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002960332/0xdb52b77d7ca388f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687270:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002960332/0xdb52b77d7ca388f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687287:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109725.687290:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000513cd566/0xdb52b77d7ca388ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687296:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.687298:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000513cd566/0xdb52b77d7ca388ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687304:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000513cd566/0xdb52b77d7ca388ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687311:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000513cd566/0xdb52b77d7ca388ff lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687317:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000513cd566/0xdb52b77d7ca388ff lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x408:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687326:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109725.687329:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca38906 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687334:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109725.687336:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca38906 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687348:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca38906 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687358:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca38906 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687365:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000801abf35/0xdb52b77d7ca38906 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.687376:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109725.687378:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109725.687379:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109725.687569:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+12:3648:x1872862933379200:12345-0@lo:6:osp-syn-1-1.0 Request processed in 8592us (10287us total) trans 4294975842 rc 0/0 00000100:00100000:0.0:1786109725.687578:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23176 00010000:00010000:0.0:1786109725.687815:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786109725.688028:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab950f100/2, rc 0, transno 4294975842 00000100:00100000:3.0:1786109725.688035:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933379200:0@lo:6:osp-syn-1-1.0 00000001:00080000:0.0:1786109725.689109:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975838 is committed 00010000:00010000:1.0:1786109725.689539:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109725.690133:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933378944 00000100:00100000:2.0:1786109725.690143:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933378944 00000100:00100000:2.0:1786109725.690321:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23183 00000100:00100000:2.0:1786109725.690332:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+11:3647:x1872862933378944:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1786109725.690365:0:179239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1033 count 1 00002000:00010000:2.0:1786109725.690396:0:179239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x409:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109725.690404:0:179239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca3890d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109725.690892:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x409:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:2.0:1786109725.690899:0:179239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x409:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109725.690905:0:179239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca3890d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109725.691238:0:179239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca3890d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109725.691248:0:179239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca3890d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109725.691256:0:179239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca3890d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109725.691365:0:179239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786109725.691569:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+12:3647:x1872862933378944:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1238us (6153us total) trans 4294975845 rc 0/0 00000100:00100000:2.0:1786109725.691579:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23183 00000100:00100000:3.0:1786109725.691953:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109725.691968:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933379584:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1786109725.692014:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109725.692047:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933379584 00000100:00100000:3.0:1786109725.692052:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933379584 00000100:00100000:3.0:1786109725.692091:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23184 00000100:00100000:3.0:1786109725.692099:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+12:3649:x1872862933379584:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1786109725.692118:0:179240:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1034 count 1 00002000:00010000:3.0:1786109725.692143:0:179240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x40a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109725.692150:0:179240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b555b7/0xdb52b77d7ca38914 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x40a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.692167:0:179240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x40a:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:3.0:1786109725.692595:0:179240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x40a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109725.692602:0:179240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b555b7/0xdb52b77d7ca38914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.692615:0:179240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048b555b7/0xdb52b77d7ca38914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.692624:0:179240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b555b7/0xdb52b77d7ca38914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.692632:0:179240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048b555b7/0xdb52b77d7ca38914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.693006:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109725.693015:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca3890d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.693026:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109725.693031:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca3890d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.693041:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca3890d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.693058:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca3890d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.693066:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc533b7b/0xdb52b77d7ca3890d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.693165:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109725.693229:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048b555b7/0xdb52b77d7ca38914 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.693238:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ba00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109725.693242:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b555b7/0xdb52b77d7ca38914 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.693251:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b555b7/0xdb52b77d7ca38914 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.693262:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048b555b7/0xdb52b77d7ca38914 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.693270:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109725.693272:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109725.693274:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109725.693329:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109725.693625:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975838 gen 2 00000004:00080000:0.0:1786109725.693631:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab1c22680, transno 4294975838 00000100:00100000:0.0:1786109725.693644:0:3647:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff930a97fd7100 x1872862933378560/t4294975839(4294975839) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786109741 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1786109725.693654:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9309852ba680/2, rc 0, transno 4294975845 00000100:00100000:0.0:1786109725.693660:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933378944:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1786109725.693669:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933379456:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1786109725.693925:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1786109725.693970:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9309859e9500/2, rc 0, transno 38654705685 00000100:00100000:0.0:1786109725.693975:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933377920:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1786109725.693987:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9309859eb480/2, rc 0, transno 38654705688 00000100:00100000:0.0:1786109725.693990:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309859eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933378432:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1786109725.695122:0:179240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109725.695133:0:179240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048b555b7/0xdb52b77d7ca38914 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x40a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109725.695310:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+13:3649:x1872862933379584:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3209us (3293us total) trans 4294975846 rc 0/0 00000100:00100000:3.0:1786109725.695320:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23184 00000100:00100000:3.0:1786109725.695718:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933379456 00000100:00100000:3.0:1786109725.695795:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933379456 00000100:00100000:3.0:1786109725.695844:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23185 00000100:00100000:3.0:1786109725.695853:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+13:3647:x1872862933379456:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1786109725.695885:0:179240:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1028 count 1 00002000:00010000:3.0:1786109725.695978:0:179240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x404:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109725.695987:0:179240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091467a5e/0xdb52b77d7ca3891b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.696000:0:179240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x404:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:3.0:1786109725.696004:0:179240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x404:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109725.696011:0:179240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091467a5e/0xdb52b77d7ca3891b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.696024:0:179240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091467a5e/0xdb52b77d7ca3891b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.696033:0:179240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091467a5e/0xdb52b77d7ca3891b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.696041:0:179240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091467a5e/0xdb52b77d7ca3891b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.696061:0:179240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786109725.696279:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0001-mdtlov_UUID+14:3647:x1872862933379456:12345-0@lo:6:osp-syn-1-1.0 Request processed in 426us (2354us total) trans 4294975847 rc 0/0 00000100:00100000:3.0:1786109725.696286:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23185 00000100:00100000:3.0:1786109725.696318:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933379712:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786109725.696347:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786109725.696385:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9309851f1500/2, rc 0, transno 4294975846 00000100:00100000:3.0:1786109725.696392:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933379584:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1786109725.696581:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109725.696588:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091467a5e/0xdb52b77d7ca3891b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.696598:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109725.696602:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091467a5e/0xdb52b77d7ca3891b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.696611:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091467a5e/0xdb52b77d7ca3891b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.696628:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091467a5e/0xdb52b77d7ca3891b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.696637:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091467a5e/0xdb52b77d7ca3891b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.696657:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109725.696658:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109725.696660:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109725.696836:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109725.696847:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933379712 00000100:00100000:3.0:1786109725.696851:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933379712 00000100:00100000:3.0:1786109725.696888:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23186 00000100:00100000:3.0:1786109725.696895:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+13:3649:x1872862933379712:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1786109725.697682:0:43922:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1029 count 1 00002000:00010000:3.0:1786109725.697720:0:43922:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x405:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109725.697803:0:43922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38922 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x405:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.697817:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x405:0x0].0x0 since=8582s v=(0 0) 00010000:00010000:3.0:1786109725.697821:0:43922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x405:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109725.697826:0:43922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.697840:0:43922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.697850:0:43922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.697858:0:43922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.697923:0:43922:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786109725.698164:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+14:3649:x1872862933379712:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1180us (1726us total) trans 38654705689 rc 0/0 00000100:00100000:3.0:1786109725.698185:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23186 00000004:00080000:3.0:1786109725.698252:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab950d180/2, rc 0, transno 4294975847 00000100:00100000:3.0:1786109725.698258:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933379456:0@lo:6:osp-syn-1-1.0 00000004:00080000:1.0:1786109725.698499:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff930ab950c000/2, rc 0, transno 38654705689 00000100:00100000:1.0:1786109725.698505:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933379712:0@lo:6:osp-syn-0-1.0 00000001:00080000:1.0:1786109725.699385:0:194579:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705688 is committed 00010000:00010000:0.0:1786109725.703351:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109725.703365:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.703380:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628bc00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109725.703385:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.703396:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38922 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.703440:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38922 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.703449:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38922 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109725.703674:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109725.703677:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109725.703679:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786109725.719674:0:194579:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705689 is committed 00000001:00080000:2.0:1786109725.722632:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975847 is committed 00000100:00100000:1.0:1786109725.818813:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109725.819499:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922180224 00000100:00100000:2.0:1786109725.819510:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922180224 00000100:00100000:2.0:1786109725.819570:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1258 00000100:00100000:2.0:1786109725.819581:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+8:165788:x1872862922180224:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1786109725.819620:0:187899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445601280 avail 1299361792 00010000:00000080:2.0:1786109725.819638:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930986552a00 x1872862922180224/t0(0) o41->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:196/0 lens 224/368 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109725.819712:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+8:165788:x1872862922180224:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 132us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109725.819720:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1258 00000100:00100000:2.0:1786109725.829384:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109725.829656:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922180352 00000100:00100000:3.0:1786109725.829666:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922180352 00000100:00100000:3.0:1786109725.829999:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1259 00000100:00100000:3.0:1786109725.830010:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:165788:x1872862922180352:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:3.0:1786109725.830044:0:187901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446019072 avail 1299779584 00000100:00100000:3.0:1786109725.830179:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:165788:x1872862922180352:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 170us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109725.830186:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1259 00000100:00100000:2.0:1786109725.839530:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109725.839563:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922180480 00000100:00100000:2.0:1786109725.839572:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922180480 00000100:00100000:2.0:1786109725.839638:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5947 00000100:00100000:2.0:1786109725.839649:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:165788:x1872862922180480:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1786109725.839675:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109725.839753:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:165788:x1872862922180480:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 106us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109725.839765:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5947 00000100:00080000:1.0:1786109725.840086:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109725.843528:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109725.843562:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922180608 00000100:00100000:0.0:1786109725.843571:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922180608 00000100:00100000:0.0:1786109725.843623:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5948 00000100:00100000:0.0:1786109725.843632:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:165788:x1872862922180608:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:0.0:1786109725.843658:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109725.843730:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:165788:x1872862922180608:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109725.843738:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5948 00000100:00080000:0.0:1786109725.843759:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109725.924809:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109725.927879:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922180864 00000100:00100000:3.0:1786109725.927891:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922180864 00000100:00100000:3.0:1786109725.927963:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1260 00000100:00100000:3.0:1786109725.927974:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+8:165795:x1872862922180864:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00010000:3.0:1786109725.928027:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109725.928052:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413000/0xdb52b77d7ca38826 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18b2 expref: 8 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928071:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:3.0:1786109725.928075:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109725.928142:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38929 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928154:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38929 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928168:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38929 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928181:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38930 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928187:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38930 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928194:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38930 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928725:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38929 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928734:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38929 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928740:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38929 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928746:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ba00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109725.928749:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38929 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928756:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38929 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928765:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:3.0:1786109725.928768:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109725.928773:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38929 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928779:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38929 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109725.928789:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057036a28 reply state 0000000009b2d405 transno 343597383714 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38930 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928802:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38930 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.928808:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a85613500) 00010000:00010000:3.0:1786109725.928810:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109725.928813:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1786109725.928899:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c51f80 x1872862922180864/t343597383714(0) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:196/0 lens 528/448 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109725.929009:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+9:165795:x1872862922180864:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 1037us (4207us total) trans 343597383714 rc 0/0 00000100:00100000:2.0:1786109725.929016:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1260 00010000:00010000:2.0:1786109725.956712:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109725.966301:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109725.966407:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922180992 00000100:00100000:3.0:1786109725.966416:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922180992 00000100:00100000:3.0:1786109725.966596:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1261 00000100:00100000:3.0:1786109725.966607:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+9:165798:x1872862922180992:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1786109725.966631:0:188678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109725.966652:0:188678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18dc expref: -99 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.966760:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3893e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.966773:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3893e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.966783:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3893e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109725.966820:0:188678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:3.0:1786109725.966824:0:188678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1786109725.966842:0:188678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3893e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.966864:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca38937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18dc expref: 11 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.966881:0:188678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3893e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18dc expref: 10 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.966889:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:3.0:1786109725.966892:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109725.966895:0:188678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628b200, rc 0) 00010000:00000080:3.0:1786109725.966902:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab950f800 x1872862922180992/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:196/0 lens 576/688 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1786109725.967005:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+10:165798:x1872862922180992:12345-192.168.203.38@tcp:101:rm.0 Request processed in 399us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109725.967012:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1261 00000100:00100000:0.0:1786109725.970202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109725.970356:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922181120 00000100:00100000:3.0:1786109725.970366:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922181120 00000100:00100000:3.0:1786109725.970577:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1262 00000100:00100000:3.0:1786109725.970589:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+10:165798:x1872862922181120:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1786109725.970614:0:187901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109725.970638:0:187901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca38945 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18e3 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970715:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca3894c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970732:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca3894c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970744:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca3894c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970754:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca38953 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970761:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca38953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970767:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca38953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970850:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3895a lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970858:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3895a lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970865:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3895a lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109725.970922:0:187901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x8:0x0]: returning size 0 00000004:00200000:3.0:1786109725.970926:0:187901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1786109725.970943:0:187901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3895a lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970954:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3895a lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970966:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca3894c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970973:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca3894c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970979:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca3894c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970985:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109725.970989:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca3894c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.970996:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca3894c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.971006:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:3.0:1786109725.971009:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109725.971014:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca3894c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.971019:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca3894c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.971032:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca38953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.971038:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca38953 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.971044:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca38953 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.971050:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ae00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109725.971053:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca38953 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.971059:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca38953 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.971065:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a85613500) 00010000:00010000:3.0:1786109725.971068:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109725.971070:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca38953 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.971075:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca38953 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.971102:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca38945 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18e3 expref: 12 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.971113:0:187901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3895a lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18e3 expref: 11 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109725.971120:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x8:0x0].0x0 (ffff930a85613300) 00010000:00010000:3.0:1786109725.971123:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109725.971125:0:187901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628b400, rc 0) 00010000:00000080:3.0:1786109725.971132:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab950d880 x1872862922181120/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:196/0 lens 600/584 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1786109725.971192:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+11:165798:x1872862922181120:12345-192.168.203.38@tcp:101:rm.0 Request processed in 605us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109725.971203:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1262 00000100:00100000:2.0:1786109725.974765:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109725.974918:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922181376 00000100:00100000:1.0:1786109725.974929:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922181376 00000100:00100000:1.0:1786109725.975021:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1263 00000100:00100000:1.0:1786109725.975032:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+11:165798:x1872862922181376:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1786109725.975087:0:187900:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1786109725.975112:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca3895a lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18e3 expref: 11 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975131:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x8:0x0].0x0 (ffff930a85613300) 00010000:00010000:1.0:1786109725.975147:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca3893e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18dc expref: 10 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975154:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:1.0:1786109725.975158:0:187900:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109725.975177:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca38961 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975189:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca38961 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975198:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca38961 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975207:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360000/0xdb52b77d7ca38968 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975214:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360000/0xdb52b77d7ca38968 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975220:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360000/0xdb52b77d7ca38968 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975317:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca3896f lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975325:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca3896f lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975331:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca3896f lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975562:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca38976 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975570:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca38976 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975578:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca38976 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975585:0:187900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca38976 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975592:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca38976 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975598:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca38976 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975615:0:187900:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109725.975632:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca3896f lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975638:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca3896f lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975643:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca3896f lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975649:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109725.975653:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca3896f lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975660:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca3896f lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975668:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x8:0x0].0x0 (ffff930a9a33e200) 00010000:00010000:1.0:1786109725.975671:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786109725.975675:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca3896f lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975680:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca3896f lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975775:0:187900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca38961 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975782:0:187900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca38961 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975792:0:187900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca38961 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975797:0:187900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109725.975800:0:187900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca38961 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975806:0:187900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca38961 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975813:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:1.0:1786109725.975816:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109725.975819:0:187900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca38961 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975826:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361800/0xdb52b77d7ca38961 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109725.975835:0:187900:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f094b4c4 reply state 000000003a32fdea transno 343597383715 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360000/0xdb52b77d7ca38968 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975845:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360000/0xdb52b77d7ca38968 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109725.975851:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a85613500) 00010000:00010000:1.0:1786109725.975853:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109725.975856:0:187900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1786109725.975873:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c50380 x1872862922181376/t343597383715(0) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:196/0 lens 512/456 e 0 to 0 dl 1786109736 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1786109725.975956:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109725.975963:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca38976 lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.975970:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109725.975973:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca38976 lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.975981:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca38976 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.975990:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x8:0x0].0x0 (ffff930a9a33e200) 00010000:00010000:0.0:1786109725.975993:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786109725.975996:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca38976 lrc: 1/0,0 mode: --/PW res: [0x200026d31:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.976002:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360c00/0xdb52b77d7ca38976 lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109725.976016:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109725.976018:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109725.976020:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109725.976150:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+11:165798:x1872862922181376:12345-192.168.203.38@tcp:36:rm.0 Request processed in 1118us (1391us total) trans 343597383715 rc 0/0 00000100:00100000:1.0:1786109725.976158:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1263 00000100:00100000:2.0:1786109726.473041:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933379840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109726.473140:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109726.474523:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933379968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109726.474739:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109726.481797:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933379840 00000100:00100000:3.0:1786109726.481815:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933379840 00000100:00100000:3.0:1786109726.482058:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933379968 00000100:00100000:3.0:1786109726.482063:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933379968 00000100:00100000:0.0:1786109726.483293:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786109726.483332:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933379840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786109726.483390:0:199402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445601280 avail 1299361792 00010000:00000080:0.0:1786109726.483411:0:199402:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab1c50000 x1872862933379840/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:197/0 lens 224/368 e 0 to 0 dl 1786109737 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109726.483546:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933379840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 227us (10404us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109726.483554:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786109726.483935:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933379840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109726.484125:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933380096:0@lo:400:kworker.0 00000100:00100000:1.0:1786109726.484248:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109726.486956:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786109726.487008:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933379968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786109726.487066:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446019072 avail 1299779584 00000100:00100000:3.0:1786109726.487191:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933379968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 209us (12451us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109726.487200:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786109726.487627:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109726.487645:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933380224:0@lo:400:kworker.0 00000100:00100000:1.0:1786109726.487795:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109726.487891:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933380096 00000100:00100000:1.0:1786109726.487901:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933380096 00000100:00100000:1.0:1786109726.487966:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1786109726.487975:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933380096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109726.488030:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933380096:12345-0@lo:400:kworker.0 Request processed in 56us (3782us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109726.488037:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1786109726.488089:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933380096:0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.489226:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933380736:0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.489312:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109726.489358:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933381248:0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.489383:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109726.489410:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786109726.489417:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933380608:0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.489486:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109726.494707:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933380352:0@lo:400:kworker.0 00000100:00100000:1.0:1786109726.494823:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933380480:0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.496829:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933381120:0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.496894:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109726.496942:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933380736 00000100:00100000:0.0:1786109726.496952:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933380736 00000100:00100000:0.0:1786109726.497021:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933381248 00000100:00100000:0.0:1786109726.497025:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933381248 00000100:00100000:0.0:1786109726.497040:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933381120 00000100:00100000:0.0:1786109726.497042:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933381120 00000100:00100000:0.0:1786109726.497063:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7120 00000100:00100000:0.0:1786109726.497072:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933380736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.497132:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933380736:12345-0@lo:400:kworker.0 Request processed in 60us (7831us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109726.497139:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7120 00000100:00100000:0.0:1786109726.497154:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7121 00000100:00100000:0.0:1786109726.497649:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933381248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.497710:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933381248:12345-0@lo:400:kworker.0 Request processed in 550us (8325us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109726.497717:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7121 00000100:00100000:0.0:1786109726.497733:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7122 00000100:00100000:0.0:1786109726.497740:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933381120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.497765:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933381120:12345-0@lo:400:kworker.0 Request processed in 26us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109726.497771:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7122 00000100:00100000:3.0:1786109726.503802:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933380224 00000100:00100000:3.0:1786109726.503826:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933380224 00000100:00100000:3.0:1786109726.503931:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933380608 00000100:00100000:3.0:1786109726.503935:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933380608 00000100:00100000:3.0:1786109726.503975:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1786109726.503990:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933380224:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109726.504028:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930986550380 x1872862933380224/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:197/0 lens 224/224 e 0 to 0 dl 1786109737 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109726.504146:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933380224:12345-0@lo:400:kworker.0 Request processed in 160us (16351us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109726.504155:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1786109726.504526:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1786109726.504537:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933380608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109726.504663:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933380608:12345-0@lo:400:kworker.0 Request processed in 129us (15176us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109726.504674:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1786109726.504778:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933380224:0@lo:400:kworker.0 00000100:00080000:2.0:1786109726.505710:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109726.505720:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786109726.505724:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109726.505753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109726.505814:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933380864:0@lo:400:kworker.0 00000100:00100000:2.0:1786109726.505875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109726.505904:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933381376:0@lo:400:kworker.0 00000100:00100000:2.0:1786109726.505934:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109726.505994:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933380352 00000100:00100000:2.0:1786109726.506002:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933380352 00000100:00100000:2.0:1786109726.506055:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933381376 00000100:00100000:2.0:1786109726.506059:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933381376 00000100:00100000:2.0:1786109726.506085:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1786109726.506095:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933380352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109726.506151:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933380352:12345-0@lo:400:kworker.0 Request processed in 58us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109726.506487:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1786109726.506515:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1786109726.506524:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933381376:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109726.506620:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098e35b800 x1872862933381376/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:197/0 lens 224/224 e 0 to 0 dl 1786109737 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109726.506659:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933381376:12345-0@lo:400:kworker.0 Request processed in 137us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109726.506667:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00080000:2.0:1786109726.506710:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109726.506752:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933380352:0@lo:400:kworker.0 00000100:00100000:2.0:1786109726.506768:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933381376:0@lo:400:kworker.0 00000100:00100000:2.0:1786109726.506804:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109726.506835:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933380992:0@lo:400:kworker.0 00000100:00100000:2.0:1786109726.506863:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109726.506901:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933379968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109726.506928:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933380480 00000100:00100000:2.0:1786109726.506932:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933380480 00000100:00100000:2.0:1786109726.506965:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933380992 00000100:00100000:2.0:1786109726.506969:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933380992 00000100:00100000:2.0:1786109726.506985:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1786109726.506991:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933380480:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109726.507005:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098e358e00 x1872862933380480/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:197/0 lens 224/224 e 0 to 0 dl 1786109737 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109726.507038:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933380480:12345-0@lo:400:kworker.0 Request processed in 48us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109726.507045:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1786109726.507057:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1786109726.507063:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933380992:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109726.507075:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098e359880 x1872862933380992/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:197/0 lens 224/224 e 0 to 0 dl 1786109737 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109726.507103:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933380992:12345-0@lo:400:kworker.0 Request processed in 40us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109726.507109:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00080000:2.0:1786109726.507124:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109726.507147:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933380480:0@lo:400:kworker.0 00000100:00100000:2.0:1786109726.507159:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933380992:0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.519793:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933380864 00000100:00100000:0.0:1786109726.519812:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933380864 00000100:00100000:0.0:1786109726.519920:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7123 00000100:00100000:0.0:1786109726.519934:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933380864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.520065:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933380864:12345-0@lo:400:kworker.0 Request processed in 135us (14189us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109726.520073:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7123 00000100:00080000:0.0:1786109726.520099:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109726.522826:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933380864:0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.522878:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933380608:0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.522892:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705689 gen 2 00000004:00080000:0.0:1786109726.522897:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930aa5c0a300, transno 38654705681 00000004:00080000:0.0:1786109726.522911:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9309859e8380, transno 38654705682 00000004:00080000:0.0:1786109726.522914:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930aa5c0b480, transno 38654705683 00000004:00080000:0.0:1786109726.522917:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9309859e8700, transno 38654705684 00000004:00080000:0.0:1786109726.522920:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9309859e9500, transno 38654705685 00000004:00080000:0.0:1786109726.522923:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9309859e9180, transno 38654705686 00000004:00080000:0.0:1786109726.522925:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9309859e9c00, transno 38654705687 00000004:00080000:0.0:1786109726.522928:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9309859eb480, transno 38654705688 00000004:00080000:0.0:1786109726.522931:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab950c000, transno 38654705689 00000100:00100000:0.0:1786109726.522936:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933381120:0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.522952:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933380736:0@lo:400:kworker.0 00000100:00100000:0.0:1786109726.522965:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975847 gen 2 00000004:00080000:0.0:1786109726.522968:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930a97fd7100, transno 4294975839 00000004:00080000:0.0:1786109726.522981:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab950c380, transno 4294975840 00000004:00080000:0.0:1786109726.522984:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930a97fd6680, transno 4294975841 00000004:00080000:0.0:1786109726.522987:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab950f100, transno 4294975842 00000004:00080000:0.0:1786109726.522989:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930a97fd5c00, transno 4294975843 00000004:00080000:0.0:1786109726.522992:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab950ce00, transno 4294975844 00000004:00080000:0.0:1786109726.522995:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9309852ba680, transno 4294975845 00000004:00080000:0.0:1786109726.522998:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9309851f1500, transno 4294975846 00000004:00080000:0.0:1786109726.523001:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff930ab950d180, transno 4294975847 00000100:00100000:0.0:1786109726.523004:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933381248:0@lo:400:kworker.0 00000004:00080000:0.0:1786109726.526713:0:198785:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 9 done 00000004:00080000:3.0:1786109726.528497:0:198787:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:1.0:1786109726.985078:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109726.985101:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933381504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109726.985168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109726.985222:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933381504 00000100:00100000:1.0:1786109726.985229:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933381504 00000100:00100000:1.0:1786109726.985278:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5949 00000100:00100000:1.0:1786109726.985288:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933381504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109726.985316:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109726.985361:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933381504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109726.985369:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5949 00000100:00100000:1.0:1786109726.985415:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933381504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109726.986052:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109726.986064:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933381632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109726.986099:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786109726.986127:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109726.986137:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933381632 00000100:00100000:3.0:1786109726.986141:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933381632 00000100:00100000:3.0:1786109726.986170:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5950 00000100:00100000:3.0:1786109726.986177:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933381632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109726.986199:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109726.986233:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933381632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109726.986239:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5950 00000100:00100000:3.0:1786109726.986271:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933381632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109727.778514:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109727.778567:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109727.778740:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922181632 00000100:00100000:2.0:1786109727.778750:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922181632 00000100:00100000:2.0:1786109727.779316:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 439 00000100:00100000:2.0:1786109727.779328:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+11:2405:x1872862922181632:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:2.0:1786109727.779362:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098c38b100 x1872862922181632/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:198/0 lens 224/224 e 0 to 0 dl 1786109738 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109727.779421:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+11:2405:x1872862922181632:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 97us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109727.779447:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 439 00000100:00100000:0.0:1786109727.784109:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109727.784154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109727.784254:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922181504 00000100:00100000:3.0:1786109727.784264:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922181504 00000100:00100000:3.0:1786109727.784316:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:3.0:1786109727.784326:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922181504:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109727.784396:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922181504:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109727.784404:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:0.0:1786109727.784778:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109727.784950:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922181760 00000100:00100000:3.0:1786109727.784955:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922181760 00000100:00100000:3.0:1786109727.784998:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 440 00000100:00100000:3.0:1786109727.785006:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922181760:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109727.785046:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922181760:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 41us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109727.785053:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 440 00000100:00100000:1.0:1786109727.785151:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922181888 00000100:00100000:1.0:1786109727.785208:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922181888 00000100:00100000:1.0:1786109727.785244:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7124 00000100:00100000:1.0:1786109727.785252:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922181888:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109727.785280:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922181888:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (6714us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109727.785286:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7124 00000100:00080000:2.0:1786109727.788853:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109727.789282:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109727.789286:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109727.792587:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922182016 00000100:00100000:2.0:1786109727.792613:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922182016 00000100:00100000:2.0:1786109727.792859:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7125 00000100:00100000:2.0:1786109727.792873:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922182016:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109727.792950:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922182016:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 81us (8172us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109727.792957:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7125 00000100:00080000:0.0:1786109727.792975:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786109728.010822:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109729.028607:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109730.053337:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109730.053361:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933381760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786109730.053521:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109730.053583:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786109730.053593:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933381888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109730.053990:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109730.054016:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933381760 00000100:00100000:2.0:1786109730.054024:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933381760 00000100:00100000:2.0:1786109730.054082:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5951 00000100:00100000:2.0:1786109730.054093:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933381760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786109730.054121:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00080000:0.0:1786109730.054170:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109730.054309:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109730.054367:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933381888 00000100:00100000:3.0:1786109730.054371:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933381888 00000100:00100000:3.0:1786109730.054403:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5952 00000100:00100000:3.0:1786109730.054410:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933381888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786109730.054447:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109730.054489:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933381888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109730.054496:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5952 00000100:00100000:2.0:1786109730.054508:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933381760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 419us (520us total) trans 0 rc 0/0 00000100:00080000:3.0:1786109730.054513:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109730.054515:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5951 00000100:00100000:1.0:1786109730.054909:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933381760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109730.054973:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933381888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786109731.076909:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786109731.076966:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383715 is committed 00010000:00010000:3.0:1786109731.076996:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38930 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077007:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38930 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077015:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38930 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077027:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109731.077032:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38930 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077041:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38930 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077055:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a85613500) 00010000:00010000:3.0:1786109731.077058:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109731.077063:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38930 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077070:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38930 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077087:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360000/0xdb52b77d7ca38968 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077093:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360000/0xdb52b77d7ca38968 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077099:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360000/0xdb52b77d7ca38968 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077105:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109731.077108:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360000/0xdb52b77d7ca38968 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077114:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360000/0xdb52b77d7ca38968 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077126:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a85613500) 00010000:00010000:3.0:1786109731.077129:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109731.077131:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360000/0xdb52b77d7ca38968 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109731.077137:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360000/0xdb52b77d7ca38968 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109731.589592:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109731.589613:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098c38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933382016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109731.589692:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109731.589752:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933382016 00000100:00100000:0.0:1786109731.589759:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933382016 00000100:00100000:0.0:1786109731.589803:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786109731.589811:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933382016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786109731.589844:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445601280 avail 1299361792 00010000:00000080:0.0:1786109731.589858:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa5c0a300 x1872862933382016/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:202/0 lens 224/368 e 0 to 0 dl 1786109742 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109731.589915:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3646:x1872862933382016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109731.589922:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786109731.589969:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098c38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933382016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109731.590325:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933382144:0@lo:400:kworker.0 00000100:00100000:1.0:1786109731.590358:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109731.590423:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933382144 00000100:00100000:0.0:1786109731.590427:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933382144 00000100:00100000:0.0:1786109731.590475:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1786109731.590483:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933382144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.593731:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933382144:12345-0@lo:400:kworker.0 Request processed in 3239us (3362us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109731.593748:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1786109731.593844:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109731.593858:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933382400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109731.593924:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109731.593963:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933382400 00000100:00100000:0.0:1786109731.593970:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933382400 00000100:00100000:0.0:1786109731.594006:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786109731.594015:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098c38aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933382400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1786109731.594046:0:199402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446019072 avail 1299779584 00000100:00100000:0.0:1786109731.594088:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098c38aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933382400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109731.594094:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786109731.594132:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933382400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109731.594501:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933382272:0@lo:400:kworker.0 00000100:00100000:3.0:1786109731.594534:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109731.594556:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933382784:0@lo:400:kworker.0 00000100:00100000:3.0:1786109731.594576:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109731.594593:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933383296:0@lo:400:kworker.0 00000100:00100000:3.0:1786109731.594614:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109731.594634:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786109731.594639:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933382656:0@lo:400:kworker.0 00000100:00100000:3.0:1786109731.594672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109731.594690:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933383168:0@lo:400:kworker.0 00000100:00100000:3.0:1786109731.594710:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109731.594735:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933382272 00000100:00100000:3.0:1786109731.594739:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933382272 00000100:00100000:3.0:1786109731.594774:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933382784 00000100:00100000:3.0:1786109731.594777:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933382784 00000100:00100000:3.0:1786109731.594790:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933382656 00000100:00100000:3.0:1786109731.594793:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933382656 00000100:00100000:3.0:1786109731.594804:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933383168 00000100:00100000:3.0:1786109731.594806:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933383168 00000100:00100000:3.0:1786109731.594820:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1786109731.594826:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933382272:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109731.594841:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab950ea00 x1872862933382272/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:202/0 lens 224/224 e 0 to 0 dl 1786109742 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109731.594892:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933382272:12345-0@lo:400:kworker.0 Request processed in 66us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109731.594900:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1786109731.594914:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1786109731.594921:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933382784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109731.594948:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933382784:12345-0@lo:400:kworker.0 Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109731.594953:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1786109731.594964:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1786109731.594970:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933382656:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109731.594980:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c57100 x1872862933382656/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:202/0 lens 224/224 e 0 to 0 dl 1786109742 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109731.595005:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933382656:12345-0@lo:400:kworker.0 Request processed in 36us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109731.595011:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1786109731.595022:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1786109731.595027:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933383168:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109731.595037:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa66ee680 x1872862933383168/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:202/0 lens 224/224 e 0 to 0 dl 1786109742 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109731.595062:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933383168:12345-0@lo:400:kworker.0 Request processed in 35us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109731.595071:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1786109731.595093:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933383296 00000100:00100000:3.0:1786109731.595097:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933383296 00000100:00100000:3.0:1786109731.595127:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7126 00000100:00100000:3.0:1786109731.595134:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933383296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109731.595164:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933383296:12345-0@lo:400:kworker.0 Request processed in 31us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109731.595171:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7126 00000100:00080000:3.0:1786109731.595191:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786109731.595195:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109731.595197:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786109731.595221:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933382656:0@lo:400:kworker.0 00000100:00100000:3.0:1786109731.595231:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933383168:0@lo:400:kworker.0 00000100:00100000:3.0:1786109731.595241:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933382272:0@lo:400:kworker.0 00000100:00100000:3.0:1786109731.595249:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933382784:0@lo:400:kworker.0 00000100:00100000:3.0:1786109731.595257:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933383296:0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.595741:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933382528:0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.595775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109731.595807:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933383040:0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.595830:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109731.595848:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933383552:0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.595934:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109731.595957:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786109731.595963:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933382912:0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.595986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109731.596003:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933383424:0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.596023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109731.596052:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933383040 00000100:00100000:0.0:1786109731.596056:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933383040 00000100:00100000:0.0:1786109731.596084:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933382912 00000100:00100000:0.0:1786109731.596087:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933382912 00000100:00100000:0.0:1786109731.596106:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933383424 00000100:00100000:0.0:1786109731.596108:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933383424 00000100:00100000:0.0:1786109731.596134:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7127 00000100:00100000:0.0:1786109731.596142:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933383040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.596182:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933383040:12345-0@lo:400:kworker.0 Request processed in 41us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109731.596188:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7127 00000100:00100000:0.0:1786109731.596202:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7128 00000100:00100000:0.0:1786109731.596207:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933382912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.596234:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933382912:12345-0@lo:400:kworker.0 Request processed in 27us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109731.596239:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7128 00000100:00100000:2.0:1786109731.596372:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933382528 00000100:00100000:2.0:1786109731.596376:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933382528 00000100:00100000:2.0:1786109731.596404:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933383552 00000100:00100000:2.0:1786109731.596407:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933383552 00000100:00100000:2.0:1786109731.596423:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1786109731.596453:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933382528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109731.596490:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933382528:12345-0@lo:400:kworker.0 Request processed in 61us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109731.596495:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1786109731.596508:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1786109731.596514:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933383552:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109731.596525:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309859e8700 x1872862933383552/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:202/0 lens 224/224 e 0 to 0 dl 1786109742 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109731.596550:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933383552:12345-0@lo:400:kworker.0 Request processed in 36us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109731.596556:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1786109731.596611:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7129 00000100:00100000:0.0:1786109731.596621:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933383424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.596665:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933383424:12345-0@lo:400:kworker.0 Request processed in 46us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109731.596671:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7129 00000100:00080000:0.0:1786109731.596705:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109731.596709:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109731.596735:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933382912:0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.596745:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933383424:0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.596753:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933382528:0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.596764:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933383040:0@lo:400:kworker.0 00000100:00100000:0.0:1786109731.596773:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933383552:0@lo:400:kworker.0 00000100:00100000:1.0:1786109731.598253:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933382144:0@lo:400:kworker.0 00000001:02000400:0.0:1786109731.636159:0:200029:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1786109732.101566:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e35b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933383680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109732.101635:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109732.101708:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933383680 00000100:00100000:2.0:1786109732.101715:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933383680 00000100:00100000:2.0:1786109732.101761:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5953 00000100:00100000:2.0:1786109732.101770:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933383680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109732.101800:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109732.101849:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933383680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109732.101856:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5953 00000100:00100000:2.0:1786109732.101904:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e35b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933383680:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1786109732.105496:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109732.105980:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933383808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109732.106125:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109732.106198:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933383808 00000100:00100000:2.0:1786109732.106205:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933383808 00000100:00100000:2.0:1786109732.106247:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5954 00000100:00100000:2.0:1786109732.106255:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933383808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109732.106283:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109732.106326:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933383808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109732.106333:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5954 00000100:00100000:2.0:1786109732.106495:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933383808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109732.500366:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109732.500564:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922182144 00000100:00100000:3.0:1786109732.500575:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922182144 00000100:00100000:3.0:1786109732.500805:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1264 00000100:00100000:3.0:1786109732.500818:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:165879:x1872862922182144:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109732.500838:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109732.500859:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3897d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18ea expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.500941:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38984 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.500956:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.500969:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109732.501013:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:3.0:1786109732.501017:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1786109732.501038:0:187899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.501063:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca3897d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ea expref: 9 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.501079:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38984 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ea expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.501087:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:3.0:1786109732.501090:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109732.501094:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628a800, rc 0) 00010000:00000080:3.0:1786109732.501101:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9309859e9c00 x1872862922182144/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:203/0 lens 576/688 e 0 to 0 dl 1786109743 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1786109732.501162:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+8:165879:x1872862922182144:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 347us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109732.501170:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1264 00000100:00100000:2.0:1786109732.507129:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109732.507219:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922182272 00000100:00100000:3.0:1786109732.507229:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922182272 00000100:00100000:3.0:1786109732.507291:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1265 00000100:00100000:3.0:1786109732.507301:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+8:165879:x1872862922182272:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:3.0:1786109732.507339:0:187900:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445601280 avail 1299361792 00010000:00000080:3.0:1786109732.507359:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098e358a80 x1872862922182272/t0(0) o41->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:242/0 lens 224/368 e 0 to 0 dl 1786109782 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109732.507564:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+8:165879:x1872862922182272:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 264us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109732.507573:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1265 00000100:00080000:0.0:1786109732.511367:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109732.513335:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109732.513564:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922182400 00000100:00100000:3.0:1786109732.513573:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922182400 00000100:00100000:3.0:1786109732.513689:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1266 00000100:00100000:3.0:1786109732.513700:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309859eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+7:165879:x1872862922182400:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:3.0:1786109732.513736:0:189813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446019072 avail 1299779584 00000100:00100000:3.0:1786109732.513804:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309859eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+7:165879:x1872862922182400:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 106us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109732.513811:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1266 00000100:00100000:2.0:1786109732.520296:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109732.520366:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922182528 00000100:00100000:3.0:1786109732.520474:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922182528 00000100:00080000:0.0:1786109732.523516:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109732.523526:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109732.525764:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5955 00000100:00100000:3.0:1786109732.525781:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:165879:x1872862922182528:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:3.0:1786109732.525811:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109732.525897:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:165879:x1872862922182528:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 120us (5610us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109732.525905:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5955 00000100:00100000:1.0:1786109732.529821:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109732.530506:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922182656 00000100:00100000:3.0:1786109732.530517:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922182656 00000100:00080000:0.0:1786109732.531955:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109732.532214:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5956 00000100:00100000:3.0:1786109732.532229:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:165879:x1872862922182656:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:3.0:1786109732.532258:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109732.532329:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:165879:x1872862922182656:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 105us (2517us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109732.532336:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5956 00000100:00100000:2.0:1786109732.666076:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109732.666112:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922182912 00000100:00100000:2.0:1786109732.666121:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922182912 00000100:00100000:2.0:1786109732.666171:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1267 00000100:00100000:2.0:1786109732.666181:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+8:165886:x1872862922182912:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00010000:2.0:1786109732.666234:0:188678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109732.666262:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38984 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ea expref: 8 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.666279:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:2.0:1786109732.666283:0:188678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109732.666356:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca3898b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.666371:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca3898b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.666395:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca3898b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.666411:0:188678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38992 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.666418:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38992 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.666425:0:188678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38992 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.667636:0:188678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca3898b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.667661:0:188678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca3898b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.667668:0:188678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca3898b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.667675:0:188678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca3898b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.667816:0:188678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109732.667821:0:188678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca3898b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.667829:0:188678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca3898b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.667843:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:2.0:1786109732.667847:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109732.667851:0:188678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca3898b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.667857:0:188678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca3898b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109732.668083:0:188678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d7c0bce reply state 000000009787d057 transno 343597383716 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38992 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.668097:0:188678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38992 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.668104:0:188678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930aa0615f00) 00010000:00010000:2.0:1786109732.668107:0:188678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109732.668109:0:188678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1786109732.668140:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97808700 x1872862922182912/t343597383716(0) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:242/0 lens 528/448 e 0 to 0 dl 1786109782 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109732.668214:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+9:165886:x1872862922182912:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 2034us (2146us total) trans 343597383716 rc 0/0 00000100:00100000:2.0:1786109732.668222:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1267 00000100:00100000:0.0:1786109732.720560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109732.723213:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922183040 00000100:00100000:3.0:1786109732.723228:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922183040 00000100:00100000:3.0:1786109732.723298:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1268 00000100:00100000:3.0:1786109732.723309:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+9:165889:x1872862922183040:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1786109732.723334:0:187900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109732.723354:0:187900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca38999 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18f1 expref: -99 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.724086:0:187900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca389a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.724103:0:187900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca389a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.724115:0:187900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca389a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109732.724155:0:187900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:3.0:1786109732.724159:0:187900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1786109732.724179:0:187900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca389a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 187900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.724209:0:187900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a200/0xdb52b77d7ca38999 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18f1 expref: 11 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.724226:0:187900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca389a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18f1 expref: 10 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.724235:0:187900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:3.0:1786109732.724238:0:187900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109732.724241:0:187900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628ae00, rc 0) 00010000:00000080:3.0:1786109732.724249:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa60a3480 x1872862922183040/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:242/0 lens 576/688 e 0 to 0 dl 1786109782 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1786109732.724315:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+10:165889:x1872862922183040:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1008us (3763us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109732.724323:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1268 00000100:00100000:3.0:1786109732.728833:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109732.728890:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922183168 00000100:00100000:3.0:1786109732.728899:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922183168 00000100:00100000:3.0:1786109732.728947:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1269 00000100:00100000:3.0:1786109732.728958:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+10:165889:x1872862922183168:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:3.0:1786109732.728979:0:187899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109732.728998:0:187899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca389a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18f8 expref: -99 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729060:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca389ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729080:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca389ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729092:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca389ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729103:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca389b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729110:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca389b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729116:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca389b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729203:0:187899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca389bc lrc: 3/1,0 mode: --/PR res: [0x200026d31:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729212:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca389bc lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729219:0:187899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca389bc lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109732.729257:0:187899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x9:0x0]: returning size 0 00000004:00200000:3.0:1786109732.729261:0:187899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1786109732.729278:0:187899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca389bc lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729288:0:187899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca389bc lrc: 3/1,0 mode: PR/PR res: [0x200026d31:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729300:0:187899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca389ae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729306:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca389ae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729313:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca389ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729320:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca389ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729326:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628ba00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109732.729330:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca389ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729337:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca389ae lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729348:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:3.0:1786109732.729351:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109732.729355:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca389ae lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729361:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ba00/0xdb52b77d7ca389ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729387:0:187899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca389b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729394:0:187899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca389b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729400:0:187899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca389b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729405:0:187899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628aa00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109732.729408:0:187899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca389b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729414:0:187899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca389b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729421:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930aa0615f00) 00010000:00010000:3.0:1786109732.729423:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109732.729426:0:187899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca389b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729459:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628aa00/0xdb52b77d7ca389b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729487:0:187899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b000/0xdb52b77d7ca389a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18f8 expref: 12 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729501:0:187899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca389bc lrc: 3/0,0 mode: PR/PR res: [0x200026d31:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18f8 expref: 11 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109732.729509:0:187899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x9:0x0].0x0 (ffff930a85613500) 00010000:00010000:3.0:1786109732.729511:0:187899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786109732.729514:0:187899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628a600, rc 0) 00010000:00000080:3.0:1786109732.729521:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa66ec000 x1872862922183168/t0(0) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:242/0 lens 600/584 e 0 to 0 dl 1786109782 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1786109732.729585:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+11:165889:x1872862922183168:12345-192.168.203.38@tcp:101:rm.0 Request processed in 628us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109732.729592:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1269 00000100:00100000:2.0:1786109732.746603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109732.750359:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922183424 00000100:00100000:0.0:1786109732.750375:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922183424 00000100:00100000:2.0:1786109732.750619:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1270 00000100:00100000:2.0:1786109732.750630:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+11:165889:x1872862922183424:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1786109732.750699:0:187901:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786109732.750724:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a600/0xdb52b77d7ca389bc lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18f8 expref: 11 pid: 187899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.750748:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x9:0x0].0x0 (ffff930a85613500) 00010000:00010000:2.0:1786109732.750766:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628ae00/0xdb52b77d7ca389a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18f1 expref: 10 pid: 187900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.750831:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:2.0:1786109732.750835:0:187901:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786109732.750856:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca389c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.750870:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca389c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.750998:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca389c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751012:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412c00/0xdb52b77d7ca389ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751020:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412c00/0xdb52b77d7ca389ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751026:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412c00/0xdb52b77d7ca389ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751118:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca389d1 lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751126:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca389d1 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751200:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca389d1 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751386:0:187901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412800/0xdb52b77d7ca389d8 lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751395:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412800/0xdb52b77d7ca389d8 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751403:0:187901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412800/0xdb52b77d7ca389d8 lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751414:0:187901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412800/0xdb52b77d7ca389d8 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751421:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412800/0xdb52b77d7ca389d8 lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751427:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412800/0xdb52b77d7ca389d8 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751517:0:187901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109732.751536:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca389d1 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751542:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca389d1 lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751548:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca389d1 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751554:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109732.751559:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca389d1 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751566:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca389d1 lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751575:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x9:0x0].0x0 (ffff930aa0615b00) 00010000:00010000:2.0:1786109732.751578:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109732.751582:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca389d1 lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751591:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413800/0xdb52b77d7ca389d1 lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751607:0:187901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca389c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751614:0:187901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca389c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751619:0:187901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca389c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751624:0:187901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109732.751627:0:187901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca389c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751633:0:187901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca389c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751651:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:2.0:1786109732.751654:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109732.751657:0:187901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca389c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751663:0:187901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413200/0xdb52b77d7ca389c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109732.751673:0:187901:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a889ede reply state 00000000835ed9ce transno 343597383717 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412c00/0xdb52b77d7ca389ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751682:0:187901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412c00/0xdb52b77d7ca389ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109732.751689:0:187901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930aa0615f00) 00010000:00010000:2.0:1786109732.751692:0:187901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109732.751694:0:187901:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1786109732.751712:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa5c55180 x1872862922183424/t343597383717(0) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:242/0 lens 512/456 e 0 to 0 dl 1786109782 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1786109732.751837:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109732.751844:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412800/0xdb52b77d7ca389d8 lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109732.751852:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109732.751855:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412800/0xdb52b77d7ca389d8 lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109732.751862:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412800/0xdb52b77d7ca389d8 lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109732.751873:0:10402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x9:0x0].0x0 (ffff930aa0615b00) 00010000:00010000:1.0:1786109732.751876:0:10402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786109732.751879:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412800/0xdb52b77d7ca389d8 lrc: 1/0,0 mode: --/PW res: [0x200026d31:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109732.751885:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412800/0xdb52b77d7ca389d8 lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109732.751899:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109732.751900:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109732.751902:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109732.753736:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+11:165889:x1872862922183424:12345-192.168.203.38@tcp:36:rm.0 Request processed in 3096us (7129us total) trans 343597383717 rc 0/0 00000100:00100000:2.0:1786109732.753748:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1270 00000100:00100000:3.0:1786109732.880600:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109732.880715:0:196397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922183552 00000100:00100000:0.0:1786109732.880725:0:196397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922183552 00000100:00100000:0.0:1786109732.880776:0:196397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:0.0:1786109732.880786:0:196397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922183552:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109732.881085:0:196397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922183552:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 298us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109732.881095:0:196397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 142 00010000:00010000:2.0:1786109733.133665:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109734.151692:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109735.172729:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa66ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933383936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109735.172735:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933384064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109735.172820:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109735.173426:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933383936 00000100:00100000:3.0:1786109735.173454:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933383936 00000100:00100000:3.0:1786109735.173522:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5957 00000100:00100000:3.0:1786109735.173534:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933383936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786109735.173571:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109735.173646:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933383936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109735.173654:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5957 00010000:00010000:3.0:1786109735.173677:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109735.173693:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109735.173726:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933384064 00000100:00100000:3.0:1786109735.173730:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933384064 00000100:00100000:3.0:1786109735.173758:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5958 00000100:00100000:3.0:1786109735.173765:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933384064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109735.173781:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109735.173815:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933384064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109735.173821:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5958 00000100:00100000:3.0:1786109735.174582:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309852ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933384064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109735.174647:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa66ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933383936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786109735.175280:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109735.175286:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786109736.197025:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109736.198831:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 1 seconds 00000100:00100000:3.0:1786109736.708928:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933384192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109736.709000:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109736.709545:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933384320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109736.709578:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109736.709627:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933384192 00000100:00100000:1.0:1786109736.709634:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933384192 00000100:00100000:1.0:1786109736.709674:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933384320 00000100:00100000:1.0:1786109736.709677:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933384320 00000100:00100000:1.0:1786109736.709691:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786109736.709704:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933384192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109736.709736:0:199402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446019072 avail 1299779584 00010000:00000080:1.0:1786109736.709749:0:199402:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab950f100 x1872862933384192/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:207/0 lens 224/368 e 0 to 0 dl 1786109747 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109736.709785:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933384192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109736.710144:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786109736.710155:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3649:x1872862933384320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786109736.710176:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445601280 avail 1299361792 00010000:00000080:3.0:1786109736.710187:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1782a00 x1872862933384320/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:207/0 lens 224/368 e 0 to 0 dl 1786109747 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109736.710218:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3649:x1872862933384320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109736.710225:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786109736.710250:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933384448:0@lo:400:kworker.0 00000100:00100000:3.0:1786109736.710280:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109736.710306:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933384960:0@lo:400:kworker.0 00000100:00100000:1.0:1786109736.710318:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786109736.710344:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933384832:0@lo:400:kworker.0 00000100:00100000:1.0:1786109736.710377:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109736.710399:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933385344:0@lo:400:kworker.0 00000100:00100000:1.0:1786109736.710420:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109736.710479:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933384320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109736.710495:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1786109736.710500:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933384704:0@lo:400:kworker.0 00000100:00100000:1.0:1786109736.710522:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109736.710540:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933385216:0@lo:400:kworker.0 00000100:00100000:1.0:1786109736.710562:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109736.710581:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933385728:0@lo:400:kworker.0 00000100:00100000:1.0:1786109736.710600:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109736.710648:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933384832 00000100:00100000:1.0:1786109736.710652:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933384832 00000100:00100000:1.0:1786109736.710686:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933385344 00000100:00100000:1.0:1786109736.710689:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933385344 00000100:00100000:1.0:1786109736.710700:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933384704 00000100:00100000:1.0:1786109736.710702:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933384704 00000100:00100000:1.0:1786109736.710715:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933385728 00000100:00100000:1.0:1786109736.710718:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933385728 00000100:00100000:1.0:1786109736.710730:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1786109736.710736:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933384832:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109736.710748:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1781c00 x1872862933384832/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:246/0 lens 224/224 e 0 to 0 dl 1786109786 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109736.710789:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933384832:12345-0@lo:400:kworker.0 Request processed in 53us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109736.710795:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1786109736.710810:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1786109736.710816:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8c52850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933385344:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109736.710826:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab8c52850 x1872862933385344/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:246/0 lens 224/224 e 0 to 0 dl 1786109786 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109736.710850:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8c52850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1872862933385344:12345-0@lo:400:kworker.0 Request processed in 35us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109736.710855:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1786109736.710869:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1786109736.710876:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933384704:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109736.710886:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1783800 x1872862933384704/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:246/0 lens 224/224 e 0 to 0 dl 1786109786 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109736.710911:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933384704:12345-0@lo:400:kworker.0 Request processed in 36us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109736.710917:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1786109736.710930:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1786109736.710937:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933385728:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109736.710947:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1782d80 x1872862933385728/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:246/0 lens 224/224 e 0 to 0 dl 1786109786 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109736.710962:0:196399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933384448 00000100:00100000:2.0:1786109736.710966:0:196399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933384448 00000100:00100000:1.0:1786109736.710971:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933385728:12345-0@lo:400:kworker.0 Request processed in 35us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109736.710976:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:2.0:1786109736.710993:0:196399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1786109736.710999:0:196399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933384448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109736.711001:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933385216 00000100:00100000:1.0:1786109736.711004:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933385216 00000100:00100000:1.0:1786109736.711026:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7130 00000100:00100000:1.0:1786109736.711031:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933385216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109736.711034:0:196399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933384448:12345-0@lo:400:kworker.0 Request processed in 36us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109736.711039:0:196399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1786109736.711060:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933385216:12345-0@lo:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109736.711066:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7130 00000100:00080000:1.0:1786109736.711083:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109736.711153:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109736.711196:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933384704:0@lo:400:kworker.0 00000100:00100000:1.0:1786109736.711205:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933385216:0@lo:400:kworker.0 00000100:00100000:1.0:1786109736.711213:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933385728:0@lo:400:kworker.0 00000100:00100000:1.0:1786109736.711220:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933384832:0@lo:400:kworker.0 00000100:00100000:1.0:1786109736.711227:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1872862933385344:0@lo:400:kworker.0 00000100:00100000:3.0:1786109736.711940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109736.712285:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933384576:0@lo:400:kworker.0 00000100:00100000:3.0:1786109736.712975:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933385472:0@lo:400:kworker.0 00000100:00100000:3.0:1786109736.713000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109736.713227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109736.713257:0:179242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933385472 00000100:00100000:0.0:1786109736.713263:0:179242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933385472 00000100:00100000:0.0:1786109736.713303:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7131 00000100:00100000:0.0:1786109736.713311:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933385472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109736.713352:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933385472:12345-0@lo:400:kworker.0 Request processed in 41us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109736.713358:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7131 00000100:00080000:0.0:1786109736.713376:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109736.713418:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933385472:0@lo:400:kworker.0 00000100:00100000:3.0:1786109736.713460:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933384448:0@lo:400:kworker.0 00000100:00100000:3.0:1786109736.713488:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933384192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109736.717306:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933384960 00000100:00100000:1.0:1786109736.717321:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933384960 00000100:00080000:1.0:1786109736.717371:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109736.718688:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933384576 00000100:00100000:3.0:1786109736.718697:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933384576 00000100:00100000:3.0:1786109736.718744:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1786109736.718754:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933384960:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109736.718780:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab950c000 x1872862933384960/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:246/0 lens 224/224 e 0 to 0 dl 1786109786 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109736.718795:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1786109736.718802:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933384576:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109736.718814:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1704a80 x1872862933384576/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:246/0 lens 224/224 e 0 to 0 dl 1786109786 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109736.719473:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109736.720126:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933384576:12345-0@lo:400:kworker.0 Request processed in 1320us (6894us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109736.720137:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1786109736.720166:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933384960:12345-0@lo:400:kworker.0 Request processed in 1412us (8225us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109736.720173:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1786109736.720229:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933384960:0@lo:400:kworker.0 00000100:00100000:2.0:1786109736.720313:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933384576:0@lo:400:kworker.0 00000100:00100000:2.0:1786109736.720325:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933385088:0@lo:400:kworker.0 00000100:00100000:2.0:1786109736.720368:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109736.720427:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933385600:0@lo:400:kworker.0 00000100:00100000:2.0:1786109736.720474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109736.720721:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933385088 00000100:00100000:3.0:1786109736.720728:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933385088 00000100:00100000:3.0:1786109736.720767:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933385600 00000100:00100000:3.0:1786109736.720770:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933385600 00000100:00100000:3.0:1786109736.720799:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7132 00000100:00100000:3.0:1786109736.720808:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933385088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109736.720854:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933385088:12345-0@lo:400:kworker.0 Request processed in 48us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109736.720860:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7132 00000100:00100000:3.0:1786109736.720871:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7133 00000100:00100000:3.0:1786109736.720877:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933385600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109736.720904:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933385600:12345-0@lo:400:kworker.0 Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109736.720910:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7133 00000100:00080000:3.0:1786109736.720928:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109736.720982:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933385088:0@lo:400:kworker.0 00000100:00100000:2.0:1786109736.720991:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933385600:0@lo:400:kworker.0 00010000:00010000:3.0:1786109737.223288:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109737.223976:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 1 seconds 00000100:00100000:3.0:1786109737.226592:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933385856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109737.226673:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109737.226771:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933385856 00000100:00100000:1.0:1786109737.226780:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933385856 00000100:00100000:1.0:1786109737.226845:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5959 00000100:00100000:1.0:1786109737.226855:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933385856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109737.226886:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109737.226937:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933385856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109737.226943:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5959 00000100:00100000:3.0:1786109737.229950:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933385856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109737.233589:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109737.233625:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933385984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109737.233689:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109737.233947:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933385984 00000100:00100000:3.0:1786109737.233955:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933385984 00000100:00100000:3.0:1786109737.234000:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5960 00000100:00100000:3.0:1786109737.234009:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933385984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109737.234038:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109737.234085:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933385984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109737.234092:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5960 00000100:00100000:3.0:1786109737.234141:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933385984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109738.008092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109738.008169:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109738.008207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109738.008229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109738.008256:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109738.008280:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922183936 00000100:00100000:2.0:1786109738.008290:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922183936 00000100:00100000:2.0:1786109738.008340:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922183808 00000100:00100000:2.0:1786109738.008343:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922183808 00000100:00100000:2.0:1786109738.008364:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 453 00000100:00100000:2.0:1786109738.008373:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922183936:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:2.0:1786109738.008401:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1705c00 x1872862922183936/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:248/0 lens 224/224 e 0 to 0 dl 1786109788 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109738.008473:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922183936:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109738.008480:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 453 00000100:00100000:2.0:1786109738.008499:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 454 00000100:00100000:2.0:1786109738.008504:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+11:2405:x1872862922183808:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:2.0:1786109738.008518:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1706300 x1872862922183808/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:248/0 lens 224/224 e 0 to 0 dl 1786109788 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109738.008537:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+11:2405:x1872862922183808:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 34us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109738.008542:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 454 00000100:00100000:2.0:1786109738.008561:0:179241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922184192 00000100:00100000:2.0:1786109738.008563:0:179241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922184192 00000100:00100000:2.0:1786109738.008587:0:179241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922184064 00000100:00100000:2.0:1786109738.008590:0:179241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922184064 00000100:00100000:2.0:1786109738.008678:0:179241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7134 00000100:00100000:2.0:1786109738.008686:0:179241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922184192:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109738.008714:0:179241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922184192:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109738.008720:0:179241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7134 00000100:00100000:2.0:1786109738.008731:0:179241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7135 00000100:00100000:2.0:1786109738.008737:0:179241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922184064:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109738.008760:0:179241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922184064:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 23us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109738.008765:0:179241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7135 00000100:00080000:2.0:1786109738.008780:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109738.008784:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109738.008787:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786109738.008789:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109738.010576:0:196398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922183680 00000100:00100000:0.0:1786109738.010588:0:196398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922183680 00000100:00100000:0.0:1786109738.010658:0:196398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:0.0:1786109738.010669:0:196398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922183680:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109738.010727:0:196398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922183680:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 60us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109738.010735:0:196398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:0.0:1786109738.244624:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 1 seconds 00000001:00080000:3.0:1786109738.248776:0:196392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383717 is committed 00010000:00010000:0.0:1786109738.248975:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109738.249469:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38992 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249483:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38992 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249490:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38992 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249496:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109738.249501:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38992 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249508:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38992 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249524:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930aa0615f00) 00010000:00010000:3.0:1786109738.249528:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109738.249533:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38992 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249539:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413e00/0xdb52b77d7ca38992 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249555:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412c00/0xdb52b77d7ca389ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249561:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412c00/0xdb52b77d7ca389ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249566:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412c00/0xdb52b77d7ca389ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249571:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109738.249573:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412c00/0xdb52b77d7ca389ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249579:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412c00/0xdb52b77d7ca389ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249586:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930aa0615f00) 00010000:00010000:3.0:1786109738.249589:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109738.249592:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412c00/0xdb52b77d7ca389ca lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109738.249597:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412c00/0xdb52b77d7ca389ca lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 187901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109739.268845:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109739.273605:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 1 seconds 00000001:02000400:3.0:1786109739.551049:0:200424:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds2 REPLAY BARRIER on lustre-MDT0001 00000100:00100000:1.0:1786109740.292667:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 1 seconds 00000100:00100000:0.0:1786109740.292943:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933386112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786109740.292976:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109740.293016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109740.293250:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933386240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109740.293284:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109740.293416:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933386112 00000100:00100000:0.0:1786109740.293424:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933386112 00000100:00100000:0.0:1786109740.293650:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933386240 00000100:00100000:0.0:1786109740.293655:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933386240 00000100:00080000:1.0:1786109740.293738:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109740.293743:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109740.293848:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5961 00000100:00100000:0.0:1786109740.293859:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933386112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109740.293889:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109740.293940:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933386112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109740.293948:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5961 00000100:00100000:0.0:1786109740.293964:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5962 00000100:00100000:0.0:1786109740.293971:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933386240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109740.293987:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109740.294021:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933386240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109740.294028:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5962 00000100:00100000:0.0:1786109740.294074:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933386240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109740.294110:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933386112:0@lo:13:osp-pre-0-0.0 00000020:01000004:0.0:1786109741.215136:0:200521:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1786109741.215195:0:200521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.215212:0:200521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.215219:0:200521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.215226:0:200521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.215251:0:200521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1786109741.215256:0:200521:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1786109741.215554:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109741.215562:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.215570:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f38e00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109741.215574:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.215594:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109741.215602:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109741.215608:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786109741.215611:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1786109741.215614:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1786109741.215651:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.215658:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109741.215688:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.215696:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac1f38e00/0xdb52b77d7ca373e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca373ea expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.215711:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109741.215713:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109741.215715:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109741.215723:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109741.215740:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933386368:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1786109741.216222:0:200521:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109741.216227:0:200521:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1786109741.216232:0:200521:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1786109741.216246:0:200521:0:(import.c:65:import_set_state_nolock()) ffff930ab2ab9000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1786109741.216540:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109741.216621:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933386368 00000100:00100000:3.0:1786109741.216628:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933386368 00000100:00100000:3.0:1786109741.216674:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4542 00000100:00100000:3.0:1786109741.216683:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a90737450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933386368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109741.216695:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109741.216709:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6ca00/0xdb52b77d7ca373ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca373e3 expref: 24 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.216722:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109741.216755:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a90737450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3648:x1872862933386368:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109741.216762:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4542 00000100:00100000:2.0:1786109741.217417:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933386496:0@lo:39:umount.0 00000100:00100000:2.0:1786109741.217952:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109741.219559:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933386368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109741.219624:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933386496 00000100:00100000:3.0:1786109741.219631:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933386496 00000100:00100000:3.0:1786109741.219675:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1786109741.219684:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872862933386496:12345-0@lo:39:umount.0 00000020:00000080:3.0:1786109741.219712:0:187901:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca374f4 00000100:00080000:3.0:1786109741.219721:0:187901:0:(import.c:65:import_set_state_nolock()) ffff930ab9960000 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1786109741.219753:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c5c00 x1872862933386496/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:251/0 lens 224/224 e 0 to 0 dl 1786109791 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109741.219816:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1872862933386496:12345-0@lo:39:umount.0 Request processed in 121us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109741.219824:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000020:00000080:3.0:1786109741.219833:0:187901:0:(genops.c:906:class_export_put()) final put ffff930ab9964000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1786109741.219859:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab9964000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1786109741.219908:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab9960000 for lustre-MDT0000 00000100:00080000:3.0:1786109741.219934:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab2ab9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1786109741.219946:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933386496:0@lo:39:umount.0 00010000:00010000:1.0:1786109741.220167:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109741.220223:0:200521:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109741.220227:0:200521:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1786109741.220232:0:200521:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1786109741.222922:0:200521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.222939:0:200521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.222947:0:200521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.222953:0:200521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.223069:0:200521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109741.223077:0:200521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.223084:0:200521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.223090:0:200521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.223096:0:200521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.223129:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786109741.223136:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.223144:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3e00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:1.0:1786109741.223147:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.223156:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786109741.223163:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109741.223168:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1786109741.223170:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1786109741.223200:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.223207:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109741.223244:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.223252:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca3730a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37311 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.223267:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109741.223270:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.223276:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424400 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:1.0:1786109741.223279:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.223284:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786109741.223290:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109741.223295:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1786109741.223297:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1786109741.223308:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.223313:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109741.223391:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.223404:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109741.223405:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109741.223407:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109741.223487:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933386624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109741.223554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109741.223616:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109741.223622:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933386752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109741.223643:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109741.223789:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933386624 00000100:00100000:3.0:1786109741.223797:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933386624 00000100:00100000:3.0:1786109741.223924:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933386752 00000100:00100000:3.0:1786109741.223928:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933386752 00000100:00100000:3.0:1786109741.223952:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4543 00000100:00100000:3.0:1786109741.223961:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933386624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109741.223975:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109741.223991:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac1f39e00/0xdb52b77d7ca37311 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3730a expref: 24 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.224079:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109741.224119:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3646:x1872862933386624:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109741.224127:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4543 00000100:00100000:3.0:1786109741.224143:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4544 00000100:00100000:3.0:1786109741.224149:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3646:x1872862933386752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109741.224158:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109741.224168:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f07a00/0xdb52b77d7ca38069 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca38062 expref: 22 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.224176:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109741.224198:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3646:x1872862933386752:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109741.224204:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4544 00000100:00100000:3.0:1786109741.224242:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933386752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109741.224249:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933386624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109741.224756:0:200521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109741.224764:0:200521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930986424400/0xdb52b77d7ca38062 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38069 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109741.224775:0:200521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1786109741.224784:0:200521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.224791:0:200521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.224797:0:200521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.224804:0:200521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.224897:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109741.224903:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.224911:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac1f39c00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109741.224914:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.224921:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109741.224927:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109741.224933:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1786109741.224935:0:10402:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1786109741.224954:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.224961:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1786109741.225076:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933386880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109741.225115:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109741.225182:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933386880 00000100:00100000:2.0:1786109741.225188:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933386880 00000100:00100000:2.0:1786109741.225223:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4545 00000100:00100000:2.0:1786109741.225232:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3648:x1872862933386880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109741.225242:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109741.225254:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166c000/0xdb52b77d7ca373dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca373d5 expref: 21 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.225264:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786109741.225308:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.225391:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109741.225394:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109741.225396:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109741.225467:0:200521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786109741.225473:0:200521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac1f39c00/0xdb52b77d7ca373d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca373dc expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109741.225482:0:200521:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1786109741.225489:0:200521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.225496:0:200521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.225502:0:200521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.225509:0:200521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109741.225523:0:200521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1786109741.225526:0:200521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1786109741.225529:0:200521:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1786109741.225568:0:200521:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1786109741.225572:0:200521:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1786109741.225577:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1786109741.225595:0:200521:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1786109741.227950:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109741.227963:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.227976:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d600 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109741.227980:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.227990:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109741.228403:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109741.228410:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1786109741.228413:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1786109741.228416:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1786109741.228572:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.228580:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00000080:0.0:1786109741.228667:0:200521:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:0.0:1786109741.228947:0:200521:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1786109741.228956:0:200521:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930a87b28000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786109741.228962:0:200521:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff93098650c000 lustre-MDT0001-mdtlov_UUID 0@lo 7 (0 0 3) 0 0 0 0: 0000000000000000 343597383713 stale:0 00000020:00080000:0.0:1786109741.228966:0:200521:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930ab9967000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786109741.228970:0:200521:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930ab9963000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786109741.228976:0:200521:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff930a90aa2800 fac74500-4523-4794-af20-dfdcdfae19c1 192.168.203.38@tcp 6 (0 0 1) 0 0 0 0: 0000000000000000 343597383717 stale:0 00000020:00080000:0.0:1786109741.228982:0:200521:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff930ac11b0000) has exports, disconnecting them 00000020:00080000:0.0:1786109741.228986:0:200521:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930a87b28000), last request at 1786109695 00000020:00000080:0.0:1786109741.229067:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3803f 00000100:00080000:0.0:1786109741.229077:0:200521:0:(import.c:65:import_set_state_nolock()) ffff930a87b2b800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786109741.229107:0:200521:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930a87b28000): rc 0 00000020:00000080:0.0:1786109741.229110:0:200521:0:(genops.c:906:class_export_put()) final put ffff930a87b28000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1786109741.229120:0:200521:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93098650c000), last request at 1786109695 00000020:00000080:0.0:1786109741.229124:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37fd6 00000020:00010000:0.0:1786109741.229127:0:200521:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93098650c000: total 1 00000100:00080000:0.0:1786109741.229131:0:200521:0:(import.c:65:import_set_state_nolock()) ffff93098650f800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786109741.229142:0:200521:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93098650c000): rc 0 00000020:00080000:0.0:1786109741.229144:0:200521:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930ab9967000), last request at 1786109736 00000020:00000080:0.0:1786109741.229146:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca374ed 00000100:00080000:0.0:1786109741.229150:0:200521:0:(import.c:65:import_set_state_nolock()) ffff930ab9965000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786109741.229154:0:200521:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab9967000): rc 0 00000020:00000080:0.0:1786109741.229156:0:200521:0:(genops.c:906:class_export_put()) final put ffff930ab9967000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1786109741.229160:0:200521:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff930ab9963000), last request at 1786109736 00000020:00000080:0.0:1786109741.229167:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca374df 00000100:00080000:0.0:1786109741.229174:0:200521:0:(import.c:65:import_set_state_nolock()) ffff930ab9960800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786109741.229211:0:200521:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab9963000): rc 0 00000020:00000080:0.0:1786109741.229214:0:200521:0:(genops.c:906:class_export_put()) final put ffff930ab9963000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1786109741.229218:0:200521:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.38@tcp (ffff930a90aa2800), last request at 1786109738 00000020:00000080:0.0:1786109741.229221:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37350 00000020:00010000:0.0:1786109741.229230:0:200521:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930a90aa2800: total 3 00000100:00080000:0.0:1786109741.229233:0:200521:0:(import.c:65:import_set_state_nolock()) ffff930ab7c42000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786109741.229258:0:200521:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.38@tcp (ffff930a90aa2800): rc 0 00000004:00000080:0.0:1786109741.229263:0:200521:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa66f01d3bae0 00000100:00080000:0.0:1786109741.229278:0:200521:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1786109741.229282:0:200521:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:1.0:1786109741.229571:0:6514:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93098650c000: total 3 00010000:00010000:1.0:1786109741.229629:0:6514:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93098650c000, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1786109741.229664:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9412000/0xdb52b77d7ca388a4 lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3889d expref: 4 pid: 187904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.229691:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38206 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca381ff expref: 3 pid: 177399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.229711:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a400/0xdb52b77d7ca38896 lrc: 0/0,0 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3888f expref: 2 pid: 187905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109741.229724:0:6514:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93098650c000, canceled 3 locks, left on hash table 0. 00000100:00100000:2.0:1786109741.230140:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:3648:x1872862933386880:12345-0@lo:103:ldlm_bl.0 Request processed in 4904us (5019us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109741.230152:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4545 00000100:00100000:2.0:1786109741.230507:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933387008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109741.230569:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786109741.230974:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.230984:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d600/0xdb52b77d7ca372f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca37303 expref: -99 pid: 196391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1786109741.231917:0:6515:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930a90aa2800: total 3 00010000:00010000:3.0:1786109741.231992:0:6515:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930a90aa2800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1786109741.232097:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ac16c2200/0xdb52b77d7ca38842 lrc: 0/0,0 mode: --/PR res: [0x200026d31:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18b9 expref: 2 pid: 188678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109741.232119:0:6515:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930a90aa2800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1786109741.233110:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109741.233924:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933387008 00000100:00100000:2.0:1786109741.233938:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933387008 00000100:00100000:2.0:1786109741.234087:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4546 00000100:00100000:2.0:1786109741.234098:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:3649:x1872862933387008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109741.234113:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109741.234132:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac1f38000/0xdb52b77d7ca37303 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca372f5 expref: 20 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.234150:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109741.234231:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3649:x1872862933387008:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (3660us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109741.234238:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4546 00000100:00100000:2.0:1786109741.234282:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933387008:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1786109741.235930:0:200521:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1786109741.235963:0:200521:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1786109741.236075:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933387136:0@lo:39:umount.0 00000100:00100000:2.0:1786109741.236134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786109741.239973:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109741.240089:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933386880:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1786109741.242520:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b28000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109741.242592:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab9967000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109741.242624:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab9963000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109741.242648:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a87b2b800 for lustre-MDT0000 00000020:00000080:0.0:1786109741.242651:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab9965000 for lustre-MDT0000 00000020:00000080:0.0:1786109741.242654:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab9960800 for lustre-MDT0000 00000100:00100000:0.0:1786109741.244617:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933387136 00000100:00100000:0.0:1786109741.244629:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933387136 00000100:00100000:0.0:1786109741.244682:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786109741.244690:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933387136:12345-0@lo:39:umount.0 00000020:00000080:0.0:1786109741.244719:0:187904:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37fa5 00000100:00080000:0.0:1786109741.244738:0:187904:0:(import.c:65:import_set_state_nolock()) ffff930ac1364000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786109741.244765:0:187904:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 7, last_transno is 30064771142 00010000:00000080:0.0:1786109741.244872:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac16c5880 x1872862933387136/t30064771143(0) o39->lustre-MDT0000-mdtlov_UUID@0@lo:212/0 lens 224/224 e 0 to 0 dl 1786109752 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1786109741.245135:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109741.248966:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3645:x1872862933387136:12345-0@lo:39:umount.0 Request processed in 4264us (12818us total) trans 30064771143 rc 0/0 00000100:00100000:0.0:1786109741.248981:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1786109741.249259:0:200521:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1786109741.249266:0:200521:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705668 gen 3 00000004:00080000:0.0:1786109741.249291:0:200521:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1786109741.249518:0:200521:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1786109741.249550:0:200521:0:(import.c:65:import_set_state_nolock()) ffff930a8a715800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1786109741.249564:0:200521:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1786109741.249567:0:200521:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975826 gen 3 00000004:00080000:0.0:1786109741.249593:0:200521:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1786109741.249654:0:200521:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1786109741.249664:0:200521:0:(import.c:65:import_set_state_nolock()) ffff930a8a711000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1786109741.249709:0:200521:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff930ac11b0000) has no exports 00000100:00080000:2.0:1786109741.253651:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930985f23800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1786109741.253668:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933387136:0@lo:39:umount.0 00000100:00100000:2.0:1786109741.253693:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933387264:0@lo:9:umount.0 00000100:00100000:2.0:1786109741.253758:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109741.255076:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933387264 00000100:00100000:2.0:1786109741.255092:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933387264 00000100:00100000:2.0:1786109741.255164:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23187 00000100:00100000:2.0:1786109741.255174:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933387264:12345-0@lo:9:umount.0 00000020:00000080:2.0:1786109741.255204:0:40692:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca373b2 00000100:00080000:2.0:1786109741.255215:0:40692:0:(import.c:65:import_set_state_nolock()) ffff930ac09cd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786109741.255265:0:40692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705689 00000100:00100000:2.0:1786109741.256215:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3645:x1872862933387264:12345-0@lo:9:umount.0 Request processed in 1037us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109741.256225:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23187 00010000:00010000:2.0:1786109741.256250:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109741.256284:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a715800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1786109741.256291:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1786109741.256293:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786109741.256297:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933387264:0@lo:9:umount.0 00000100:00100000:2.0:1786109741.256307:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933387392:0@lo:9:umount.0 00000100:00100000:2.0:1786109741.258523:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109741.258674:0:43917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933387392 00000100:00100000:0.0:1786109741.258681:0:43917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933387392 00000100:00100000:0.0:1786109741.258728:0:43917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23188 00000100:00100000:0.0:1786109741.258737:0:43917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac16c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3645:x1872862933387392:12345-0@lo:9:umount.0 00000020:00000080:0.0:1786109741.258764:0:43917:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca373c0 00000100:00080000:0.0:1786109741.258773:0:43917:0:(import.c:65:import_set_state_nolock()) ffff930a905fb000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1786109741.258916:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1786109741.259399:0:43917:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975847 00000100:00100000:0.0:1786109741.259580:0:43917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac16c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3645:x1872862933387392:12345-0@lo:9:umount.0 Request processed in 842us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109741.259601:0:43917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23188 00000100:00080000:2.0:1786109741.259918:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a711000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1786109741.259925:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1786109741.259927:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786109741.259931:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab950ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933387392:0@lo:9:umount.0 00000020:00080000:0.0:1786109741.289170:0:200521:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff930ac11b0000) has no exports 00000020:00000080:1.0:1786109741.301696:0:6514:0:(genops.c:906:class_export_put()) final put ffff93098650c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1786109741.302048:0:6515:0:(genops.c:906:class_export_put()) final put ffff930a90aa2800/fac74500-4523-4794-af20-dfdcdfae19c1 00010000:00010000:3.0:1786109741.302074:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109741.302077:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109741.302080:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786109741.302084:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098650c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1786109741.302134:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a90aa2800/fac74500-4523-4794-af20-dfdcdfae19c1 for lustre-MDT0000 00000020:00000080:2.0:1786109741.302160:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098650f800 for lustre-MDT0000 00000020:00000080:2.0:1786109741.302164:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab7c42000 for lustre-MDT0000 00010000:00010000:1.0:1786109741.302920:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109741.302925:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109741.302927:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1786109741.318691:0:198783:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109725/real 1786109725] req@ffff930a97fd5180 x1872862933377408/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2520/4320 e 0 to 1 dl 1786109741 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109741.318724:0:198783:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1786109741.318728:0:198783:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1786109741.318733:0:198783:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1786109741.318756:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00080000:2.0:1786109741.318922:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109741.318926:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109741.318929:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109741.318935:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8552 00000100:00080000:2.0:1786109741.318943:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a8a47d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109741.318961:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930984908380 x1872862933388032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109741.319017:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933387776:0@lo:400:kworker.0 00000100:00100000:2.0:1786109741.319076:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109741.319106:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933388416:0@lo:400:kworker.0 00000100:00100000:2.0:1786109741.319125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109741.319145:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109741.319150:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933387904:0@lo:400:kworker.0 00000100:00100000:2.0:1786109741.319168:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109741.319192:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933387776 00000100:00100000:2.0:1786109741.319199:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933387776 00000100:00100000:2.0:1786109741.319242:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933388416 00000100:00100000:2.0:1786109741.319245:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933388416 00000100:00100000:2.0:1786109741.319255:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933387904 00000100:00100000:2.0:1786109741.319257:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933387904 00000100:00100000:2.0:1786109741.319282:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1786109741.319293:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933387904:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109741.319312:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a89098e00 x1872862933387904/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:251/0 lens 224/224 e 0 to 0 dl 1786109791 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109741.320125:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933387904:12345-0@lo:400:kworker.0 Request processed in 834us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109741.320133:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1786109741.320153:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:2.0:1786109741.320158:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098490b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1872862933387776:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1786109741.320164:0:189813:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1786109741.320188:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098490b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1872862933387776:12345-0@lo:400:kworker.0 Request processed in 28us (1112us total) trans 0 rc -107/-107 00000100:00100000:2.0:1786109741.320193:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:2.0:1786109741.320203:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:2.0:1786109741.320206:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1872862933388416:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1786109741.320211:0:189813:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1786109741.320227:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1872862933388416:12345-0@lo:400:kworker.0 Request processed in 19us (1102us total) trans 0 rc -107/-107 00000100:00100000:2.0:1786109741.320232:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:2.0:1786109741.320278:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933387904:0@lo:400:kworker.0 00000100:00080000:2.0:1786109741.320288:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1786109741.320291:0:3648:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1786109741.320295:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1786109741.320300:0:3648:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109741.320304:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8488 00000100:00080000:2.0:1786109741.320308:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109741.320909:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933387648:0@lo:400:kworker.0 00000100:00100000:1.0:1786109741.320948:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109741.320973:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933388288:0@lo:400:kworker.0 00000100:00100000:1.0:1786109741.320993:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109741.321015:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786109741.321022:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933387520:0@lo:400:kworker.0 00000100:00100000:1.0:1786109741.321042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109741.321060:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933388160:0@lo:400:kworker.0 00000100:00100000:1.0:1786109741.321079:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109741.321121:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933387648 00000100:00100000:1.0:1786109741.321126:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933387648 00000100:00100000:1.0:1786109741.321163:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933387520 00000100:00100000:1.0:1786109741.321166:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933387520 00000100:00100000:1.0:1786109741.321185:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1786109741.321192:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933387648:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109741.321211:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1780380 x1872862933387648/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:251/0 lens 224/224 e 0 to 0 dl 1786109791 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109741.321243:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933387648:12345-0@lo:400:kworker.0 Request processed in 51us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109741.321249:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1786109741.321266:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:1.0:1786109741.321269:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1872862933387520:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1786109741.321274:0:187900:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109741.321296:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1872862933387520:12345-0@lo:400:kworker.0 Request processed in 25us (253us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109741.321302:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00080000:1.0:1786109741.321319:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109741.321330:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933388288 00000100:00100000:1.0:1786109741.321334:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933388288 00000100:00100000:1.0:1786109741.321359:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933388160 00000100:00100000:1.0:1786109741.321361:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933388160 00000100:00100000:1.0:1786109741.321377:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7136 00000100:00100000:1.0:1786109741.321383:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933388288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109741.321413:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933388288:12345-0@lo:400:kworker.0 Request processed in 31us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109741.321419:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7136 00000100:00100000:1.0:1786109741.321446:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7137 00000100:00100000:1.0:1786109741.321453:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933388160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109741.321475:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a8909b100 x1872862933388544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109741.321480:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933388160:12345-0@lo:400:kworker.0 Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109741.321485:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7137 00000100:00100000:2.0:1786109741.321493:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933387776:0@lo:400:kworker.0 00000100:00080000:2.0:1786109741.321512:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786109741.321514:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109741.321516:0:3648:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:1.0:1786109741.321516:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:02000400:2.0:1786109741.321520:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1786109741.321524:0:3648:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109741.321527:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8552 00000100:00080000:1.0:1786109741.321528:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786109741.321531:0:3647:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:2.0:1786109741.321532:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da3000 using connection 192.168.203.138@tcp/0@lo 00000100:02000400:1.0:1786109741.321534:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1786109741.321536:0:3647:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109741.321539:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8488 00000100:00080000:1.0:1786109741.321542:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109741.321549:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac1f52d80 x1872862933388672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109741.321552:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa5c54380 x1872862933388800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109741.321560:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1872862933388416:0@lo:400:kworker.0 00000100:00100000:1.0:1786109741.321561:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933387520:0@lo:400:kworker.0 00000100:00100000:1.0:1786109741.321573:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933388160:0@lo:400:kworker.0 00000100:00100000:1.0:1786109741.321596:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933387648:0@lo:400:kworker.0 00000100:00100000:1.0:1786109741.321607:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933388288:0@lo:400:kworker.0 00000100:00100000:2.0:1786109741.321610:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933388032:0@lo:38:kworker.0 00000100:00100000:2.0:1786109741.321640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109741.321661:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933388544:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1786109741.321671:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933388032 00000100:00100000:1.0:1786109741.321674:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933388032 00000100:00100000:2.0:1786109741.321681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109741.321696:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933388672:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1786109741.321696:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786109741.321700:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1872862933388032:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1786109741.321713:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:1.0:1786109741.321715:0:187905:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1786109741.321743:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933388544 00000100:00100000:2.0:1786109741.321746:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933388544 00000100:00100000:2.0:1786109741.321767:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933388672 00000100:00100000:2.0:1786109741.321770:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933388672 00000100:00100000:2.0:1786109741.321786:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1786109741.321790:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933388544:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1786109741.321799:0:187901:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1786109741.324125:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933388544:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 2324us (2434us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109741.324138:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1786109741.324183:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1786109741.324189:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933388672:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1786109741.324207:0:187901:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1786109741.324235:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933388672:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 45us (2520us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109741.324241:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00010000:00010000:2.0:1786109741.326097:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109741.326158:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109741.326165:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109741.326170:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933388672:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1786109741.326181:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933388800:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1786109741.326228:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109741.326277:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109741.326281:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109741.326284:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933388544:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1786109741.328017:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933388800 00000100:00100000:2.0:1786109741.328028:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933388800 00000100:00100000:2.0:1786109741.328068:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:2.0:1786109741.328075:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933388800:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1786109741.328095:0:188678:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1786109741.328156:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933388800:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 81us (1927us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109741.328162:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00080000:2.0:1786109741.328204:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109741.328208:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109741.328212:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933388800:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1786109741.355932:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109741.355944:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109741.355949:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933388032:0@lo:38:kworker.0 00000100:00100000:1.0:1786109741.357853:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1872862933388032:12345-0@lo:38:kworker.0 Request processed in 36143us (36204us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109741.357866:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000020:00000080:0.0:1786109741.389791:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3736c 00000020:00000080:0.0:1786109741.389805:0:200521:0:(genops.c:906:class_export_put()) final put ffff930ab199c000/lustre-QMT0000_UUID 00000020:01000000:0.0:1786109741.389824:0:200521:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1786109741.389881:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab199c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1786109741.389908:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786109741.389919:0:200521:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1786109741.389922:0:200521:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9309835d3380) has no exports 00000020:00000080:2.0:1786109741.390790:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37365 00000020:00000080:2.0:1786109741.390797:0:200521:0:(genops.c:906:class_export_put()) final put ffff930ac125f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786109741.390853:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786109741.390862:0:200521:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1786109741.390865:0:200521:0:(genops.c:906:class_export_put()) final put ffff9309866c5800/lustre-QMT0000_UUID 00000020:00000080:2.0:1786109741.390867:0:200521:0:(genops.c:865:class_export_destroy()) destroying export ffff9309866c5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1786109741.390873:0:200521:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1786109741.391023:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac125f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1786109741.391219:0:200521:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930a8a6f8ae0 - data ffff930abfa7b6c0/ffff930a87bb6400 00000020:01000000:2.0:1786109741.391351:0:200521:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ab9403360 - data ffff930aa436c870/ffff930ac1438800 00000100:00080000:3.0:1786109741.451285:0:200521:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1786109741.451294:0:200521:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1786109741.451310:0:200521:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff930aa60a1500 x1872862933387136/t30064771143(30064771143) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109751 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109741.451346:0:200521:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1786109741.454203:0:200521:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1786109741.454210:0:200521:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705668 gen 4 00000004:00080000:3.0:1786109741.454258:0:200521:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109741.454260:0:200521:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1786109741.454952:0:196411:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1786109741.454957:0:196411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x140:0x0] index 1 count 1 00000040:00080000:3.0:1786109741.454966:0:196411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 80 count 2 00000100:00080000:0.0:1786109741.455524:0:200521:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1786109741.455528:0:200521:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975826 gen 4 00000004:00080000:0.0:1786109741.455538:0:200521:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109741.455540:0:200521:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1786109741.455829:0:196413:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1786109741.455833:0:196413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x142:0x0] index 1 count 1 00000040:00080000:1.0:1786109741.455843:0:196413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 80 count 2 00000020:00000080:0.0:1786109741.456669:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37326 00000020:00000080:0.0:1786109741.456679:0:200521:0:(genops.c:906:class_export_put()) final put ffff93098c88a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786109741.457192:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3733b 00000020:00000080:0.0:1786109741.457197:0:200521:0:(genops.c:906:class_export_put()) final put ffff930a90aa3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1786109741.457202:0:200521:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1786109741.457206:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109741.457215:0:200521:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786109741.457219:0:200521:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9309824819c0) has no exports 00000004:01000000:0.0:1786109741.457355:0:200521:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1786109741.457363:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca373b9 00000020:00000080:0.0:1786109741.457366:0:200521:0:(genops.c:906:class_export_put()) final put ffff930ab2a23800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1786109741.457369:0:200521:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1786109741.457372:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109741.457377:0:200521:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1786109741.457380:0:200521:0:(genops.c:1579:class_disconnect_exports()) OBD device 19 (ffff930a97cbb380) has no exports 00000020:00000080:0.0:1786109741.457384:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca373ab 00000020:00000080:0.0:1786109741.457386:0:200521:0:(genops.c:906:class_export_put()) final put ffff930a901fc800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1786109741.457507:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098c88a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1786109741.457515:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a90aa3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1786109741.457519:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2a23800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1786109741.457523:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a901fc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1786109741.457854:0:200521:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1786109741.457859:0:200521:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1786109741.457862:0:200521:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975826 gen 5 00000004:00080000:0.0:1786109741.457867:0:200521:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109741.457869:0:200521:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786109741.457947:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109741.457954:0:200521:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109741.457960:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3739d 00000020:00000080:0.0:1786109741.457965:0:200521:0:(genops.c:906:class_export_put()) final put ffff930ab2a26800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786109741.458307:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a8a711000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1786109741.458315:0:192991:0:(genops.c:906:class_export_put()) final put ffff930ab2a25800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786109741.458318:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2a25800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1786109741.458323:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1786109741.458642:0:200521:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1786109741.458707:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109741.458715:0:200521:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786109741.458718:0:200521:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff930a97cb99c0) has no exports 00000020:00000080:3.0:1786109741.458723:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37396 00000020:00000080:3.0:1786109741.458727:0:200521:0:(genops.c:906:class_export_put()) final put ffff930a901f9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1786109741.458750:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2a26800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1786109741.459337:0:200521:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1786109741.459341:0:200521:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1786109741.459344:0:200521:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705668 gen 5 00000004:00080000:3.0:1786109741.459349:0:200521:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786109741.459351:0:200521:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786109741.459693:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a901f9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1786109741.459809:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109741.459819:0:200521:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1786109741.459831:0:200521:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1786109741.459837:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37381 00000020:00000080:3.0:1786109741.459842:0:200521:0:(genops.c:906:class_export_put()) final put ffff930985f20800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786109741.459867:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a8a715800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1786109741.459873:0:192991:0:(genops.c:906:class_export_put()) final put ffff930985f26800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786109741.459876:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930985f26800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1786109741.459881:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1786109741.460276:0:200521:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1786109741.460281:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786109741.460288:0:200521:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786109741.460292:0:200521:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff930a97cbcd40) has no exports 00000020:00000080:3.0:1786109741.460296:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca3737a 00000020:00000080:3.0:1786109741.460301:0:200521:0:(genops.c:906:class_export_put()) final put ffff930985f21800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1786109741.460607:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930985f20800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1786109741.461398:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930985f21800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1786109741.468522:0:200521:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1786109741.468530:0:200521:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1786109741.468535:0:200521:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1786109741.468541:0:200521:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786109741.468641:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109741.468654:0:200521:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109741.468699:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109741.468703:0:200521:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109741.468709:0:200521:0:(genops.c:906:class_export_put()) final put ffff930983750000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786109741.468714:0:200521:0:(genops.c:865:class_export_destroy()) destroying export ffff930983750000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1786109741.468720:0:200521:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786109741.468820:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37342 00000020:00000080:0.0:1786109741.468829:0:200521:0:(genops.c:906:class_export_put()) final put ffff930a90aa3000/lustre-MDD0000_UUID 00000020:00000080:1.0:1786109741.468952:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930985f23800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1786109741.468960:0:192991:0:(genops.c:906:class_export_put()) final put ffff930985f25800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786109741.468962:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930985f25800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1786109741.468967:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1786109741.469200:0:200521:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1786109741.469206:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109741.469212:0:200521:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786109741.469216:0:200521:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9309835d0000) has no exports 00000020:00000080:0.0:1786109741.469240:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109741.469245:0:200521:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1786109741.469249:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37349 00000020:00000080:0.0:1786109741.469254:0:200521:0:(genops.c:906:class_export_put()) final put ffff930a90aa6000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1786109741.469263:0:200521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930ab282d000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1786109741.469266:0:200521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab282d000 3 00000020:01000004:0.0:1786109741.469269:0:200521:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff930ab282d000 from lustre-MDT0000 00000020:00000080:0.0:1786109741.469289:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109741.469293:0:200521:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1786109741.469296:0:200521:0:(genops.c:906:class_export_put()) final put ffff93098c88d800/lustre-MDT0000_UUID 00000020:00000080:0.0:1786109741.469297:0:200521:0:(genops.c:865:class_export_destroy()) destroying export ffff93098c88d800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1786109741.469305:0:200521:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1786109741.469341:0:200521:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1786109741.469344:0:200521:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1786109741.469347:0:200521:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1786109741.469350:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109741.469352:0:200521:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1786109741.469358:0:200521:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff930ab29d1000 aeab97cc-8463-4daa-a678-1bb2ad93cc69 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786109741.469365:0:200521:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff930ac0b7d000 4929093a-da1f-45c7-90e6-dcd2fb5a5df4 192.168.203.38@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786109741.469370:0:200521:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff930982480000) has exports, disconnecting them 00000020:00080000:0.0:1786109741.469374:0:200521:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff930ab29d1000), last request at 1786109626 00000020:00000080:0.0:1786109741.469396:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca372e7 00000020:00010000:0.0:1786109741.469401:0:200521:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930ab29d1000: total 2 00000100:00080000:0.0:1786109741.469405:0:200521:0:(import.c:65:import_set_state_nolock()) ffff930ab29d1800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786109741.469421:0:200521:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab29d1000): rc 0 00000020:00080000:0.0:1786109741.469425:0:200521:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.38@tcp (ffff930ac0b7d000), last request at 1786109623 00000020:00000080:0.0:1786109741.469481:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca372c4 00000020:00010000:0.0:1786109741.469485:0:200521:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930ac0b7d000: total 2 00000100:00080000:0.0:1786109741.469487:0:200521:0:(import.c:65:import_set_state_nolock()) ffff930983755800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786109741.469497:0:200521:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.38@tcp (ffff930ac0b7d000): rc 0 00000020:00080000:0.0:1786109741.469501:0:200521:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff930982480000) has no exports 00000100:00100000:0.0:1786109741.469549:0:196398:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff930ab2cf4200:196398] 1 exiting: rc = 0 00000100:00100000:1.0:1786109741.469644:0:196397:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff930981d43a00:196397] 0 exiting: rc = 1 00000020:00000080:1.0:1786109741.469704:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a90aa3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1786109741.469709:0:192991:0:(genops.c:906:class_export_put()) final put ffff93098c88b800/lustre-MDD0000_UUID 00000020:00000080:1.0:1786109741.469711:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098c88b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1786109741.469714:0:192991:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1786109741.469755:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930a90aa6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1786109741.469874:0:10402:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930ab29d1000: total 0 00010000:00010000:2.0:1786109741.469913:0:10402:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930ab29d1000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1786109741.469942:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6cc00/0xdb52b77d7ca374ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca374a7 expref: 14 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.469959:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6c200/0xdb52b77d7ca3743e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37437 expref: 13 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.469971:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6d200/0xdb52b77d7ca374bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca374b5 expref: 12 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.469982:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930986424600/0xdb52b77d7ca37f5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37f58 expref: 11 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.469999:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6ce00/0xdb52b77d7ca3744c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37445 expref: 10 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470009:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9452600/0xdb52b77d7ca37f6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37f66 expref: 9 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470020:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f07200/0xdb52b77d7ca3802a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca38023 expref: 8 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470030:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9453600/0xdb52b77d7ca374d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca374d1 expref: 7 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470039:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930986425600/0xdb52b77d7ca3801c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca38015 expref: 6 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470050:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930986424a00/0xdb52b77d7ca3805b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca38054 expref: 5 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470060:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166c800/0xdb52b77d7ca374ca lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca374c3 expref: 4 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470073:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab8f6d800/0xdb52b77d7ca37430 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37429 expref: 3 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470083:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166d600/0xdb52b77d7ca374a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca37499 expref: 2 pid: 196398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470096:0:10402:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930ab29d1000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1786109741.470112:0:10402:0:(genops.c:906:class_export_put()) final put ffff930ab29d1000/aeab97cc-8463-4daa-a678-1bb2ad93cc69 00000020:00010000:2.0:1786109741.470163:0:10402:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930ac0b7d000: total 1 00010000:00010000:2.0:1786109741.470166:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109741.470184:0:10402:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930ac0b7d000, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1786109741.470199:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac1f38200/0xdb52b77d7ca372d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a165f expref: 5 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470211:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac1f38400/0xdb52b77d7ca372e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a166d expref: 4 pid: 196399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470222:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930986424200/0xdb52b77d7ca3804d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a17bd expref: 3 pid: 196404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470233:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a8166c200/0xdb52b77d7ca372d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1666 expref: 2 pid: 196397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109741.470242:0:10402:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930ac0b7d000, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1786109741.470250:0:10402:0:(genops.c:906:class_export_put()) final put ffff930ac0b7d000/4929093a-da1f-45c7-90e6-dcd2fb5a5df4 00000020:00000080:1.0:1786109741.470273:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab29d1000/aeab97cc-8463-4daa-a678-1bb2ad93cc69 for MGS 00000020:00000080:1.0:1786109741.470304:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab29d1800 for MGS 00010000:00010000:2.0:1786109741.470570:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109741.470572:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109741.470574:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109741.470612:0:196399:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff930ab7ef2000:196399] 2 exiting: rc = 0 00000100:00100000:2.0:1786109741.470680:0:196404:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff930ab8c12400:196404] 3 exiting: rc = 0 00000020:00000080:0.0:1786109741.470921:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0b7d000/4929093a-da1f-45c7-90e6-dcd2fb5a5df4 for MGS 00000020:00000080:0.0:1786109741.470943:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930983755800 for MGS 00000100:00100000:0.0:1786109741.470978:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.470986:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.470992:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.470997:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471003:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471008:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471014:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471020:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471025:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471030:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471035:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471041:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471046:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471054:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471061:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471068:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471074:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471079:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471084:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471089:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471094:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471100:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471104:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471110:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471116:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471121:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471126:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471131:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471136:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471141:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471146:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471153:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471158:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471163:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471170:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471175:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471181:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471187:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471192:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471197:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471202:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471207:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471213:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471218:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471223:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471229:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471235:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471241:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471247:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471253:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471258:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471263:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471269:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471274:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471280:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471285:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471290:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471295:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471301:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471306:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471312:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471318:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471324:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786109741.471329:0:200521:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1786109741.473076:0:200521:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930985650360 - data ffff93098a037e58/ffff930ab2e8b000 00000020:01000000:1.0:1786109741.473190:0:200521:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff930ab9403180 - data ffff930abfa48af8/ffff930983c8e000 00000020:00000080:1.0:1786109741.473631:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca372bd 00000020:00000080:1.0:1786109741.473639:0:200521:0:(genops.c:906:class_export_put()) final put ffff930ab99c1800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1786109741.473652:0:200521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930ab282d000 from MGS, refs=2 00000020:01000004:1.0:1786109741.473655:0:200521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab282d000 2 00000020:01000004:1.0:1786109741.473658:0:200521:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff930ab282d000 from MGS 00000020:00000080:1.0:1786109741.473680:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109741.473687:0:200521:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1786109741.473689:0:200521:0:(genops.c:906:class_export_put()) final put ffff930ab99c6000/MGS 00000020:00000080:1.0:1786109741.473692:0:200521:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab99c6000/MGS for MGS 00000020:01000000:1.0:1786109741.473697:0:200521:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1786109741.473761:0:200521:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1786109741.473764:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109741.473771:0:200521:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1786109741.473778:0:200521:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff930ab2abd800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786109741.473784:0:200521:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff930a97cb8000) has exports, disconnecting them 00000020:00080000:1.0:1786109741.473788:0:200521:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff930ab2abd800), last request at 1786109626 00000020:00000080:1.0:1786109741.473792:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca373f8 00000020:00080000:1.0:1786109741.473801:0:200521:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ab2abd800): rc 0 00000020:00000080:1.0:1786109741.473806:0:200521:0:(genops.c:906:class_export_put()) final put ffff930ab2abd800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1786109741.474462:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab99c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786109741.474470:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2abd800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1786109741.483489:0:200521:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1786109741.483499:0:200521:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109741.483503:0:200521:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1786109741.483511:0:200521:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786109741.483540:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab2ab9000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1786109741.483686:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109741.483697:0:200521:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1786109741.483702:0:200521:0:(genops.c:906:class_export_put()) final put ffff930ab2a20800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1786109741.483705:0:200521:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2a20800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1786109741.483716:0:200521:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1786109741.483806:0:200521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab282d000 1 00000020:00000080:0.0:1786109741.483812:0:200521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca372af 00000020:00000080:0.0:1786109741.483819:0:200521:0:(genops.c:906:class_export_put()) final put ffff930ab99c2800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1786109741.483827:0:200521:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1786109741.483834:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab99c2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786109741.483844:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109741.483847:0:200521:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1786109741.483851:0:200521:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff930985210000) has no exports 00010000:00010000:3.0:1786109741.486763:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786109741.529632:0:200521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109741.529645:0:200521:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1786109741.529652:0:200521:0:(genops.c:906:class_export_put()) final put ffff930ab2828800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786109741.529656:0:200521:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2828800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1786109741.529665:0:200521:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1786109741.529792:0:200521:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff930ab282e800 00000020:02000400:0.0:1786109741.529850:0:200521:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1786109742.352355:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933389056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109742.353243:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00100000:2.0:1786109742.353347:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933388928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109742.353519:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109742.353559:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933388928 00000100:00100000:0.0:1786109742.353571:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933388928 00000100:00100000:0.0:1786109742.353921:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5963 00000100:00100000:0.0:1786109742.353935:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933388928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109742.353975:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109742.354045:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933388928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109742.354117:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109742.354138:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5963 00000100:00100000:2.0:1786109742.354221:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933388928:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1786109742.355490:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109742.359567:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933389056 00000100:00100000:0.0:1786109742.359601:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933389056 00000100:00100000:0.0:1786109742.359680:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5964 00000100:00100000:0.0:1786109742.359694:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933389056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109742.359741:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109742.359942:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933389056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 250us (6134us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109742.359950:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5964 00000100:00100000:1.0:1786109742.361164:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933389056:0@lo:13:osp-pre-0-1.0 00000400:00000100:2.0:1786109743.143306:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922184320 offset 0 length 224: 4 00000100:00100000:2.0:1786109743.205765:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109743.205819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109743.205952:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109743.205987:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109743.206024:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922184704 00000100:00100000:2.0:1786109743.206037:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922184704 00000100:00100000:3.0:1786109743.206066:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922184832 00000100:00100000:3.0:1786109743.206080:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922184832 00000100:00100000:3.0:1786109743.206149:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7138 00000100:00100000:3.0:1786109743.206163:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922184832:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109743.206193:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7139 00000100:00100000:2.0:1786109743.206209:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922184704:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109743.206251:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922184832:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 88us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109743.206260:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7138 00000100:00100000:2.0:1786109743.206275:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922184704:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 69us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109743.206286:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7139 00000100:00100000:0.0:1786109743.206375:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922184448 00000100:00100000:0.0:1786109743.206382:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922184448 00000100:00100000:0.0:1786109743.206533:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922184576 00000100:00100000:0.0:1786109743.206537:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922184576 00000100:00100000:0.0:1786109743.206584:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 457 00000100:00100000:0.0:1786109743.206596:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2403:x1872862922184576:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:0.0:1786109743.206617:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7c52d80 x1872862922184576/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:253/0 lens 224/224 e 0 to 0 dl 1786109793 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109743.206733:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2403:x1872862922184576:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 140us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109743.206740:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 457 00000100:00100000:0.0:1786109743.206757:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1278 00000100:00100000:0.0:1786109743.206762:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1872862922184448:12345-192.168.203.38@tcp:400:kworker.0 00000020:00080000:0.0:1786109743.206768:0:187900:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.38@tcp 00000100:00100000:0.0:1786109743.206796:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1872862922184448:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 33us (1049us total) trans 0 rc -107/-107 00000100:00100000:0.0:1786109743.206804:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1278 00000100:00080000:0.0:1786109743.206846:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786109743.206852:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109743.206854:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109743.227303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109743.228306:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922184960 00000100:00100000:3.0:1786109743.228322:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922184960 00000100:00100000:3.0:1786109743.228450:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1279 00000100:00100000:3.0:1786109743.228463:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922184960:12345-192.168.203.38@tcp:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1786109743.228493:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109743.229187:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922184960:12345-192.168.203.38@tcp:38:ptlrpcd_00_01.0 Request processed in 720us (1893us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109743.229203:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1279 00010000:00010000:1.0:1786109743.365648:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109743.371986:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00100000:1.0:1786109744.389518:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:3.0:1786109744.395131:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109745.412654:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109745.413502:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00080000:2.0:1786109746.436861:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109746.436872:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109746.436877:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109746.436888:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8597 00000100:00080000:2.0:1786109746.436896:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109746.436906:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109746.436940:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930984908700 x1872862933389312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109746.437394:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109746.437422:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933389184:0@lo:400:kworker.0 00000400:00000100:0.0:1786109746.437523:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933389184 offset 0 length 224: 4 00000100:00100000:3.0:1786109746.443638:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933389312:0@lo:38:kworker.0 00000100:00100000:3.0:1786109746.443752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109746.443797:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109746.443804:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109746.443808:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109746.443816:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8597 00000100:00080000:2.0:1786109746.443823:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109746.443832:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109746.443862:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac17bc380 x1872862933389568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109746.443885:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109746.443889:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109746.443891:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109746.443896:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8597 00000100:00080000:2.0:1786109746.443899:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109746.443903:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a8a47d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109746.443919:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930982e53100 x1872862933389824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109746.443956:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109746.443960:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109746.443962:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109746.443966:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8597 00000100:00080000:2.0:1786109746.443969:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109746.443973:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da3000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109746.443984:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930982e53b80 x1872862933390208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109746.444018:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933389440:0@lo:400:kworker.0 00000100:00100000:2.0:1786109746.444060:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933389696:0@lo:400:kworker.0 00000100:00100000:2.0:1786109746.444098:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933389952:0@lo:400:kworker.0 00000100:00100000:2.0:1786109746.444129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109746.444192:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109746.444198:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933390080:0@lo:400:kworker.0 00000100:00100000:2.0:1786109746.444222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109746.444369:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933389952 00000100:00100000:2.0:1786109746.444380:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933389952 00000100:00100000:2.0:1786109746.444479:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933390080 00000100:00100000:2.0:1786109746.444487:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933390080 00000100:00100000:2.0:1786109746.444520:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7140 00000100:00100000:2.0:1786109746.444535:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933389952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109746.444600:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933389568:0@lo:38:kworker.0 00000100:00100000:2.0:1786109746.444614:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933389952:12345-0@lo:400:kworker.0 Request processed in 83us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109746.444623:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7140 00000100:00100000:3.0:1786109746.444636:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109746.444647:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7141 00000100:00100000:2.0:1786109746.444656:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933390080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109746.444694:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933389824:0@lo:38:kworker.0 00000100:00100000:3.0:1786109746.444721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109746.444751:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933390208:0@lo:38:kworker.0 00000100:00100000:2.0:1786109746.444775:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933390080:12345-0@lo:400:kworker.0 Request processed in 120us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109746.444786:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7141 00000100:00100000:3.0:1786109746.444787:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109746.444815:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109746.444821:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109746.445653:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00100000:0.0:1786109746.445840:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933389824 00000100:00100000:0.0:1786109746.445847:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933389824 00000100:00100000:0.0:1786109746.445892:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786109746.445900:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1872862933389824:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109746.445925:0:199402:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109746.445983:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1872862933389824:12345-0@lo:38:kworker.0 Request processed in 82us (1260us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109746.445990:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786109746.446110:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933390080:0@lo:400:kworker.0 00000100:00100000:0.0:1786109746.446126:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933389952:0@lo:400:kworker.0 00000100:00100000:1.0:1786109746.446235:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933389312 00000100:00100000:1.0:1786109746.446242:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933389312 00000100:00100000:1.0:1786109746.446285:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933389568 00000100:00100000:1.0:1786109746.446288:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933389568 00000100:00100000:1.0:1786109746.446309:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1786109746.446315:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa66ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933389312:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109746.446327:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109746.446371:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa66ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933389312:12345-0@lo:38:kworker.0 Request processed in 55us (2621us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109746.446378:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00080000:3.0:1786109746.446700:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109746.446707:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109746.446710:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933389312:0@lo:38:kworker.0 00000100:00100000:2.0:1786109746.446729:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933390208 00000100:00080000:3.0:1786109746.446735:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1786109746.446736:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933390208 00000100:00080000:3.0:1786109746.446742:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109746.446746:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933389824:0@lo:38:kworker.0 00000100:00100000:1.0:1786109746.448599:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:0.0:1786109746.448694:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1786109746.448705:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933390208:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109746.448735:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109746.448827:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109746.448845:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933390208:12345-0@lo:38:kworker.0 Request processed in 139us (4059us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109746.448854:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1786109746.448879:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933389440 00000100:00100000:0.0:1786109746.448887:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933389440 00000100:00100000:2.0:1786109746.448918:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109746.449661:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309852ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933389568:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109746.450081:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109746.450391:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309852ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933389568:12345-0@lo:38:kworker.0 Request processed in 732us (5755us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109746.450607:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1786109746.450642:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933389696 00000100:00100000:1.0:1786109746.450651:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933389696 00000100:00100000:2.0:1786109746.450946:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1786109746.450960:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933389440:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109746.450993:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930982e53100 x1872862933389440/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:217/0 lens 224/224 e 0 to 0 dl 1786109757 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109746.451058:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933389440:12345-0@lo:400:kworker.0 Request processed in 103us (2233us total) trans 0 rc 0/0 00000100:00080000:0.0:1786109746.451135:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109746.451757:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1786109746.452224:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933389440:0@lo:400:kworker.0 00000100:00080000:3.0:1786109746.459788:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109746.459807:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109746.460496:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933389568:0@lo:38:kworker.0 00000100:00080000:3.0:1786109746.460520:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109746.460524:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109746.460527:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933390208:0@lo:38:kworker.0 00000100:00100000:1.0:1786109746.460699:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1786109746.460724:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933389696:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109746.460765:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930982e50a80 x1872862933389696/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:217/0 lens 224/224 e 0 to 0 dl 1786109757 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109746.460876:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933389696:12345-0@lo:400:kworker.0 Request processed in 166us (11957us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109746.460884:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00010000:00010000:3.0:1786109746.463326:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109746.463778:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933389696:0@lo:400:kworker.0 00000001:00100000:1.0:1786109747.463068:0:198777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1786109747.463087:0:198777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 30064771143 is committed 00000020:00000080:1.0:1786109747.463093:0:198777:0:(genops.c:906:class_export_put()) final put ffff930ab1996800/lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1786109747.464003:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109747.464038:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933390336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109747.464132:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109747.464192:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933390336 00000100:00100000:3.0:1786109747.464202:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933390336 00000100:00100000:3.0:1786109747.464263:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5965 00000100:00100000:3.0:1786109747.464273:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933390336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109747.464325:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109747.464414:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933390336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 142us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109747.464422:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5965 00000100:00100000:3.0:1786109747.464557:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933390336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109747.466221:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109747.466255:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309851f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933390464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109747.466347:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109747.468234:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000020:00000080:2.0:1786109747.468762:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab1996800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1786109747.468836:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac1364000 for lustre-MDT0001 00000100:00100000:2.0:1786109747.468909:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933390464 00000100:00100000:2.0:1786109747.468922:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933390464 00000001:00100000:3.0:1786109747.468931:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786109747.468939:0:9518:0:(genops.c:906:class_export_put()) final put ffff930ab199f800/lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1786109747.469003:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5966 00000100:00100000:2.0:1786109747.469016:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab950ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933390464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109747.469067:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109747.469176:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab950ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933390464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (2828us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109747.469183:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5966 00000100:00100000:2.0:1786109747.469258:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309851f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933390464:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1786109747.469636:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab199f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000001:00100000:2.0:1786109747.469653:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786109747.469656:0:194579:0:(genops.c:906:class_export_put()) final put ffff930ac09cf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786109747.469677:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a905fb000 for lustre-OST0001 00000020:00000080:0.0:1786109747.469682:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac09cf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1786109747.469712:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac09cd800 for lustre-OST0000 00010000:00010000:1.0:1786109747.525933:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109748.241634:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109748.241721:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922185216 00000100:00100000:0.0:1786109748.241735:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922185216 00000100:00100000:0.0:1786109748.241801:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1283 00000100:00100000:0.0:1786109748.241813:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309851f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922185216:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:0.0:1786109748.241844:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000400:00000100:3.0:1786109748.242517:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922185088 offset 0 length 224: 4 00000100:00100000:0.0:1786109748.242601:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309851f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922185216:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 787us (981us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109748.242612:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1283 00000100:00100000:3.0:1786109748.242623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109748.242784:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109748.242904:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922185344 00000100:00100000:0.0:1786109748.242911:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922185344 00000100:00100000:3.0:1786109748.244074:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109748.244335:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 460 00000100:00100000:0.0:1786109748.244360:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2403:x1872862922185344:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:0.0:1786109748.244472:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984908700 x1872862922185344/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:219/0 lens 224/224 e 0 to 0 dl 1786109759 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109748.244553:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2403:x1872862922185344:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 203us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109748.244562:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 460 00000100:00080000:0.0:1786109748.244606:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109748.247733:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922185600 00000100:00100000:2.0:1786109748.247753:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922185600 00000100:00100000:2.0:1786109748.248001:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922185472 00000100:00100000:2.0:1786109748.248006:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922185472 00000100:00100000:3.0:1786109748.248067:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7142 00000100:00100000:3.0:1786109748.248084:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922185600:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109748.248266:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922185600:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 186us (5481us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109748.248350:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7142 00000100:00080000:1.0:1786109748.250593:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109748.250605:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109748.251048:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7143 00000100:00100000:2.0:1786109748.251068:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922185472:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109748.252527:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922185472:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1454us (8448us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109748.252767:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7143 00000100:00100000:0.0:1786109748.484851:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:3.0:1786109748.548899:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109749.508724:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:3.0:1786109749.572637:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109750.534069:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:3.0:1786109750.596599:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109751.556706:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109751.556717:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109751.556721:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109751.556732:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8603 00000100:00080000:2.0:1786109751.556740:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109751.556750:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109751.556781:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930982e53b80 x1872862933390720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109751.556813:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109751.556816:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109751.556818:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109751.556822:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8603 00000100:00080000:2.0:1786109751.556825:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109751.556829:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109751.556840:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac173df80 x1872862933390976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109751.556857:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00080000:2.0:1786109751.556871:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109751.556876:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109751.556878:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109751.556883:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8603 00000100:00080000:2.0:1786109751.556886:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109751.556890:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a8a47d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109751.556918:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac173c000 x1872862933391232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109751.556929:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933391104:0@lo:400:kworker.0 00000100:00080000:2.0:1786109751.556948:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109751.556952:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109751.556954:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109751.556959:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8603 00000100:00080000:2.0:1786109751.556963:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109751.556968:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da3000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109751.556980:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933390592:0@lo:400:kworker.0 00000100:00100000:2.0:1786109751.556985:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab94c5f80 x1872862933391616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109751.557025:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933390720:0@lo:38:kworker.0 00000400:00000100:3.0:1786109751.557026:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933390592 offset 0 length 224: 4 00000100:00100000:0.0:1786109751.557034:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109751.557081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109751.557094:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933391488:0@lo:400:kworker.0 00000100:00100000:2.0:1786109751.557114:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933390976:0@lo:38:kworker.0 00000100:00100000:1.0:1786109751.557128:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933390848:0@lo:400:kworker.0 00000100:00100000:3.0:1786109751.557134:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109751.557175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109751.557183:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933391360:0@lo:400:kworker.0 00000100:00100000:1.0:1786109751.557204:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933391104 00000100:00100000:2.0:1786109751.557211:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac173c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933391232:0@lo:38:kworker.0 00000100:00100000:1.0:1786109751.557215:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933391104 00000100:00100000:3.0:1786109751.557221:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109751.557250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109751.557272:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933391488 00000100:00100000:3.0:1786109751.557279:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933391488 00000100:00100000:2.0:1786109751.557279:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933391616:0@lo:38:kworker.0 00000100:00100000:1.0:1786109751.557284:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933390720 00000100:00100000:1.0:1786109751.557289:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933390720 00000100:00100000:2.0:1786109751.557313:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109751.557314:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933390976 00000100:00100000:1.0:1786109751.557319:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933390976 00000100:00100000:3.0:1786109751.557332:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933391360 00000100:00100000:1.0:1786109751.557336:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933391616 00000100:00100000:3.0:1786109751.557337:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933391360 00000100:00100000:1.0:1786109751.557342:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933391616 00000100:00100000:1.0:1786109751.557365:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1786109751.557375:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1786109751.557381:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7144 00000100:00100000:1.0:1786109751.557382:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933391104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109751.557388:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933390720:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1786109751.557396:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933391488:12345-0@lo:400:kworker.0 00010000:00020000:2.0:1786109751.557414:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00000080:1.0:1786109751.557416:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac17bf800 x1872862933391104/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:222/0 lens 224/224 e 0 to 0 dl 1786109762 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109751.557493:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933391488:12345-0@lo:400:kworker.0 Request processed in 101us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109751.557504:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7144 00000100:00100000:2.0:1786109751.557506:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933390720:12345-0@lo:38:kworker.0 Request processed in 116us (422us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109751.557507:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933391104:12345-0@lo:400:kworker.0 Request processed in 130us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109751.557537:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1786109751.557541:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7145 00000100:00100000:3.0:1786109751.557550:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab911b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933391360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109751.557590:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab911b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933391360:12345-0@lo:400:kworker.0 Request processed in 41us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109751.557597:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7145 00000100:00100000:0.0:1786109751.557603:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933391104:0@lo:400:kworker.0 00000100:00100000:3.0:1786109751.557637:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933391360:0@lo:400:kworker.0 00000100:00100000:0.0:1786109751.557655:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933391232 00000100:00100000:0.0:1786109751.557661:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933391232 00000100:00100000:3.0:1786109751.557669:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933391488:0@lo:400:kworker.0 00000100:00080000:3.0:1786109751.557704:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109751.557709:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109751.557712:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933390720:0@lo:38:kworker.0 00000100:00100000:0.0:1786109751.557743:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786109751.557751:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1872862933391232:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109751.557763:0:199402:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109751.557799:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1872862933391232:12345-0@lo:38:kworker.0 Request processed in 48us (549us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109751.557806:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1786109751.557836:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109751.557840:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109751.557844:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933391232:0@lo:38:kworker.0 00000100:00100000:1.0:1786109751.562492:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1786109751.562576:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:1.0:1786109751.562588:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933390976:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109751.562620:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109751.562753:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933390976:12345-0@lo:38:kworker.0 Request processed in 165us (5587us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109751.562761:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:1.0:1786109751.562776:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1786109751.562782:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933391616:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109751.562793:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109751.562826:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933391616:12345-0@lo:38:kworker.0 Request processed in 43us (5515us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109751.562832:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00080000:2.0:1786109751.562851:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109751.562862:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109751.562866:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109751.562875:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109751.562898:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933390848 00000100:00100000:0.0:1786109751.563160:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933390848 00000100:00080000:2.0:1786109751.563213:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109751.563220:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109751.563225:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933390976:0@lo:38:kworker.0 00000100:00100000:0.0:1786109751.563238:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1786109751.563246:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933390848:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786109751.563274:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00000080:0.0:1786109751.563280:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930aa5c56680 x1872862933390848/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:222/0 lens 224/224 e 0 to 0 dl 1786109762 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109751.567722:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933390848:12345-0@lo:400:kworker.0 Request processed in 4462us (4833us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109751.567742:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1786109751.567756:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac173fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933390848:0@lo:400:kworker.0 00000100:00080000:2.0:1786109751.567769:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109751.567779:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109751.567783:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab94c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933391616:0@lo:38:kworker.0 00010000:00010000:1.0:1786109751.620778:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109752.580724:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00100000:3.0:1786109752.580735:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109752.580761:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9119c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933391744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109752.580764:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933391872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109752.580943:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109752.581083:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933391872 00000100:00100000:1.0:1786109752.581093:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933391872 00000100:00100000:2.0:1786109752.581152:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109752.581232:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933391744 00000100:00100000:1.0:1786109752.581236:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933391744 00000100:00100000:2.0:1786109752.581252:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5967 00000100:00100000:2.0:1786109752.581267:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933391872:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109752.581286:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5968 00000100:00100000:1.0:1786109752.581296:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933391744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109752.581312:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715072 pending 0 free 3923472384 avail 3691950080 00002000:00000024:1.0:1786109752.581319:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8578624 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109752.581380:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933391744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109752.581388:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5968 00000100:00100000:2.0:1786109752.581393:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933391872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109752.581402:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5967 00000100:00100000:0.0:1786109752.581517:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9119c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933391744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109752.581519:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933391872:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1786109752.644765:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1786109753.361710:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922185728 offset 0 length 224: 4 00000100:00100000:3.0:1786109753.363060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109753.363102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109753.363257:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922185984 00000100:00100000:1.0:1786109753.363273:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922185984 00000100:00100000:3.0:1786109753.363278:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109753.363318:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109753.363346:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922186112 00000100:00100000:3.0:1786109753.363351:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922186112 00000100:00100000:1.0:1786109753.363371:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922185856 00000100:00100000:1.0:1786109753.363376:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922185856 00000100:00100000:3.0:1786109753.363390:0:43914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922186240 00000100:00100000:3.0:1786109753.363395:0:43914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922186240 00000100:00100000:1.0:1786109753.363408:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 463 00000100:00100000:1.0:1786109753.363425:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922185984:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109753.363426:0:43914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23189 00000100:00100000:3.0:1786109753.363470:0:43914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fac74500-4523-4794-af20-dfdcdfae19c1+5:2401:x1872862922186112:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:3.0:1786109753.363522:0:43914:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca381c0 00000100:00080000:3.0:1786109753.363533:0:43914:0:(import.c:65:import_set_state_nolock()) ffff93098650a800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1786109753.363566:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23190 00000100:00100000:0.0:1786109753.363580:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fac74500-4523-4794-af20-dfdcdfae19c1+5:2401:x1872862922186240:12345-192.168.203.38@tcp:9:kworker.0 00000001:00000004:3.0:1786109753.363586:0:43914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705689 00000020:00000080:0.0:1786109753.363599:0:9990:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca381c7 00000100:00080000:0.0:1786109753.363624:0:9990:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786109753.363674:0:9990:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975847 00010000:00000080:1.0:1786109753.363794:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9119500 x1872862922185984/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:224/0 lens 224/224 e 0 to 0 dl 1786109764 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109753.363816:0:43914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fac74500-4523-4794-af20-dfdcdfae19c1+2:2401:x1872862922186112:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 346us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109753.363825:0:43914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23189 00000100:00100000:1.0:1786109753.363835:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922185984:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 416us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109753.363845:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 463 00000100:00100000:3.0:1786109753.363856:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1287 00000100:00100000:3.0:1786109753.363862:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922185856:12345-192.168.203.38@tcp:38:kworker.0 00000100:00080000:1.0:1786109753.363874:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109753.363880:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109753.363884:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00020000:3.0:1786109753.363886:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109753.363925:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922185856:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 61us (822us total) trans 0 rc -19/-19 00010000:00010000:1.0:1786109753.363930:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109753.363934:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1287 00010000:00010000:3.0:1786109753.363974:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109753.364192:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fac74500-4523-4794-af20-dfdcdfae19c1+2:2401:x1872862922186240:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 615us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109753.364200:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23190 00000100:00100000:2.0:1786109753.604975:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:1.0:1786109753.669133:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109754.628801:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:0.0:1786109754.728831:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109755.657846:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:0.0:1786109755.783991:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109756.676715:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00080000:1.0:1786109756.677625:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109756.677631:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109756.677634:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109756.677642:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8608 00000100:00080000:1.0:1786109756.677649:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1786109756.677655:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109756.677677:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa5c57b80 x1872862933392128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109756.677848:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933392000:0@lo:400:kworker.0 00000400:00000100:2.0:1786109756.677900:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933392000 offset 0 length 224: 4 00000100:00080000:1.0:1786109756.678016:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109756.678020:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109756.678022:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109756.678026:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8608 00000100:00080000:1.0:1786109756.678029:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1786109756.678033:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109756.678047:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a1500 x1872862933392384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109756.678062:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109756.678065:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109756.678066:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109756.678070:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8608 00000100:00080000:1.0:1786109756.678073:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1786109756.678076:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a8a47d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109756.678088:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986551180 x1872862933392640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109756.678112:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109756.678115:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109756.678117:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109756.678120:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8608 00000100:00080000:1.0:1786109756.678122:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1786109756.678125:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da3000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109756.678137:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9676d80 x1872862933393024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109756.678158:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933392128:0@lo:38:kworker.0 00000100:00100000:1.0:1786109756.678193:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109756.678217:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933392384:0@lo:38:kworker.0 00000100:00100000:1.0:1786109756.678237:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109756.678253:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933392640:0@lo:38:kworker.0 00000100:00100000:1.0:1786109756.678274:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109756.678291:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933393024:0@lo:38:kworker.0 00000100:00100000:1.0:1786109756.678311:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109756.678476:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933392768:0@lo:400:kworker.0 00000100:00100000:0.0:1786109756.678518:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109756.678541:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109756.678547:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933392896:0@lo:400:kworker.0 00000100:00100000:0.0:1786109756.678568:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109756.678823:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933392512:0@lo:400:kworker.0 00000100:00100000:1.0:1786109756.678851:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109756.678871:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109756.678877:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933392256:0@lo:400:kworker.0 00000100:00100000:1.0:1786109756.678898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109756.678933:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933392128 00000100:00100000:1.0:1786109756.678940:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933392128 00000100:00100000:1.0:1786109756.678964:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933392384 00000100:00100000:1.0:1786109756.678967:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933392384 00000100:00100000:1.0:1786109756.678974:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933393024 00000100:00100000:1.0:1786109756.678977:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933393024 00000100:00100000:1.0:1786109756.678984:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933392512 00000100:00100000:1.0:1786109756.678986:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933392512 00000100:00100000:1.0:1786109756.679014:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933392256 00000100:00100000:1.0:1786109756.679017:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933392256 00000100:00100000:1.0:1786109756.679038:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1786109756.679047:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933392512:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109756.679070:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984ff0000 x1872862933392512/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:227/0 lens 224/224 e 0 to 0 dl 1786109767 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109756.679109:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933392512:12345-0@lo:400:kworker.0 Request processed in 63us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109756.679116:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1786109756.679135:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1786109756.679141:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933392256:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1786109756.679152:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984ff1180 x1872862933392256/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:227/0 lens 224/224 e 0 to 0 dl 1786109767 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109756.679176:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933392256:12345-0@lo:400:kworker.0 Request processed in 36us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109756.679182:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1786109756.679193:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:1.0:1786109756.679197:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933392128:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109756.679214:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109756.679247:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933392128:12345-0@lo:38:kworker.0 Request processed in 48us (1053us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109756.679253:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:1.0:1786109756.679266:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:1.0:1786109756.679270:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933392384:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109756.679279:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109756.679302:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933392384:12345-0@lo:38:kworker.0 Request processed in 31us (1065us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109756.679308:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:0.0:1786109756.679448:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933392768 00000100:00100000:0.0:1786109756.679453:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933392768 00000100:00100000:0.0:1786109756.679495:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933392896 00000100:00100000:0.0:1786109756.679499:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933392896 00000100:00100000:0.0:1786109756.679522:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7146 00000100:00100000:0.0:1786109756.679529:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933392768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109756.679568:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933392768:12345-0@lo:400:kworker.0 Request processed in 40us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109756.679574:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7146 00000100:00100000:0.0:1786109756.679588:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7147 00000100:00100000:0.0:1786109756.679593:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933392896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109756.679623:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933392896:12345-0@lo:400:kworker.0 Request processed in 29us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109756.679628:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7147 00000100:00100000:0.0:1786109756.679674:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933392896:0@lo:400:kworker.0 00000100:00100000:0.0:1786109756.679685:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933392768:0@lo:400:kworker.0 00000100:00100000:1.0:1786109756.679892:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:1.0:1786109756.679898:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933393024:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109756.679911:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109756.679943:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933393024:12345-0@lo:38:kworker.0 Request processed in 44us (1631us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109756.679948:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:1.0:1786109756.679974:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933392640 00000100:00100000:1.0:1786109756.679979:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933392640 00000100:00100000:1.0:1786109756.680410:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786109756.680416:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1872862933392640:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109756.680452:0:187905:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109756.680497:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1872862933392640:12345-0@lo:38:kworker.0 Request processed in 80us (2221us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109756.680504:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1786109756.685039:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109756.685048:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109756.685052:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109756.685104:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933392256:0@lo:400:kworker.0 00000100:00100000:1.0:1786109756.685120:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933392512:0@lo:400:kworker.0 00000100:00080000:1.0:1786109756.685163:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109756.685169:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109756.685172:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933392128:0@lo:38:kworker.0 00000100:00080000:1.0:1786109756.685182:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109756.685185:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109756.685187:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933392384:0@lo:38:kworker.0 00000100:00080000:1.0:1786109756.685196:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109756.685200:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109756.685203:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933392640:0@lo:38:kworker.0 00000100:00080000:1.0:1786109756.685212:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109756.685723:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109756.685729:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933393024:0@lo:38:kworker.0 00010000:00010000:3.0:1786109756.813170:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109757.700787:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00100000:2.0:1786109757.700910:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933393152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109757.701016:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109757.701136:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933393152 00000100:00100000:3.0:1786109757.701146:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933393152 00000100:00100000:3.0:1786109757.701402:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5969 00000100:00100000:3.0:1786109757.701419:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab94c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933393152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109757.701498:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109757.701559:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab94c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933393152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109757.701568:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5969 00000100:00100000:2.0:1786109757.701671:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933393152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109757.703160:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930982e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933393280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109757.703302:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109757.704338:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933393280 00000100:00100000:0.0:1786109757.704352:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933393280 00000100:00100000:0.0:1786109757.704423:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5970 00000100:00100000:0.0:1786109757.704484:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933393280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109757.704524:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140864 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109757.704604:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933393280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109757.704611:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5970 00000100:00100000:0.0:1786109757.704676:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933393280:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1786109757.836598:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1786109758.484561:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922186368 offset 0 length 224: 4 00000100:00100000:0.0:1786109758.484603:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109758.484678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109758.489815:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922186624 00000100:00100000:2.0:1786109758.489830:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922186624 00000100:00100000:1.0:1786109758.491306:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922186496 00000100:00100000:1.0:1786109758.491315:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922186496 00000100:00100000:1.0:1786109758.492851:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 466 00000100:00100000:1.0:1786109758.492875:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922186624:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:1.0:1786109758.492908:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac173fb80 x1872862922186624/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:229/0 lens 224/224 e 0 to 0 dl 1786109769 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109758.492992:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922186624:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 127us (8390us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109758.493001:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 466 00000100:00100000:1.0:1786109758.493033:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1291 00000100:00100000:1.0:1786109758.493039:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922186496:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:1.0:1786109758.493059:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109758.493088:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922186496:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 48us (8410us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109758.493095:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1291 00000100:00080000:2.0:1786109758.494008:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109758.735038:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:1.0:1786109758.852769:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786109759.372831:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:1.0:1786109759.372841:0:9518:0:(genops.c:906:class_export_put()) final put ffff930ab8da0000/fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:0.0:1786109759.376996:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab8da0000/fac74500-4523-4794-af20-dfdcdfae19c1 for lustre-OST0001 00000001:00100000:2.0:1786109759.377170:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:1.0:1786109759.377178:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab8da3800 for lustre-OST0001 00000020:00000080:2.0:1786109759.377766:0:194579:0:(genops.c:906:class_export_put()) final put ffff930986508800/fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:0.0:1786109759.382438:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930986508800/fac74500-4523-4794-af20-dfdcdfae19c1 for lustre-OST0000 00000020:00000080:3.0:1786109759.383080:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098650a800 for lustre-OST0000 00000400:00000100:3.0:1786109759.472363:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.38@tcp portal 26 match 1872862922186752 offset 0 length 520: 4 00000100:00100000:3.0:1786109759.472417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109759.472475:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922186880 00000100:00100000:3.0:1786109759.472484:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922186880 00000100:00100000:3.0:1786109759.472523:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1292 00000100:00100000:3.0:1786109759.472530:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922186880:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:3.0:1786109759.472551:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109759.472616:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922186880:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 84us (197us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109759.472623:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1292 00000100:00100000:3.0:1786109759.749260:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:1.0:1786109759.877812:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109760.773208:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:3.0:1786109760.900585:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109761.797216:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933393408:0@lo:400:kworker.0 00000400:00000100:0.0:1786109761.797273:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933393408 offset 0 length 224: 4 00000100:00080000:1.0:1786109761.797343:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109761.797348:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109761.797351:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109761.797356:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8613 00000100:00080000:1.0:1786109761.797359:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109761.797365:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109761.797387:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930984ff2300 x1872862933393536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109761.797468:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933393664:0@lo:400:kworker.0 00000100:00100000:3.0:1786109761.797601:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00100000:2.0:1786109761.803999:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109761.804092:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933393664 00000100:00100000:2.0:1786109761.804101:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933393664 00000100:00100000:2.0:1786109761.804153:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1786109761.804165:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933393664:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109761.804193:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984cfca80 x1872862933393664/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:302/0 lens 224/224 e 0 to 0 dl 1786109842 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109761.804238:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933393664:12345-0@lo:400:kworker.0 Request processed in 76us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109761.804245:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00080000:2.0:1786109761.804266:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786109761.804301:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933393664:0@lo:400:kworker.0 00000100:00100000:2.0:1786109761.804361:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933393536:0@lo:38:kworker.0 00000100:00100000:2.0:1786109761.804390:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109761.804468:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933393536 00000100:00100000:2.0:1786109761.804473:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933393536 00000100:00100000:2.0:1786109761.804765:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1786109761.804771:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933393536:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109761.804789:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109761.804824:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933393536:12345-0@lo:38:kworker.0 Request processed in 52us (433us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109761.804831:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00080000:2.0:1786109761.804861:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109761.804866:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109761.804870:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933393536:0@lo:38:kworker.0 00000100:00080000:1.0:1786109761.806111:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109761.806120:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109761.806123:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109761.806130:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8613 00000100:00080000:1.0:1786109761.806134:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109761.806140:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109761.806173:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930984ff2300 x1872862933393792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109761.806228:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933393792:0@lo:38:kworker.0 00000100:00100000:2.0:1786109761.806269:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109761.806328:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933393792 00000100:00100000:3.0:1786109761.806334:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933393792 00000100:00100000:3.0:1786109761.806374:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1786109761.806381:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933393792:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109761.806398:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1786109761.806573:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109761.806576:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109761.806579:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109761.806582:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8613 00000100:00080000:1.0:1786109761.806585:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109761.806588:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a8a47d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109761.806600:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9676d80 x1872862933394048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109761.806639:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109761.806650:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933393920:0@lo:400:kworker.0 00000100:00100000:0.0:1786109761.806691:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109761.806717:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933393920 00000100:00100000:0.0:1786109761.806721:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933393920 00000100:00100000:0.0:1786109761.806754:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1786109761.806759:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933393920:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109761.806774:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac173f800 x1872862933393920/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:302/0 lens 224/224 e 0 to 0 dl 1786109842 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109761.806802:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872862933393920:12345-0@lo:400:kworker.0 Request processed in 43us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109761.806808:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00080000:0.0:1786109761.806825:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109761.806852:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1872862933393920:0@lo:400:kworker.0 00000100:00100000:3.0:1786109761.841777:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933393792:12345-0@lo:38:kworker.0 Request processed in 35383us (35495us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109761.841791:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00080000:1.0:1786109761.841985:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109761.841990:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109761.841994:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109761.841998:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8613 00000100:00080000:1.0:1786109761.842002:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109761.842009:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da3000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109761.842029:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa5c57b80 x1872862933394432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109761.842077:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109761.842089:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933394304:0@lo:400:kworker.0 00000100:00100000:1.0:1786109761.842144:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109761.842177:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933394304 00000100:00100000:1.0:1786109761.842184:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933394304 00000100:00100000:1.0:1786109761.842227:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7148 00000100:00100000:1.0:1786109761.842236:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933394304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109761.842283:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933394304:12345-0@lo:400:kworker.0 Request processed in 49us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109761.842289:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7148 00000100:00100000:1.0:1786109761.842326:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933394304:0@lo:400:kworker.0 00000100:00100000:3.0:1786109761.842394:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933394176:0@lo:400:kworker.0 00000100:00100000:3.0:1786109761.842604:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109761.842673:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933394176 00000100:00100000:1.0:1786109761.842677:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933394176 00000100:00100000:1.0:1786109761.842914:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7149 00000100:00100000:1.0:1786109761.842923:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933394176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109761.842965:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933394176:12345-0@lo:400:kworker.0 Request processed in 45us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109761.842972:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7149 00000100:00100000:3.0:1786109761.843027:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933394176:0@lo:400:kworker.0 00000100:00100000:2.0:1786109761.843875:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933394048:0@lo:38:kworker.0 00000100:00100000:2.0:1786109761.843920:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109761.843946:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933394432:0@lo:38:kworker.0 00000100:00100000:2.0:1786109761.843966:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109761.844001:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109761.844006:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109761.844009:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933393792:0@lo:38:kworker.0 00000100:00100000:1.0:1786109761.844084:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933394048 00000100:00100000:1.0:1786109761.844089:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933394048 00000100:00100000:1.0:1786109761.844121:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786109761.844128:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1872862933394048:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109761.844147:0:187904:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109761.844183:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1872862933394048:12345-0@lo:38:kworker.0 Request processed in 54us (262us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109761.844189:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1786109761.844239:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933394432 00000100:00100000:3.0:1786109761.844243:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933394432 00000100:00100000:3.0:1786109761.844270:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1786109761.844275:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933394432:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109761.844286:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109761.844314:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933394432:12345-0@lo:38:kworker.0 Request processed in 38us (347us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109761.844320:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00080000:2.0:1786109761.844606:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109761.844611:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109761.844614:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933394048:0@lo:38:kworker.0 00000100:00080000:2.0:1786109761.844622:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109761.844625:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109761.844627:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933394432:0@lo:38:kworker.0 00000100:00080000:0.0:1786109761.845368:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109761.845375:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786109761.926425:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1786109762.820617:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109746/real 1786109746] req@ffff930984909180 x1872862933389184/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109762 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109762.820646:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff930984909180 x1872862933389184/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109762 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109762.820655:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1786109762.820670:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1786109762.820674:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.138@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1786109762.820676:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1786109762.820680:0:3646:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930984909180 x1872862933389184/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786109762 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109762.820689:0:3646:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930982e52680 x1872862933390592/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109767 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109762.820698:0:3646:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930aa5c56300 x1872862933392000/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109772 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109762.820711:0:3646:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff930984ff0380 x1872862933393408/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786109777 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1786109762.820722:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1786109762.820724:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1786109762.820726:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1786109762.820865:0:3646:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1786109762.820896:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930982e52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933390592:0@lo:400:kworker.0 00000100:00100000:0.0:1786109762.820902:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933389184:0@lo:400:kworker.0 00000100:00100000:0.0:1786109762.820936:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933394560:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1786109762.821062:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109762.821068:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1786109762.821070:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109762.821075:0:171804:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8483 00000100:00080000:2.0:1786109762.821083:0:171804:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109762.821099:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930984cfd180 x1872862933394688/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109762.821114:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109762.821117:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109762.821118:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109762.821121:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8618 00000100:00080000:2.0:1786109762.821123:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1786109762.821126:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109762.821138:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9676d80 x1872862933394816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109762.821161:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109762.821163:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109762.821165:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109762.821167:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8618 00000100:00080000:2.0:1786109762.821169:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1786109762.821172:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109762.821180:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac17bbb80 x1872862933395072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109762.821193:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109762.821197:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109762.821198:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109762.821201:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8618 00000100:00080000:2.0:1786109762.821203:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1786109762.821330:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109762.821367:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933392000:0@lo:400:kworker.0 00000100:00100000:0.0:1786109762.821396:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933393408:0@lo:400:kworker.0 00000100:00100000:0.0:1786109762.821417:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933394560 00000100:00100000:0.0:1786109762.821424:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933394560 00000100:00100000:0.0:1786109762.821497:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5971 00000100:00100000:0.0:1786109762.821507:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933394560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109762.821535:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140864 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109762.821578:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933394560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109762.821585:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5971 00000100:00100000:0.0:1786109762.821608:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933394944:0@lo:400:kworker.0 00000100:00100000:0.0:1786109762.821631:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109762.821648:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109762.821652:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933395200:0@lo:400:kworker.0 00000100:00100000:0.0:1786109762.821684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109762.821705:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933394944 00000100:00100000:0.0:1786109762.821708:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933394944 00000100:00080000:2.0:1786109762.821818:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a8a47d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109762.821834:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7f17800 x1872862933395328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109762.821854:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109762.821856:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786109762.821858:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109762.821861:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8618 00000100:00080000:2.0:1786109762.821863:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1786109762.821866:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da3000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109762.821874:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7f17480 x1872862933395584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109762.821893:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933394688:0@lo:250:kworker.0 00000400:00000100:2.0:1786109762.821914:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872862933394688 offset 0 length 520: 4 00000100:00100000:2.0:1786109762.821935:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933394816:0@lo:38:kworker.0 00000100:00100000:2.0:1786109762.822027:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109762.822045:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933395072:0@lo:38:kworker.0 00000100:00100000:2.0:1786109762.822062:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109762.822076:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933395328:0@lo:38:kworker.0 00000100:00100000:2.0:1786109762.822096:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109762.822111:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933395584:0@lo:38:kworker.0 00000100:00100000:2.0:1786109762.822129:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109762.822155:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933395200 00000100:00100000:2.0:1786109762.822159:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933395200 00000100:00100000:2.0:1786109762.822177:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933394816 00000100:00100000:2.0:1786109762.822180:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933394816 00000100:00100000:2.0:1786109762.822187:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933395072 00000100:00100000:2.0:1786109762.822189:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933395072 00000100:00100000:2.0:1786109762.822195:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933395584 00000100:00100000:2.0:1786109762.822197:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933395584 00000100:00100000:3.0:1786109762.822359:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00100000:3.0:1786109762.827119:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1786109762.829322:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac173dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933394944:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109762.829356:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac173dc00 x1872862933394944/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:303/0 lens 224/224 e 0 to 0 dl 1786109843 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109762.829467:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac173dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933394944:12345-0@lo:400:kworker.0 Request processed in 165us (7833us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109762.831021:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933394944:0@lo:400:kworker.0 00000100:00100000:2.0:1786109762.834173:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1786109762.834400:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933395328 00000100:00100000:2.0:1786109762.834410:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933395328 00000100:00100000:2.0:1786109762.834498:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786109762.834505:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1872862933395328:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109762.834527:0:187905:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109762.834608:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1872862933395328:12345-0@lo:38:kworker.0 Request processed in 102us (12510us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109762.834615:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1786109762.834663:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109762.834669:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109762.834673:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933395328:0@lo:38:kworker.0 00000100:00100000:2.0:1786109762.834723:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933395200:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109762.834746:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984909180 x1872862933395200/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:303/0 lens 224/224 e 0 to 0 dl 1786109843 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109762.834788:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933395200:12345-0@lo:400:kworker.0 Request processed in 602us (13103us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109762.834795:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1786109762.834830:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933395200:0@lo:400:kworker.0 00000100:00100000:2.0:1786109762.834860:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1786109762.834865:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933394816:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109762.834876:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109762.834907:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933394816:12345-0@lo:38:kworker.0 Request processed in 41us (12880us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109762.834913:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00080000:2.0:1786109762.834937:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109762.834941:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109762.834944:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933394816:0@lo:38:kworker.0 00000100:00100000:2.0:1786109762.834963:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:2.0:1786109762.834968:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933395072:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109762.834976:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109762.835007:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933395072:12345-0@lo:38:kworker.0 Request processed in 37us (12944us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109762.835013:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00080000:2.0:1786109762.835050:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109762.835054:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109762.835057:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933395072:0@lo:38:kworker.0 00000100:00100000:2.0:1786109762.835075:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:2.0:1786109762.835079:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933395584:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109762.835089:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109762.835116:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933395584:12345-0@lo:38:kworker.0 Request processed in 35us (12985us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109762.835124:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00080000:2.0:1786109762.835145:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109762.835149:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109762.835153:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933395584:0@lo:38:kworker.0 00000100:00100000:3.0:1786109762.835875:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1786109762.835956:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933395456:0@lo:400:kworker.0 00000100:00100000:2.0:1786109762.835999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109762.836148:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109762.836156:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933395712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109762.836182:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109762.836368:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933394560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109762.836502:0:179239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933395456 00000100:00100000:3.0:1786109762.836509:0:179239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933395456 00000100:00100000:2.0:1786109762.836650:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7150 00000100:00100000:2.0:1786109762.836659:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933395456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109762.836712:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933395456:12345-0@lo:400:kworker.0 Request processed in 54us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109762.836718:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7150 00000100:00100000:2.0:1786109762.836793:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933395456:0@lo:400:kworker.0 00000100:00100000:0.0:1786109762.861846:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933395712 00000100:00100000:0.0:1786109762.861860:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933395712 00000100:00100000:0.0:1786109762.861909:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5972 00000100:00100000:0.0:1786109762.861918:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933395712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109762.861950:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109762.863145:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933395712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (25845us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109762.863162:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5972 00000100:00100000:2.0:1786109762.863341:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933395712:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1786109762.970917:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109763.846593:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:1.0:1786109763.975792:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109764.631894:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109764.631956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109764.632038:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922187136 00000100:00100000:3.0:1786109764.632051:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922187136 00000100:00100000:3.0:1786109764.632142:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922187008 00000100:00100000:3.0:1786109764.632146:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922187008 00000100:00100000:3.0:1786109764.632170:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 471 00000100:00100000:3.0:1786109764.632184:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2404:x1872862922187136:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:3.0:1786109764.632225:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac17bbb80 x1872862922187136/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:305/0 lens 224/224 e 0 to 0 dl 1786109845 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109764.632315:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2404:x1872862922187136:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 134us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109764.632323:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 471 00000100:00100000:3.0:1786109764.632345:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1299 00000100:00100000:3.0:1786109764.632350:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922187008:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:3.0:1786109764.632376:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109764.632406:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922187008:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 54us (449us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109764.632413:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1299 00000100:00080000:0.0:1786109764.632744:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109764.868585:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:3.0:1786109764.996555:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1786109765.114846:0:201140:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1786109765.114853:0:201140:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1786109765.114854:0:201140:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1786109765.114964:0:201140:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93098617c000 00000020:01000004:1.0:1786109765.114980:0:201140:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1786109765.114993:0:201140:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1786109765.115006:0:201140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff930985210000) 00000020:00000080:1.0:1786109765.115026:0:201140:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1786109765.197296:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1786109765.198330:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1786109765.199464:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1786109765.199741:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1786109765.200132:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1786109765.200367:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1786109765.200738:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1786109765.200938:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1786109765.201133:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1786109765.201339:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1786109765.201773:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1786109765.201993:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1786109765.202195:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1786109765.202376:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1786109765.209138:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1786109765.210133:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.210366:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.210683:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.210924:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.211147:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.211371:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.211676:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.211903:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.212133:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.212358:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.212738:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.212936:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.213125:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.213317:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.213548:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.213847:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.214039:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.214263:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.214504:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.214743:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.214977:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.215208:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.215451:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.215693:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.215930:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.216150:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.216374:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.216697:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1786109765.216927:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.217161:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1786109765.217378:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1786109765.217943:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1786109765.219625:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1786109765.220014:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1786109765.220190:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1786109765.220619:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1786109765.220853:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1786109765.221068:0:201140:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:1.0:1786109765.221661:0:201140:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1786109765.221855:0:201140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1786109765.221864:0:201140:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1786109765.221875:0:201140:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca389e6 00000020:01000004:1.0:1786109765.221881:0:201140:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1786109765.221892:0:201140:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1786109765.221897:0:201140:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93098617c000 from MGS 00000020:01000004:1.0:1786109765.221900:0:201140:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1786109765.221910:0:201140:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff930a97cb8000) 00000020:00000080:1.0:1786109765.221922:0:201140:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1786109765.221978:0:201140:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93098617c000 from MGS, refs=2 00080000:01000000:1.0:1786109765.221983:0:201140:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1786109765.221987:0:201140:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca389f4 00010000:00010000:1.0:1786109765.222105:0:201140:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1786109765.225729:0:201140:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1786109765.228452:0:201144:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1786109765.228521:0:201140:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1786109765.228573:0:201140:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1786109765.229246:0:201140:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1786109765.229527:0:201140:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786109765.229666:0:201140:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1786109765.229672:0:201140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1786109765.230301:0:201140:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1786109765.230309:0:201140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1786109765.230846:0:201140:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1786109765.230852:0:201140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1786109765.231551:0:201140:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1786109765.231572:0:201140:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1786109765.231574:0:201140:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1786109765.231577:0:201140:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1786109765.231582:0:201140:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff930a8a640000 already not connected (conn 13803, was 0): CONNECTING 00000100:00100000:0.0:1786109765.231587:0:201140:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1786109765.892760:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:3.0:1786109766.020780:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:02000400:3.0:1786109766.404561:0:189889:0:(service.c:2875:ptlrpc_watchdog_fire()) mdt00_005: service thread pid 196401 was inactive for 41.360 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: 00000100:00100000:1.0:1786109766.916710:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:1.0:1786109767.044838:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109767.940649:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00080000:1.0:1786109767.940702:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109767.940707:0:171804:0:(pinger.c:247:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1786109767.940709:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109767.940713:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109767.940716:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109767.940723:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8619 00000100:00080000:1.0:1786109767.940728:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109767.940734:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109767.940760:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa5c56300 x1872862933395968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109767.940772:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933395840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109767.940835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109767.941130:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933396224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109767.941157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786109767.941326:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1786109767.941331:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1786109767.941332:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109767.941337:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1786109767.941341:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933396096:0@lo:400:kworker.0 00000100:00080000:1.0:1786109767.941343:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8619 00000100:00080000:1.0:1786109767.941348:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109767.941353:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109767.941375:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109767.941386:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a1500 x1872862933396352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109767.941426:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1786109767.941452:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109767.941459:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933396480:0@lo:400:kworker.0 00000100:00100000:0.0:1786109767.941606:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933395840 00000100:00100000:0.0:1786109767.941613:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933395840 00000100:00100000:0.0:1786109767.941657:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933396224 00000100:00100000:0.0:1786109767.941661:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933396224 00000100:00100000:2.0:1786109767.941672:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5973 00000100:00100000:2.0:1786109767.941686:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930982e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933395840:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109767.941702:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5974 00000100:00100000:0.0:1786109767.941711:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933396224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109767.941731:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109767.941767:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933396224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109767.941773:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5974 00000100:00100000:0.0:1786109767.941795:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933396096 00000100:00100000:0.0:1786109767.941797:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933396096 00000100:00100000:0.0:1786109767.941819:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1786109767.941825:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933396096:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109767.941837:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984ff0380 x1872862933396096/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:308/0 lens 224/224 e 0 to 0 dl 1786109848 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109767.941864:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933396096:12345-0@lo:400:kworker.0 Request processed in 39us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109767.941869:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00080000:0.0:1786109767.941884:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109767.941888:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109767.941922:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933396096:0@lo:400:kworker.0 00000100:00100000:3.0:1786109767.941930:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109767.941967:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933396224:0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109767.942089:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140864 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109767.942135:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930982e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933395840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 453us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109767.942142:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5973 00000100:00100000:3.0:1786109767.942265:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933396480 00000100:00100000:3.0:1786109767.942270:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933396480 00000100:00100000:3.0:1786109767.942295:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1786109767.942302:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933396480:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109767.942314:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97fd6680 x1872862933396480/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:308/0 lens 224/224 e 0 to 0 dl 1786109848 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109767.942346:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933396480:12345-0@lo:400:kworker.0 Request processed in 45us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109767.942354:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1786109767.942383:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933396480:0@lo:400:kworker.0 00000100:00080000:1.0:1786109767.943041:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109767.943045:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109767.943052:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8619 00000100:00080000:1.0:1786109767.943056:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109767.943061:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a8a47d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109767.943088:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a2d80 x1872862933396608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109767.943091:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933395968:0@lo:38:kworker.0 00000100:00080000:1.0:1786109767.943110:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109767.943114:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109767.943116:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109767.943120:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8619 00000100:00080000:1.0:1786109767.943122:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1786109767.943126:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da3000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109767.943135:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109767.943351:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a893c2300 x1872862933396736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109767.943370:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933395968 00000100:00100000:2.0:1786109767.943375:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933395968 00000100:00100000:1.0:1786109767.943422:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933395840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109767.943563:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:2.0:1786109767.943570:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933395968:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109767.943586:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109767.943623:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933395968:12345-0@lo:38:kworker.0 Request processed in 52us (489us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109767.943629:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00080000:0.0:1786109767.944021:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109767.944027:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109767.944030:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933395968:0@lo:38:kworker.0 00000100:00100000:0.0:1786109767.944036:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933396352:0@lo:38:kworker.0 00000100:00100000:0.0:1786109767.944063:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109767.944100:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933396608:0@lo:38:kworker.0 00000100:00100000:0.0:1786109767.944121:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109767.944145:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933396736:0@lo:38:kworker.0 00000100:00100000:0.0:1786109767.944161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109767.944235:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933396608 00000100:00100000:2.0:1786109767.944240:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933396608 00000100:00100000:2.0:1786109767.944265:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786109767.944270:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1872862933396608:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109767.944284:0:199402:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109767.944318:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1872862933396608:12345-0@lo:38:kworker.0 Request processed in 46us (194us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109767.944325:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1786109767.944358:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109767.944363:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1786109767.944366:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933396608:0@lo:38:kworker.0 00000100:00100000:3.0:1786109767.944892:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933396352 00000100:00100000:3.0:1786109767.944897:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933396352 00000100:00100000:3.0:1786109767.944925:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933396736 00000100:00100000:3.0:1786109767.944928:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933396736 00000100:00100000:3.0:1786109767.944956:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:3.0:1786109767.944961:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933396352:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109767.944975:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109767.945018:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933396352:12345-0@lo:38:kworker.0 Request processed in 55us (953us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109767.945024:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:3.0:1786109767.945037:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:3.0:1786109767.945041:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933396736:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109767.945051:0:187901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109767.945074:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1872862933396736:12345-0@lo:38:kworker.0 Request processed in 32us (912us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109767.945080:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00080000:3.0:1786109767.945108:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109767.945112:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109767.945115:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933396736:0@lo:38:kworker.0 00000100:00080000:3.0:1786109767.945124:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109767.945127:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1786109767.945130:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933396352:0@lo:38:kworker.0 00010000:00010000:1.0:1786109768.069062:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109768.847041:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109768.847196:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922187264 00000100:00100000:2.0:1786109768.847209:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922187264 00000100:00100000:2.0:1786109768.847297:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1786109768.847308:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1872862922187264:12345-192.168.203.38@tcp:250:kworker.0 00010000:00080000:2.0:1786109768.847349:0:201146:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 4929093a-da1f-45c7-90e6-dcd2fb5a5df4@192.168.203.38@tcp t0 exp 0000000000000000 cur 8625 last 0 00000020:00000080:2.0:1786109768.847385:0:201146:0:(genops.c:1406:class_connect()) connect: client 4929093a-da1f-45c7-90e6-dcd2fb5a5df4, cookie 0xdb52b77d7ca389fb 00000100:00080000:2.0:1786109768.847801:0:201146:0:(import.c:65:import_set_state_nolock()) ffff930a97c8a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109768.847981:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+5:2401:x1872862922187264:12345-192.168.203.38@tcp:250:kworker.0 Request processed in 671us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109768.847990:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:3.0:1786109768.848104:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109768.848302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109768.848498:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922187392 00000100:00100000:2.0:1786109768.848505:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922187392 00000100:00100000:2.0:1786109768.848540:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922187520 00000100:00100000:2.0:1786109768.848543:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922187520 00000100:00100000:2.0:1786109768.848593:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 474 00000100:00100000:2.0:1786109768.848605:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922187520:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:2.0:1786109768.848630:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9631500 x1872862922187520/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:239/0 lens 224/224 e 0 to 0 dl 1786109779 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109768.848670:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922187520:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 68us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109768.848678:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 474 00000100:00100000:2.0:1786109768.848695:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1303 00000100:00100000:2.0:1786109768.848700:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1872862922187392:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:2.0:1786109768.848719:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109768.848741:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1872862922187392:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 40us (639us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109768.848749:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1303 00000100:00100000:1.0:1786109768.964610:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:3.0:1786109769.092601:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109769.988859:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:3.0:1786109770.116598:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109770.706892:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109770.707657:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922187648 00000100:00100000:3.0:1786109770.707668:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922187648 00000100:00100000:3.0:1786109770.708089:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:3.0:1786109770.708101:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+5:161855:x1872862922187648:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109770.708119:0:201148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109770.708140:0:201148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930aa628b000/0xdb52b77d7ca38a02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18ff expref: -99 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109770.708167:0:201148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930aa628b000/0xdb52b77d7ca38a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ff expref: 6 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109770.708180:0:201148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930aa628b000/0xdb52b77d7ca38a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ff expref: 6 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109770.708189:0:201148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628b000, rc 0) 00000100:00100000:3.0:1786109770.708362:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+6:161855:x1872862922187648:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 263us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109770.708370:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:3.0:1786109770.713213:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109770.713395:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922187776 00000100:00100000:2.0:1786109770.713410:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922187776 00000100:00100000:3.0:1786109770.713808:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:3.0:1786109770.713822:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+6:161855:x1872862922187776:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786109770.713936:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+6:161855:x1872862922187776:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 Request processed in 117us (738us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786109770.713944:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1786109770.720654:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109770.720821:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922187904 00000100:00100000:3.0:1786109770.720834:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922187904 00000100:00100000:3.0:1786109770.720956:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:3.0:1786109770.720969:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+6:161855:x1872862922187904:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109770.720995:0:201148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109770.721076:0:201148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930aa628b600/0xdb52b77d7ca38a09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1906 expref: -99 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109770.721121:0:201148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930aa628b600/0xdb52b77d7ca38a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1906 expref: 7 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109770.721133:0:201148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930aa628b600/0xdb52b77d7ca38a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1906 expref: 7 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109770.721143:0:201148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628b600, rc 0) 00000100:00100000:3.0:1786109770.721264:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+7:161855:x1872862922187904:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 296us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109770.721271:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1786109770.724692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109770.724863:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922188032 00000100:00100000:3.0:1786109770.724875:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922188032 00000100:00100000:3.0:1786109770.725000:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1786109770.725014:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+7:161855:x1872862922188032:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1786109770.725655:0:201149:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1786109770.725916:0:201146:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 333 20000000:01000000:0.0:1786109770.727426:0:201150:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1786109770.727458:0:201150:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1786109770.727461:0:201150:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1786109770.727464:0:201150:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1786109770.727684:0:201150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1786109770.727948:0:201146:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1786109770.728075:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161855:x1872862922188032:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 3056us (3390us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109770.728087:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:0.0:1786109770.733077:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109770.733179:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922188160 00000100:00100000:3.0:1786109770.733192:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922188160 00000100:00100000:3.0:1786109770.733294:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:3.0:1786109770.733306:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161855:x1872862922188160:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109770.733539:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161855:x1872862922188160:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 233us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109770.733553:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:0.0:1786109770.739348:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109770.739615:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922188288 00000100:00100000:3.0:1786109770.739629:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922188288 00000100:00100000:3.0:1786109770.739758:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1786109770.739772:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+8:161855:x1872862922188288:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109770.739797:0:201146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109770.739824:0:201146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930aa628ba00/0xdb52b77d7ca38a10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a190d expref: -99 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109770.739861:0:201146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930aa628ba00/0xdb52b77d7ca38a10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a190d expref: 9 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109770.739874:0:201146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930aa628ba00/0xdb52b77d7ca38a10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a190d expref: 9 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109770.739884:0:201146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628ba00, rc 0) 00000100:00100000:3.0:1786109770.739962:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922188288:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 193us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109770.739981:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:0.0:1786109770.743478:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109770.743606:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922188416 00000100:00100000:3.0:1786109770.743625:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922188416 00000100:00100000:3.0:1786109770.743735:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:3.0:1786109770.743748:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922188416:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109770.743980:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922188416:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 234us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109770.743988:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:0.0:1786109770.748055:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109770.748167:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922188544 00000100:00100000:3.0:1786109770.748180:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922188544 00000100:00100000:3.0:1786109770.748296:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:3.0:1786109770.748309:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922188544:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109770.748563:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922188544:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 255us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109770.748572:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1786109770.761565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109770.762612:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922188672 00000100:00100000:3.0:1786109770.762630:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922188672 00000100:00100000:3.0:1786109770.763370:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1786109770.763397:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922188672:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109770.763424:0:201148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109770.763491:0:201148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca38a17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1914 expref: -99 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109770.763531:0:201148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca38a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1914 expref: 10 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109770.763544:0:201148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930aa628a200/0xdb52b77d7ca38a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1914 expref: 10 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109770.763555:0:201148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628a200, rc 0) 00000100:00100000:3.0:1786109770.764309:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922188672:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 922us (2754us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109770.764319:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1786109770.768837:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109770.769048:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922188800 00000100:00100000:3.0:1786109770.769062:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922188800 00000100:00100000:3.0:1786109770.769372:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1786109770.769395:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922188800:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109770.770233:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922188800:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 206us (766us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786109770.770251:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1786109771.015781:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:0.0:1786109771.141061:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109772.036623:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00100000:3.0:1786109772.048507:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786109762/real 1786109762] req@ffff930984cfd180 x1872862933394688/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786109772 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109772.048554:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff930984cfd180 x1872862933394688/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786109772 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786109772.048577:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109772.048619:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1786109772.048641:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933394688:0@lo:250:kworker.0 00000100:00080000:1.0:1786109772.049045:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) aeab97cc-8463-4daa-a678-1bb2ad93cc69->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109772.049053:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1786109772.049056:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109772.049075:0:183576:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8619 00000100:00080000:1.0:1786109772.049081:0:183576:0:(import.c:589:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1786109772.049090:0:183576:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109772.049135:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a893c0700 x1872862933396864/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786109772.049159:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109772.049163:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 10000000:01000000:2.0:1786109772.049165:0:201140:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:1.0:1786109772.049165:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109772.049173:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8624 00000100:00080000:1.0:1786109772.049176:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1786109772.049180:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00010000:00010000:2.0:1786109772.049189:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab8f6da00/0xdb52b77d7ca374c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca374ca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109772.049201:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a893c2300 x1872862933396992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:00010000:2.0:1786109772.049204:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6da00/0xdb52b77d7ca374c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca374ca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109772.049220:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1786109772.049237:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109772.049250:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab8f6da00/0xdb52b77d7ca374c3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca374ca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786109772.049261:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109772.049266:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109772.049268:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109772.049275:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8624 00010000:00010000:2.0:1786109772.049288:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c400/0xdb52b77d7ca37429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca37430 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786109772.049290:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1786109772.049299:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 10000000:00010000:2.0:1786109772.049301:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c400/0xdb52b77d7ca37429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca37430 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109772.049315:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0fdc380 x1872862933397248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1786109772.049326:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109772.049335:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109772.049343:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c400/0xdb52b77d7ca37429 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca37430 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786109772.049345:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786109772.049353:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109772.049356:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:2.0:1786109772.049362:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c000/0xdb52b77d7ca37437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3743e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786109772.049363:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8624 00000100:00080000:1.0:1786109772.049368:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 10000000:00010000:2.0:1786109772.049387:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c000/0xdb52b77d7ca37437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3743e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786109772.049388:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a8a47d000 using connection 192.168.203.138@tcp/0@lo 10000000:01000000:2.0:1786109772.049397:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109772.049402:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1786109772.049407:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0fdd880 x1872862933397504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1786109772.049408:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c000/0xdb52b77d7ca37437 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3743e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.049487:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac1f38600/0xdb52b77d7ca37499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca374a0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786109772.049493:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 10000000:00010000:2.0:1786109772.049498:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac1f38600/0xdb52b77d7ca37499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca374a0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786109772.049499:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786109772.049503:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109772.049510:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8624 10000000:01000000:2.0:1786109772.049512:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:1.0:1786109772.049515:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00010000:00010000:2.0:1786109772.049518:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1786109772.049522:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da3000 using connection 192.168.203.138@tcp/0@lo 00010000:00010000:2.0:1786109772.049526:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac1f38600/0xdb52b77d7ca37499 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca374a0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109772.049538:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0fdce00 x1872862933397888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1786109772.049540:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d400/0xdb52b77d7ca374a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca374ae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109772.049560:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d400/0xdb52b77d7ca374a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca374ae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109772.049567:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109772.049572:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109772.049576:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab8f6d400/0xdb52b77d7ca374a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca374ae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.049586:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca374d8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109772.049588:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933397120:0@lo:400:kworker.0 00000100:00100000:1.0:1786109772.049677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109772.049745:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109772.049752:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933397376:0@lo:400:kworker.0 00000100:00100000:1.0:1786109772.049778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109772.049809:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933397760:0@lo:400:kworker.0 00000100:00100000:1.0:1786109772.049840:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109772.049868:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109772.049874:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933397632:0@lo:400:kworker.0 00000100:00100000:1.0:1786109772.049900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00020000:3.0:1786109772.050171:0:3645:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff930a893c0700 x1872862933396864/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:2.0:1786109772.050190:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca374d8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109772.050196:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109772.050200:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:3.0:1786109772.050225:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109772.050241:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:3.0:1786109772.050245:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:0:1872862933396864:0@lo:250:kworker.0 00000100:00100000:3.0:1786109772.050253:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933396992:0@lo:38:kworker.0 00010000:00010000:2.0:1786109772.050412:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930a8166d800/0xdb52b77d7ca374d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca374d8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.050428:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9453000/0xdb52b77d7ca37f66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca37f6d expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109772.050455:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9453000/0xdb52b77d7ca37f66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca37f6d expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109772.050461:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1786109772.050501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786109772.050537:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109772.050541:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9453000/0xdb52b77d7ca37f66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca37f6d expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.050552:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9453a00/0xdb52b77d7ca38023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3802a expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109772.050558:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9453a00/0xdb52b77d7ca38023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3802a expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109772.050563:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109772.050566:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109772.050569:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9453a00/0xdb52b77d7ca38023 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3802a expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.050589:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930986425200/0xdb52b77d7ca38054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3805b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109772.050594:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930986425200/0xdb52b77d7ca38054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3805b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109772.050598:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1786109772.050668:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933397248:0@lo:38:kworker.0 00000100:00100000:3.0:1786109772.050695:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.050716:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933397504:0@lo:38:kworker.0 00000100:00100000:3.0:1786109772.050738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.050756:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933397888:0@lo:38:kworker.0 00000100:00100000:3.0:1786109772.050775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786109772.050852:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109772.050857:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930986425200/0xdb52b77d7ca38054 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3805b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.050873:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9453800/0xdb52b77d7ca37f58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca37f5f expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109772.050880:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9453800/0xdb52b77d7ca37f58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca37f5f expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109772.050885:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109772.050888:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109772.050892:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9453800/0xdb52b77d7ca37f58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca37f5f expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.051023:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930a8166ca00/0xdb52b77d7ca37445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3744c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109772.051031:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930a8166ca00/0xdb52b77d7ca37445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3744c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109772.051045:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786109772.051050:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109772.051055:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930a8166ca00/0xdb52b77d7ca37445 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3744c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.051064:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930a8166cc00/0xdb52b77d7ca374b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca374bc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109772.051071:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930a8166cc00/0xdb52b77d7ca374b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca374bc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109772.051077:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786109772.051080:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109772.051084:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930a8166cc00/0xdb52b77d7ca374b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca374bc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.051093:0:201140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9452400/0xdb52b77d7ca38015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca3801c expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109772.051099:0:201140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9452400/0xdb52b77d7ca38015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca3801c expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109772.051104:0:201140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786109772.051107:0:201140:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1786109772.051110:0:201140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9452400/0xdb52b77d7ca38015 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca3801c expref: -99 pid: 198776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786109772.051130:0:201140:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff930a8a640000 already not connected (conn 13804, was 0): DISCONN 00000100:00080000:2.0:1786109772.051135:0:201140:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109772.051140:0:201140:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 8628 00000100:00080000:2.0:1786109772.051145:0:201140:0:(import.c:589:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109772.051150:0:201140:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff930a8a640000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109772.051177:0:201140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7f17800 x1872862933398016/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109772.051192:0:201140:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1786109772.051559:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933398016:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1786109772.051594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109772.051744:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933397120 00000100:00100000:2.0:1786109772.051753:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933397120 00000100:00100000:2.0:1786109772.051864:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933397376 00000100:00100000:2.0:1786109772.051869:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933397376 00000100:00100000:2.0:1786109772.051885:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933396992 00000100:00100000:2.0:1786109772.051888:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933396992 00000100:00100000:2.0:1786109772.051897:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933397248 00000100:00100000:2.0:1786109772.052015:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933397248 00000100:00100000:2.0:1786109772.052029:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933397888 00000100:00100000:2.0:1786109772.052032:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933397888 00000100:00100000:2.0:1786109772.052056:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1786109772.052068:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933397120:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109772.052099:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0fddc00 x1872862933397120/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:243/0 lens 224/224 e 0 to 0 dl 1786109783 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109772.052153:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933397120:12345-0@lo:400:kworker.0 Request processed in 87us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.052161:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1786109772.052179:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1786109772.052186:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933397376:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109772.052198:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930a97c4f800 x1872862933397376/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:243/0 lens 224/224 e 0 to 0 dl 1786109783 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109772.052226:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933397376:12345-0@lo:400:kworker.0 Request processed in 41us (2448us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.052233:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1786109772.052246:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:2.0:1786109772.052251:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933396992:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109772.052479:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109772.052522:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933396992:12345-0@lo:38:kworker.0 Request processed in 270us (2022us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109772.052529:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:2.0:1786109772.052540:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:2.0:1786109772.052544:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933397248:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109772.052554:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109772.052577:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933397248:12345-0@lo:38:kworker.0 Request processed in 31us (1882us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109772.052582:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:2.0:1786109772.052591:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1786109772.052595:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933397888:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109772.052673:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109772.052700:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933397888:12345-0@lo:38:kworker.0 Request processed in 103us (1924us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109772.052705:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1786109772.052735:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933397760 00000100:00100000:2.0:1786109772.052739:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933397760 00000100:00100000:2.0:1786109772.052780:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933397632 00000100:00100000:2.0:1786109772.052783:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933397632 00000100:00100000:2.0:1786109772.052880:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7151 00000100:00100000:2.0:1786109772.052887:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933397760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109772.053076:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933397760:12345-0@lo:400:kworker.0 Request processed in 189us (3234us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.053087:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7151 00000100:00100000:2.0:1786109772.053100:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7152 00000100:00100000:2.0:1786109772.053106:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933397632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109772.053138:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933397632:12345-0@lo:400:kworker.0 Request processed in 33us (3237us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.053143:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7152 00000100:00100000:2.0:1786109772.053171:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933397504 00000100:00100000:2.0:1786109772.053176:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933397504 00000100:00100000:2.0:1786109772.053197:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1786109772.053202:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1872862933397504:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109772.053215:0:187905:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109772.053245:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1872862933397504:12345-0@lo:38:kworker.0 Request processed in 42us (2505us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109772.053251:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1786109772.053521:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933398016 00000100:00100000:2.0:1786109772.053526:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933398016 00000100:00100000:2.0:1786109772.053550:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786109772.053555:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3645:x1872862933398016:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1786109772.053577:0:201148:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from aeab97cc-8463-4daa-a678-1bb2ad93cc69@0@lo t0 exp 0000000000000000 cur 8628 last 0 00000020:00000080:2.0:1786109772.053687:0:201148:0:(genops.c:1406:class_connect()) connect: client aeab97cc-8463-4daa-a678-1bb2ad93cc69, cookie 0xdb52b77d7ca38a1e 00000100:00080000:2.0:1786109772.054085:0:201148:0:(import.c:65:import_set_state_nolock()) ffff930a97c8d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109772.054146:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+5:3645:x1872862933398016:12345-0@lo:250:mount.lustre.0 Request processed in 589us (2550us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.054155:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786109772.054225:0:3645:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.138@tcp: committing for last_committed 0 gen 81 00000100:00080000:2.0:1786109772.054237:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.138@tcp: connect to target with instance 0 00000100:00080000:2.0:1786109772.054246:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1786109772.054252:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1786109772.054256:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a640000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1786109772.054485:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1786109772.054507:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1786109772.054519:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3645:1872862933398016:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1786109772.054541:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109772.054545:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109772.054548:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933396992:0@lo:38:kworker.0 00000100:00080000:2.0:1786109772.054561:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109772.054564:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109772.054567:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933397248:0@lo:38:kworker.0 00000100:00080000:2.0:1786109772.054578:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109772.054581:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109772.054584:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933397504:0@lo:38:kworker.0 00000100:00080000:2.0:1786109772.054594:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109772.054597:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109772.054600:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933397888:0@lo:38:kworker.0 00000100:00080000:2.0:1786109772.054667:0:201140:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1786109772.054679:0:201140:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1786109772.054719:0:201140:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1786109772.054725:0:201140:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1786109772.054864:0:201140:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786109772.054929:0:201140:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1786109772.054934:0:201140:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786109772.054936:0:201140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109772.054938:0:201140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109772.054939:0:201140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109772.054940:0:201140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109772.054942:0:201140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109772.054943:0:201140:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109772.054945:0:201140:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109772.054946:0:201140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109772.054947:0:201140:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786109772.054950:0:201140:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1786109772.054952:0:201140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786109772.054953:0:201140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109772.054954:0:201140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109772.054955:0:201140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109772.054955:0:201140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109772.054956:0:201140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109772.054957:0:201140:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109772.054958:0:201140:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109772.054959:0:201140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109772.054960:0:201140:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786109772.054984:0:201140:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1786109772.055002:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933398144:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786109772.055060:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109772.055094:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8df8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.055129:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933398144 00000100:00100000:2.0:1786109772.055134:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933398144 00000100:00100000:2.0:1786109772.055171:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786109772.055181:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+5:201140:x1872862933398144:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1786109772.055228:0:201146:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1786109772.055231:0:201146:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1786109772.055235:0:201146:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1786109772.055243:0:201146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00080000:0.0:1786109772.056151:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109772.056159:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109772.056524:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933397632:0@lo:400:kworker.0 00000100:00100000:1.0:1786109772.056542:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933397760:0@lo:400:kworker.0 00000100:00100000:1.0:1786109772.056590:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933397376:0@lo:400:kworker.0 00000020:01000000:0.0:1786109772.056758:0:183576:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.203.138@tcp 10000000:01000000:0.0:1786109772.056780:0:183576:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1786109772.056784:0:183576:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1786109772.057549:0:183576:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786109772.057553:0:183576:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109772.057554:0:183576:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109772.057555:0:183576:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109772.057557:0:183576:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109772.057559:0:183576:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786109772.057561:0:183576:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109772.057563:0:183576:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1786109772.057735:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933397120:0@lo:400:kworker.0 00000100:00100000:2.0:1786109772.058584:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+5:201140:x1872862933398144:12345-0@lo:253:mount.lustre.0 Request processed in 3398us (3517us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.058863:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1786109772.059426:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933398144:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786109772.059478:0:201140:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1786109772.059482:0:201140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786109772.059484:0:201140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786109772.059485:0:201140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109772.059486:0:201140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109772.059487:0:201140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109772.059488:0:201140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109772.059489:0:201140:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786109772.059491:0:201140:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786109772.059493:0:201140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109772.059494:0:201140:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1786109772.059521:0:201140:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93098617c000 from lustre-MDT0000 10000000:01000000:0.0:1786109772.059561:0:201140:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1786109772.059564:0:201140:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1786109772.059574:0:201140:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93098617c000 10000000:01000000:0.0:1786109772.059579:0:201140:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1786109772.059585:0:201140:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93098617c000 10000000:01000000:0.0:1786109772.059588:0:201140:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1786109772.059592:0:201140:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff93098617c000 from 1 10000000:01000000:0.0:1786109772.059595:0:201140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1786109772.059861:0:201140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca38a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109772.059874:0:201140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca38a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109772.059890:0:201140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca38a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109772.060023:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933398272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109772.060090:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109772.060139:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a9ae86540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.060424:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933398272 00000100:00100000:2.0:1786109772.060447:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933398272 00000100:00100000:2.0:1786109772.060496:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786109772.060507:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+5:201140:x1872862933398272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109772.060524:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109772.060545:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9412200/0xdb52b77d7ca38a2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38a25 expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.060573:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9412200/0xdb52b77d7ca38a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38a25 expref: 6 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.060586:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9412200/0xdb52b77d7ca38a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38a25 expref: 6 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.060597:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412200, rc 0) 00000100:00100000:2.0:1786109772.060861:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+6:201140:x1872862933398272:12345-0@lo:101:mount.lustre.0 Request processed in 354us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.060869:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786109772.061117:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933398272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109772.061137:0:201140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca38a25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38a2c expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.061147:0:201140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca38a25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38a2c expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109772.061169:0:201140:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1786109772.061189:0:201140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca38a25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38a2c expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.061197:0:201140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c2e00/0xdb52b77d7ca38a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38a2c expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109772.061206:0:201140:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1786109772.061212:0:201140:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786109772.061218:0:201140:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93098617c000 10000000:01000000:1.0:1786109772.061221:0:201140:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1786109772.061225:0:201140:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1786109772.061228:0:201140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1786109772.061251:0:201140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca38a33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.061479:0:201140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca38a33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.061492:0:201140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca38a33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109772.061511:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933398400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786109772.061550:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109772.061586:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a9056fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109772.061725:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933398400 00000100:00100000:1.0:1786109772.061731:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933398400 00000100:00100000:1.0:1786109772.061765:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786109772.061773:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+6:201140:x1872862933398400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109772.061784:0:201146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109772.061869:0:201146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9361200/0xdb52b77d7ca38a3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38a33 expref: -99 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.061889:0:201146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9361200/0xdb52b77d7ca38a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38a33 expref: 7 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.061898:0:201146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9361200/0xdb52b77d7ca38a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38a33 expref: 7 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.062031:0:201146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9361200, rc 0) 00000100:00100000:1.0:1786109772.062079:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:201140:x1872862933398400:12345-0@lo:101:mount.lustre.0 Request processed in 306us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109772.062086:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786109772.062133:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933398400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109772.062146:0:201140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca38a33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38a3a expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.062155:0:201140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca38a33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38a3a expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109772.062230:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933398528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109772.062583:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109772.062870:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a9056fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109772.062891:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933398528 00000100:00100000:1.0:1786109772.062897:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933398528 00000100:00100000:1.0:1786109772.063029:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786109772.063047:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+7:201140:x1872862933398528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109772.063236:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:201140:x1872862933398528:12345-0@lo:501:mount.lustre.0 Request processed in 190us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109772.063243:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786109772.063299:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933398528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109772.064155:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933398656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109772.064235:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109772.064477:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a9056fcc0 going to sleep for 11 seconds 00000020:01000000:3.0:1786109772.064647:0:183576:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1786109772.064670:0:183576:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1786109772.064673:0:183576:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1786109772.064675:0:183576:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1786109772.064677:0:183576:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109772.064678:0:183576:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109772.064680:0:183576:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109772.064681:0:183576:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109772.064683:0:183576:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786109772.064685:0:183576:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109772.064686:0:183576:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1786109772.064700:0:183576:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1786109772.064704:0:183576:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1786109772.064705:0:183576:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1786109772.064707:0:183576:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1786109772.064708:0:183576:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109772.064709:0:183576:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109772.064710:0:183576:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109772.064711:0:183576:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109772.064712:0:183576:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786109772.064713:0:183576:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109772.064714:0:183576:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1786109772.064736:0:183576:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1786109772.064773:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933399040:0@lo:253:kworker.0 00000100:00100000:2.0:1786109772.065088:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933398912:0@lo:253:kworker.0 00000100:00100000:2.0:1786109772.065142:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.065252:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109772.065462:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933398784:0@lo:253:kworker.0 00000100:00100000:1.0:1786109772.065503:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109772.066239:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933398656 00000100:00100000:2.0:1786109772.066250:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933398656 00000100:00100000:2.0:1786109772.066371:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933398912 00000100:00100000:2.0:1786109772.066375:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933398912 00000100:00100000:2.0:1786109772.066400:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933399040 00000100:00100000:2.0:1786109772.066402:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933399040 00000100:00100000:2.0:1786109772.066416:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786109772.066426:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201140:x1872862933398656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109772.069065:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201140:x1872862933398656:12345-0@lo:503:mount.lustre.0 Request processed in 2627us (4817us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.069084:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786109772.069157:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786109772.069173:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:3647:x1872862933398912:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1786109772.069211:0:201147:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1786109772.069229:0:201147:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1786109772.070228:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933398656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109772.071560:0:201152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201152:1872862933399168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109772.071809:0:201152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.071853:0:201152:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098be89000 going to sleep for 11 seconds 00000100:00100000:1.0:1786109772.075694:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933399168 00000100:00100000:1.0:1786109772.075714:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933399168 00000100:00100000:1.0:1786109772.075761:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933398784 00000100:00100000:1.0:1786109772.075764:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933398784 00000100:00100000:1.0:1786109772.076073:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786109772.076091:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:3648:x1872862933399040:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1786109772.076138:0:201146:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1786109772.076413:0:201147:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786109772.076459:0:201147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1786109772.077029:0:201149:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1786109772.077045:0:201149:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786109772.077075:0:201149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.077098:0:201149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930aa628b000/0xdb52b77d7ca38a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ff expref: 9 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.077107:0:201149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.077158:0:201149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930aa628b000/0xdb52b77d7ca38a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ff expref: 9 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.077187:0:201149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930aa628b000/0xdb52b77d7ca38a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ff expref: 9 pid: 201148 timeout: 8728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109772.077205:0:201149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201149:1872862933399296:192.168.203.38@tcp:104: 00000100:00100000:2.0:1786109772.077552:0:201149:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8df8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.078070:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:3647:x1872862933398912:12345-0@lo:253:kworker.0 Request processed in 8900us (12924us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.078083:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786109772.078131:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786109772.078143:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201152:x1872862933399168:12345-0@lo:502:llog_process_th.0 00000020:01000004:2.0:1786109772.078584:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1786109772.078588:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786109772.078589:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109772.078591:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109772.078592:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109772.078593:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109772.078595:0:3647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786109772.078597:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109772.078756:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1786109772.078762:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933398912:0@lo:253:kworker.0 00000100:00100000:2.0:1786109772.079774:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201152:x1872862933399168:12345-0@lo:502:llog_process_th.0 Request processed in 1627us (7958us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109772.080023:0:201152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201152:1872862933399168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786109772.080081:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109772.080097:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109772.080100:0:201152:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1786109772.080106:0:201152:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1786109772.080111:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109772.080132:0:201152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff930ab99d19c0) 00000020:00000080:3.0:1786109772.080164:0:201152:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1786109772.080171:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1786109772.080323:0:201152:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1786109772.080333:0:201152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca38a4f 00000020:00000080:3.0:1786109772.081465:0:201152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1786109772.081477:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109772.081486:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109772.081489:0:201152:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1786109772.081492:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109772.081497:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109772.081499:0:201152:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1786109772.081503:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109772.081518:0:201152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff930ab99d4d40) 00000020:00000080:3.0:1786109772.081542:0:201152:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1786109772.081548:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1786109772.081550:0:201152:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1786109772.081553:0:201152:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1786109772.081560:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1786109772.082418:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786109772.082526:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786109772.082542:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:3646:x1872862933398784:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1786109772.082585:0:201147:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1786109772.083215:0:201147:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:3.0:1786109772.085114:0:201152:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93098617c000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1786109772.085149:0:201152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff930ab99d3380) 00000020:00000080:3.0:1786109772.085176:0:201152:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1786109772.086011:0:201152:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1786109772.086026:0:201152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca38a64 00000020:00000080:3.0:1786109772.086232:0:201152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1786109772.086241:0:201152:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1786109772.086248:0:201152:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdb52b77d7ca38a6b 00080000:01000000:3.0:1786109772.086256:0:201152:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1786109772.086273:0:201152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca38a72 00000100:00100000:0.0:1786109772.089813:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109772.089911:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922188928 00000100:00100000:3.0:1786109772.089923:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922188928 00010000:00010000:3.0:1786109772.089968:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930aa628b000/0xdb52b77d7ca38a02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ff expref: 10 pid: 201148 timeout: 8728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109772.090018:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12654 00000100:00100000:3.0:1786109772.090097:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922188928:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109772.090117:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109772.090124:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930aa628b000/0xdb52b77d7ca38a02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ff expref: 10 pid: 201148 timeout: 8728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.090139:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930aa628b000/0xdb52b77d7ca38a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ff expref: 10 pid: 201148 timeout: 8728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.090414:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.090425:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1786109772.090479:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013434409s 00010000:00010000:3.0:1786109772.090486:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.090494:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.090505:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.090511:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.090518:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109772.090523:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.090532:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.090541:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.090552:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109772.090616:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922188928:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 522us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109772.090626:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12654 20000000:01000000:0.0:1786109772.090884:0:201147:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786109772.090891:0:201147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1786109772.091132:0:201146:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1786109772.091360:0:201149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930aa628b000/0xdb52b77d7ca38a02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18ff expref: 9 pid: 201148 timeout: 8728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109772.091389:0:201149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f17800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201149:1872862933399296:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109772.091416:0:201149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.091425:0:201149:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.091504:0:201149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.091510:0:201149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9413800/0xdb52b77d7ca38a41 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786109772.091524:0:201149:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786109772.091528:0:201149:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786109772.091545:0:201149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.091557:0:201149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a79 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786109772.091565:0:201149:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013434409s 00010000:00010000:1.0:1786109772.091569:0:201149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a79 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.091574:0:201149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a79 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.091580:0:201149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a79 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.091586:0:201149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a79 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.091593:0:201149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109772.091596:0:201149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a79 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.091604:0:201149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.091614:0:201149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a79 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.091620:0:201149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.091627:0:201149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a79 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109772.092330:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:3646:x1872862933398784:12345-0@lo:253:kworker.0 Request processed in 9788us (26818us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109772.092343:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000020:01000004:1.0:1786109772.092470:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1786109772.092473:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786109772.092475:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786109772.092476:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786109772.092477:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786109772.092479:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786109772.092481:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786109772.092483:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786109772.092485:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1786109772.092488:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933398784:0@lo:253:kworker.0 20000000:01000000:3.0:1786109772.116371:0:201146:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786109772.117539:0:201146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1786109772.118021:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:3648:x1872862933399040:12345-0@lo:253:kworker.0 Request processed in 41928us (52761us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109772.118177:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000020:01000004:3.0:1786109772.118251:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1786109772.118254:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1786109772.118256:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109772.118257:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109772.118259:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109772.118261:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109772.118263:0:3648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786109772.118265:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109772.118267:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1786109772.118270:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933399040:0@lo:253:kworker.0 20000000:01000000:1.0:1786109772.118551:0:201149:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786109772.118559:0:201149:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786109772.118588:0:201149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.118673:0:201149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a80 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786109772.118686:0:201149:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013434409s 00010000:00010000:1.0:1786109772.118692:0:201149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.118700:0:201149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.118708:0:201149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a80 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.118716:0:201149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.118724:0:201149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109772.118729:0:201149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.118742:0:201149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.118758:0:201149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a80 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.118766:0:201149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.118772:0:201149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9360a00/0xdb52b77d7ca38a80 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.166650:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109772.200481:0:201152:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1786109772.201593:0:201152:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: fac74500-4523-4794-af20-dfdcdfae19c1 idx: 0 lr: 339302416393 srv lr: 343597383680 lx: 0 gen 24 00000001:00080000:2.0:1786109772.201829:0:201152:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 339302416391 srv lr: 343597383680 lx: 0 gen 23 00000001:00000004:2.0:1786109772.201867:0:201152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 81, last_transno is 343597383680 00000001:00080000:2.0:1786109772.202013:0:201152:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1786109772.202427:0:201152:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930aafd133c0: xid 1872862922143616, transno 343597383691, client gen 24, slot idx 0 00000001:00080000:2.0:1786109772.202469:0:201152:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930aafd13b40: xid 1872862933329792, transno 343597383690, client gen 23, slot idx 1 00000001:00080000:2.0:1786109772.202475:0:201152:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930a88e76e40: xid 1872862933333376, transno 343597383692, client gen 23, slot idx 2 00000001:00080000:2.0:1786109772.202481:0:201152:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ab7e42000: xid 1872862922144512, transno 343597383693, client gen 24, slot idx 3 00000001:00080000:2.0:1786109772.202487:0:201152:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ab7e42600: xid 1872862932692096, transno 322122568361, client gen 23, slot idx 4 00000001:00080000:2.0:1786109772.202491:0:201152:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff930ab7e42e40: xid 1872862932691584, transno 322122568360, client gen 23, slot idx 5 00000020:00000080:2.0:1786109772.206096:0:201152:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff930ab1d499c0) 00000020:00000080:2.0:1786109772.206134:0:201152:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1786109772.206275:0:201152:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1786109772.206284:0:201152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca38a9c 00000020:00000080:1.0:1786109772.214585:0:201152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1786109772.220216:0:201152:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdb52b77d7ca38aa3 00000020:00000080:1.0:1786109772.221900:0:201152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1786109772.221915:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109772.221923:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.221925:0:201152:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1786109772.221928:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1786109772.221931:0:201152:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1786109772.221932:0:201152:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786109772.221934:0:201152:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786109772.221935:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1786109772.221938:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.221939:0:201152:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1786109772.221941:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109772.221947:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.221948:0:201152:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1786109772.221954:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1786109772.222004:0:201152:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1786109772.222024:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109772.222028:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.222030:0:201152:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1786109772.222032:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109772.222035:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.222037:0:201152:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1786109772.222040:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1786109772.222044:0:201152:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:1.0:1786109772.222068:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786109772.222121:0:201152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff930a97cbcd40) 00000020:00000080:1.0:1786109772.222144:0:201152:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1786109772.222149:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1786109772.222230:0:201152:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1786109772.222236:0:201152:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1786109772.222242:0:201152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca38ab1 00010000:00080000:1.0:1786109772.222275:0:201152:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930a88c1d800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1786109772.225205:0:201152:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1786109772.235791:0:201152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109772.235807:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1786109772.235851:0:201152:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1786109772.235873:0:201152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca38ab8 00000100:00080000:3.0:1786109772.235884:0:201152:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786109772.235890:0:201152:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930a88c1d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109772.235925:0:201152:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a893c2300 x1872862933399424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786109772.236029:0:201152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1786109772.236105:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109772.236111:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109772.236113:0:201152:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1786109772.236116:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1786109772.236119:0:201152:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1786109772.236121:0:201152:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109772.236122:0:201152:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109772.236124:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1786109772.236126:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109772.236128:0:201152:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1786109772.236130:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786109772.236135:0:201152:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1786109772.236139:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109772.236140:0:201152:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1786109772.236143:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1786109772.236147:0:201152:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1786109772.236172:0:201152:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1786109772.236175:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109772.236188:0:201152:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff930ab99d0000) 00000020:00000080:3.0:1786109772.236204:0:201152:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1786109772.236209:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1786109772.236267:0:201152:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1786109772.236273:0:201152:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:3.0:1786109772.236278:0:201152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca38ac6 00010000:00080000:3.0:1786109772.236308:0:201152:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930ac0b3a800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.138@tcp at head 00000100:00100000:2.0:1786109772.236460:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933399424:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786109772.236532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109772.236613:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933399424 00000100:00100000:2.0:1786109772.236620:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933399424 00000100:00100000:2.0:1786109772.236652:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1786109772.236659:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1872862933399424:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1786109772.236682:0:187904:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8628 last 0 00000020:00000080:2.0:1786109772.236716:0:187904:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca38acd 00000004:00100000:2.0:1786109772.236729:0:187904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786109772.236817:0:187904:0:(import.c:65:import_set_state_nolock()) ffff930ac0c8b000 : changing import state from RECOVER to FULL 00010000:00000080:2.0:1786109772.236838:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7f14000 x1872862933399424/t0(0) o38->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1786109792 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109772.236884:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933399424:12345-0@lo:38:llog_process_th.0 Request processed in 224us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.236891:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1786109772.236953:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786109772.236962:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 7 00000100:00080000:2.0:1786109772.236969:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1786109772.236973:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1786109772.236976:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1786109772.236982:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933399424:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1786109772.237314:0:201152:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1786109772.237783:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109772.237796:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933399552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109772.237834:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.238034:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933399552 00000100:00100000:3.0:1786109772.238041:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933399552 00000100:00100000:3.0:1786109772.238088:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1786109772.238097:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933399552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786109772.238127:0:199402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446019072 avail 1299779584 00010000:00000080:3.0:1786109772.238141:0:199402:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7f17800 x1872862933399552/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:243/0 lens 224/368 e 0 to 0 dl 1786109783 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109772.238186:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933399552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109772.238194:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1786109772.238238:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933399552:0@lo:41:osp-pre-1-0.0 00000040:01000000:3.0:1786109772.238873:0:201152:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1786109772.238897:0:201152:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1786109772.238972:0:201152:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 79, last_idx 80 00000040:00080000:3.0:1786109772.239923:0:201152:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109772.239951:0:201152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].81, 64 off13376 00000040:00080000:3.0:1786109772.240120:0:201152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x144:0x0].1, 64 off8256 00000040:00080000:2.0:1786109772.241003:0:201158:0:(llog.c:805:llog_process_thread()) index: 80, lh_last_idx: 81 synced_idx: 0 lgh_last_idx: 81 00000040:00080000:2.0:1786109772.241009:0:201158:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x140:0x0] at index 80 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1786109772.241144:0:201158:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 80, last_idx 81 00000040:00080000:2.0:1786109772.241160:0:201158:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x140:0x0] at index 80 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1786109772.241267:0:201158:0:(llog.c:805:llog_process_thread()) index: 81, lh_last_idx: 81 synced_idx: 81 lgh_last_idx: 81 00000040:00080000:2.0:1786109772.241271:0:201158:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x144:0x0] at index 81 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1786109772.242054:0:201152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786109772.242066:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1786109772.242105:0:201152:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1786109772.242131:0:201152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca38ad4 00000100:00080000:3.0:1786109772.242141:0:201152:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786109772.242147:0:201152:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff930ac0b3a800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109772.242181:0:201152:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a893c0700 x1872862933399680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109772.242238:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933399680:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1786109772.242305:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786109772.242373:0:201152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1786109772.242481:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109772.242486:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109772.242488:0:201152:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1786109772.242491:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1786109772.242493:0:201152:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1786109772.242495:0:201152:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109772.242496:0:201152:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786109772.242498:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1786109772.242500:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109772.242501:0:201152:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1786109772.242504:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786109772.242508:0:201152:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1786109772.242511:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109772.242512:0:201152:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1786109772.242515:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1786109772.242518:0:201152:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:3.0:1786109772.242537:0:201152:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1786109772.242539:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109772.242552:0:201152:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff930ab7c4b380) 00000020:00000080:3.0:1786109772.242567:0:201152:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type osp with refcount 2 00000020:00000080:3.0:1786109772.242572:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1786109772.242785:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933399680 00000100:00100000:0.0:1786109772.242793:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933399680 00000100:00100000:0.0:1786109772.242835:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23191 00000100:00100000:0.0:1786109772.242843:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3645:x1872862933399680:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1786109772.242868:0:43916:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8628 last 0 00000020:00000080:0.0:1786109772.242890:0:43916:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca38ae2 00002000:00100000:0.0:1786109772.242903:0:43916:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff930a83bbd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1786109772.242907:0:43916:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1786109772.242910:0:43916:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1786109772.242973:0:43916:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1786109772.242995:0:43916:0:(import.c:65:import_set_state_nolock()) ffff930a83bb9000 : changing import state from RECOVER to FULL 00000004:00080000:3.0:1786109772.243088:0:201152:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1786109772.243094:0:201152:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:3.0:1786109772.243101:0:201152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb52b77d7ca38ae9 00010000:00080000:3.0:1786109772.243125:0:201152:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930ab198a800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1786109772.243306:0:201152:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1786109772.243363:0:201152:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1786109772.243412:0:201152:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1786109772.243520:0:201152:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 79, last_idx 80 00000040:00080000:3.0:1786109772.244393:0:201152:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109772.244424:0:201152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].81, 64 off13376 00000040:00080000:3.0:1786109772.244572:0:201152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x146:0x0].1, 64 off8256 00000040:00080000:1.0:1786109772.245170:0:201160:0:(llog.c:805:llog_process_thread()) index: 80, lh_last_idx: 81 synced_idx: 0 lgh_last_idx: 81 00000040:00080000:1.0:1786109772.245175:0:201160:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x142:0x0] at index 80 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1786109772.245285:0:201160:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 80, last_idx 81 00000040:00080000:1.0:1786109772.245300:0:201160:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x142:0x0] at index 80 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1786109772.245418:0:201160:0:(llog.c:805:llog_process_thread()) index: 81, lh_last_idx: 81 synced_idx: 81 lgh_last_idx: 81 00000040:00080000:1.0:1786109772.245422:0:201160:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x146:0x0] at index 81 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1786109772.246126:0:201152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1786109772.246136:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1786109772.246169:0:201152:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1786109772.246190:0:201152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca38af0 00000100:00080000:1.0:1786109772.246199:0:201152:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786109772.246205:0:201152:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff930ab198a800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109772.246236:0:201152:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab9660a80 x1872862933399808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109772.246331:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933399808:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1786109772.246407:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.246506:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933399808 00000100:00100000:3.0:1786109772.246514:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933399808 00000100:00100000:3.0:1786109772.246546:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23192 00000100:00100000:3.0:1786109772.246554:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3645:x1872862933399808:12345-0@lo:8:llog_process_th.0 00000100:00100000:0.0:1786109772.246887:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933399680:12345-0@lo:8:llog_process_th.0 Request processed in 4040us (4579us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109772.246896:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23191 00010000:00080000:3.0:1786109772.246963:0:43922:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8628 last 0 00000020:00000080:3.0:1786109772.246990:0:43922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb52b77d7ca38af7 00002000:00100000:3.0:1786109772.247002:0:43922:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff930ab9960800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1786109772.247007:0:43922:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1786109772.247010:0:43922:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1786109772.247072:0:43922:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786109772.247095:0:43922:0:(import.c:65:import_set_state_nolock()) ffff930ab9965000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786109772.247147:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933399808:12345-0@lo:8:llog_process_th.0 Request processed in 592us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109772.247154:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23192 00000100:00100000:2.0:1786109772.249559:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786109772.249573:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 9 00000100:00080000:2.0:1786109772.249582:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1786109772.249587:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1786109772.249591:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ac0b3a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1786109772.249740:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1786109772.249750:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933399680:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1786109772.249788:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786109772.249792:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1786109772.249797:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1786109772.249800:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1786109772.249802:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab198a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1786109772.249813:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1786109772.249817:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933399808:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1786109772.249886:0:201158:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1786109772.249965:0:201158:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8628916533721ns, next at 0ns, rc = 0 00080000:00080000:3.0:1786109772.249972:0:201158:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1786109772.250975:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933399936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109772.251042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1786109772.251093:0:201160:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1786109772.251149:0:201160:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8628917717710ns, next at 0ns, rc = 0 00080000:00080000:1.0:1786109772.251154:0:201160:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:1.0:1786109772.251165:0:201152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1786109772.251548:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933399936 00000100:00100000:2.0:1786109772.251556:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933399936 00000100:00100000:2.0:1786109772.251620:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5975 00000100:00100000:2.0:1786109772.251629:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933399936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109772.251656:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109772.251704:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933399936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.251711:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5975 00000100:00100000:2.0:1786109772.251749:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933399936:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786109772.251854:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1786109772.252488:0:201141:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1786109772.253573:0:201141:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:01000000:1.0:1786109772.253970:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109772.253977:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.253979:0:201152:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1786109772.253984:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109772.253988:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.253989:0:201152:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1786109772.253992:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786109772.253994:0:201152:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1786109772.253996:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109772.253998:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.253999:0:201152:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1786109772.254001:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109772.254003:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.254004:0:201152:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1786109772.254007:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1786109772.254049:0:201152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201152:1872862933400064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109772.254127:0:201152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109772.254173:0:201152:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab19ee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.254226:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933400064 00000100:00100000:2.0:1786109772.254233:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933400064 00000100:00100000:2.0:1786109772.254285:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786109772.254295:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a86928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:201152:x1872862933400064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786109772.254414:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a86928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:201152:x1872862933400064:12345-0@lo:502:llog_process_th.0 Request processed in 121us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.254422:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1786109772.254655:0:201152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201152:1872862933400064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786109772.254678:0:201152:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109772.254682:0:201152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.254684:0:201152:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1786109772.254688:0:201152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1786109772.254905:0:201140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1786109772.254931:0:201140:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1786109772.254956:0:201140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca38a33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38a3a expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.254966:0:201140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9361400/0xdb52b77d7ca38a33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38a3a expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109772.254979:0:201140:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93098617c000 from 1 10000000:01000000:2.0:1786109772.254982:0:201140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1786109772.255011:0:201140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.255019:0:201140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.255027:0:201140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109772.255041:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933400192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1786109772.255071:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109772.255107:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098469fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109772.255196:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933400192 00000100:00100000:1.0:1786109772.255200:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933400192 00000100:00100000:1.0:1786109772.255238:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786109772.255245:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+8:201140:x1872862933400192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109772.255254:0:201146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109772.255267:0:201146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca38b05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38afe expref: -99 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.255288:0:201146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca38b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38afe expref: 9 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.255298:0:201146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca38b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38afe expref: 9 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.255306:0:201146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9361e00, rc 0) 00000100:00100000:1.0:1786109772.255348:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:201140:x1872862933400192:12345-0@lo:101:mount.lustre.0 Request processed in 103us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109772.255353:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786109772.255458:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933400192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109772.255472:0:201140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b05 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109772.255481:0:201140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b05 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109772.256037:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933400320:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1786109772.256080:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109772.256103:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.256239:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933400320 00000100:00100000:2.0:1786109772.256244:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933400320 00000100:00100000:2.0:1786109772.256286:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786109772.256294:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:201140:x1872862933400320:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1786109772.256309:0:201148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1786109772.256327:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1786109772.256331:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1786109772.256334:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1786109772.256337:0:201148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 336 00000100:00100000:2.0:1786109772.256456:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:201140:x1872862933400320:12345-0@lo:256:mount.lustre.0 Request processed in 162us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.256464:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786109772.256637:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933400320:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1786109772.257316:0:201140:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786109772.257403:0:201140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b05 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109772.257414:0:201140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b05 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109772.257422:0:201140:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93098617c000 from 1 10000000:01000000:0.0:1786109772.257425:0:201140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786109772.257482:0:201140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca38b0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109772.257491:0:201140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca38b0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109772.257500:0:201140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca38b0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109772.257520:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933400448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109772.257557:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109772.257588:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f000 going to sleep for 11 seconds 00000100:00100000:3.0:1786109772.257769:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786109772.257780:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933400576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109772.257834:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109772.257942:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933400448 00000100:00100000:1.0:1786109772.257948:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933400448 00000100:00100000:1.0:1786109772.257981:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786109772.257990:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+9:201140:x1872862933400448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786109772.258001:0:201148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109772.258014:0:201148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9360200/0xdb52b77d7ca38b13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38b0c expref: -99 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.258036:0:201148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9360200/0xdb52b77d7ca38b13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b0c expref: 10 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.258046:0:201148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9360200/0xdb52b77d7ca38b13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b0c expref: 10 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.258054:0:201148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360200, rc 0) 00000100:00100000:1.0:1786109772.258085:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201140:x1872862933400448:12345-0@lo:101:mount.lustre.0 Request processed in 97us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109772.258091:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786109772.258204:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933400576 00000100:00100000:0.0:1786109772.258208:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933400576 00000100:00100000:0.0:1786109772.258267:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5976 00000100:00100000:0.0:1786109772.258274:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933400576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109772.258293:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140864 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109772.258331:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933400576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109772.258337:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5976 00000100:00100000:0.0:1786109772.258390:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933400576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109772.258420:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933400448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109772.258456:0:201140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca38b0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b13 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109772.258465:0:201140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca38b0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b13 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109772.258522:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933400704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109772.258548:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109772.258570:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f000 going to sleep for 11 seconds 00000100:00100000:0.0:1786109772.258585:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933400704 00000100:00100000:0.0:1786109772.258589:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933400704 00000100:00080000:3.0:1786109772.258697:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109772.258742:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786109772.258750:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201140:x1872862933400704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109772.258845:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201140:x1872862933400704:12345-0@lo:501:mount.lustre.0 Request processed in 96us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109772.258853:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786109772.258885:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933400704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109772.258915:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933400832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109772.258957:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109772.259019:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac085f000 going to sleep for 11 seconds 00000100:00100000:3.0:1786109772.259158:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933400832 00000100:00100000:3.0:1786109772.259163:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933400832 00000100:00100000:3.0:1786109772.259222:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786109772.259230:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201140:x1872862933400832:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109772.259329:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201140:x1872862933400832:12345-0@lo:503:mount.lustre.0 Request processed in 99us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109772.259336:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786109772.259420:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933400832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109772.259909:0:201162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201162:1872862933400960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109772.259948:0:201162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109772.260204:0:201162:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab19eec00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109772.260263:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933400960 00000100:00100000:0.0:1786109772.260268:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933400960 00000100:00100000:0.0:1786109772.260290:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786109772.260296:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201162:x1872862933400960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109772.260814:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201162:x1872862933400960:12345-0@lo:502:llog_process_th.0 Request processed in 516us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109772.260822:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786109772.260894:0:201162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201162:1872862933400960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786109772.260920:0:201162:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109772.260929:0:201162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.260931:0:201162:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1786109772.260939:0:201162:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93098617c000 00000020:00000080:1.0:1786109772.260941:0:201162:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786109772.260948:0:201162:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109772.260951:0:201162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.260952:0:201162:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1786109772.260954:0:201162:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109772.260957:0:201162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.260958:0:201162:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786109772.260962:0:201162:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93098617c000 00000020:00000080:1.0:1786109772.260964:0:201162:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1786109772.261046:0:201162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201162:1872862933401088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786109772.261084:0:201162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109772.261107:0:201162:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab19eec00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109772.262451:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933401088 00000100:00100000:3.0:1786109772.262461:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933401088 00000100:00100000:3.0:1786109772.262508:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786109772.262518:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201162:x1872862933401088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109772.262826:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201162:x1872862933401088:12345-0@lo:502:llog_process_th.0 Request processed in 308us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109772.262834:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786109772.265759:0:201162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201162:1872862933401088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786109772.265818:0:201162:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109772.265827:0:201162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109772.265830:0:201162:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1786109772.265835:0:201162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1786109772.270581:0:201140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1786109772.270717:0:201140:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786109772.270782:0:201140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca38b0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b13 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.270794:0:201140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3800/0xdb52b77d7ca38b0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b13 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109772.271556:0:201140:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1786109772.271560:0:201140:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93098617c000 10000000:01000000:3.0:1786109772.271564:0:201140:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93098617c000 10000000:01000000:3.0:1786109772.271569:0:201140:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786109772.271574:0:201140:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93098617c000 from 1 10000000:01000000:3.0:1786109772.271577:0:201140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786109772.271629:0:201140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628ac00/0xdb52b77d7ca38b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.271638:0:201140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930aa628ac00/0xdb52b77d7ca38b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.271653:0:201140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930aa628ac00/0xdb52b77d7ca38b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109772.271676:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933401216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786109772.271733:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.271777:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0f14000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.272463:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933401216 00000100:00100000:2.0:1786109772.272472:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933401216 00000100:00100000:2.0:1786109772.272517:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786109772.272526:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:201140:x1872862933401216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109772.272541:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109772.272554:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9413e00/0xdb52b77d7ca38b21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38b1a expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.272579:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9413e00/0xdb52b77d7ca38b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b1a expref: 11 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.272588:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9413e00/0xdb52b77d7ca38b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b1a expref: 11 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.272611:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413e00, rc 0) 00000100:00100000:2.0:1786109772.272666:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201140:x1872862933401216:12345-0@lo:101:mount.lustre.0 Request processed in 141us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.272673:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786109772.272822:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933401216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786109772.272838:0:201140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930aa628ac00/0xdb52b77d7ca38b1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b21 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109772.272847:0:201140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930aa628ac00/0xdb52b77d7ca38b1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b21 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109772.272912:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933401344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109772.272942:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.272977:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0f14000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.273024:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933401344 00000100:00100000:2.0:1786109772.273029:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933401344 00000100:00100000:2.0:1786109772.273065:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786109772.273073:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201140:x1872862933401344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109772.273184:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201140:x1872862933401344:12345-0@lo:501:mount.lustre.0 Request processed in 112us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.273191:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786109772.273259:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933401344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109772.273286:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933401472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109772.273327:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.273355:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0f14000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.273404:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933401472 00000100:00100000:2.0:1786109772.273409:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933401472 00000100:00100000:2.0:1786109772.273458:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786109772.273466:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201140:x1872862933401472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109772.273539:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201140:x1872862933401472:12345-0@lo:503:mount.lustre.0 Request processed in 74us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.273546:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786109772.274481:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933401472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109772.274943:0:201165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201165:1872862933401600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109772.274995:0:201165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.275035:0:201165:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0f14e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109772.275118:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933401600 00000100:00100000:0.0:1786109772.275124:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933401600 00000100:00100000:0.0:1786109772.275170:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786109772.275178:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201165:x1872862933401600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109772.275283:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201165:x1872862933401600:12345-0@lo:502:llog_process_th.0 Request processed in 105us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109772.275290:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786109772.275340:0:201165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201165:1872862933401600:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1786109772.275626:0:201165:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1786109772.275642:0:201165:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff930982480000) 00000020:00000080:0.0:1786109772.275667:0:201165:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1786109772.275829:0:201165:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93098617c000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1786109772.275834:0:201165:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93098617c000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1786109772.275836:0:201165:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93098617c000 4 00010000:00080000:0.0:1786109772.275862:0:201165:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93098e512800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1786109772.280853:0:201165:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1786109772.280968:0:201165:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1786109772.281017:0:201165:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786109772.281030:0:201165:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdb52b77d7ca38b2f 00000100:00080000:0.0:1786109772.281040:0:201165:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786109772.281046:0:201165:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93098e512800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109772.281079:0:201165:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930aa60a1500 x1872862933401728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109772.281113:0:201165:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1786109772.283826:0:201165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201165:1872862933401856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109772.283898:0:201165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.283938:0:201165:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0f146c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.284014:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933401728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786109772.284049:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.284416:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933401728 00000100:00100000:3.0:1786109772.284423:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933401728 00000100:00100000:3.0:1786109772.284499:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1786109772.284506:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933401728:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1786109772.284563:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933401728:12345-0@lo:38:llog_process_th.0 Request processed in 56us (512us total) trans 0 rc -11/-11 00000100:00100000:3.0:1786109772.284570:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1786109772.284686:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786109772.284694:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098e512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109772.284698:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1786109772.284702:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa60a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933401728:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786109772.284896:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933401856 00000100:00100000:0.0:1786109772.284901:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933401856 00000100:00100000:0.0:1786109772.284937:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786109772.284944:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201165:x1872862933401856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786109772.285057:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201165:x1872862933401856:12345-0@lo:502:llog_process_th.0 Request processed in 112us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109772.285064:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1786109772.285591:0:201165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201165:1872862933401856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109772.285800:0:201165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201165:1872862933401984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109772.285845:0:201165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109772.289714:0:201165:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0f146c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.290625:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933401984 00000100:00100000:2.0:1786109772.290636:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933401984 00000100:00100000:3.0:1786109772.290833:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786109772.290843:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201165:x1872862933401984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786109772.291057:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201165:x1872862933401984:12345-0@lo:502:llog_process_th.0 Request processed in 214us (5211us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109772.291066:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786109772.291718:0:201165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201165:1872862933401984:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786109772.291827:0:201165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1786109772.291997:0:201140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1786109772.292021:0:201140:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786109772.292077:0:201140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628ac00/0xdb52b77d7ca38b1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b21 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.292088:0:201140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930aa628ac00/0xdb52b77d7ca38b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b21 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1786109772.292136:0:201140:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1786109772.292139:0:201140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109772.292141:0:201140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109772.292142:0:201140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109772.292143:0:201140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109772.292145:0:201140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109772.292146:0:201140:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109772.292147:0:201140:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109772.292149:0:201140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109772.292150:0:201140:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786109772.292154:0:201140:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1786109772.292156:0:201140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786109772.292157:0:201140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786109772.292159:0:201140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109772.292160:0:201140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109772.292161:0:201140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109772.292161:0:201140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109772.292162:0:201140:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109772.292163:0:201140:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786109772.292164:0:201140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109772.292166:0:201140:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786109772.292187:0:201140:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1786109772.292204:0:201140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933402112:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786109772.292252:0:201140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109772.292294:0:201140:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9689840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109772.292352:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933402112 00000100:00100000:1.0:1786109772.292357:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933402112 00000100:00100000:1.0:1786109772.292407:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786109772.292416:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201140:x1872862933402112:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1786109772.292479:0:201148:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1786109772.292493:0:201148:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1786109772.298177:0:201148:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1786109772.298247:0:201148:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1786109772.298578:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:201140:x1872862933402112:12345-0@lo:253:mount.lustre.0 Request processed in 6159us (6321us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109772.298590:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786109772.298797:0:201140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:201140:1872862933402112:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1786109772.298810:0:201140:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1786109772.298813:0:201140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786109772.298815:0:201140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786109772.298816:0:201140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786109772.298818:0:201140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786109772.298819:0:201140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786109772.298820:0:201140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786109772.298821:0:201140:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786109772.298823:0:201140:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786109772.298824:0:201140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786109772.298825:0:201140:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1786109772.298839:0:201140:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1786109772.299754:0:201149:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1786109772.299759:0:201149:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786109772.299780:0:201149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.299797:0:201149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca38b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38afe expref: 10 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.299804:0:201149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.299840:0:201149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca38b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca38afe expref: 10 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.299855:0:201149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca38b05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb52b77d7ca38afe expref: 10 pid: 201146 timeout: 8728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109772.299869:0:201149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201149:1872862933402240:0@lo:104: 00000100:00100000:2.0:1786109772.299918:0:201149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109772.300037:0:201149:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9689300 going to sleep for 11 seconds 00000100:00100000:0.0:1786109772.300132:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933402240 00000100:00100000:0.0:1786109772.300139:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933402240 00000100:00100000:0.0:1786109772.300182:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5273 00000100:00100000:0.0:1786109772.300190:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:201149:x1872862933402240:12345-0@lo:104: 00010000:00010000:0.0:1786109772.300202:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca38b05 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109772.300327:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786109772.300333:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:201149:x1872862933402240:12345-0@lo:104: Request processed in 144us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109772.300339:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5273 00010000:00010000:2.0:1786109772.300392:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109772.300398:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca38b05 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300405:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412c00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:2.0:1786109772.300409:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb52b77d7ca38b05 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300416:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca38b05 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109772.300424:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca38b05 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109772.300456:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1786109772.300484:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca38b05 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300490:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786109772.300512:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca38b05 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300519:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38afe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca38b05 expref: -99 pid: 201140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300535:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109772.300537:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109772.300539:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109772.300632:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786109772.300644:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933402368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109772.300674:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109772.300799:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933402368 00000100:00100000:2.0:1786109772.300803:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933402368 00010000:00010000:2.0:1786109772.300822:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca38b05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca38afe expref: 11 pid: 201146 timeout: 8728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109772.300862:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12655 00000100:00100000:2.0:1786109772.300869:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa60a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:3649:x1872862933402368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109772.300881:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109772.300886:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca38b05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca38afe expref: 11 pid: 201146 timeout: 8728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300896:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca38b05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb52b77d7ca38afe expref: 11 pid: 201146 timeout: 8728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300913:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300920:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786109772.300933:0:6512:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013434409s 00010000:00010000:2.0:1786109772.300938:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300945:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300951:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300963:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300969:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109772.300973:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300980:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300988:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109772.300997:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109772.301027:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa60a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:3649:x1872862933402368:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.301034:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12655 00000100:00100000:0.0:1786109772.301103:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933402368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786109772.302283:0:201149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9361e00/0xdb52b77d7ca38b05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca38afe expref: 10 pid: 201146 timeout: 8728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109772.302298:0:201149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9660a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201149:1872862933402240:0@lo:104: 00010000:00010000:1.0:1786109772.302317:0:201149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.302326:0:201149:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.302333:0:201149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109772.302339:0:201149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9413200/0xdb52b77d7ca38b36 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1786109772.307877:0:201140:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 322122568692 00000040:01000000:3.0:1786109772.308218:0:201140:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1786109772.308691:0:201171:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1786109772.311161:0:201140:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:0.0:1786109772.312015:0:201140:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1786109772.312056:0:201140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1786109772.312527:0:201140:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1786109772.312536:0:201140:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1786109772.312572:0:201140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786109772.313052:0:201172:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201172:1872862933402496:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109772.313123:0:201172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109772.313174:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933402496 00000100:00100000:2.0:1786109772.313181:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933402496 00000100:00100000:2.0:1786109772.313230:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786109772.313239:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:201172:x1872862933402496:12345-0@lo:1000:lod0000_rec0001.0 00010000:00000080:2.0:1786109772.313289:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0fdc000 x1872862933402496/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:243/0 lens 304/4320 e 0 to 0 dl 1786109783 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109772.313328:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:201172:x1872862933402496:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 90us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.313335:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786109772.313357:0:201172:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9689840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.313396:0:201172:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201172:1872862933402496:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1786109772.313426:0:201172:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1786109772.313468:0:201172:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201172:1872862933402624:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109772.314760:0:201172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109772.314803:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933402624 00000100:00100000:2.0:1786109772.314809:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933402624 00000100:00100000:2.0:1786109772.314840:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786109772.314849:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201172:x1872862933402624:12345-0@lo:1000:lod0000_rec0001.0 00010000:00000080:2.0:1786109772.314947:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0fdce00 x1872862933402624/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:243/0 lens 336/4320 e 0 to 0 dl 1786109783 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109772.314978:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201172:x1872862933402624:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 130us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.314985:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786109772.315008:0:201172:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab29e6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.315027:0:201172:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201172:1872862933402624:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109772.315102:0:201172:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201172:1872862933402752:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109772.315123:0:201172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109772.315141:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933402752 00000100:00100000:2.0:1786109772.315145:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933402752 00000100:00100000:2.0:1786109772.315165:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786109772.315171:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201172:x1872862933402752:12345-0@lo:1000:lod0000_rec0001.0 00010000:00000080:2.0:1786109772.315197:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0fdd880 x1872862933402752/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:243/0 lens 304/4320 e 0 to 0 dl 1786109783 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109772.315226:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201172:x1872862933402752:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 55us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.315232:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786109772.315249:0:201172:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9689840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109772.315262:0:201172:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201172:1872862933402752:0@lo:1000:lod0000_rec0001.0 00000020:00080000:1.0:1786109772.315709:0:201170:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 322122568692 00000020:00080000:1.0:1786109772.315714:0:201170:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 322122568692 00000040:00080000:0.0:1786109772.315886:0:201140:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1786109772.316589:0:201172:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201172:1872862933402880:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1786109772.316805:0:201172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109772.316849:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933402880 00000100:00100000:2.0:1786109772.316854:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933402880 00000100:00100000:2.0:1786109772.316889:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786109772.316897:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201172:x1872862933402880:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1786109772.318326:0:201140:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1786109772.319042:0:201140:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1786109772.319151:0:201140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786109772.319547:0:201172:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab29e69c0 going to sleep for 11 seconds 00000040:00080000:3.0:1786109772.320180:0:201171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20001a210:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1786109772.320245:0:201171:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00010000:00000080:2.0:1786109772.320558:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0fdc380 x1872862933402880/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:243/0 lens 336/33016 e 0 to 0 dl 1786109783 ref 1 fl Interpret:/200/0 rc 0/0 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00080000:10000000:0.0:1786109772.321184:0:201140:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x84:0x0] (8/32) registered 00000100:00100000:2.0:1786109772.321477:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:201172:x1872862933402880:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 4579us (4670us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109772.321489:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786109772.321634:0:201172:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:201172:1872862933402880:0@lo:1000:lod0000_rec0001.0 00010000:00080000:0.0:1786109772.325622:0:201140:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 343597383693 00000040:00080000:1.0:1786109772.326487:0:201172:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007ec:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1786109772.326581:0:201172:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1786109772.326591:0:201172:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1786109772.327614:0:201173:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 201173 00010000:02000000:0.0:1786109772.327622:0:201173:0:(ldlm_lib.c:2336:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1786109772.327625:0:201173:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1786109772.327629:0:201173:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1786109772.327786:0:201140:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1786109772.327803:0:201140:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1786109772.327824:0:201140:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1786109772.327853:0:201140:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1786109772.329676:0:201140:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1786109772.331153:0:201140:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1786109773.061491:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00000100:00100000:2.0:1786109773.061654:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933403008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109773.061715:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.061765:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933403008 00000100:00100000:2.0:1786109773.061771:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933403008 00000100:00100000:2.0:1786109773.061809:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5977 00000100:00100000:2.0:1786109773.061817:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933403008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109773.061838:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140864 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109773.061875:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933403008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.061882:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5977 00000100:00100000:2.0:1786109773.061921:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933403008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109773.068694:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933403136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109773.068762:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109773.068819:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933403136 00000100:00100000:3.0:1786109773.068826:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933403136 00000100:00100000:3.0:1786109773.068872:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5978 00000100:00100000:3.0:1786109773.068882:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933403136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109773.068904:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109773.068950:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933403136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109773.068957:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5978 00000100:00100000:3.0:1786109773.069016:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933403136:0@lo:13:osp-pre-0-1.0 10000000:01000000:2.0:1786109773.128595:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1786109773.128603:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93098617c000 from 337 10000000:01000000:2.0:1786109773.128609:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1786109773.128652:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.128664:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.128675:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109773.128699:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933403264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.128758:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.129568:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9689840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109773.135576:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933403264 00000100:00100000:0.0:1786109773.135591:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933403264 00000100:00100000:0.0:1786109773.137301:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786109773.137319:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+10:6524:x1872862933403264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109773.137339:0:201146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109773.137361:0:201146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca38b44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38b3d expref: -99 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.137403:0:201146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca38b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b3d expref: 11 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.137414:0:201146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca38b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b3d expref: 11 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.137423:0:201146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2c00, rc 0) 00000100:00100000:0.0:1786109773.137530:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933403264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (8770us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109773.137538:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1786109773.137659:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933403264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109773.137679:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b44 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.137689:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b44 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109773.137753:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933403392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786109773.137794:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.147344:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933403392 00000100:00100000:2.0:1786109773.147360:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933403392 00000100:00100000:2.0:1786109773.147460:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1786109773.147472:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933403392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1786109773.147503:0:201147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1786109773.147527:0:201147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786109773.147531:0:201147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 337 00000100:00100000:2.0:1786109773.147670:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933403392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 200us (9874us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.147679:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1786109773.149513:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac10c1000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109773.149551:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933403392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1786109773.149628:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786109773.149638:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b44 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.149649:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b44 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109773.149659:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786109773.149662:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930ab1980800 from 52 10000000:01000000:2.0:1786109773.149664:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786109773.149694:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.149703:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.149713:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109773.149733:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933403520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.149786:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.149810:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9689840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109773.149830:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933403520 00000100:00100000:2.0:1786109773.149835:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933403520 00000100:00100000:2.0:1786109773.149869:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1786109773.149878:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+11:6524:x1872862933403520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109773.149891:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109773.149903:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9413600/0xdb52b77d7ca38b52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38b4b expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.149925:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9413600/0xdb52b77d7ca38b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b4b expref: 12 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.149936:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9413600/0xdb52b77d7ca38b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b4b expref: 12 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.149944:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413600, rc 0) 00000100:00100000:2.0:1786109773.149978:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933403520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.149984:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1786109773.150022:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933403520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109773.150033:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.150042:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109773.150095:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933403648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.150120:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.150134:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9689840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109773.150145:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933403648 00000100:00100000:2.0:1786109773.150149:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933403648 00000100:00100000:2.0:1786109773.150166:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786109773.150173:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933403648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.150281:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933403648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.150288:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786109773.150320:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933403648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.150354:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933403776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.150413:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.150428:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109773.150459:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933403776 00000100:00100000:2.0:1786109773.150463:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933403776 00000100:00100000:2.0:1786109773.150480:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786109773.150486:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933403776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.150559:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933403776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.150565:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786109773.150604:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933403776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786109773.151265:0:201231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1786109773.151333:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1786109773.151355:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786109773.151363:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.151426:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109773.151464:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1786109773.151466:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930ab1980800 from 335 10000000:01000000:2.0:1786109773.151469:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1786109773.151494:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.151502:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.151511:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109773.151527:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933403904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.151562:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.151597:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109773.151618:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933403904 00000100:00100000:2.0:1786109773.151622:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933403904 00000100:00100000:2.0:1786109773.151648:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1786109773.151655:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+12:6524:x1872862933403904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109773.151665:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109773.151676:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9412e00/0xdb52b77d7ca38b60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38b59 expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.151696:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9412e00/0xdb52b77d7ca38b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b59 expref: 13 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.151705:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9412e00/0xdb52b77d7ca38b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b59 expref: 13 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.151717:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412e00, rc 0) 00000100:00100000:2.0:1786109773.151807:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933403904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.151814:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786109773.151837:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933403904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109773.151849:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.151857:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109773.151907:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786109773.151934:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109773.151947:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac10c1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109773.151957:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933404032 00000100:00100000:3.0:1786109773.151960:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933404032 00000100:00100000:3.0:1786109773.151975:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786109773.151980:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933404032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1786109773.151992:0:201148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1786109773.152006:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786109773.152009:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1786109773.152012:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1786109773.152014:0:201148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 337 00000100:00100000:3.0:1786109773.152084:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933404032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109773.152090:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786109773.152119:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1786109773.152183:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786109773.152204:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.152252:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109773.152259:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1786109773.152260:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1786109773.152263:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1786109773.152276:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.152282:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.152289:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109773.152299:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109773.152319:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109773.152332:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac10c1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109773.152340:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933404160 00000100:00100000:3.0:1786109773.152343:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933404160 00000100:00100000:3.0:1786109773.152357:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1786109773.152361:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+13:6524:x1872862933404160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109773.152368:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109773.152389:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930aa628a400/0xdb52b77d7ca38b6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38b67 expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.152403:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930aa628a400/0xdb52b77d7ca38b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b67 expref: 14 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.152411:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930aa628a400/0xdb52b77d7ca38b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b67 expref: 14 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.152418:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628a400, rc 0) 00000100:00100000:3.0:1786109773.152473:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933404160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109773.152479:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1786109773.152518:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109773.152529:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.152537:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109773.152684:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109773.152707:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109773.152725:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac10c1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786109773.152737:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933404288 00000100:00100000:3.0:1786109773.152740:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933404288 00000100:00100000:3.0:1786109773.152754:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1786109773.152759:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933404288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109773.152938:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933404288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109773.152944:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786109773.153002:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.153025:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.153056:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.153078:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786109773.153110:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933404416 00000100:00100000:3.0:1786109773.153114:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933404416 00000100:00100000:3.0:1786109773.153140:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786109773.153145:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933404416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109773.153904:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933404416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 756us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109773.153911:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786109773.160528:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109773.161402:0:201233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1786109773.162060:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1786109773.162112:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1786109773.162128:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.162141:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109773.162150:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1786109773.162152:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff930ab1980800 from 1 10000000:01000000:2.0:1786109773.162155:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1786109773.162191:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.162200:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.162215:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109773.162239:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.162303:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.162359:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109773.162425:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933404544 00000100:00100000:1.0:1786109773.162457:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933404544 00000100:00100000:1.0:1786109773.162504:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786109773.162513:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+14:6524:x1872862933404544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109773.162527:0:201148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109773.162539:0:201148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9361c00/0xdb52b77d7ca38b7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38b75 expref: -99 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.162562:0:201148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9361c00/0xdb52b77d7ca38b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b75 expref: 15 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.162571:0:201148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9361c00/0xdb52b77d7ca38b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b75 expref: 15 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.162580:0:201148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9361c00, rc 0) 00000100:00100000:1.0:1786109773.162694:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933404544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109773.162701:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786109773.162795:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109773.162808:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.162817:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109773.162830:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1786109773.162835:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.162841:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109773.162847:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786109773.162849:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930ab1980800 from 7 10000000:01000000:2.0:1786109773.162851:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786109773.162864:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.162871:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.162883:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109773.162895:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.162918:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.162950:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109773.162992:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933404672 00000100:00100000:1.0:1786109773.162996:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933404672 00000100:00100000:1.0:1786109773.163030:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786109773.163037:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+15:6524:x1872862933404672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109773.163044:0:201146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109773.163052:0:201146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9361600/0xdb52b77d7ca38b8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38b83 expref: -99 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.163066:0:201146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9361600/0xdb52b77d7ca38b8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b83 expref: 16 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.163075:0:201146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9361600/0xdb52b77d7ca38b8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b83 expref: 16 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.163080:0:201146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9361600, rc 0) 00000100:00100000:1.0:1786109773.163108:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933404672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109773.163113:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786109773.163171:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109773.163181:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.163189:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109773.163236:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.163259:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.163280:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109773.163293:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933404800 00000100:00100000:2.0:1786109773.163297:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933404800 00000100:00100000:2.0:1786109773.163318:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786109773.163323:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933404800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.163476:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933404800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.163483:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786109773.163511:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.163539:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.163579:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.163588:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109773.163698:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933404928 00000100:00100000:1.0:1786109773.163703:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933404928 00000100:00100000:1.0:1786109773.163721:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786109773.163727:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933404928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109773.163805:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933404928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109773.163811:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786109773.163876:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933404928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109773.164948:0:201234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1786109773.165913:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1786109773.165940:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786109773.165951:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.165962:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109773.165971:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786109773.165973:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930a88c18000 from 52 10000000:01000000:3.0:1786109773.165976:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786109773.166011:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628ae00/0xdb52b77d7ca38b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.166021:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930aa628ae00/0xdb52b77d7ca38b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.166031:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930aa628ae00/0xdb52b77d7ca38b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109773.166055:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109773.166114:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109773.166161:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930983e3fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109773.166209:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933405056 00000100:00100000:0.0:1786109773.166217:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933405056 00000100:00100000:0.0:1786109773.166297:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1786109773.166306:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+16:6524:x1872862933405056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109773.166319:0:201146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109773.166331:0:201146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca38b98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38b91 expref: -99 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.166352:0:201146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca38b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b91 expref: 17 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.166361:0:201146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c2000/0xdb52b77d7ca38b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b91 expref: 17 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.166381:0:201146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2000, rc 0) 00000100:00100000:0.0:1786109773.166427:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933405056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109773.166465:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786109773.166539:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109773.166552:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930aa628ae00/0xdb52b77d7ca38b91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b98 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.166561:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930aa628ae00/0xdb52b77d7ca38b91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b98 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109773.171780:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109773.171851:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109773.171902:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930983e3fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109773.172062:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933405184 00000100:00100000:0.0:1786109773.172070:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933405184 00000100:00100000:0.0:1786109773.172205:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786109773.172215:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933405184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109773.172348:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933405184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109773.172357:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786109773.172475:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109773.172510:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786109773.172551:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109773.172573:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930983e3fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109773.172733:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933405312 00000100:00100000:0.0:1786109773.172738:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933405312 00000100:00100000:0.0:1786109773.172760:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786109773.172767:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933405312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109773.172854:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933405312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109773.172861:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1786109773.173460:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786109773.176988:0:201236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1786109773.177238:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1786109773.177263:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786109773.177276:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628ae00/0xdb52b77d7ca38b91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b98 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.177287:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930aa628ae00/0xdb52b77d7ca38b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b98 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109773.177296:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1786109773.177299:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1786109773.177301:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1786109773.177341:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413800/0xdb52b77d7ca38b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.177349:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9413800/0xdb52b77d7ca38b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.177360:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9413800/0xdb52b77d7ca38b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109773.177403:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.177486:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.177526:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109773.177546:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933405440 00000100:00100000:2.0:1786109773.177552:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933405440 00000100:00100000:2.0:1786109773.177596:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1786109773.177606:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+17:6524:x1872862933405440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109773.177621:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109773.177633:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9413c00/0xdb52b77d7ca38ba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38b9f expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.177657:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9413c00/0xdb52b77d7ca38ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b9f expref: 18 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.177668:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9413c00/0xdb52b77d7ca38ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b9f expref: 18 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.177675:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9413c00, rc 0) 00000100:00100000:2.0:1786109773.177713:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933405440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.177720:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1786109773.177776:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109773.177790:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9413800/0xdb52b77d7ca38b9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38ba6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.177798:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9413800/0xdb52b77d7ca38b9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38ba6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109773.177849:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.177873:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.177890:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109773.177903:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933405568 00000100:00100000:2.0:1786109773.177906:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933405568 00000100:00100000:2.0:1786109773.177929:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1786109773.177936:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933405568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.178066:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933405568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.178073:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1786109773.178105:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.178131:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.178176:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.178191:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c74a480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109773.178202:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933405696 00000100:00100000:2.0:1786109773.178206:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933405696 00000100:00100000:2.0:1786109773.178228:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1786109773.178234:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933405696:12345-0@lo:503:ll_cfg_requeue.0 00010000:00010000:3.0:1786109773.190679:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109773.190763:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933405696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 12523us (12581us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109773.190775:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786109773.193546:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1786109773.195477:0:201237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1786109773.195674:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1786109773.195721:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1786109773.195732:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413800/0xdb52b77d7ca38b9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38ba6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.195744:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9413800/0xdb52b77d7ca38b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38ba6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109773.195753:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786109773.195756:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930a88c18000 from 7 10000000:01000000:0.0:1786109773.195759:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786109773.195793:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3200/0xdb52b77d7ca38bad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.195801:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3200/0xdb52b77d7ca38bad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.195812:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3200/0xdb52b77d7ca38bad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109773.195836:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109773.195899:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109773.195948:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9643b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109773.196002:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933405824 00000100:00100000:3.0:1786109773.196009:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933405824 00000100:00100000:3.0:1786109773.196599:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786109773.196610:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+18:6524:x1872862933405824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109773.196626:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109773.196640:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930aa628a600/0xdb52b77d7ca38bb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38bad expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.196662:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930aa628a600/0xdb52b77d7ca38bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38bad expref: 19 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.196673:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930aa628a600/0xdb52b77d7ca38bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38bad expref: 19 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.196682:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930aa628a600, rc 0) 00000100:00100000:3.0:1786109773.197415:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933405824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 805us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109773.197423:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1786109773.198471:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109773.198494:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3200/0xdb52b77d7ca38bad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bb4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.198505:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3200/0xdb52b77d7ca38bad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38bb4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109773.198582:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.198628:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.198659:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c74a840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109773.200466:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933405952 00000100:00100000:0.0:1786109773.200480:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933405952 00000100:00100000:0.0:1786109773.200537:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786109773.200547:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa0c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933405952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109773.200694:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa0c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933405952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109773.200701:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1786109773.203106:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933405952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.203168:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.203239:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.203275:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c74a840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109773.205784:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933406080 00000100:00100000:0.0:1786109773.205797:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933406080 00000100:00100000:0.0:1786109773.205850:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786109773.205861:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098dbcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933406080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109773.206025:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098dbcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933406080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (2786us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109773.206033:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1786109773.207060:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109773.209933:0:201238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1786109773.210098:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1786109773.210124:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786109773.210134:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3200/0xdb52b77d7ca38bad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bb4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.210146:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3200/0xdb52b77d7ca38bad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bb4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109773.210156:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786109773.210158:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930aa6612000 from 52 10000000:01000000:2.0:1786109773.210161:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786109773.210197:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca38bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.210204:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca38bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.210214:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca38bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109773.210238:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.210297:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.210344:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c74a840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109773.210405:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933406208 00000100:00100000:0.0:1786109773.210412:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933406208 00000100:00100000:0.0:1786109773.210485:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786109773.210495:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:6524:x1872862933406208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109773.210510:0:201146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109773.210525:0:201146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c2800/0xdb52b77d7ca38bc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38bbb expref: -99 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.210547:0:201146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c2800/0xdb52b77d7ca38bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38bbb expref: 20 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.210558:0:201146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c2800/0xdb52b77d7ca38bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38bbb expref: 20 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.210566:0:201146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2800, rc 0) 00000100:00100000:0.0:1786109773.210607:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933406208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109773.210613:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1786109773.210696:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109773.210709:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca38bbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bc2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.210718:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca38bbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38bc2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109773.210768:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.210793:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.210822:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c74a840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109773.210865:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933406336 00000100:00100000:0.0:1786109773.210869:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933406336 00000100:00100000:0.0:1786109773.210902:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786109773.210909:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933406336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109773.211013:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933406336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109773.211020:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786109773.211084:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.211109:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.211153:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.211180:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c74a840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109773.211219:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933406464 00000100:00100000:0.0:1786109773.211224:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933406464 00000100:00100000:0.0:1786109773.211255:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786109773.211261:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933406464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109773.211340:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933406464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109773.211347:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786109773.211399:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109773.212261:0:201239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1786109773.212417:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1786109773.212469:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786109773.212477:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca38bbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bc2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.212486:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9413400/0xdb52b77d7ca38bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bc2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109773.212494:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1786109773.212497:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1786109773.212499:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1786109773.212524:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2400/0xdb52b77d7ca38bc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.212531:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c2400/0xdb52b77d7ca38bc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.212540:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c2400/0xdb52b77d7ca38bc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109773.212556:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109773.212595:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109773.212626:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8913a000 going to sleep for 11 seconds 00000100:00100000:1.0:1786109773.212741:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933406592 00000100:00100000:1.0:1786109773.212747:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933406592 00000100:00100000:1.0:1786109773.212788:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1786109773.212797:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:6524:x1872862933406592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109773.212808:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109773.212820:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9360c00/0xdb52b77d7ca38bd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38bc9 expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.212841:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9360c00/0xdb52b77d7ca38bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38bc9 expref: 21 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.212852:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9360c00/0xdb52b77d7ca38bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38bc9 expref: 21 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.212860:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360c00, rc 0) 00000100:00100000:1.0:1786109773.212905:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933406592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109773.212911:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786109773.213004:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109773.213017:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c2400/0xdb52b77d7ca38bc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bd0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.213026:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c2400/0xdb52b77d7ca38bc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38bd0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109773.213077:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786109773.213101:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109773.213131:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8913a000 going to sleep for 11 seconds 00000100:00100000:1.0:1786109773.213168:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933406720 00000100:00100000:1.0:1786109773.213172:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933406720 00000100:00100000:1.0:1786109773.213200:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786109773.213207:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab29e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933406720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109773.213337:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab29e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933406720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109773.213344:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786109773.213410:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.213482:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.213527:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109773.213548:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c74a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109773.213603:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933406848 00000100:00100000:1.0:1786109773.213607:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933406848 00000100:00100000:1.0:1786109773.213701:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1786109773.213709:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933406848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109773.218557:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933406848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4840us (5021us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109773.218573:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786109773.244956:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109773.249567:0:201240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1786109773.249734:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1786109773.249770:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1786109773.249782:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2400/0xdb52b77d7ca38bc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bd0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.249794:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c2400/0xdb52b77d7ca38bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bd0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109773.249804:0:6524:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786109773.249807:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930aa6612000 from 7 10000000:01000000:0.0:1786109773.249810:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786109773.249848:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca38bd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.249857:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca38bd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.249870:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca38bd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109773.249894:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109773.249961:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109773.250039:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8913ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109773.250084:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933406976 00000100:00100000:2.0:1786109773.250091:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933406976 00000100:00100000:2.0:1786109773.250176:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1786109773.250187:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:6524:x1872862933406976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109773.250200:0:201148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109773.250214:0:201148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9412a00/0xdb52b77d7ca38bde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38bd7 expref: -99 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.250237:0:201148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9412a00/0xdb52b77d7ca38bde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38bd7 expref: 22 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.250253:0:201148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9412a00/0xdb52b77d7ca38bde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38bd7 expref: 22 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.250262:0:201148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412a00, rc 0) 00000100:00100000:2.0:1786109773.250316:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933406976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.250323:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1786109773.250404:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933406976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109773.250418:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca38bd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bde expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.250428:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca38bd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38bde expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109773.250643:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933407104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109773.250670:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109773.250733:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109773.250768:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933407104 00000100:00100000:2.0:1786109773.250773:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933407104 00000100:00100000:2.0:1786109773.250841:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786109773.250849:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933407104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786109773.250956:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933407104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.250963:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786109773.251016:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933407104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109773.251043:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933407232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786109773.251088:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109773.251201:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109773.251265:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933407232 00000100:00100000:0.0:1786109773.251270:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933407232 00000100:00100000:0.0:1786109773.251292:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786109773.251299:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933407232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786109773.251406:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933407232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109773.251413:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1786109773.251577:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933407232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786109773.252417:0:201241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1786109773.252697:0:6524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1786109773.252719:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786109773.252728:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca38bd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bde expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.252738:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3a00/0xdb52b77d7ca38bd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bde expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109773.252747:0:6524:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1786109773.252750:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff930a8a73cd40 from 1 10000000:01000000:0.0:1786109773.252753:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1786109773.252783:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca38be5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.252791:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca38be5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.252801:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca38be5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109773.252819:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933407360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109773.252862:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109773.252905:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a8913a600 going to sleep for 11 seconds 00000100:00100000:1.0:1786109773.252955:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933407360 00000100:00100000:1.0:1786109773.252960:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933407360 00000100:00100000:1.0:1786109773.252998:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1786109773.253007:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933407360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109773.253017:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109773.253031:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9360000/0xdb52b77d7ca38bec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38be5 expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.253050:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9360000/0xdb52b77d7ca38bec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38be5 expref: 23 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.253060:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9360000/0xdb52b77d7ca38bec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38be5 expref: 23 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.253068:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360000, rc 0) 00000100:00100000:1.0:1786109773.253184:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933407360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109773.253191:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786109773.253353:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933407360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786109773.253366:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca38be5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bec expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.253387:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca38be5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38bec expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109773.253411:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1786109773.253416:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca38be5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bec expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109773.253423:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3400/0xdb52b77d7ca38be5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bec expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109773.253638:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1786109773.253641:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff930a8a73cd40 from 1 10000000:01000000:1.0:1786109773.253644:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1786109773.253661:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361800/0xdb52b77d7ca38bf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.253670:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9361800/0xdb52b77d7ca38bf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109773.253677:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9361800/0xdb52b77d7ca38bf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109773.253692:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933407488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109773.253719:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109773.253777:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930987ce6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109773.253810:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933407488 00000100:00100000:2.0:1786109773.253815:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933407488 00000100:00100000:2.0:1786109773.253877:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1786109773.253886:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933407488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109773.253895:0:201146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109773.253904:0:201146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9412400/0xdb52b77d7ca38bfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38bf3 expref: -99 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.253920:0:201146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9412400/0xdb52b77d7ca38bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38bf3 expref: 24 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.253929:0:201146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9412400/0xdb52b77d7ca38bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38bf3 expref: 24 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.253942:0:201146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412400, rc 0) 00000100:00100000:2.0:1786109773.253989:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933407488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.253995:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1786109773.254059:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933407488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109773.254071:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9361800/0xdb52b77d7ca38bf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bfa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.254079:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9361800/0xdb52b77d7ca38bf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38bfa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109773.254131:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933407616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786109773.254160:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109773.254277:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930983e3f840 going to sleep for 11 seconds 00000100:00100000:1.0:1786109773.254356:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933407616 00000100:00100000:1.0:1786109773.254360:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933407616 00000100:00100000:1.0:1786109773.254395:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786109773.254403:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933407616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786109773.254505:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933407616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (343us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786109773.254512:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1786109773.254579:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933407616:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1786109773.254605:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1786109773.254612:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361800/0xdb52b77d7ca38bf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bfa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109773.254620:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9361800/0xdb52b77d7ca38bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bfa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109773.582697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109773.582929:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922189056 00000100:00100000:2.0:1786109773.582938:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922189056 00000100:00100000:2.0:1786109773.583156:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:2.0:1786109773.583168:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922189056:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109773.583188:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109773.583207:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab9412000/0xdb52b77d7ca38c01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a191b expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.583237:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9412000/0xdb52b77d7ca38c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a191b expref: 10 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.583249:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab9412000/0xdb52b77d7ca38c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a191b expref: 10 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109773.583259:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9412000, rc 0) 00000100:00100000:2.0:1786109773.583333:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922189056:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 167us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.583340:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:1.0:1786109773.587471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109773.587613:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922189184 00000100:00100000:2.0:1786109773.587623:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922189184 00000100:00100000:2.0:1786109773.587673:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:2.0:1786109773.587682:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922189184:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1786109773.587712:0:201148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1786109773.587728:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786109773.587732:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1786109773.587735:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1786109773.587737:0:201148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 337 00000100:00100000:2.0:1786109773.592973:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922189184:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 Request processed in 5280us (5500us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.592988:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:3.0:1786109773.595569:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109773.596187:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922189312 00000100:00100000:2.0:1786109773.596198:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922189312 00000100:00100000:2.0:1786109773.596345:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1308 00000100:00100000:2.0:1786109773.596355:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922189312:12345-192.168.203.38@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1786109773.596401:0:187901:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'fac74500-4523-4794-af20-dfdcdfae19c1' at ffff930981e14800, cookie 0xdb52b77d7ca38a87 00010000:00080000:2.0:1786109773.596408:0:187901:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp recovering/t343597383694 exp ffff930981e14800 cur 8630 last 1786109772 00010000:02000400:2.0:1786109773.596417:0:187901:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1786109773.596425:0:187901:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 110 seconds 00000004:00100000:2.0:1786109773.596474:0:187901:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1786109773.596614:0:187901:0:(import.c:65:import_set_state_nolock()) ffff930ac10a1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109773.596682:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922189312:12345-192.168.203.38@tcp:38:ll_cfg_requeue.0 Request processed in 326us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109773.596691:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1308 00000100:00100000:3.0:1786109773.600818:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109773.600972:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922145664 00000100:00100000:2.0:1786109773.600985:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922145664 00000100:00100000:2.0:1786109773.601342:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1309 00000100:00100000:2.0:1786109773.601355:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922145664:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00080000:2.0:1786109773.601391:0:188678:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383694, current: 343597383694, replaying 00000100:00100000:2.0:1786109773.601428:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922145664:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 75us (618us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109773.601461:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1309 00010000:00080000:0.0:1786109773.601481:0:201173:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1786109774.145888:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:3.0:1786109774.213560:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109774.351400:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109774.353422:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922189440 00000100:00100000:2.0:1786109774.353460:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922189440 00000100:00100000:2.0:1786109774.353581:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 477 00000100:00100000:2.0:1786109774.353605:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:2404:x1872862922189440:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:2.0:1786109774.353636:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098e50f100 x1872862922189440/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:245/0 lens 224/224 e 0 to 0 dl 1786109785 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109774.353711:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:2404:x1872862922189440:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 109us (2319us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109774.353718:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 477 00000100:00100000:1.0:1786109775.172525:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:1.0:1786109775.241481:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109776.196489:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:2.0:1786109776.260774:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786109776.658507:0:201423:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1786109777.220516:0:198783:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7cc6f00 going to sleep for 0 seconds 00010000:00010000:3.0:1786109777.284820:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1786109777.352896:0:201476:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1786109777.353169:0:201476:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1786109777.669295:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933407744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109777.669375:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109777.669551:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109777.669557:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109777.669560:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109777.669578:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8628 00000100:00080000:0.0:1786109777.669584:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109777.669590:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93098349a000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109777.669612:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930986553800 x1872862933408000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109777.669640:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109777.669644:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109777.669646:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109777.669650:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8628 00000100:00080000:0.0:1786109777.669653:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109777.669657:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff930981e11800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109777.669669:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a97fab100 x1872862933408256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109777.669805:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933407744 00000100:00100000:2.0:1786109777.669813:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933407744 00000100:00100000:2.0:1786109777.669862:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786109777.669874:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933407744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109777.669907:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446019072 avail 1299779584 00010000:00000080:2.0:1786109777.669921:0:187905:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7e5ca80 x1872862933407744/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:248/0 lens 224/368 e 0 to 0 dl 1786109788 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109777.676764:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933407744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6882us (7377us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109777.676780:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786109777.678243:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933408384:0@lo:400:kworker.0 00000100:00100000:2.0:1786109777.678310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109777.678394:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933408000:0@lo:38:kworker.0 00000100:00100000:2.0:1786109777.678423:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109777.678467:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933408256:0@lo:38:kworker.0 00000100:00100000:2.0:1786109777.678489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109777.678528:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933408128:0@lo:400:kworker.0 00000100:00100000:2.0:1786109777.678553:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109777.678652:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109777.678660:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933407872:0@lo:400:kworker.0 00000100:00100000:2.0:1786109777.678689:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109777.678726:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933408384 00000100:00100000:2.0:1786109777.678733:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933408384 00000100:00100000:2.0:1786109777.678778:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933408000 00000100:00100000:2.0:1786109777.678781:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933408000 00000100:00100000:2.0:1786109777.678791:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933408256 00000100:00100000:2.0:1786109777.678794:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933408256 00000100:00100000:2.0:1786109777.678802:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933408128 00000100:00100000:2.0:1786109777.678803:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933408128 00000100:00100000:2.0:1786109777.678821:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1786109777.678829:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933408384:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109777.678855:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0fdf800 x1872862933408384/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:248/0 lens 224/224 e 0 to 0 dl 1786109788 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109777.678896:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933408384:12345-0@lo:400:kworker.0 Request processed in 67us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109777.678904:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1786109777.678920:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1786109777.678926:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933408128:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109777.678938:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab9676d80 x1872862933408128/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:248/0 lens 224/224 e 0 to 0 dl 1786109788 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109777.678970:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1872862933408128:12345-0@lo:400:kworker.0 Request processed in 44us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109777.678976:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1786109777.678988:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1786109777.678992:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933408000:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1786109777.679017:0:187900:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8634 last 0 00000020:00000080:2.0:1786109777.679052:0:187900:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdb52b77d7ca38c08 00000004:00100000:2.0:1786109777.679066:0:187900:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786109777.679768:0:187900:0:(import.c:65:import_set_state_nolock()) ffff930a905fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109777.679825:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872862933408000:12345-0@lo:38:kworker.0 Request processed in 830us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109777.679833:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1786109777.679851:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1786109777.679858:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933408256:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1786109777.679876:0:187900:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8634 last 0 00000020:00000080:2.0:1786109777.679901:0:187900:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdb52b77d7ca38c0f 00000004:00100000:2.0:1786109777.679910:0:187900:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786109777.679931:0:187900:0:(import.c:65:import_set_state_nolock()) ffff930ac09cf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109777.679962:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872862933408256:12345-0@lo:38:kworker.0 Request processed in 104us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109777.679969:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1786109777.680004:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933407872 00000100:00100000:2.0:1786109777.680008:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933407872 00000100:00100000:2.0:1786109777.680047:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786109777.680054:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933407872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109777.680219:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933407744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109777.681205:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933407872:12345-0@lo:400:kworker.0 Request processed in 1147us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109777.681215:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1786109777.681255:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1786109777.681289:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930986553800 x1872862933408000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109777.681304:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 81 00000100:00080000:2.0:1786109777.682284:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff930986553800 x1872862933408000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109797 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109777.682295:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1786109777.682300:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349a000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1786109777.682304:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1786109777.682309:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1872862933408000:0@lo:38:kworker.0 00010000:00080000:2.0:1786109777.682335:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a97fab100 x1872862933408256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109777.682685:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109777.682691:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109777.682695:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109777.682700:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8628 00000100:00080000:0.0:1786109777.682704:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109777.682710:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a8a47d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109777.682743:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a97faaa00 x1872862933408512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109777.682800:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109777.682803:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109777.682805:0:183576:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109777.682809:0:183576:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8628 00000100:00080000:0.0:1786109777.682811:0:183576:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1786109777.682814:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da3000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109777.682825:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a97fa9f80 x1872862933408896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109777.682848:0:183576:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1786109777.682852:0:183576:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1786109777.682854:0:183576:0:(import.c:65:import_set_state_nolock()) ffff93098e512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109777.682858:0:183576:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93098e512800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109777.682868:0:183576:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0bb0e00 x1872862933409280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109777.682935:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97faa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933408640:0@lo:400:kworker.0 00000100:00100000:1.0:1786109777.682985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109777.683027:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109777.683033:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933409152:0@lo:400:kworker.0 00000100:00100000:1.0:1786109777.683059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109777.683160:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933408640 00000100:00100000:1.0:1786109777.683167:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933408640 00000100:00100000:1.0:1786109777.683210:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933409152 00000100:00100000:1.0:1786109777.683213:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933409152 00000100:00100000:1.0:1786109777.683235:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7153 00000100:00100000:1.0:1786109777.683244:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933408640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109777.683291:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933408640:12345-0@lo:400:kworker.0 Request processed in 49us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109777.683298:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7153 00000100:00100000:1.0:1786109777.683311:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7154 00000100:00100000:1.0:1786109777.683317:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933409152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109777.683358:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3647:x1872862933409152:12345-0@lo:400:kworker.0 Request processed in 41us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109777.683364:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7154 00000100:00080000:1.0:1786109777.683385:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109777.683389:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109777.683408:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933409152:0@lo:400:kworker.0 00000100:00100000:1.0:1786109777.683419:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97faa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933408640:0@lo:400:kworker.0 00000100:00100000:3.0:1786109777.684552:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933409024:0@lo:400:kworker.0 00000100:00100000:3.0:1786109777.685495:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109777.685553:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933407872:0@lo:400:kworker.0 00000100:00100000:3.0:1786109777.686161:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930986551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1872862933408128:0@lo:400:kworker.0 00000100:00100000:3.0:1786109777.686188:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109777.686197:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933408768:0@lo:400:kworker.0 00000100:00100000:3.0:1786109777.686228:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109777.686270:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933409024 00000100:00100000:3.0:1786109777.686275:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933409024 00000100:00100000:3.0:1786109777.686319:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933408768 00000100:00100000:3.0:1786109777.686323:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933408768 00000100:00100000:3.0:1786109777.686357:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7155 00000100:00100000:3.0:1786109777.686367:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933409024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109777.686418:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933409024:12345-0@lo:400:kworker.0 Request processed in 52us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109777.686425:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7155 00000100:00100000:3.0:1786109777.686471:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7156 00000100:00100000:3.0:1786109777.686478:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933408768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109777.686507:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933408768:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109777.686513:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7156 00000100:00080000:3.0:1786109777.686529:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109777.686533:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109777.686675:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 81 00000100:00080000:2.0:1786109777.688058:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff930a97fab100 x1872862933408256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109797 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109777.688070:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00100000:3.0:1786109777.688506:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933408384:0@lo:400:kworker.0 00000100:00100000:3.0:1786109777.688639:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933408768:0@lo:400:kworker.0 00000100:00100000:3.0:1786109777.688656:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933409024:0@lo:400:kworker.0 00000100:00080000:2.0:1786109777.689171:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930981e11800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1786109777.689178:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1786109777.689184:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1872862933408256:0@lo:38:kworker.0 00000100:00100000:3.0:1786109777.689281:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97faaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933408512:0@lo:38:kworker.0 00000100:00100000:3.0:1786109777.689350:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109777.689388:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97fa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933408896:0@lo:38:kworker.0 00000100:00100000:3.0:1786109777.689412:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109777.689469:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933409280:0@lo:38:kworker.0 00000100:00100000:3.0:1786109777.689492:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109777.689648:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933408896 00000100:00100000:0.0:1786109777.689654:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933408896 00000100:00100000:0.0:1786109777.689685:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933409280 00000100:00100000:0.0:1786109777.689688:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933409280 00000100:00100000:0.0:1786109777.689706:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:0.0:1786109777.689713:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933408896:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109777.689741:0:187900:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8634 last 0 00000020:00000080:0.0:1786109777.689776:0:187900:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdb52b77d7ca38c16 00000004:00100000:0.0:1786109777.689789:0:187900:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109777.689816:0:187900:0:(import.c:65:import_set_state_nolock()) ffff930ab2abd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109777.689868:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872862933408896:12345-0@lo:38:kworker.0 Request processed in 153us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109777.689875:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:0.0:1786109777.689892:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1786109777.689896:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933409280:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109777.689910:0:187900:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8634 last 0 00000020:00000080:0.0:1786109777.689932:0:187900:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdb52b77d7ca38c1d 00000004:00100000:0.0:1786109777.689938:0:187900:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109777.689952:0:187900:0:(import.c:65:import_set_state_nolock()) ffff930ab2ab9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109777.689982:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872862933409280:12345-0@lo:38:kworker.0 Request processed in 83us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109777.689991:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00010000:00080000:0.0:1786109777.690028:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930a97fa9f80 x1872862933408896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109777.690041:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 81 00000100:00100000:2.0:1786109777.690232:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933408512 00000100:00100000:2.0:1786109777.690237:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933408512 00000100:00100000:2.0:1786109777.690271:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786109777.690276:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1872862933408512:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1786109777.690292:0:187904:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff930981e10800, cookie 0xdb52b77d7ca38a8e 00010000:00080000:2.0:1786109777.690296:0:187904:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t343597383701 exp ffff930981e10800 cur 8634 last 1786109772 00000004:00100000:2.0:1786109777.690306:0:187904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786109777.690323:0:187904:0:(import.c:65:import_set_state_nolock()) ffff930ac09cd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109777.690381:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933408512:12345-0@lo:38:kworker.0 Request processed in 103us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109777.690387:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1786109777.690406:0:201173:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1786109777.690411:0:201173:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 343597383694 00000020:00080000:2.0:1786109777.690417:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.690420:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383694, next_transno: 343597383694 00010000:00080000:2.0:1786109777.690424:0:201173:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (343597383694) 00000020:00080000:2.0:1786109777.690426:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.690461:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922145664 t343597383694 from 192.168.203.38@tcp req@ffff93098e50d180 x1872862922145664/t0(343597383694) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:283/0 lens 528/0 e 0 to 0 dl 1786109823 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1786109777.692070:0:201173:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1559us 00000100:00080000:0.0:1786109777.694859:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff930a97fa9f80 x1872862933408896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109797 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109777.694873:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109777.694879:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109777.694884:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109777.694890:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933408896:0@lo:38:kworker.0 00010000:00080000:0.0:1786109777.694931:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac0bb0e00 x1872862933409280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109777.694949:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 81 00000100:00080000:0.0:1786109777.694957:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1786109777.694961:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786109777.694964:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098e512800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786109777.694968:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872862933409280:0@lo:38:kworker.0 00000100:00100000:0.0:1786109777.694998:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383692 gen 2 00000100:00100000:0.0:1786109777.695004:0:3645:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff930ab7f14380 x1872862933358976/t343597383701(343597383701) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 1786109711 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109777.695015:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 81 00000100:00080000:0.0:1786109777.695021:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1786109777.695027:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1786109777.695030:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383692 gen 2 00000100:00100000:0.0:1786109777.695033:0:3645:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff930ab7f14380 x1872862933358976/t343597383701(343597383701) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 1786109711 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109777.695041:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a8a47d000 from lustre-MDT0000_UUID committed 343597383692 last 0 00000100:00080000:0.0:1786109777.695047:0:3645:0:(client.c:3540:ptlrpc_replay_req()) @@@ REPLAY req@ffff930ab7f14380 x1872862933358976/t343597383701(343597383701) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 1786109711 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109777.695058:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97faaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933408512:0@lo:38:kworker.0 00000100:00100000:0.0:1786109777.696188:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933358976:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109777.696253:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109777.702236:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933358976 00000100:00100000:3.0:1786109777.702250:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933358976 00000100:00100000:3.0:1786109777.702303:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786109777.702314:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933358976:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:3.0:1786109777.702335:0:187905:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383694, current: 343597383701, replaying 00000100:00100000:3.0:1786109777.702358:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933358976:12345-0@lo:1000:osp_up0-1.0 Request processed in 46us (6106us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109777.702365:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1786109777.724289:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c24 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724313:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724327:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724356:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424600/0xdb52b77d7ca38c2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724364:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424600/0xdb52b77d7ca38c2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724371:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424600/0xdb52b77d7ca38c2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724766:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724776:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c24 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724783:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724790:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109777.724795:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724804:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c24 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724817:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894200) 00010000:00010000:2.0:1786109777.724820:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109777.724825:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c24 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724831:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c24 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109777.724849:0:201173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5e7b9b0 reply state 00000000b1e0d17d transno 343597383694 ns: mdt-lustre-MDT0000_UUID lock: ffff930986424600/0xdb52b77d7ca38c2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724859:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424600/0xdb52b77d7ca38c2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.724866:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ab2894a00) 00010000:00010000:2.0:1786109777.724868:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109777.724871:0:201173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1786109777.724975:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 127 seconds 00000020:00080000:2.0:1786109777.724995:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.724999:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383701, next_transno: 343597383695 00000020:00080000:2.0:1786109777.725005:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.725007:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383701, next_transno: 343597383695 00000100:00100000:3.0:1786109777.731409:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109777.732210:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922146176 00000100:00100000:2.0:1786109777.732221:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922146176 00000100:00100000:2.0:1786109777.732278:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1314 00000100:00100000:2.0:1786109777.732288:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930986551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:2401:x1872862922146176:12345-192.168.203.38@tcp:36:rm.0 00010000:00080000:2.0:1786109777.732308:0:187901:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383695, current: 343597383695, replaying 00000100:00100000:2.0:1786109777.732322:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+8:2401:x1872862922146176:12345-192.168.203.38@tcp:36:rm.0 Request processed in 36us (923us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109777.732329:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1314 00000020:00080000:2.0:1786109777.732378:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.732383:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 343597383695, next_transno: 343597383695 00010000:00080000:2.0:1786109777.732387:0:201173:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (343597383695) 00000020:00080000:2.0:1786109777.732390:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.732399:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922146176 t343597383695 from 192.168.203.38@tcp req@ffff930986551f80 x1872862922146176/t0(343597383695) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:287/0 lens 512/0 e 0 to 0 dl 1786109827 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1786109777.732493:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38c32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732509:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38c32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732522:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38c32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732535:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca38c39 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732544:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca38c39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732550:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca38c39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732639:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38c40 lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732648:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38c40 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732656:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38c40 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732872:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38c40 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732881:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38c40 lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732889:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38c40 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732896:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109777.732900:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38c40 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732908:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38c40 lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732923:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x5:0x0].0x0 (ffff930ab2894c00) 00010000:00010000:2.0:1786109777.732927:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109777.732931:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38c40 lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732938:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38c40 lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732959:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38c32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732965:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38c32 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732970:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38c32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732975:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109777.732978:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38c32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732989:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38c32 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.732997:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894b00) 00010000:00010000:2.0:1786109777.732999:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109777.733002:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38c32 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.733008:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38c32 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109777.733019:0:201173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003b6d8a1 reply state 00000000a7c2d8ff transno 343597383695 ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca38c39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.733029:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca38c39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.733035:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ab2894a00) 00010000:00010000:2.0:1786109777.733037:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109777.733039:0:201173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1786109777.733644:0:201141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383694 is committed 00010000:00010000:1.0:1786109777.733745:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424600/0xdb52b77d7ca38c2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.733755:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986424600/0xdb52b77d7ca38c2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.733762:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986424600/0xdb52b77d7ca38c2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.733768:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109777.733772:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424600/0xdb52b77d7ca38c2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.733779:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424600/0xdb52b77d7ca38c2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.733796:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ab2894a00) 00010000:00010000:1.0:1786109777.733799:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109777.733802:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986424600/0xdb52b77d7ca38c2b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.733809:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424600/0xdb52b77d7ca38c2b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1786109777.734282:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 127 seconds 00000020:00080000:2.0:1786109777.734304:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.734308:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383701, next_transno: 343597383696 00000020:00080000:2.0:1786109777.734312:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.734315:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383701, next_transno: 343597383696 00000100:00100000:0.0:1786109777.742243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109777.742320:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922148352 00000100:00100000:1.0:1786109777.742329:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922148352 00000100:00100000:1.0:1786109777.742400:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1315 00000100:00100000:1.0:1786109777.742412:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+8:2401:x1872862922148352:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00080000:1.0:1786109777.742450:0:187899:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383696, current: 343597383696, replaying 00000100:00100000:1.0:1786109777.742470:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+8:2401:x1872862922148352:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 61us (238us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109777.742477:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1315 00000020:00080000:2.0:1786109777.742873:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.742878:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 343597383696, next_transno: 343597383696 00010000:00080000:2.0:1786109777.742883:0:201173:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (343597383696) 00000020:00080000:2.0:1786109777.742887:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.742897:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922148352 t343597383696 from 192.168.203.38@tcp req@ffff930ac0bb2300 x1872862922148352/t0(343597383696) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:287/0 lens 528/0 e 0 to 0 dl 1786109827 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1786109777.743023:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425800/0xdb52b77d7ca38c47 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743039:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986425800/0xdb52b77d7ca38c47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743049:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425800/0xdb52b77d7ca38c47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743061:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca38c4e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743068:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca38c4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743150:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca38c4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743796:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425800/0xdb52b77d7ca38c47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743806:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986425800/0xdb52b77d7ca38c47 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743814:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986425800/0xdb52b77d7ca38c47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743820:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109777.743825:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425800/0xdb52b77d7ca38c47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743837:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425800/0xdb52b77d7ca38c47 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743851:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894d00) 00010000:00010000:2.0:1786109777.743854:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109777.743859:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986425800/0xdb52b77d7ca38c47 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743866:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425800/0xdb52b77d7ca38c47 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109777.743883:0:201173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7177fa2 reply state 00000000b96c0d16 transno 343597383696 ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca38c4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743895:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca38c4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.743902:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ab2894a00) 00010000:00010000:2.0:1786109777.743904:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109777.743907:0:201173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1786109777.744026:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 127 seconds 00000020:00080000:2.0:1786109777.744043:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.744046:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383701, next_transno: 343597383697 00000020:00080000:2.0:1786109777.744051:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.744053:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383701, next_transno: 343597383697 00000100:00100000:2.0:1786109777.752251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109777.752331:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922148864 00000100:00100000:0.0:1786109777.752351:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922148864 00000100:00100000:0.0:1786109777.752408:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1316 00000100:00100000:0.0:1786109777.752419:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+10:2401:x1872862922148864:12345-192.168.203.38@tcp:36:rm.0 00010000:00080000:0.0:1786109777.752459:0:188678:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383697, current: 343597383697, replaying 00000100:00100000:0.0:1786109777.752473:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+10:2401:x1872862922148864:12345-192.168.203.38@tcp:36:rm.0 Request processed in 57us (231us total) trans 0 rc 0/-999 00000100:00100000:0.0:1786109777.752481:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1316 00000020:00080000:2.0:1786109777.752542:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.752547:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 343597383697, next_transno: 343597383697 00010000:00080000:2.0:1786109777.752551:0:201173:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (343597383697) 00000020:00080000:2.0:1786109777.752554:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.752635:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922148864 t343597383697 from 192.168.203.38@tcp req@ffff930ab9928e00 x1872862922148864/t0(343597383697) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:287/0 lens 512/0 e 0 to 0 dl 1786109827 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1786109777.752718:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c55 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.752734:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.752746:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.752759:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca38c5c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.752767:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca38c5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.752775:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca38c5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.752865:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca38c63 lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.752873:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca38c63 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.752881:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca38c63 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753799:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca38c63 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753816:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca38c63 lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753823:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca38c63 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753830:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109777.753835:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca38c63 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753843:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca38c63 lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753856:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x6:0x0].0x0 (ffff930ab2894500) 00010000:00010000:2.0:1786109777.753860:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109777.753864:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca38c63 lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753871:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425000/0xdb52b77d7ca38c63 lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753891:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753898:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c55 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753905:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753910:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109777.753914:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753920:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c55 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753928:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab2894200) 00010000:00010000:2.0:1786109777.753931:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109777.753933:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c55 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753939:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425600/0xdb52b77d7ca38c55 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109777.753951:0:201173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df73a1fb reply state 00000000ca219c73 transno 343597383697 ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca38c5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753962:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca38c5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.753968:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ab2894a00) 00010000:00010000:2.0:1786109777.753971:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109777.753973:0:201173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1786109777.754160:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 127 seconds 00000020:00080000:2.0:1786109777.754180:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.754183:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383701, next_transno: 343597383698 00000020:00080000:2.0:1786109777.754187:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.754189:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383701, next_transno: 343597383698 00000100:00100000:3.0:1786109777.760165:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109777.760260:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922177024 00000100:00100000:0.0:1786109777.760269:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922177024 00000100:00100000:0.0:1786109777.760314:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1317 00000100:00100000:0.0:1786109777.760325:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+12:2401:x1872862922177024:12345-192.168.203.38@tcp:36:rm.0 00010000:00080000:0.0:1786109777.760355:0:187900:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383698, current: 343597383710, replaying 00000100:00100000:0.0:1786109777.760380:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+12:2401:x1872862922177024:12345-192.168.203.38@tcp:36:rm.0 Request processed in 57us (225us total) trans 0 rc 0/-999 00000100:00100000:0.0:1786109777.760388:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1317 00000020:00080000:3.0:1786109777.760516:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.760521:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 343597383701, next_transno: 343597383698 00010000:00080000:3.0:1786109777.760526:0:201173:0:(ldlm_lib.c:2259:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 343597383698, ql: 2, comp: 0, conn: 2, next: 343597383701, next_update 0 last_committed: 343597383694) 00000020:00080000:3.0:1786109777.760531:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.760540:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862933358976 t343597383701 from 0@lo req@ffff930ac0bb0e00 x1872862933358976/t0(343597383701) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 416/0 e 0 to 0 dl 1786109788 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1786109777.760887:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 127 seconds 00000020:00080000:3.0:1786109777.760902:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.760905:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383710, next_transno: 343597383702 00000020:00080000:3.0:1786109777.760909:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.760911:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383710, next_transno: 343597383702 00000100:00080000:0.0:1786109777.761263:0:3645:0:(client.c:3425:ptlrpc_replay_interpret()) @@@ got reply req@ffff930ab7f14380 x1872862933358976/t343597383701(343597383701) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 1786109793 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109777.761273:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1786109777.761276:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383692 gen 2 00000100:00100000:0.0:1786109777.761281:0:3645:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff930ab7f14380 x1872862933358976/t343597383701(343597383701) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 1786109793 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109777.761289:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a8a47d000 from lustre-MDT0000_UUID committed 343597383692 last 343597383701 00000100:00080000:0.0:1786109777.761296:0:3645:0:(client.c:3540:ptlrpc_replay_req()) @@@ REPLAY req@ffff930ab7f14e00 x1872862933359232/t343597383702(343597383702) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 1786109711 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109777.761308:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933358976:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109777.761324:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933359232:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109777.761373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109777.761512:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933359232 00000100:00100000:3.0:1786109777.761518:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933359232 00000100:00100000:3.0:1786109777.761552:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786109777.761632:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1872862933359232:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:3.0:1786109777.761647:0:199402:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383702, current: 343597383702, replaying 00000100:00100000:3.0:1786109777.763197:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1872862933359232:12345-0@lo:1000:osp_up0-1.0 Request processed in 1629us (1816us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109777.763212:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000020:00080000:1.0:1786109777.764033:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109777.764039:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 343597383702, next_transno: 343597383702 00010000:00080000:1.0:1786109777.764044:0:201173:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (343597383702) 00000020:00080000:1.0:1786109777.764048:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109777.764057:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862933359232 t343597383702 from 0@lo req@ffff930ac1d3ed80 x1872862933359232/t0(343597383702) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 744/0 e 0 to 0 dl 1786109788 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109777.766882:0:3645:0:(client.c:3425:ptlrpc_replay_interpret()) @@@ got reply req@ffff930ab7f14e00 x1872862933359232/t343597383702(343597383702) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 1786109793 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109777.766894:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1786109777.766897:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383692 gen 2 00000100:00100000:1.0:1786109777.766903:0:3645:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff930ab7f14380 x1872862933358976/t343597383701(343597383701) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 1786109793 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109777.766911:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a8a47d000 from lustre-MDT0000_UUID committed 343597383692 last 343597383702 00000100:00080000:1.0:1786109777.766919:0:3645:0:(client.c:3540:ptlrpc_replay_req()) @@@ REPLAY req@ffff930ab7c57800 x1872862933369856/t343597383706(343597383706) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1786109731 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109777.766930:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933359232:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786109777.766949:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933369856:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786109777.767000:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109777.767164:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933369856 00000100:00100000:2.0:1786109777.767172:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933369856 00000100:00100000:2.0:1786109777.767221:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1786109777.767230:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1872862933369856:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:2.0:1786109777.767247:0:187904:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383702, current: 343597383706, replaying 00000100:00100000:2.0:1786109777.767254:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1872862933369856:12345-0@lo:1000:osp_up0-1.0 Request processed in 27us (255us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109777.767261:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1786109777.767349:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 127 seconds 00000020:00080000:0.0:1786109777.767650:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1786109777.767654:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 343597383706, next_transno: 343597383703 00010000:00080000:0.0:1786109777.767659:0:201173:0:(ldlm_lib.c:2259:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 343597383703, ql: 2, comp: 0, conn: 2, next: 343597383706, next_update 0 last_committed: 343597383694) 00000020:00080000:0.0:1786109777.767663:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1786109777.767670:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862933369856 t343597383706 from 0@lo req@ffff930ab7e5e680 x1872862933369856/t0(343597383706) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 1312/0 e 0 to 0 dl 1786109788 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000001:00080000:0.0:1786109777.770694:0:201141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383706 is committed 00000001:00080000:0.0:1786109777.770735:0:201141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383697 is committed 00010000:00080000:0.0:1786109777.770861:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 127 seconds 00000020:00080000:0.0:1786109777.770883:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1786109777.770887:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383710, next_transno: 343597383707 00000020:00080000:0.0:1786109777.770892:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1786109777.770894:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383710, next_transno: 343597383707 00010000:00010000:1.0:1786109777.770954:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca38c39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.770966:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca38c39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.770974:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca38c39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.770980:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109777.770984:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca38c39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.770992:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca38c39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771008:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ab2894a00) 00010000:00010000:1.0:1786109777.771012:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109777.771016:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca38c39 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771026:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424c00/0xdb52b77d7ca38c39 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771041:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca38c4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771047:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca38c4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771052:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca38c4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771057:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109777.771060:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca38c4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771065:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca38c4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771153:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ab2894a00) 00010000:00010000:1.0:1786109777.771158:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109777.771162:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca38c4e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771169:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425a00/0xdb52b77d7ca38c4e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771183:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca38c5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771189:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca38c5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771195:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca38c5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771200:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424e00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109777.771203:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca38c5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771209:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca38c5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771217:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930ab2894a00) 00010000:00010000:1.0:1786109777.771220:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109777.771222:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca38c5c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.771228:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424e00/0xdb52b77d7ca38c5c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109777.771276:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383706 gen 2 00000004:00080000:1.0:1786109777.771283:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 343597383701 committed transno 343597383706 00000004:00080000:1.0:1786109777.771302:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 343597383702 committed transno 343597383706 00000004:00080000:1.0:1786109777.771312:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 343597383706 committed transno 343597383706 00000100:00100000:1.0:1786109777.771325:0:3645:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff930a97809500 x1872862933370112/t343597383707(343597383707) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1786109731 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109777.771350:0:3645:0:(client.c:3425:ptlrpc_replay_interpret()) @@@ got reply req@ffff930ab7c57800 x1872862933369856/t343597383706(343597383706) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1786109793 ref 1 fl Interpret:RMQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109777.771359:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1786109777.771362:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383706 gen 2 00000100:00100000:1.0:1786109777.771366:0:3645:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff930a97809500 x1872862933370112/t343597383707(343597383707) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1786109731 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109777.771374:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a8a47d000 from lustre-MDT0000_UUID committed 343597383706 last 343597383706 00000100:00080000:1.0:1786109777.771380:0:3645:0:(client.c:3540:ptlrpc_replay_req()) @@@ REPLAY req@ffff930a97809500 x1872862933370112/t343597383707(343597383707) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1786109731 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109777.771392:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933369856:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786109777.771412:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933370112:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786109777.771477:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109777.771626:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933370112 00000100:00100000:0.0:1786109777.771633:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933370112 00000100:00100000:0.0:1786109777.771712:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786109777.771722:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87bb3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933370112:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1786109777.771738:0:199402:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383707, current: 343597383707, replaying 00000100:00100000:0.0:1786109777.771750:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87bb3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933370112:12345-0@lo:1000:osp_up0-1.0 Request processed in 30us (274us total) trans 0 rc 0/-999 00000100:00100000:0.0:1786109777.771756:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000020:00080000:1.0:1786109777.774497:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109777.774506:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 343597383707, next_transno: 343597383707 00010000:00080000:1.0:1786109777.774511:0:201173:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (343597383707) 00000020:00080000:1.0:1786109777.774514:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109777.774525:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862933370112 t343597383707 from 0@lo req@ffff930a87bb3850 x1872862933370112/t0(343597383707) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 1312/0 e 0 to 0 dl 1786109788 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000001:00080000:2.0:1786109777.781037:0:201141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383707 is committed 00010000:00080000:1.0:1786109777.786724:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 127 seconds 00000100:00100000:1.0:1786109777.786768:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383707 gen 2 00000004:00080000:1.0:1786109777.786774:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 343597383707 committed transno 343597383707 00000100:00100000:1.0:1786109777.786791:0:3645:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff930ab1c20000 x1872862933370496/t343597383708(343597383708) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1786109731 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109777.786805:0:3645:0:(client.c:3425:ptlrpc_replay_interpret()) @@@ got reply req@ffff930a97809500 x1872862933370112/t343597383707(343597383707) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 1786109793 ref 1 fl Interpret:RMQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109777.786813:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1786109777.786815:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383707 gen 2 00000100:00100000:1.0:1786109777.786819:0:3645:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff930ab1c20000 x1872862933370496/t343597383708(343597383708) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1786109731 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109777.786831:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a8a47d000 from lustre-MDT0000_UUID committed 343597383707 last 343597383707 00000100:00080000:1.0:1786109777.786837:0:3645:0:(client.c:3540:ptlrpc_replay_req()) @@@ REPLAY req@ffff930ab1c20000 x1872862933370496/t343597383708(343597383708) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1786109731 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109777.786848:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933370112:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786109777.786879:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933370496:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786109777.786964:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109777.787007:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933370496 00000100:00100000:1.0:1786109777.787013:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933370496 00000100:00100000:1.0:1786109777.787053:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786109777.787062:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1872862933370496:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:1.0:1786109777.788911:0:187905:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383707, current: 343597383708, replaying 00000100:00100000:1.0:1786109777.788926:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1872862933370496:12345-0@lo:1000:osp_up0-1.0 Request processed in 1863us (1959us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109777.788937:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000020:00080000:1.0:1786109777.789210:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109777.789214:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 343597383708, next_transno: 343597383708 00010000:00080000:1.0:1786109777.789218:0:201173:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (343597383708) 00000020:00080000:1.0:1786109777.789220:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109777.789228:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862933370496 t343597383708 from 0@lo req@ffff930ab7e5e300 x1872862933370496/t0(343597383708) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 264/0 e 0 to 0 dl 1786109788 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000400:1.0:1786109777.789610:0:201173:0:(out_handler.c:886:out_tx_end()) lustre-MDT0000-osd: error during execution of #0 from /home/green/git/lustre-release/lustre/ptlrpc/../target/out_handler.c:565: rc = -2 00000001:00020000:1.0:1786109777.805033:0:201173:0:(tgt_lastrcvd.c:1516:tgt_last_rcvd_update()) lustre-MDT0000: replay transno 343597383708 failed: rc = -2 00010000:00080000:1.0:1786109777.823663:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 127 seconds 00000100:00080000:1.0:1786109777.823716:0:3645:0:(client.c:3425:ptlrpc_replay_interpret()) @@@ got reply req@ffff930ab1c20000 x1872862933370496/t343597383708(343597383708) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1786109793 ref 2 fl Interpret:RQU/204/0 rc -2/-2 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00020000:1.0:1786109777.823729:0:3645:0:(client.c:3435:ptlrpc_replay_interpret()) @@@ status -2, old was 0 req@ffff930ab1c20000 x1872862933370496/t343597383708(343597383708) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 1786109793 ref 2 fl Interpret:RQU/204/0 rc -2/-2 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00080000:0.0:1786109777.826500:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1786109777.826508:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383710, next_transno: 343597383709 00000020:00080000:0.0:1786109777.826516:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1786109777.826518:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 343597383710, next_transno: 343597383709 00000004:00080000:1.0:1786109777.858726:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 343597383708 committed transno 343597383707 00000020:00080000:1.0:1786109777.858737:0:3645:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff93098469fe40 refcount 2 committed 0 result -2 batchid 25769804643 00000020:00080000:1.0:1786109777.858743:0:3645:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aa6220800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result -2 sub_th ffff93098469f300 00000020:00080000:1.0:1786109777.858748:0:3645:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200027501:0x1:0x0].1 00000020:00080000:1.0:1786109777.858751:0:3645:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aa6220600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930986230a00 00000020:00080000:1.0:1786109777.858753:0:3645:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400036c8:0x1:0x0].1 00000100:00080000:1.0:1786109777.858799:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1786109777.858803:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383707 gen 2 00000100:00080000:1.0:1786109777.858807:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a8a47d000 from lustre-MDT0000_UUID committed 343597383707 last 343597383708 00000100:00080000:1.0:1786109777.858811:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00080000:1.0:1786109777.858841:0:198797:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 25769804643 committed batchid 21474840726 00000020:00080000:1.0:1786109777.858935:0:198797:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840726 00000004:00080000:1.0:1786109777.858954:0:198783:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x200027501:0x1:0x0]: rc = -5 00000004:00080000:1.0:1786109777.858959:0:198783:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x200027501:0x1:0x0]: rc = -5 00000004:00080000:1.0:1786109777.858962:0:198783:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x200027501:0x1:0x0]: rc = -5 00000004:00080000:1.0:1786109777.858964:0:198783:0:(osp_md_object.c:1171:osp_write_interpreter()) error [0x200027501:0x1:0x0]: rc = -5 00000004:00080000:1.0:1786109777.858974:0:198783:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200027501:0x1:0x0] 00000100:00100000:1.0:1786109777.858983:0:198783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97fd5180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:198783:1872862933377408:0@lo:1000:osp_up0-1.0 00000020:00080000:1.0:1786109777.858996:0:198783:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff930ab7cc43c0 refcount 3 committed 0 result -5 batchid 25769804644 00000020:00080000:1.0:1786109777.859000:0:198783:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab1d83400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result -5 sub_th ffff930ab7cc4180 00000020:00080000:1.0:1786109777.859003:0:198783:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200027501:0x1:0x0].2 00000020:00080000:1.0:1786109777.859005:0:198783:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab1d83500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ac0b53200 00000020:00080000:1.0:1786109777.859010:0:198783:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400036c8:0x1:0x0].2 00000100:00100000:0.0:1786109777.860545:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933370496:0@lo:1000:osp_up0-1.0 00010000:00080000:2.0:1786109777.860716:0:201505:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1786109777.860721:0:201505:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1786109777.860726:0:201505:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000004:00080000:1.0:1786109777.861985:0:196401:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x7:0x0] 00010000:00010000:1.0:1786109777.862006:0:196401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 5/0,1 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.862019:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 5/0,1 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.862028:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 4/0,0 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.862055:0:196401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786109777.862062:0:196401:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200026d31:0x7:0x0] 00010000:00010000:1.0:1786109777.862067:0:196401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 5/0,1 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca388a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.862196:0:201505:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1786109777.862220:0:201505:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00010000:00010000:2.0:1786109777.862229:0:201505:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 5/0,1 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca388a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1786109777.862236:0:201505:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 2(512) 00010000:00010000:2.0:1786109777.862242:0:201505:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38206 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1786109777.862248:0:201505:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 3(512) 00000100:00100000:2.0:1786109777.862329:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933409408:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1786109777.862502:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109777.862536:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933409536:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1786109777.862556:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109777.862666:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab992a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933409664:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1786109777.862691:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786109777.862756:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109777.862764:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 2/0,0 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109777.862773:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628be00 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:0.0:1786109777.862778:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786109777.862787:0:10402:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109777.862819:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109777.862825:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109777.862862:0:196401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 4/0,1 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca388a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.862872:0:196401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca388a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.862897:0:196401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00000080:1.0:1786109777.862929:0:196401:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930986552680 x1872862922179968/t30064771142(0) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:246/0 lens 560/448 e 2 to 0 dl 1786109786 ref 1 fl Interpret:/200/0 rc -5/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109777.862992:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930986552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+6:165779:x1872862922179968:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 52818679us (52818882us total) trans 30064771142 rc -5/-5 00000100:00100000:1.0:1786109777.863001:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1257 00010000:00010000:2.0:1786109777.864600:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109777.864611:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 2/0,0 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca388a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.864622:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a000 already unused, calling callback (ffffffffc1a93ee0) 00010000:00010000:2.0:1786109777.864628:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca388a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109777.864638:0:6514:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca388a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.864674:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 2/0,0 mode: --/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca388a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.864681:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:02000400:1.0:1786109777.869238:0:196401:0:(service.c:2915:ptlrpc_watchdog_update()) mdt00_005: service thread pid 196401 completed after 52.824s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources). 00000100:00100000:3.0:1786109777.871049:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933409408 00000100:00100000:3.0:1786109777.871063:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933409408 00000100:00100000:3.0:1786109777.871122:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933409536 00000100:00100000:3.0:1786109777.871125:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933409536 00000100:00100000:3.0:1786109777.871136:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933409664 00000100:00100000:3.0:1786109777.871139:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933409664 00000100:00100000:3.0:1786109777.871157:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786109777.871166:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872862933409408:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:3.0:1786109777.871192:0:187905:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff930ac0fb9880 x1872862933409408/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 328/0 e 0 to 0 dl 1786109788 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109777.871215:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872862933409408:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 50us (8713us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109777.871221:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786109777.871249:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786109777.871255:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872862933409536:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:3.0:1786109777.871264:0:187905:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff930ac0fb8a80 x1872862933409536/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 328/0 e 0 to 0 dl 1786109788 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109777.871273:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872862933409536:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 19us (8717us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109777.871278:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786109777.871287:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786109777.871292:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872862933409664:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:3.0:1786109777.871299:0:187905:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff930ac0fba300 x1872862933409664/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 328/0 e 0 to 0 dl 1786109788 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109777.871314:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872862933409664:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 23us (8624us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109777.871320:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00080000:3.0:1786109777.871354:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.871359:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 343597383710, next_transno: 343597383709 00010000:00080000:3.0:1786109777.871364:0:201173:0:(ldlm_lib.c:2259:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 343597383709, ql: 1, comp: 1, conn: 2, next: 343597383710, next_update 0 last_committed: 343597383707) 00000020:00080000:3.0:1786109777.871368:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.871378:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922177024 t343597383710 from 192.168.203.38@tcp req@ffff930ac1f3fb80 x1872862922177024/t0(343597383710) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:287/0 lens 512/0 e 0 to 0 dl 1786109827 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1786109777.871480:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca38c6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.871496:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca38c6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.871510:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca38c6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.871523:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38c71 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.871531:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38c71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.871538:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38c71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109777.871770:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 1/0,0 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109777.871781:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628be00/0xdb52b77d7ca3888f lrc: 0/0,0 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38896 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109777.871828:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109777.871830:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109777.871833:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109777.872534:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca38c78 lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.872548:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca38c78 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.873147:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca38c78 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109777.873417:0:201173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1786109777.873454:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca38c78 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.873463:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca38c78 lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.873470:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca38c78 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.873477:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109777.873481:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca38c78 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.873490:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca38c78 lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.873503:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x4:0x0].0x0 (ffff930a81356b00) 00010000:00010000:3.0:1786109777.873507:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109777.873512:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca38c78 lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.873518:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b400/0xdb52b77d7ca38c78 lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.873544:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca38c6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.873551:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca38c6a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.873557:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca38c6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.873872:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 1/0,0 mode: --/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca388a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.873895:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930aa628a000/0xdb52b77d7ca3889d lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca388a4 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.873918:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109777.873920:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109777.873922:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109777.873943:0:3648:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != REPLAY_LOCKS) req@ffff930ac0fbbb80 x1872862933409920/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109777.874928:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1786109777.874945:0:3646:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != REPLAY_LOCKS) req@ffff930ac1d3c380 x1872862933409792/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1786109777.875257:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109777.875263:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca38c6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.875271:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca38c6a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.875286:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a81356100) 00010000:00010000:3.0:1786109777.875288:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109777.875293:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca38c6a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.875300:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b200/0xdb52b77d7ca38c6a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109777.875319:0:201173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027ee6a3d reply state 0000000044d99334 transno 343597383710 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38c71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.875330:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38c71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1786109777.875517:0:198797:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 25769804644 committed batchid 21474840726 00010000:00010000:3.0:1786109777.875960:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff930a81356200) 00010000:00010000:3.0:1786109777.875965:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109777.875970:0:201173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1786109777.876067:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 171 seconds 00000020:00080000:3.0:1786109777.876098:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.876102:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383711 00000020:00080000:3.0:1786109777.876106:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.876108:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383711 00000020:00080000:2.0:1786109777.876513:0:198797:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840726 00000100:00100000:2.0:1786109777.882420:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109777.882483:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922178816 00000100:00100000:2.0:1786109777.882493:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922178816 00000100:00100000:2.0:1786109777.882540:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1318 00000100:00100000:2.0:1786109777.882549:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+8:2401:x1872862922178816:12345-192.168.203.38@tcp:36:lfs.0 00010000:00080000:2.0:1786109777.882639:0:189813:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383711, current: 343597383711, replaying 00000100:00100000:2.0:1786109777.882660:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+8:2401:x1872862922178816:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 112us (332us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109777.882668:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1318 00000020:00080000:3.0:1786109777.882801:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.882806:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 343597383711, next_transno: 343597383711 00010000:00080000:3.0:1786109777.882810:0:201173:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (343597383711) 00000020:00080000:3.0:1786109777.882813:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.882823:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922178816 t343597383711 from 192.168.203.38@tcp req@ffff930ac0fb9f80 x1872862922178816/t0(343597383711) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:307/0 lens 568/0 e 0 to 0 dl 1786109847 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1786109777.885622:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca38c7f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.885647:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca38c7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.885659:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca38c7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.885673:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca38c86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.885681:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca38c86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.885688:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca38c86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.888393:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca38c8d lrc: 3/0,1 mode: --/PW res: [0x200026d31:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.888415:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca38c8d lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.888425:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca38c8d lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109777.888469:0:201173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064e5175f reply state 0000000041636ffc transno 343597383711 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca38c8d lrc: 3/0,1 mode: PW/PW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.888481:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca38c8d lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.888489:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a81356c00) 00010000:00010000:3.0:1786109777.888492:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109777.888496:0:201173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1786109777.888502:0:201173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x7:0x0]: returning size 4096 00010000:00010000:3.0:1786109777.888510:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca38c7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.888517:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca38c7f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.888524:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca38c7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.888530:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628bc00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109777.888535:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca38c7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.888548:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca38c7f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.888558:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a81356300) 00010000:00010000:3.0:1786109777.889493:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109777.889502:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca38c7f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.889510:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628bc00/0xdb52b77d7ca38c7f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109777.889535:0:201173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064e5175f reply state 0000000041636ffc transno 343597383711 ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca38c86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.889547:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca38c86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.889554:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff930a81356500) 00010000:00010000:3.0:1786109777.889557:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109777.889559:0:201173:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00010000:00080000:3.0:1786109777.894057:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 170 seconds 00000020:00080000:3.0:1786109777.894157:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.894162:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383712 00000020:00080000:3.0:1786109777.894166:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.894168:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383712 00000020:00080000:2.0:1786109777.905268:0:198777:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 25769804643 batchid updated 00000001:00100000:2.0:1786109777.905278:0:198777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1786109777.916890:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109777.916928:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922179712 00000100:00100000:3.0:1786109777.916937:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922179712 00000100:00100000:3.0:1786109777.916990:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1319 00000100:00100000:3.0:1786109777.917001:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+10:2401:x1872862922179712:12345-192.168.203.38@tcp:101:lfs.0 00010000:00080000:3.0:1786109777.917021:0:187901:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383712, current: 343597383712, replaying 00000100:00100000:3.0:1786109777.917034:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+10:2401:x1872862922179712:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 36us (166us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109777.917041:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1319 00000020:00080000:3.0:1786109777.917060:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.917063:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 343597383712, next_transno: 343597383712 00010000:00080000:3.0:1786109777.917067:0:201173:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (343597383712) 00000020:00080000:3.0:1786109777.917070:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.917214:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922179712 t343597383712 from 192.168.203.38@tcp req@ffff930ac1f3c000 x1872862922179712/t0(343597383712) o101->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:307/0 lens 520/0 e 0 to 0 dl 1786109847 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1786109777.917238:0:201173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109777.917263:0:201173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38c94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a18d5 expref: -99 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109777.917637:0:201173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200026d31:0x7:0x0]: returning size 4096 00000004:00080000:3.0:1786109777.917659:0:201173:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x200026d31:0x7:0x0], cookie = 0xdb52b77d7ca38888 00000004:00080000:3.0:1786109777.917662:0:201173:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xdb52b77d7ca38888 in new mfd 00010000:00010000:3.0:1786109777.917740:0:201173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38c94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18d5 expref: 12 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.917756:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a81356100) 00010000:00010000:3.0:1786109777.917759:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786109777.917765:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38c94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a18d5 expref: 12 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.917782:0:201173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f07200, rc 0) 00010000:00080000:3.0:1786109777.917849:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 170 seconds 00000020:00080000:3.0:1786109777.917864:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.917866:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383713 00000020:00080000:3.0:1786109777.917870:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.917872:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383713 00000100:00100000:0.0:1786109777.924308:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109777.924782:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922180864 00000100:00100000:2.0:1786109777.924792:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922180864 00000100:00100000:2.0:1786109777.924910:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1320 00000100:00100000:2.0:1786109777.924921:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+11:2401:x1872862922180864:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00080000:2.0:1786109777.924941:0:187899:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383713, current: 343597383714, replaying 00000100:00100000:2.0:1786109777.924954:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+11:2401:x1872862922180864:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 36us (657us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109777.924961:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1320 00000020:00080000:3.0:1786109777.925151:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.925155:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 343597383714, next_transno: 343597383713 00010000:00080000:3.0:1786109777.925160:0:201173:0:(ldlm_lib.c:2259:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 343597383713, ql: 1, comp: 1, conn: 2, next: 343597383714, next_update 0 last_committed: 343597383707) 00000020:00080000:3.0:1786109777.925165:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.925174:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922180864 t343597383714 from 192.168.203.38@tcp req@ffff930ac1d3e680 x1872862922180864/t0(343597383714) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:307/0 lens 528/0 e 0 to 0 dl 1786109847 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1786109777.925317:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca38ca2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.925333:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca38ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.925364:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca38ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.925377:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38ca9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.925384:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.925389:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.927042:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca38ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.927056:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca38ca2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.927063:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca38ca2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.927069:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109777.928109:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca38ca2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.928124:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca38ca2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.928141:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a81356300) 00010000:00010000:3.0:1786109777.928144:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109777.928148:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca38ca2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.928154:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07a00/0xdb52b77d7ca38ca2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109777.928173:0:201173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f523742a reply state 0000000004679488 transno 343597383714 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.928184:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38ca9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.928192:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a81356b00) 00010000:00010000:3.0:1786109777.928195:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109777.928198:0:201173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1786109777.928975:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 170 seconds 00000020:00080000:3.0:1786109777.928999:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.929003:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383715 00000020:00080000:3.0:1786109777.929007:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.929009:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383715 00000100:00100000:3.0:1786109777.936864:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109777.937670:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922181376 00000100:00100000:2.0:1786109777.937681:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922181376 00000100:00100000:2.0:1786109777.937748:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1321 00000100:00100000:2.0:1786109777.937759:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+13:2401:x1872862922181376:12345-192.168.203.38@tcp:36:rm.0 00010000:00080000:2.0:1786109777.937779:0:188678:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383715, current: 343597383715, replaying 00000100:00100000:2.0:1786109777.937793:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+13:2401:x1872862922181376:12345-192.168.203.38@tcp:36:rm.0 Request processed in 37us (939us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109777.937801:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1321 00000020:00080000:3.0:1786109777.937854:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.937859:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 343597383715, next_transno: 343597383715 00010000:00080000:3.0:1786109777.937863:0:201173:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (343597383715) 00000020:00080000:3.0:1786109777.937867:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.937954:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922181376 t343597383715 from 192.168.203.38@tcp req@ffff930ac1f3f800 x1872862922181376/t0(343597383715) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:307/0 lens 512/0 e 0 to 0 dl 1786109847 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1786109777.938046:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38cb0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938062:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38cb0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938420:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38cb0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938470:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca38cb7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938479:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca38cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938487:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca38cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938591:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07000/0xdb52b77d7ca38cbe lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938599:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07000/0xdb52b77d7ca38cbe lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938618:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07000/0xdb52b77d7ca38cbe lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938816:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07000/0xdb52b77d7ca38cbe lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938824:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07000/0xdb52b77d7ca38cbe lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938830:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07000/0xdb52b77d7ca38cbe lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938836:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109777.938840:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07000/0xdb52b77d7ca38cbe lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938848:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07000/0xdb52b77d7ca38cbe lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938859:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x8:0x0].0x0 (ffff930a81356f00) 00010000:00010000:3.0:1786109777.938862:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786109777.938866:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07000/0xdb52b77d7ca38cbe lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938873:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07000/0xdb52b77d7ca38cbe lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938908:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38cb0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938915:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38cb0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938919:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38cb0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938924:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07200 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:3.0:1786109777.938927:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38cb0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938933:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38cb0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938940:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a81356100) 00010000:00010000:3.0:1786109777.938942:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109777.938944:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38cb0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938949:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07200/0xdb52b77d7ca38cb0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786109777.938960:0:201173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043d1dcfe reply state 00000000ed8c3560 transno 343597383715 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca38cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938970:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca38cb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.938976:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a81356b00) 00010000:00010000:3.0:1786109777.938979:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786109777.938982:0:201173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1786109777.939062:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 170 seconds 00000020:00080000:3.0:1786109777.939623:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.939627:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383716 00000020:00080000:3.0:1786109777.939632:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1786109777.939634:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383716 00000100:00100000:2.0:1786109777.943768:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109777.943868:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922182912 00000100:00100000:3.0:1786109777.943946:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922182912 00000100:00100000:3.0:1786109777.944016:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1322 00000100:00100000:3.0:1786109777.944026:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+15:2401:x1872862922182912:12345-192.168.203.38@tcp:36:mcreate.0 00010000:00080000:3.0:1786109777.944047:0:187901:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383716, current: 343597383716, replaying 00000100:00100000:3.0:1786109777.944104:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+15:2401:x1872862922182912:12345-192.168.203.38@tcp:36:mcreate.0 Request processed in 80us (346us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109777.944112:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1322 00000020:00080000:1.0:1786109777.944231:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109777.944236:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 343597383716, next_transno: 343597383716 00010000:00080000:1.0:1786109777.944240:0:201173:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (343597383716) 00000020:00080000:1.0:1786109777.944243:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109777.944252:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922182912 t343597383716 from 192.168.203.38@tcp req@ffff930ac0fb9500 x1872862922182912/t0(343597383716) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:307/0 lens 528/0 e 0 to 0 dl 1786109847 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1786109777.944656:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38cc5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.944672:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.944683:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.944694:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca38ccc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.944703:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca38ccc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.944709:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca38ccc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.945040:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.945049:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38cc5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.945061:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38cc5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.945068:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:1.0:1786109777.945188:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38cc5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.945198:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38cc5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.945210:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a9a33e100) 00010000:00010000:1.0:1786109777.945213:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786109777.945217:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38cc5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.945224:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38cc5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109777.945240:0:201173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000979bd6b4 reply state 000000009f3f4c72 transno 343597383716 ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca38ccc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.945249:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca38ccc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.945255:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a81356b00) 00010000:00010000:1.0:1786109777.945257:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786109777.945259:0:201173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1786109777.945467:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 170 seconds 00000020:00080000:1.0:1786109777.945487:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109777.945490:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383717 00000020:00080000:1.0:1786109777.945493:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109777.945496:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383717 00000100:00100000:2.0:1786109777.948219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109777.948323:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922183424 00000100:00100000:1.0:1786109777.948333:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922183424 00000100:00100000:1.0:1786109777.948767:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1323 00000100:00100000:1.0:1786109777.948778:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+17:2401:x1872862922183424:12345-192.168.203.38@tcp:36:rm.0 00010000:00080000:1.0:1786109777.948797:0:187899:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 343597383717, current: 343597383717, replaying 00000100:00100000:1.0:1786109777.949005:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+17:2401:x1872862922183424:12345-192.168.203.38@tcp:36:rm.0 Request processed in 227us (793us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109777.949013:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1323 00000020:00080000:2.0:1786109777.949188:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.949193:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 343597383717, next_transno: 343597383717 00010000:00080000:2.0:1786109777.949198:0:201173:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (343597383717) 00000020:00080000:2.0:1786109777.949201:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.949210:0:201173:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1872862922183424 t343597383717 from 192.168.203.38@tcp req@ffff930ac0fb8e00 x1872862922183424/t0(343597383717) o36->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:307/0 lens 512/0 e 0 to 0 dl 1786109847 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1786109777.949290:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38cd3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949306:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949317:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949330:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38cda lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949356:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38cda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949365:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38cda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949493:0:201173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca38ce1 lrc: 3/0,1 mode: --/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949502:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca38ce1 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949508:0:201173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca38ce1 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949860:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca38ce1 lrc: 3/0,1 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949870:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca38ce1 lrc: 2/0,0 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949877:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca38ce1 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949899:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424000 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109777.949903:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca38ce1 lrc: 3/0,0 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949912:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca38ce1 lrc: 4/0,0 mode: EX/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949925:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x9:0x0].0x0 (ffff930ab1d24f00) 00010000:00010000:2.0:1786109777.949928:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786109777.949932:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca38ce1 lrc: 2/0,0 mode: --/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949939:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424000/0xdb52b77d7ca38ce1 lrc: 0/0,0 mode: --/EX res: [0x200026d31:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949960:0:201173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949966:0:201173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38cd3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949972:0:201173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949977:0:201173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109777.949980:0:201173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949986:0:201173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38cd3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.949993:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930ab1d24e00) 00010000:00010000:2.0:1786109777.949995:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109777.949998:0:201173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38cd3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.950003:0:201173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986424800/0xdb52b77d7ca38cd3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786109777.950014:0:201173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc199043 reply state 00000000c3eef078 transno 343597383717 ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38cda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.950024:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38cda lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109777.950031:0:201173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a81356b00) 00010000:00010000:2.0:1786109777.950034:0:201173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786109777.950036:0:201173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1786109777.950246:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 170 seconds 00000020:00080000:2.0:1786109777.950264:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.950267:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383718 00000020:00080000:2.0:1786109777.950271:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1786109777.950273:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 343597383718 00000100:00100000:3.0:1786109777.955387:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109777.955986:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922189824 00000100:00100000:2.0:1786109777.955997:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922189824 00000100:00100000:2.0:1786109777.956107:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 480 00000100:00100000:2.0:1786109777.956119:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+19:2401:x1872862922189824:12345-192.168.203.38@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1786109777.956146:0:188678:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ac1f3c700 x1872862922189824/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:307/0 lens 224/0 e 0 to 0 dl 1786109847 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109777.956171:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+19:2401:x1872862922189824:12345-192.168.203.38@tcp:400:ldlm_lock_repla.0 Request processed in 55us (795us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109777.956178:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 480 00000020:00080000:1.0:1786109777.956270:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109777.956276:0:201173:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 343597383718 00010000:00080000:1.0:1786109777.956279:0:201173:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1786109777.956282:0:201173:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1786109777.956288:0:201173:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1786109777.956290:0:201173:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1786109777.956298:0:201173:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff930ac0fb9880 x1872862933409408/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 328/0 e 0 to 0 dl 1786109788 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1786109777.956317:0:201173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109777.956354:0:201173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38ce8 lrc: 2/0,0 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3888f expref: -99 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.956381:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38ce8 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3888f expref: 10 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.956406:0:201173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38ce8 lrc: 3/0,0 mode: CW/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3888f expref: 10 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.956420:0:201173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9361a00, rc 0) 00010000:00080000:1.0:1786109777.956509:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 170 seconds 00010000:00080000:1.0:1786109777.956521:0:201173:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1786109777.956523:0:201173:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1786109777.956528:0:201173:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff930ac0fb8a80 x1872862933409536/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 328/0 e 0 to 0 dl 1786109788 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1786109777.956540:0:201173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109777.956554:0:201173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca38cef lrc: 2/0,0 mode: --/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca3889d expref: -99 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.956568:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca38cef lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca3889d expref: 10 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.956579:0:201173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca38cef lrc: 3/0,0 mode: PW/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca3889d expref: 10 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.956587:0:201173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9361000, rc 0) 00010000:00080000:1.0:1786109777.956612:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 170 seconds 00010000:00080000:1.0:1786109777.956619:0:201173:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1786109777.956620:0:201173:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1786109777.956625:0:201173:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff930ac0fba300 x1872862933409664/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 328/0 e 0 to 0 dl 1786109788 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1786109777.956637:0:201173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786109777.956649:0:201173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360400/0xdb52b77d7ca38cf6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca381ff expref: -99 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.956662:0:201173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360400/0xdb52b77d7ca38cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca381ff expref: 10 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.956673:0:201173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360400/0xdb52b77d7ca38cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca381ff expref: 10 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109777.956757:0:201173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360400, rc 0) 00010000:00080000:1.0:1786109777.956783:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 170 seconds 00010000:00080000:1.0:1786109777.956789:0:201173:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00020000:0.0:1786109777.956950:0:3645:0:(ldlm_request.c:2758:replay_lock_interpret()) received replay ack for unknown local cookie 0xdb52b77d7ca3888f remote cookie 0xdb52b77d7ca38ce8 from server (efault) id 0-0@<0:0> 00000100:00080000:0.0:1786109777.969156:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to CONNECTING 00000100:00080000:0.0:1786109777.969170:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8634 00000100:00080000:0.0:1786109777.969180:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930a8a47d000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109777.969314:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7e5f800 x1872862933410048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109777.969334:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933409408:0@lo:101:ldlm_lock_repla.0 00010000:00020000:1.0:1786109777.969398:0:3645:0:(ldlm_request.c:2758:replay_lock_interpret()) received replay ack for unknown local cookie 0xdb52b77d7ca3889d remote cookie 0xdb52b77d7ca38cef from server (efault) id 0-0@<0:0> 00000100:00020000:1.0:1786109777.969402:0:3645:0:(import.c:717:ptlrpc_connect_import_locked()) already connecting 00000100:00100000:1.0:1786109777.980004:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933409536:0@lo:101:ldlm_lock_repla.0 00010000:00010000:1.0:1786109777.980064:0:3645:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38cf6 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109777.980716:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab992a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933409664:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1786109777.980760:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933410048:0@lo:38:ptlrpcd_rcv.0 00000100:00100000:1.0:1786109777.980830:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109777.980931:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933410048 00000100:00100000:3.0:1786109777.980940:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933410048 00000100:00100000:3.0:1786109777.980984:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1786109777.980994:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:3645:x1872862933410048:12345-0@lo:38:ptlrpcd_rcv.0 00010000:02000400:3.0:1786109777.981024:0:187905:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-MDT0000: Received new MDS connection from 0@lo, keep former export from same NID 00010000:00080000:3.0:1786109777.988743:0:187905:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t343597383701 exp ffff930981e10800 cur 8634 last 1786109772 00000004:00100000:3.0:1786109777.988775:0:187905:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli 0@lo does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1786109777.988793:0:187905:0:(import.c:65:import_set_state_nolock()) ffff930ac09cd800 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1786109777.988802:0:187905:0:(import.c:65:import_set_state_nolock()) ffff930ac09cd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786109777.988980:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:3645:x1872862933410048:12345-0@lo:38:ptlrpcd_rcv.0 Request processed in 7986us (8148us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109777.988993:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1786109777.989076:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 81 00000100:00080000:1.0:1786109777.989089:0:3645:0:(import.c:1297:ptlrpc_connect_interpret()) reconnected to lustre-MDT0000_UUID@0@lo after partition 00000100:00080000:1.0:1786109777.989091:0:3645:0:(import.c:1307:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: reconnected to lustre-MDT0000_UUID during replay 00000100:00080000:1.0:1786109777.989093:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1786109777.989097:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1786109777.989100:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383707 gen 2 00000100:00080000:1.0:1786109777.989104:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a8a47d000 from lustre-MDT0000_UUID committed 343597383707 last 343597383708 00000100:00080000:1.0:1786109777.989108:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1786109777.989855:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933410048:0@lo:38:ptlrpcd_rcv.0 00010000:00080000:1.0:1786109777.989875:0:201509:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1786109777.989880:0:201509:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1786109777.989885:0:201509:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:1.0:1786109777.990835:0:201509:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38cf6 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1786109777.990862:0:201509:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:2.0:1786109777.991044:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933410176:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1786109777.991121:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109777.991284:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933410176 00000100:00100000:0.0:1786109777.991292:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933410176 00000100:00100000:0.0:1786109777.991384:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786109777.991396:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:3645:x1872862933410176:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:0.0:1786109777.991414:0:187904:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff930ac0fbad80 x1872862933410176/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 328/0 e 0 to 0 dl 1786109788 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109777.991460:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:3645:x1872862933410176:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 67us (338us total) trans 0 rc 0/-999 00000100:00100000:0.0:1786109777.991471:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1786109777.991520:0:201173:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1786109777.991529:0:201173:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff930ac0fbad80 x1872862933410176/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 328/0 e 0 to 0 dl 1786109788 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1786109777.991545:0:201173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109777.991557:0:201173:0:(ldlm_lockd.c:1319:ldlm_handle_enqueue()) @@@ found existing lock cookie 0xdb52b77d7ca38cf6 req@ffff930ac0fbad80 x1872862933410176/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 328/0 e 0 to 0 dl 1786109788 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1786109777.991591:0:201173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360400/0xdb52b77d7ca38cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca381ff expref: 10 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109777.991601:0:201173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab9360400, rc 0) 00010000:00080000:3.0:1786109777.991644:0:201173:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 170 seconds 00010000:00080000:3.0:1786109777.991654:0:201173:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00010000:2.0:1786109777.991830:0:3645:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38cf6 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786109777.991841:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1786109777.991859:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933410176:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1786109777.991876:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933410304:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1786109777.991903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109777.991983:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933410304 00000100:00100000:3.0:1786109777.991988:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933410304 00000100:00100000:3.0:1786109777.992034:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786109777.992041:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:3645:x1872862933410304:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1786109777.992052:0:187905:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ac0fbb800 x1872862933410304/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 224/0 e 0 to 0 dl 1786109788 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109777.992066:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:3645:x1872862933410304:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 27us (163us total) trans 0 rc 0/-999 00000100:00100000:3.0:1786109777.992332:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1786109777.992358:0:201173:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1786109777.992477:0:201173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 81, last_transno is 347892350976 00000001:00100000:3.0:1786109777.995169:0:201141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1786109777.995179:0:201141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00080000:3.0:1786109777.995597:0:201141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383717 is committed 00000001:00080000:3.0:1786109777.995620:0:201141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 343597383708 is committed 00000001:00080000:3.0:1786109777.995656:0:201173:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1786109777.995698:0:201173:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1786109777.995715:0:201173:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.203.38@tcp: req@ffff930ac1f3c700 x1872862922189824/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:307/0 lens 224/0 e 0 to 0 dl 1786109847 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1786109777.995815:0:201173:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff930ac0fbb800 x1872862933410304/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 224/0 e 0 to 0 dl 1786109788 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1786109777.995885:0:201173:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:2.0:1786109778.003805:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38c71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.003825:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38c71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.003833:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38c71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.003839:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109778.003844:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38c71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.003853:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38c71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.003872:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe59fc161 (ffff930a81356200) 00010000:00010000:2.0:1786109778.003875:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109778.003879:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38c71 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.003886:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628a800/0xdb52b77d7ca38c71 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe59fc161 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.003916:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca38c86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.003922:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca38c86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.003927:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca38c86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004490:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b800 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109778.004494:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca38c86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004502:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca38c86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004513:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb328795 (ffff930a81356500) 00010000:00010000:2.0:1786109778.004516:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109778.004519:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca38c86 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004526:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930aa628b800/0xdb52b77d7ca38c86 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb328795 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004543:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca38c8d lrc: 3/0,1 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004550:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca38c8d lrc: 2/0,0 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004557:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca38c8d lrc: 3/0,0 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004575:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413a00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109778.004578:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca38c8d lrc: 3/0,0 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004585:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca38c8d lrc: 4/0,0 mode: TXN/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004597:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a81356c00) 00010000:00010000:2.0:1786109778.004600:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109778.004603:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca38c8d lrc: 2/0,0 mode: --/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004610:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9413a00/0xdb52b77d7ca38c8d lrc: 0/0,0 mode: --/TXN res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004624:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38ca9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004630:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38ca9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004637:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38ca9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004642:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07c00 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109778.004645:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38ca9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004652:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38ca9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004659:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a81356b00) 00010000:00010000:2.0:1786109778.004662:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109778.004665:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38ca9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.004671:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07c00/0xdb52b77d7ca38ca9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.005785:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca38cb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006063:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca38cb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006080:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca38cb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006087:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109778.006092:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca38cb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006099:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca38cb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006113:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a81356b00) 00010000:00010000:2.0:1786109778.006116:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109778.006119:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca38cb7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006126:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f07600/0xdb52b77d7ca38cb7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006138:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca38ccc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006144:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca38ccc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006150:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca38ccc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006263:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9360600 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109778.006268:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca38ccc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006275:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca38ccc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006283:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a81356b00) 00010000:00010000:2.0:1786109778.006286:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109778.006289:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca38ccc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006295:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360600/0xdb52b77d7ca38ccc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006307:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38cda lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006313:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38cda lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006319:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38cda lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006324:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425400 already unused, calling callback (ffffffffc1a874f0) 00010000:00010000:2.0:1786109778.006327:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38cda lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006332:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38cda lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006353:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79cf20d7 (ffff930a81356b00) 00010000:00010000:2.0:1786109778.006355:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786109778.006358:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38cda lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.006364:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930986425400/0xdb52b77d7ca38cda lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79cf20d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 201173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109778.006424:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383708 gen 2 00000100:00080000:2.0:1786109778.006452:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1786109778.006462:0:3645:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff930ac0fbaa00 x1872862933410304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109793 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109778.006471:0:3645:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff930ac0fbaa00 x1872862933410304/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109793 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109778.006479:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1786109778.006495:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1786109778.006500:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e4f1cd99): req@ffff930ac0fbbb80 x1872862933409920/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786109778.006514:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000015c5cfb9): req@ffff930ac1d3c380 x1872862933409792/t0(0) o103->lustre-MDT0000-osp-MDT0001@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109778.006524:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933410304:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1786109778.006643:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109778.006669:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109778.006675:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933410432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109778.006764:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109778.006804:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109778.006834:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933409920 00000100:00100000:2.0:1786109778.006839:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933409920 00000100:00100000:2.0:1786109778.006873:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933409792 00000100:00100000:2.0:1786109778.006875:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933409792 00000100:00100000:2.0:1786109778.006893:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4547 00000100:00100000:2.0:1786109778.006902:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a90734850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:0:x1872862933409920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109778.006915:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109778.006917:0:6513:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie db52b77d7ca388a4) 00010000:00010000:2.0:1786109778.006919:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109778.007031:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a90734850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:0:x1872862933409920:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (386us total) trans 0 rc 116/116 00000100:00100000:2.0:1786109778.007038:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4547 00000100:00100000:2.0:1786109778.007091:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4548 00000100:00100000:2.0:1786109778.007098:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:0:x1872862933409792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109778.007105:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109778.007107:0:6513:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie db52b77d7ca38896) 00010000:00010000:2.0:1786109778.007109:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109778.007132:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:0:x1872862933409792:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (327us total) trans 0 rc 116/116 00000100:00100000:2.0:1786109778.007138:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4548 00000100:00100000:2.0:1786109778.007380:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:0:1872862933409920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109778.007403:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1872862933409792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109778.011351:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109778.016230:0:195049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922189696 00000100:00100000:2.0:1786109778.016244:0:195049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922189696 00000100:00100000:3.0:1786109778.016767:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933410432 00000100:00100000:3.0:1786109778.016774:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933410432 00000100:00100000:3.0:1786109778.016819:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786109778.016830:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933410432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786109778.016869:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00000100:00100000:3.0:1786109778.017243:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933410432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 414us (10476us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109778.017252:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1786109778.018048:0:195049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:2.0:1786109778.018064:0:195049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:165779:x1872862922189696:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1786109778.018383:0:195049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:165779:x1872862922189696:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 323us (7053us total) trans 347892350977 rc 0/0 00000100:00100000:2.0:1786109778.018391:0:195049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:2.0:1786109778.020784:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933410432:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1786109778.037724:0:201173:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa66f0870fe10 00100000:10000000:2.0:1786109778.037739:0:201173:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1786109778.038866:0:201161:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x1882:0x0] 00000100:00100000:3.0:1786109778.038913:0:201161:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:201161:1872862933410560:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1786109778.039010:0:201159:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000400:0x1902:0x0] 00000100:00100000:2.0:1786109778.039031:0:201159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:201159:1872862933410688:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1786109778.039177:0:201159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109778.039212:0:201159:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984b8d180 going to sleep for 11 seconds 00000100:00100000:2.0:1786109778.039237:0:40692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933410688 00000100:00100000:2.0:1786109778.039245:0:40692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933410688 00000100:00100000:2.0:1786109778.039292:0:40692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23193 00000100:00100000:2.0:1786109778.039301:0:40692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:201159:x1872862933410688:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1786109778.039328:0:40692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6465 -> diff = -63 00002000:02000040:2.0:1786109778.039332:0:40692:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6403 to 0x280000400:6465) 00000100:00100000:3.0:1786109778.041290:0:201161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109778.041350:0:201161:0:(client.c:2702:ptlrpc_set_wait()) set ffff930983e3f180 going to sleep for 11 seconds 00000100:00100000:3.0:1786109778.041385:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933410560 00000100:00100000:3.0:1786109778.041392:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933410560 00000100:00100000:3.0:1786109778.041449:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23194 00000100:00100000:3.0:1786109778.041459:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+6:201161:x1872862933410560:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1786109778.041489:0:179254:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 6401 -> diff = -127 00002000:02000040:3.0:1786109778.041496:0:179254:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6275 to 0x2c0000401:6401) 00002000:00010000:2.0:1786109778.049240:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1941:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.049256:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae484d35/0xdb52b77d7ca38cfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1941:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.049274:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1941:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.049279:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1941:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.049286:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae484d35/0xdb52b77d7ca38cfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.049302:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae484d35/0xdb52b77d7ca38cfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.049318:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae484d35/0xdb52b77d7ca38cfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.049326:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae484d35/0xdb52b77d7ca38cfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.049365:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.049386:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.049393:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae484d35/0xdb52b77d7ca38cfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.049401:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.049406:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae484d35/0xdb52b77d7ca38cfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.049414:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae484d35/0xdb52b77d7ca38cfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.049717:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae484d35/0xdb52b77d7ca38cfd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.049726:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae484d35/0xdb52b77d7ca38cfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1941:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.049752:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.049755:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.049757:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.050500:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1940:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.050508:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38d04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1940:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.050518:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1940:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.050522:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1940:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.050527:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38d04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.050537:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38d04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.050545:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38d04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.050553:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38d04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.050579:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109778.054310:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x193f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.054323:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdb8449b/0xdb52b77d7ca38d0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x193f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054350:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x193f:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.054355:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x193f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.054361:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdb8449b/0xdb52b77d7ca38d0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054376:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdb8449b/0xdb52b77d7ca38d0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054385:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdb8449b/0xdb52b77d7ca38d0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054394:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdb8449b/0xdb52b77d7ca38d0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054417:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786109778.054496:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x193e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.054501:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38d12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x193e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054510:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x193e:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.054513:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x193e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.054516:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38d12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054525:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38d12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054532:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38d12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054544:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38d12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054563:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1786109778.054572:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786109778.054578:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38d04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054586:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.054590:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38d04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054599:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054616:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38d04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054624:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006fa54a0/0xdb52b77d7ca38d04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1940:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054644:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786109778.054648:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdb8449b/0xdb52b77d7ca38d0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054661:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.054664:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdb8449b/0xdb52b77d7ca38d0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054672:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdb8449b/0xdb52b77d7ca38d0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x193f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054681:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdb8449b/0xdb52b77d7ca38d0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x193f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054688:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdb8449b/0xdb52b77d7ca38d0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x193f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054700:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.054703:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38d12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054709:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.054712:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38d12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054719:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38d12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x193e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054726:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38d12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x193e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054733:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8d3df3/0xdb52b77d7ca38d12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x193e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054745:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.054747:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.054748:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.054795:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x193d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.054800:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38d19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x193d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054807:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x193d:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.054810:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x193d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.054814:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38d19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054824:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38d19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054831:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38d19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054839:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38d19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054854:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.054862:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.054867:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38d19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054874:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.054877:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38d19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054885:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38d19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x193d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054895:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38d19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x193d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054902:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008de48e0f/0xdb52b77d7ca38d19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x193d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.054915:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.054917:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.054919:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.057331:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x193c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.057355:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38d20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x193c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057370:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x193c:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.057375:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x193c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.057380:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38d20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057399:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38d20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057409:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38d20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057417:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38d20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057456:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.057468:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.057474:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38d20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057483:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.057488:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38d20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057497:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38d20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x193c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057513:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38d20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x193c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057521:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000469d09f9/0xdb52b77d7ca38d20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x193c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057541:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.057543:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.057544:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.057594:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x193b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.057599:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d10c9d8/0xdb52b77d7ca38d27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x193b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057607:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x193b:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.057610:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x193b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.057615:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d10c9d8/0xdb52b77d7ca38d27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057623:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d10c9d8/0xdb52b77d7ca38d27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057631:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d10c9d8/0xdb52b77d7ca38d27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057638:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d10c9d8/0xdb52b77d7ca38d27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057650:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.057657:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.057661:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d10c9d8/0xdb52b77d7ca38d27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057673:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.057676:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d10c9d8/0xdb52b77d7ca38d27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057683:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d10c9d8/0xdb52b77d7ca38d27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x193b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057693:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d10c9d8/0xdb52b77d7ca38d27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x193b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057700:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d10c9d8/0xdb52b77d7ca38d27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x193b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057712:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.057714:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.057716:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.057755:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x193a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.057761:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025528bf9/0xdb52b77d7ca38d2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x193a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057769:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x193a:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.057772:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x193a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.057777:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025528bf9/0xdb52b77d7ca38d2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057785:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025528bf9/0xdb52b77d7ca38d2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057794:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025528bf9/0xdb52b77d7ca38d2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x193a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057801:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025528bf9/0xdb52b77d7ca38d2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057813:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.057820:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.057823:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025528bf9/0xdb52b77d7ca38d2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057830:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.057834:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025528bf9/0xdb52b77d7ca38d2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x193a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057841:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025528bf9/0xdb52b77d7ca38d2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x193a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057851:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025528bf9/0xdb52b77d7ca38d2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x193a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057858:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025528bf9/0xdb52b77d7ca38d2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x193a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057872:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.057875:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.057876:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.057916:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1939:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.057921:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38d35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1939:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057943:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1939:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.057947:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1939:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.057952:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38d35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057961:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38d35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057968:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38d35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057975:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38d35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.057987:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.057993:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.057997:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38d35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.058003:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.058006:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38d35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.058017:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38d35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.058026:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38d35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.058032:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080b91bc0/0xdb52b77d7ca38d35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1939:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.058044:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.058045:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.058047:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786109778.059511:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1786109778.059556:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1938:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.060014:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca38d3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1938:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060028:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1938:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.060032:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1938:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.060037:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca38d3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060051:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca38d3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060065:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca38d3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060142:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca38d3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060229:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.060241:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.060246:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca38d3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060253:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.060258:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca38d3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060266:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca38d3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060280:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca38d3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060286:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012d062fc/0xdb52b77d7ca38d3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1938:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060307:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.060309:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.060310:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.060402:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1937:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.060408:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000289cfe07/0xdb52b77d7ca38d43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1937:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060417:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1937:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.060420:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1937:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.060424:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000289cfe07/0xdb52b77d7ca38d43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060455:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000289cfe07/0xdb52b77d7ca38d43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060461:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000289cfe07/0xdb52b77d7ca38d43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060469:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000289cfe07/0xdb52b77d7ca38d43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060483:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.060491:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.060495:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000289cfe07/0xdb52b77d7ca38d43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060503:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.060506:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000289cfe07/0xdb52b77d7ca38d43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060519:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000289cfe07/0xdb52b77d7ca38d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060529:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000289cfe07/0xdb52b77d7ca38d43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060537:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000289cfe07/0xdb52b77d7ca38d43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1937:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.060550:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.060552:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.060553:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.062086:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1936:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.062097:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca38d4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1936:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062110:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1936:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.062115:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1936:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.062119:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca38d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062132:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca38d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062141:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca38d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062148:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca38d4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062185:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.062199:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.062205:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca38d4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062212:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.062216:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca38d4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062224:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca38d4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062236:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca38d4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062243:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000241a7bc/0xdb52b77d7ca38d4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1936:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062264:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.062266:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.062267:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.062315:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1935:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.062320:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca38d51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1935:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062328:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1935:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.062331:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1935:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.062334:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca38d51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062356:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca38d51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062364:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca38d51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062370:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca38d51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062382:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.062389:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.062393:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca38d51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062399:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.062402:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca38d51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062409:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca38d51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062419:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca38d51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062426:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009be97235/0xdb52b77d7ca38d51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1935:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062462:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.062464:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.062465:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.062508:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1934:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.062513:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137d1e7c/0xdb52b77d7ca38d58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1934:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062521:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1934:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.062524:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1934:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.062528:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000137d1e7c/0xdb52b77d7ca38d58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062537:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000137d1e7c/0xdb52b77d7ca38d58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062545:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137d1e7c/0xdb52b77d7ca38d58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.062552:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000137d1e7c/0xdb52b77d7ca38d58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.064693:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.064715:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.064723:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000137d1e7c/0xdb52b77d7ca38d58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.064734:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986424200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.064739:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000137d1e7c/0xdb52b77d7ca38d58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.064748:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000137d1e7c/0xdb52b77d7ca38d58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.064766:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000137d1e7c/0xdb52b77d7ca38d58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.064774:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000137d1e7c/0xdb52b77d7ca38d58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1934:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.064801:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.064803:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.064805:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.064906:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1933:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.064912:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca38d5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1933:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.064922:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1933:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.064993:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1933:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.065001:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca38d5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065014:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca38d5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065023:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca38d5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065030:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca38d5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065046:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.065054:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.065059:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca38d5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065066:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930986425200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.065070:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca38d5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065633:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca38d5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065647:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca38d5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065659:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aaa2754/0xdb52b77d7ca38d5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1933:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065680:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.065682:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.065683:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.065750:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1932:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.065756:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38d66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1932:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065764:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1932:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.065767:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1932:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.065772:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38d66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065780:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38d66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065788:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38d66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065796:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38d66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065812:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.065819:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.065824:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38d66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065831:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628bc00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.065834:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38d66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065842:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38d66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065852:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38d66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065859:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c88059da/0xdb52b77d7ca38d66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1932:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.065872:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.065874:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.065876:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.065917:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1931:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.065922:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca38d6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1931:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066281:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1931:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.066286:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1931:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.066291:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca38d6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066307:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca38d6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066316:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca38d6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066323:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca38d6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066351:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.066361:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.066365:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca38d6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066373:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.066376:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca38d6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066384:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca38d6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066396:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca38d6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066404:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000513cd566/0xdb52b77d7ca38d6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1931:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066417:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.066419:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.066420:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.066487:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1930:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.066493:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca38d74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1930:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066501:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1930:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.066504:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1930:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.066509:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca38d74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066521:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca38d74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066530:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca38d74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066538:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca38d74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.066551:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109778.067000:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109778.067007:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca38d74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067014:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109778.067018:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca38d74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067025:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca38d74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067036:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca38d74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067043:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2475ca9/0xdb52b77d7ca38d74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1930:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067061:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.067063:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.067064:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.067239:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.067295:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x192f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.067302:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca38d7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x192f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067312:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x192f:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.067316:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x192f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.067320:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca38d7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067329:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca38d7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067348:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca38d7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067357:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca38d7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067372:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.067379:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.067382:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca38d7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067390:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628be00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.067394:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca38d7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067402:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca38d7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x192f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067417:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca38d7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x192f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067423:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b79df84d/0xdb52b77d7ca38d7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x192f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067457:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.067458:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.067460:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.067497:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x192e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.067502:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca38d82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x192e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067509:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x192e:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.067512:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x192e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.067516:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca38d82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067523:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca38d82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067530:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca38d82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067535:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca38d82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.067547:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.067553:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.067556:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca38d82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109778.067742:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1901:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.067748:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca38d89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1901:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067757:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1901:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.067760:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1901:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.067765:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca38d89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067776:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca38d89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067784:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca38d89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067791:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca38d89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067804:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109778.067811:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109778.067815:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca38d89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067823:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109778.067826:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca38d89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067833:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca38d89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067843:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca38d89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067856:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a76386f/0xdb52b77d7ca38d89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1901:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.067871:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.067872:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.067874:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.068006:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628a000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.068010:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca38d82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068018:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca38d82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x192e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068028:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca38d82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x192e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068034:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015449a9d/0xdb52b77d7ca38d82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x192e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068047:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.068049:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.068051:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.068242:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x192d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.068249:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca38d90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x192d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068257:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x192d:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.068261:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x192d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.068266:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca38d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068274:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca38d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068282:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca38d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068289:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca38d90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068302:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.068309:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.068312:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca38d90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068318:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.068321:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca38d90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068329:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca38d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x192d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068350:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca38d90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x192d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068363:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca38d90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x192d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068376:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.068378:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.068379:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.068424:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x192c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.068447:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca38d97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x192c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068455:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x192c:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.068458:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x192c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.068462:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca38d97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068471:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca38d97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068478:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca38d97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068485:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca38d97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068544:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109778.068594:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x192b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.068599:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7797cbb/0xdb52b77d7ca38d9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x192b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.068603:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.068607:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x192b:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:0.0:1786109778.068609:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca38d97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068610:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x192b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.068615:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7797cbb/0xdb52b77d7ca38d9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.068616:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.068620:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca38d97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068624:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7797cbb/0xdb52b77d7ca38d9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.068628:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca38d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x192c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068632:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7797cbb/0xdb52b77d7ca38d9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068640:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7797cbb/0xdb52b77d7ca38d9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.068640:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca38d97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x192c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.068648:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca38d97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x192c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068653:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.068659:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.068662:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7797cbb/0xdb52b77d7ca38d9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.068662:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.068664:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.068666:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.068669:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.068672:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7797cbb/0xdb52b77d7ca38d9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068684:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7797cbb/0xdb52b77d7ca38d9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x192b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068694:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7797cbb/0xdb52b77d7ca38d9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x192b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068701:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7797cbb/0xdb52b77d7ca38d9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x192b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068714:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.068716:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.068717:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.068758:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x192a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.068764:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca38da5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x192a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068772:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x192a:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.068775:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x192a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.068779:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca38da5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068788:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca38da5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068796:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca38da5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x192a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068803:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca38da5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068827:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786109778.068867:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1929:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.068872:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca38dac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1929:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068880:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1929:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.068883:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1929:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.068887:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca38dac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068897:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca38dac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068905:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca38dac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068911:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca38dac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.068922:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786109778.069037:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1928:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.069043:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a431d5e0/0xdb52b77d7ca38db3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1928:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069051:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1928:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.069054:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1928:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.069058:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a431d5e0/0xdb52b77d7ca38db3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069067:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a431d5e0/0xdb52b77d7ca38db3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069152:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a431d5e0/0xdb52b77d7ca38db3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069171:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a431d5e0/0xdb52b77d7ca38db3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069186:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1786109778.069194:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786109778.069198:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca38da5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069205:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.069208:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca38da5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x192a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069216:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca38da5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x192a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069231:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca38da5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x192a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069239:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca38da5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x192a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069253:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786109778.069256:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca38dac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069263:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.069266:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca38dac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069274:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca38dac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069284:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca38dac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069290:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca38dac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1929:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069302:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.069305:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a431d5e0/0xdb52b77d7ca38db3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069312:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.069315:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a431d5e0/0xdb52b77d7ca38db3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069323:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a431d5e0/0xdb52b77d7ca38db3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069332:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a431d5e0/0xdb52b77d7ca38db3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069352:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a431d5e0/0xdb52b77d7ca38db3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1928:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069363:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.069365:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.069366:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.069411:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1927:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.069417:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca38dba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1927:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069425:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1927:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.069428:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1927:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.069456:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca38dba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069466:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca38dba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069473:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca38dba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069480:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca38dba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069493:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.069500:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.069503:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca38dba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069510:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.069514:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca38dba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069522:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca38dba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069532:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca38dba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069539:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca38dba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1927:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069551:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.069554:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.069556:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.069599:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1926:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.069605:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca38dc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1926:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069613:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1926:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.069616:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1926:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.069620:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca38dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069630:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca38dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069638:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca38dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069644:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca38dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069656:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.069663:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.069667:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca38dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069673:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.069676:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca38dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069689:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca38dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069699:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca38dc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069707:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca38dc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1926:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069720:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.069721:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.069723:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.069766:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1925:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.069772:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec766999/0xdb52b77d7ca38dc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1925:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069780:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1925:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.069783:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1925:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.069787:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec766999/0xdb52b77d7ca38dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069796:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec766999/0xdb52b77d7ca38dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069804:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec766999/0xdb52b77d7ca38dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069812:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec766999/0xdb52b77d7ca38dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069825:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.069832:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.069836:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec766999/0xdb52b77d7ca38dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069842:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.069845:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec766999/0xdb52b77d7ca38dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069853:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec766999/0xdb52b77d7ca38dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069863:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec766999/0xdb52b77d7ca38dc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069870:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec766999/0xdb52b77d7ca38dc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1925:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069883:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.069885:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.069886:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.069927:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1924:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.069952:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca38dcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1924:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069960:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1924:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.069963:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1924:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.069967:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca38dcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069977:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca38dcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069985:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca38dcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.069992:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca38dcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070004:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.070011:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.070015:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca38dcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070022:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.070025:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca38dcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070032:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca38dcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070044:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca38dcf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070052:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac7a24e4/0xdb52b77d7ca38dcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1924:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070065:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.070066:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.070069:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.070122:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1923:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.070127:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca38dd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1923:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070136:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1923:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.070139:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1923:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.070143:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca38dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070153:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca38dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070161:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca38dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070168:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca38dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070181:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.070187:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.070191:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca38dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070197:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.070200:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca38dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070207:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca38dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070216:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca38dd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070223:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca38dd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1923:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070233:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.070235:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.070236:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109778.070272:0:40692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1922:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109778.070277:0:40692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000361d1241/0xdb52b77d7ca38ddd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1922:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070285:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1922:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:2.0:1786109778.070288:0:40692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1922:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109778.070292:0:40692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000361d1241/0xdb52b77d7ca38ddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070301:0:40692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000361d1241/0xdb52b77d7ca38ddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070308:0:40692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000361d1241/0xdb52b77d7ca38ddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070315:0:40692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000361d1241/0xdb52b77d7ca38ddd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070328:0:40692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109778.070334:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.070352:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000361d1241/0xdb52b77d7ca38ddd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070359:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.070362:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000361d1241/0xdb52b77d7ca38ddd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070368:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000361d1241/0xdb52b77d7ca38ddd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070378:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000361d1241/0xdb52b77d7ca38ddd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070390:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000361d1241/0xdb52b77d7ca38ddd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1922:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.070402:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.070404:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.070406:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1786109778.070704:0:40692:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:6402 00000100:00100000:2.0:1786109778.070801:0:40692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:201159:x1872862933410688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 31497us (31621us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109778.070812:0:40692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23193 00000100:00100000:2.0:1786109778.070872:0:201159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:201159:1872862933410688:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1786109778.070886:0:201159:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000400:0x1941:0x0] from OST, last_created [0x280000400:0x1941:0x0]last_used is [0x280000400:0x1902:0x0] 00000100:00100000:2.0:1786109778.070948:0:201159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:201159:1872862933410944:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1786109778.070981:0:201159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109778.071006:0:201159:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a88ff2000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109778.071021:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933410816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109778.071044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109778.071081:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933410944 00000100:00100000:2.0:1786109778.071087:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933410944 00000100:00100000:2.0:1786109778.071123:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23195 00000100:00100000:2.0:1786109778.071131:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:201159:x1872862933410944:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1786109778.071173:0:179238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 6466 00010000:00010000:0.0:1786109778.072925:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.073017:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.074554:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109778.074607:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1900:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.074617:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca38de4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1900:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074633:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1900:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.074637:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1900:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.074643:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca38de4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074656:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca38de4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074665:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca38de4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074673:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca38de4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074696:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109778.074787:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.074792:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca38deb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074800:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ff:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.074803:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.074807:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca38deb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074816:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca38deb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074824:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca38deb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074831:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca38deb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074845:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786109778.074885:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.074890:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca38df2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074898:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18fe:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.074901:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.074905:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca38df2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074918:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca38df2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.074925:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca38df2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075009:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca38df2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075025:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1786109778.075066:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.075254:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca38df9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075268:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18fd:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.075271:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.075275:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca38df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075326:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786109778.075334:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca38de4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075352:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.075356:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca38de4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075365:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca38de4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075382:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca38de4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075389:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb10969b/0xdb52b77d7ca38de4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1900:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075408:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786109778.075412:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca38deb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075419:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.075422:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca38deb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075442:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca38deb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075452:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca38deb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075459:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1390/0xdb52b77d7ca38deb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075470:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.075474:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca38df2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075480:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.075483:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca38df2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075490:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca38df2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075498:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca38df2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075504:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d80ff1d/0xdb52b77d7ca38df2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.075515:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.075517:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.075519:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109778.075534:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933410816 00000100:00100000:2.0:1786109778.075543:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933410816 00010000:00010000:3.0:1786109778.075605:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca38df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075614:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca38df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075626:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca38df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075641:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109778.075649:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109778.075653:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca38df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075660:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109778.075663:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca38df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075671:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca38df9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075682:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca38df9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075689:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000396e1c1d/0xdb52b77d7ca38df9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075703:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.075704:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.075706:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109778.075753:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.075759:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca38e00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075767:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18fc:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.075770:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.075774:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca38e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075782:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca38e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075789:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca38e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075795:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca38e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075808:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109778.075846:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.075851:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca38e07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075858:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18fb:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.075861:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.075865:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca38e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075879:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca38e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075887:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca38e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075893:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca38e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075906:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1786109778.075912:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109778.075916:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca38e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.075922:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109778.075925:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca38e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076305:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca38e00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076317:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca38e00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076325:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073d05bcd/0xdb52b77d7ca38e00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1786109778.076545:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1786109778.076618:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109778.076623:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca38e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076630:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109778.076634:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca38e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076642:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca38e07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076654:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca38e07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076661:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4770689/0xdb52b77d7ca38e07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076675:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.076677:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.076679:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109778.076737:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.076743:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca38e0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076757:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18fa:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.076760:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.076765:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca38e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076774:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca38e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076783:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca38e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076790:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca38e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076803:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109778.076810:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109778.076813:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca38e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076820:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109778.076823:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca38e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076831:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca38e0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076846:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca38e0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076854:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae086d48/0xdb52b77d7ca38e0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076866:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.076868:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.076869:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109778.076910:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.076915:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca38e15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.076923:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f9:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.076926:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f9:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1786109778.077069:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5979 00000100:00100000:2.0:1786109778.077230:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933410816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109778.077256:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 896 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109778.077357:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933410816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (6311us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109778.077365:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5979 00010000:00010000:2.0:1786109778.077393:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109778.077454:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933410816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786109778.077654:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca38e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.077667:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca38e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.077676:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca38e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.077684:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca38e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.077700:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109778.077709:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109778.077713:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca38e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.077721:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109778.077725:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca38e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.077733:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca38e15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.077745:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca38e15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.077753:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca38e15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.077769:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.077770:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.077772:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109778.078667:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.078676:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca38e1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078688:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f8:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.078692:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.078696:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca38e1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078706:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca38e1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078715:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca38e1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078722:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca38e1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078745:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109778.078796:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.078801:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca38e23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078809:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f7:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.078812:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.078816:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca38e23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078825:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca38e23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078833:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca38e23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078840:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca38e23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078854:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1786109778.078863:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786109778.078867:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca38e1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078874:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109778.078878:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca38e1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078886:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca38e1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078899:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca38e1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078905:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca38e1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.078920:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109778.078924:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca38e23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.079014:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.079756:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.079764:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.079833:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109778.079838:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca38e23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.079848:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca38e23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.079862:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca38e23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.079870:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca38e23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.079887:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.079890:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.079892:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109778.080033:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.080040:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca38e2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080049:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f6:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.080053:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.080058:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca38e2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080650:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca38e2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080663:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca38e2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080670:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca38e2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080694:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109778.080746:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.080752:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca38e31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080760:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f5:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.080764:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.080767:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca38e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080776:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca38e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080784:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca38e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080795:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca38e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080808:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786109778.080845:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.080850:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca38e38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080858:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f4:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.080861:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.080865:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca38e38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080873:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca38e38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080881:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca38e38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080888:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca38e38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.080900:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1786109778.081149:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786109778.081229:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca38e2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081238:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.081243:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca38e2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081251:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca38e2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081265:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca38e2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081272:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca38e2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081289:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109778.081292:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca38e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081298:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.081301:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca38e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081307:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca38e31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081320:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca38e31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081327:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca38e31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081348:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109778.081351:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca38e38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081358:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.081361:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca38e38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081369:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca38e38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081379:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca38e38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081386:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca38e38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.081399:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.081402:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.081404:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.081412:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.081418:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109778.081511:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.081516:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca38e3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.081525:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f3:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.081528:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.081532:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca38e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.081542:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca38e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.081550:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca38e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.081557:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca38e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109778.081901:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+6:201159:x1872862933410944:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10766us (10914us total) trans 38654705690 rc 0/0 00000100:00100000:2.0:1786109778.081911:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23195 00010000:00010000:3.0:1786109778.082023:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109778.082033:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109778.082038:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca38e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082046:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109778.082049:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca38e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082057:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca38e3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082147:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca38e3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082224:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca38e3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082244:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.082246:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.082247:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109778.082311:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.082316:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca38e46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082325:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f2:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.082328:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.082332:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca38e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082354:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca38e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082361:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca38e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082368:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca38e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082381:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109778.082419:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.082424:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca38e4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082454:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f1:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.082457:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.082461:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca38e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082470:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca38e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082477:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca38e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082484:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca38e4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082495:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786109778.082533:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.082539:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca38e54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.082547:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f0:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.082550:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.082554:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca38e54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.082726:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109778.082732:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca38e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.082741:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.082744:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca38e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.082752:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca38e46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.082765:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca38e46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.082773:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca38e46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.082788:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109778.082792:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca38e4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.082798:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.082802:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca38e4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.082814:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca38e4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.082824:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca38e4d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.082832:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca38e4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.082844:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.082845:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.082847:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.082853:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109778.082900:0:201159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:201159:1872862933410944:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1786109778.082915:0:201159:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000400:0x1941:0x0]-[0x280000400:0x1961:0x0] 00010000:00010000:3.0:1786109778.083029:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca38e54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.083038:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca38e54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.083045:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca38e54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.083227:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109778.083282:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.083288:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca38e5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.083296:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ef:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.083300:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.083304:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca38e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.083314:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca38e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.083321:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca38e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.083329:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca38e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.083510:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109778.083516:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca38e54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.083525:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.083528:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca38e54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.083536:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca38e54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.083554:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca38e54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.083575:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca38e54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.083592:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109778.083595:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca38e5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.083602:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6da00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.083605:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca38e5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.083613:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca38e5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.083622:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca38e5b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.083630:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.083632:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.083634:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.083818:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109778.083823:0:179254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca38e5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109778.083880:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.083886:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca38e62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.083894:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ee:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.083896:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.083901:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca38e62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.083910:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca38e62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.083918:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca38e62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.083924:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca38e62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.084031:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109778.084037:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca38e62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.084045:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6dc00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109778.084048:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca38e62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.084056:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca38e62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.084069:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca38e62 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109778.084148:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.084150:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109778.084152:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.085785:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109778.085798:0:179254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca38e62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109778.085904:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.085911:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ad752fe/0xdb52b77d7ca38e69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.085923:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ed:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.085927:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109778.086018:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.086043:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ad752fe/0xdb52b77d7ca38e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086057:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ad752fe/0xdb52b77d7ca38e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086066:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ad752fe/0xdb52b77d7ca38e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086151:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ad752fe/0xdb52b77d7ca38e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086246:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109778.086293:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.086299:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca38e70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086307:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ec:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.086310:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.086314:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca38e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086323:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca38e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086331:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca38e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086352:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca38e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086365:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786109778.086425:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.086455:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca38e77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086463:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18eb:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.086467:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.086471:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca38e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086480:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca38e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086488:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca38e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086495:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca38e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086512:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1786109778.086521:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109778.086527:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ad752fe/0xdb52b77d7ca38e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086535:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109778.086540:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ad752fe/0xdb52b77d7ca38e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086549:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ad752fe/0xdb52b77d7ca38e69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.086661:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109778.086668:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca38e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.086675:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6ce00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.086678:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca38e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.086686:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca38e70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.086699:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca38e70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.086707:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca38e70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.086725:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109778.086729:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca38e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.086736:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.086739:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca38e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.086747:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca38e77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.086762:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca38e77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.086770:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca38e77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.086783:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.086785:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.086786:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.086793:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.086823:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ad752fe/0xdb52b77d7ca38e69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086832:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ad752fe/0xdb52b77d7ca38e69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086846:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.086849:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.086850:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109778.086897:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.086903:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca38e7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.086911:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ea:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.086915:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.086919:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca38e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087002:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca38e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087012:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca38e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087020:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca38e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087039:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786109778.087234:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109778.087240:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca38e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087248:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.087251:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca38e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087259:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca38e7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087270:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca38e7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087277:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca38e7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087290:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.087292:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.087293:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786109778.087328:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.087334:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca38e85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087353:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e9:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.087356:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.087360:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca38e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087370:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca38e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087378:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca38e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087385:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca38e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087404:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109778.087468:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.087473:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca38e8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087481:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e8:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.087483:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.087487:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca38e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087495:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca38e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087502:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca38e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087512:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca38e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087522:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786109778.087554:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.087559:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca38e93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087648:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109778.087653:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca38e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087660:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6cc00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.087664:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca38e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087671:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca38e85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087682:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca38e85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087689:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca38e85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087701:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109778.087704:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca38e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087710:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.087713:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca38e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087721:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca38e8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087729:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca38e8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087736:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca38e8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.087747:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.087749:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.087751:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.087757:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.087788:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e7:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.087790:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.087795:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca38e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087803:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca38e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087811:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca38e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087818:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca38e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087868:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109778.087911:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.087916:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5b4e2cb/0xdb52b77d7ca38e9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.087924:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e6:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.087927:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.088013:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5b4e2cb/0xdb52b77d7ca38e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.088023:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5b4e2cb/0xdb52b77d7ca38e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.088031:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5b4e2cb/0xdb52b77d7ca38e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.088039:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5b4e2cb/0xdb52b77d7ca38e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.091665:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109778.091679:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca38e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.091694:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6ca00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.091701:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca38e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.091711:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca38e93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.091736:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca38e93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.091744:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca38e93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.091764:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109778.091768:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5b4e2cb/0xdb52b77d7ca38e9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.091774:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:0.0:1786109778.091776:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5b4e2cb/0xdb52b77d7ca38e9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.091783:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5b4e2cb/0xdb52b77d7ca38e9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.091793:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5b4e2cb/0xdb52b77d7ca38e9a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.091800:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.091802:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.091804:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.096711:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786109778.096727:0:179254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5b4e2cb/0xdb52b77d7ca38e9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786109778.096860:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.096867:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086666fbe/0xdb52b77d7ca38ea1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.096881:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e5:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.096886:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.096892:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086666fbe/0xdb52b77d7ca38ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.096907:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086666fbe/0xdb52b77d7ca38ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.096916:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086666fbe/0xdb52b77d7ca38ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.096923:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086666fbe/0xdb52b77d7ca38ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.097245:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.097662:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109778.097719:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.097726:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca38ea8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.097737:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e4:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.097740:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.097745:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca38ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.097755:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca38ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.097763:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca38ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.097775:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca38ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.097794:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786109778.097835:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109778.097841:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca38eaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.097848:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e3:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:3.0:1786109778.097852:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109778.097856:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca38eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.097864:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca38eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.097871:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca38eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.097877:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca38eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.097894:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1786109778.097903:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786109778.097908:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086666fbe/0xdb52b77d7ca38ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.097917:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109778.097921:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086666fbe/0xdb52b77d7ca38ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.098034:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786109778.098040:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca38ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.098048:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6de00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109778.098051:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca38ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.098058:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca38ea8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.098148:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca38ea8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.098216:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca38ea8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.098243:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109778.098247:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca38eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.098252:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109778.098256:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca38eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.098262:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca38eaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.098273:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca38eaf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.098279:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca38eaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.098291:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109778.098292:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109778.098294:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109778.098366:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1786109778.098723:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109778.098730:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca38eb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.098740:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e2:0x0].0x0 since=8634s v=(0 0) 00010000:00010000:0.0:1786109778.098743:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109778.098747:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca38eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.098757:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca38eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.098765:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca38eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.098771:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca38eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109778.098787:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786109778.099040:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086666fbe/0xdb52b77d7ca38ea1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.099056:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086666fbe/0xdb52b77d7ca38ea1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109778.099063:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086666fbe/0xdb52b77d7ca38ea1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.099181:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786109778.099188:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca38eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.099196:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:1.0:1786109778.099200:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca38eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.099208:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca38eb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.099219:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca38eb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.099226:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca38eb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109778.099243:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109778.099246:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109778.099247:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.099387:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.099390:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109778.099392:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1786109778.100493:0:179254:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6274 00000100:00100000:0.0:1786109778.100719:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0000-mdtlov_UUID+5:201161:x1872862933410560:12345-0@lo:5:osp-pre-1-0.0 Request processed in 59257us (59429us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109778.100730:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23194 00000100:00100000:2.0:1786109778.101030:0:201161:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:201161:1872862933410560:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1786109778.101048:0:201161:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x1901:0x0] from OST, last_created [0x2c0000401:0x1901:0x0]last_used is [0x2c0000401:0x1882:0x0] 00000100:00100000:2.0:1786109778.101275:0:201161:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:201161:1872862933411200:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1786109778.101321:0:201161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109778.101363:0:201161:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a88ff2240 going to sleep for 11 seconds 00000100:00100000:1.0:1786109778.101410:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109778.101422:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933411072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109778.101481:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109778.101529:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933411200 00000100:00100000:1.0:1786109778.101536:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933411200 00000100:00100000:1.0:1786109778.101588:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23196 00000100:00100000:1.0:1786109778.101597:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:201161:x1872862933411200:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1786109778.101633:0:34008:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 6402 00000100:00100000:2.0:1786109778.103062:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933411072 00000100:00100000:2.0:1786109778.103071:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933411072 00000100:00100000:2.0:1786109778.103275:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5980 00000100:00100000:2.0:1786109778.103285:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933411072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786109778.103307:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 144960 pending 896 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109778.103397:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933411072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109778.103404:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5980 00000100:00100000:2.0:1786109778.103470:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933411072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109778.105626:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:201161:x1872862933411200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4024us (4299us total) trans 4294975848 rc 0/0 00000100:00100000:1.0:1786109778.105637:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23196 00000100:00100000:2.0:1786109778.105881:0:201161:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:201161:1872862933411200:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1786109778.105897:0:201161:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1901:0x0]-[0x2c0000401:0x1921:0x0] 00000100:00100000:2.0:1786109778.183250:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109778.183272:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933411328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109778.183348:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109778.183394:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933411328 00000100:00100000:2.0:1786109778.183402:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933411328 00000100:00100000:2.0:1786109778.183463:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5981 00000100:00100000:2.0:1786109778.183473:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933411328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109778.183498:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 144064 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109778.183543:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933411328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109778.183550:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5981 00000100:00100000:2.0:1786109778.184050:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933411328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109778.189787:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109778.190396:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933411456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109778.190496:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109778.190699:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933411456 00000100:00100000:2.0:1786109778.190707:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933411456 00000100:00100000:2.0:1786109778.190759:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5982 00000100:00100000:2.0:1786109778.190770:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933411456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109778.190795:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109778.190843:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933411456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109778.190851:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5982 00000100:00100000:1.0:1786109778.191034:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933411456:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1786109778.264291:0:201530:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1786109778.264734:0:201530:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1786109778.312058:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109779.333035:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109779.471469:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109779.471579:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109779.471614:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109779.471671:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922189952 00000100:00100000:2.0:1786109779.471697:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922189952 00000100:00100000:2.0:1786109779.471855:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:2.0:1786109779.471867:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a88c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922189952:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109779.471940:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a88c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922189952:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 76us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109779.471949:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:3.0:1786109779.472375:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922190080 00000100:00100000:3.0:1786109779.472382:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922190080 00000100:00080000:2.0:1786109779.472506:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786109779.472567:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922190208 00000100:00100000:3.0:1786109779.472572:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922190208 00000100:00100000:1.0:1786109779.472663:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 481 00000100:00100000:1.0:1786109779.472675:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2403:x1872862922190080:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109779.472724:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2403:x1872862922190080:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 52us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109779.472732:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 481 00000100:00080000:2.0:1786109779.472775:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786109779.473028:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 482 00000100:00100000:1.0:1786109779.473036:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2403:x1872862922190208:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:1.0:1786109779.473055:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1d3d180 x1872862922190208/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:309/0 lens 224/224 e 0 to 0 dl 1786109849 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109779.473131:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2403:x1872862922190208:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 95us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109779.473138:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 482 00010000:00010000:1.0:1786109780.357279:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109780.366977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109780.367171:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922190336 00000100:00100000:3.0:1786109780.367185:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922190336 00000100:00100000:3.0:1786109780.367315:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1324 00000100:00100000:3.0:1786109780.367339:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+7:166292:x1872862922190336:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1786109780.367373:0:196401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109780.367401:0:196401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca38ebd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1922 expref: -99 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109780.367523:0:196401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca38ec4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109780.367538:0:196401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca38ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109780.367564:0:196401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca38ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786109780.367631:0:196401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 73728 00000004:00200000:3.0:1786109780.367636:0:196401:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 3 00000004:00010000:3.0:1786109780.367660:0:196401:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca38ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 196401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109780.367706:0:196401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6c600/0xdb52b77d7ca38ebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1922 expref: 9 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109780.367727:0:196401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff930ab8f6d000/0xdb52b77d7ca38ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1922 expref: 8 pid: 196401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109780.367737:0:196401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a9a33ec00) 00010000:00010000:3.0:1786109780.367740:0:196401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786109780.367744:0:196401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d000, rc 0) 00000100:00100000:3.0:1786109780.367824:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+8:166292:x1872862922190336:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 488us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109780.367831:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1324 00000100:00100000:2.0:1786109780.373386:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109780.373642:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922190464 00000100:00100000:0.0:1786109780.373655:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922190464 00000100:00100000:0.0:1786109780.373758:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1325 00000100:00100000:0.0:1786109780.373771:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+8:166292:x1872862922190464:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:0.0:1786109780.373825:0:189813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445642240 avail 1299402752 00000100:00100000:0.0:1786109780.373968:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+8:166292:x1872862922190464:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 198us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109780.373976:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1325 00000100:00100000:0.0:1786109780.376919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109780.377071:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922190592 00000100:00100000:1.0:1786109780.377089:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922190592 00000100:00100000:1.0:1786109780.377179:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1326 00000100:00100000:1.0:1786109780.377193:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:166292:x1872862922190592:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:1.0:1786109780.377250:0:187899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446019072 avail 1299779584 00010000:00000080:1.0:1786109780.377282:0:187899:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1d3c700 x1872862922190592/t0(0) o41->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:310/0 lens 224/368 e 0 to 0 dl 1786109850 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109780.377387:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:166292:x1872862922190592:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 198us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109780.377396:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1326 00000100:00100000:2.0:1786109780.381251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109780.381384:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922190720 00000100:00100000:3.0:1786109780.381398:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922190720 00000100:00100000:3.0:1786109780.381531:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23197 00000100:00100000:3.0:1786109780.381542:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1872862922190720:12345-192.168.203.38@tcp:8:lfs.0 00010000:00080000:3.0:1786109780.381604:0:8443:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp t0 exp 0000000000000000 cur 8637 last 0 00000020:00000080:3.0:1786109780.381654:0:8443:0:(genops.c:1406:class_connect()) connect: client fac74500-4523-4794-af20-dfdcdfae19c1, cookie 0xdb52b77d7ca38ecb 00002000:00100000:3.0:1786109780.381669:0:8443:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fac74500-4523-4794-af20-dfdcdfae19c1/ffff930981dbd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786109780.381713:0:8443:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786109780.381798:0:8443:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1786109780.381839:0:8443:0:(import.c:65:import_set_state_nolock()) ffff93098666e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786109780.382210:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922190720:12345-192.168.203.38@tcp:8:lfs.0 Request processed in 666us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109780.382220:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23197 00000100:00100000:2.0:1786109780.384934:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109780.385081:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922190848 00000100:00100000:0.0:1786109780.385094:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922190848 00000100:00100000:0.0:1786109780.385221:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5983 00000100:00100000:0.0:1786109780.385236:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:166292:x1872862922190848:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:0.0:1786109780.385273:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109780.385378:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:166292:x1872862922190848:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 146us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109780.385386:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5983 00000100:00080000:2.0:1786109780.385829:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109780.388107:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109780.388231:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922190976 00000100:00100000:3.0:1786109780.388244:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922190976 00000100:00100000:3.0:1786109780.388351:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23198 00000100:00100000:3.0:1786109780.388362:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2401:x1872862922190976:12345-192.168.203.38@tcp:8:lfs.0 00010000:00080000:3.0:1786109780.388412:0:43913:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp t0 exp 0000000000000000 cur 8637 last 0 00000020:00000080:3.0:1786109780.388648:0:43913:0:(genops.c:1406:class_connect()) connect: client fac74500-4523-4794-af20-dfdcdfae19c1, cookie 0xdb52b77d7ca38ed2 00002000:00100000:3.0:1786109780.388664:0:43913:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fac74500-4523-4794-af20-dfdcdfae19c1/ffff93098666c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786109780.388691:0:43913:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786109780.388800:0:43913:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786109780.388847:0:43913:0:(import.c:65:import_set_state_nolock()) ffff93098666a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786109780.389004:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922190976:12345-192.168.203.38@tcp:8:lfs.0 Request processed in 641us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109780.389012:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23198 00000100:00100000:3.0:1786109780.391257:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109780.391398:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922191104 00000100:00100000:2.0:1786109780.391410:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922191104 00000100:00100000:2.0:1786109780.391576:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5984 00000100:00100000:2.0:1786109780.391590:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:166292:x1872862922191104:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1786109780.391621:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581824 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109780.391701:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:166292:x1872862922191104:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 114us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109780.391708:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5984 00000100:00080000:3.0:1786109780.391833:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786109781.380734:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109782.404647:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109782.788636:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933411584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109782.788775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109782.790623:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933411584 00000100:00100000:0.0:1786109782.790635:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933411584 00000100:00100000:0.0:1786109782.790713:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786109782.790724:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933411584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1786109782.790761:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446019072 avail 1299779584 00010000:00000080:0.0:1786109782.790776:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0cedc00 x1872862933411584/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:253/0 lens 224/368 e 0 to 0 dl 1786109793 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109782.790852:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933411584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109782.790863:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786109782.790922:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933411584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109782.791322:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933411840:0@lo:400:kworker.0 00000100:00100000:2.0:1786109782.791374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109782.791411:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933412352:0@lo:400:kworker.0 00000100:00100000:2.0:1786109782.791460:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109782.791485:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933412864:0@lo:400:kworker.0 00000100:00100000:2.0:1786109782.791509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109782.791532:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1786109782.791537:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933411968:0@lo:400:kworker.0 00000100:00100000:2.0:1786109782.791559:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109782.791579:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933412480:0@lo:400:kworker.0 00000100:00100000:2.0:1786109782.791599:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109782.791616:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933412992:0@lo:400:kworker.0 00000100:00100000:2.0:1786109782.791636:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109782.791676:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933411840 00000100:00100000:2.0:1786109782.791682:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933411840 00000100:00100000:2.0:1786109782.791731:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933411968 00000100:00100000:2.0:1786109782.791735:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933411968 00000100:00100000:2.0:1786109782.791758:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1786109782.791766:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933411840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109782.791807:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933411840:12345-0@lo:400:kworker.0 Request processed in 43us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109782.791814:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1786109782.791829:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1786109782.791835:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933411968:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109782.791847:0:188678:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff93098d89aa00 x1872862933411968/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:292/0 lens 224/224 e 0 to 0 dl 1786109832 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109782.791875:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933411968:12345-0@lo:400:kworker.0 Request processed in 41us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109782.791880:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1786109782.791900:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933412352 00000100:00100000:2.0:1786109782.791903:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933412352 00000100:00100000:2.0:1786109782.791925:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786109782.791932:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933412352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109782.791962:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933412352:12345-0@lo:400:kworker.0 Request processed in 32us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109782.791969:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786109782.791988:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933412864 00000100:00100000:2.0:1786109782.791992:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933412864 00000100:00100000:2.0:1786109782.792031:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933412480 00000100:00100000:2.0:1786109782.792035:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933412480 00000100:00100000:2.0:1786109782.792054:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933412992 00000100:00100000:2.0:1786109782.792056:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933412992 00000100:00100000:2.0:1786109782.792079:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7157 00000100:00100000:2.0:1786109782.792086:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933412864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109782.792116:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933412864:12345-0@lo:400:kworker.0 Request processed in 31us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109782.792716:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7157 00000100:00100000:1.0:1786109782.792803:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7158 00000100:00100000:1.0:1786109782.792817:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933412480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109782.792866:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933412480:12345-0@lo:400:kworker.0 Request processed in 54us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109782.792873:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7158 00000100:00100000:1.0:1786109782.792888:0:179242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7159 00000100:00100000:1.0:1786109782.792895:0:179242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933412992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109782.792927:0:179242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_024:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933412992:12345-0@lo:400:kworker.0 Request processed in 34us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109782.792934:0:179242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7159 00000100:00100000:3.0:1786109782.793104:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933412096:0@lo:400:kworker.0 00000100:00100000:3.0:1786109782.793222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109782.793262:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933412608:0@lo:400:kworker.0 00000100:00100000:3.0:1786109782.793285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109782.793315:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933413120:0@lo:400:kworker.0 00000100:00100000:3.0:1786109782.793338:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109782.793426:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1786109782.793461:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933411712:0@lo:400:kworker.0 00000100:00100000:0.0:1786109782.793485:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933412608 00000100:00100000:3.0:1786109782.793490:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109782.793491:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933412608 00000100:00100000:3.0:1786109782.793515:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933412224:0@lo:400:kworker.0 00000100:00100000:0.0:1786109782.793522:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7160 00000100:00100000:0.0:1786109782.793529:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933412608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109782.793535:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109782.793553:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933412736:0@lo:400:kworker.0 00000100:00100000:3.0:1786109782.793572:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109782.793598:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933412096 00000100:00100000:3.0:1786109782.793602:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933412096 00000100:00100000:3.0:1786109782.793626:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933413120 00000100:00100000:3.0:1786109782.793629:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933413120 00000100:00100000:0.0:1786109782.793655:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933412608:12345-0@lo:400:kworker.0 Request processed in 126us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109782.793662:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7160 00000100:00100000:0.0:1786109782.793726:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933412608:0@lo:400:kworker.0 00000100:00100000:1.0:1786109782.794465:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933412224 00000100:00100000:1.0:1786109782.794471:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933412224 00000100:00100000:1.0:1786109782.794499:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933412736 00000100:00100000:1.0:1786109782.794501:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933412736 00000100:00100000:1.0:1786109782.794516:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1786109782.794525:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933412096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109782.794597:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872862933412096:12345-0@lo:400:kworker.0 Request processed in 73us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109782.794604:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1786109782.794619:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1786109782.794625:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933413120:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786109782.794747:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109782.794752:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109782.794755:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109782.794757:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109782.794770:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1786109782.794778:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933412224:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1786109782.794793:0:187901:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1f3ea00 x1872862933412224/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:292/0 lens 224/224 e 0 to 0 dl 1786109832 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109782.794827:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933412224:12345-0@lo:400:kworker.0 Request processed in 51us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109782.794833:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1786109782.794848:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1786109782.794854:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933412736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109782.794880:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933412736:12345-0@lo:400:kworker.0 Request processed in 26us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109782.794886:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1786109782.794906:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933411712 00000100:00100000:2.0:1786109782.794911:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933411712 00000100:00100000:2.0:1786109782.794938:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1786109782.794945:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933411712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109782.794973:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933411712:12345-0@lo:400:kworker.0 Request processed in 29us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109782.794979:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786109782.795721:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933413120:12345-0@lo:400:kworker.0 Request processed in 1092us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109782.795730:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1786109782.795965:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933411968:0@lo:400:kworker.0 00000100:00100000:3.0:1786109782.795980:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933412480:0@lo:400:kworker.0 00000100:00100000:3.0:1786109782.795994:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933412992:0@lo:400:kworker.0 00000100:00100000:3.0:1786109782.796006:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933411840:0@lo:400:kworker.0 00000100:00100000:3.0:1786109782.796016:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933412352:0@lo:400:kworker.0 00000100:00100000:3.0:1786109782.796028:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933412864:0@lo:400:kworker.0 00000100:00100000:0.0:1786109782.804528:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933411712:0@lo:400:kworker.0 00000100:00100000:0.0:1786109782.804555:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933412224:0@lo:400:kworker.0 00000100:00100000:0.0:1786109782.804568:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933412736:0@lo:400:kworker.0 00000100:00100000:0.0:1786109782.804580:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1872862933412096:0@lo:400:kworker.0 00000100:00100000:0.0:1786109782.804593:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933413120:0@lo:400:kworker.0 00000100:00100000:3.0:1786109783.301360:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933413248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109783.301491:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109783.301969:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109783.301991:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933413376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109783.302057:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109783.302409:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933413248 00000100:00100000:3.0:1786109783.302422:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933413248 00000100:00100000:3.0:1786109783.302518:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933413376 00000100:00100000:3.0:1786109783.302521:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933413376 00000100:00100000:3.0:1786109783.302610:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5985 00000100:00100000:3.0:1786109783.302626:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933413248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109783.302673:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109783.302759:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933413248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109783.302770:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5985 00000100:00100000:3.0:1786109783.302797:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5986 00000100:00100000:3.0:1786109783.302807:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933413376:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109783.302812:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933413632:0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786109783.302822:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109783.302882:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933413376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109783.302885:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109783.302898:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5986 00000100:00100000:3.0:1786109783.302918:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933413632 00000100:00100000:3.0:1786109783.302924:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933413632 00000100:00100000:1.0:1786109783.302925:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109783.302936:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933413760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109783.302951:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5987 00000100:00100000:3.0:1786109783.302962:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933413632:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109783.302974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1786109783.302985:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581824 pending 0 free 3923496960 avail 3691974656 00000020:00080000:1.0:1786109783.303032:0:198777:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 25769804644 batchid updated 00000100:00100000:3.0:1786109783.303047:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933413632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109783.303059:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5987 00000100:00100000:3.0:1786109783.303075:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933413760 00000100:00100000:3.0:1786109783.303079:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933413760 00000100:00100000:1.0:1786109783.303099:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109783.303112:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933413504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786109783.303120:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5988 00000100:00100000:3.0:1786109783.303131:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933413760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109783.303147:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581824 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109783.303165:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109783.303204:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933413760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109783.303212:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5988 00000100:00100000:1.0:1786109783.303253:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933413248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786109783.303281:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933413760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109783.303319:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933413504 00000100:00100000:3.0:1786109783.303326:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933413632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109783.303331:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933413504 00000100:00100000:1.0:1786109783.303391:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1786109783.303402:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933413504:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1786109783.303421:0:198797:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840726 00000004:00000024:1.0:1786109783.303474:0:199402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445642240 avail 1299402752 00000100:00100000:3.0:1786109783.303500:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933413376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109783.304790:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933413504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109783.304954:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3648:x1872862933413504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109783.304968:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000001:00080000:3.0:1786109783.305729:0:201141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350977 is committed 00010000:00010000:0.0:1786109783.428842:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786109784.329839:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00080000:0.0:1786109784.329854:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975848 is committed 00000001:00100000:2.0:1786109784.330130:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00080000:2.0:1786109784.330140:0:194579:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705690 is committed 00010000:00010000:1.0:1786109784.452775:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109784.597043:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109784.597092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109784.597124:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109784.597501:0:179241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922191616 00000100:00100000:3.0:1786109784.597511:0:179241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922191616 00000100:00100000:2.0:1786109784.597911:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922191360 00000100:00100000:2.0:1786109784.597916:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922191360 00000100:00100000:2.0:1786109784.597968:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 489 00000100:00100000:2.0:1786109784.597978:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922191360:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109784.598049:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922191360:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 73us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109784.598696:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109784.598725:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109784.598749:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922191744 00000100:00100000:1.0:1786109784.598753:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922191744 00000100:00100000:1.0:1786109784.599061:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7161 00000100:00100000:1.0:1786109784.599072:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922191744:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109784.599123:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922191744:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 54us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109784.599130:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7161 00000100:00100000:1.0:1786109784.599205:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922191488 00000100:00100000:1.0:1786109784.599210:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922191488 00000100:00100000:1.0:1786109784.599239:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 490 00000100:00100000:1.0:1786109784.599246:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922191488:12345-192.168.203.38@tcp:400:kworker.0 00010000:00000080:1.0:1786109784.599261:0:189813:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930984ff3b80 x1872862922191488/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:314/0 lens 224/224 e 0 to 0 dl 1786109854 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109784.599290:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2402:x1872862922191488:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 44us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109784.599309:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 490 00000100:00080000:1.0:1786109784.599327:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786109784.599631:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109784.599634:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786109784.600499:0:179241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7162 00000100:00100000:3.0:1786109784.600511:0:179241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922191616:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109784.600641:0:179241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922191616:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 132us (3547us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109784.600648:0:179241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7162 00000100:00080000:1.0:1786109784.601039:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109784.601288:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 489 00000100:00100000:0.0:1786109784.603741:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922191232 00000100:00100000:0.0:1786109784.603756:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922191232 00000100:00100000:0.0:1786109784.603947:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:0.0:1786109784.603958:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922191232:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109784.604045:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922191232:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 90us (6921us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109784.604052:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 76 00010000:00010000:3.0:1786109785.476825:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786109785.672729:0:201723:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:1.0:1786109786.500784:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109787.535963:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786109787.768766:0:201772:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1786109787.909771:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786109787.909805:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933413888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109787.909900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109787.909990:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933413888 00000100:00100000:0.0:1786109787.910001:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933413888 00000100:00100000:0.0:1786109787.910071:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786109787.910082:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933413888:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109787.910476:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933414272:0@lo:400:kworker.0 00000100:00100000:1.0:1786109787.910519:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109787.910552:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933414784:0@lo:400:kworker.0 00000100:00100000:1.0:1786109787.910580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109787.910603:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933415296:0@lo:400:kworker.0 00000100:00100000:3.0:1786109787.910952:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933414400:0@lo:400:kworker.0 00000100:00100000:3.0:1786109787.910993:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109787.911023:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933414912:0@lo:400:kworker.0 00000100:00100000:3.0:1786109787.911243:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933414144:0@lo:400:kworker.0 00000100:00100000:3.0:1786109787.911290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109787.911316:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933414656:0@lo:400:kworker.0 00000100:00100000:3.0:1786109787.911342:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109787.911371:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933415168:0@lo:400:kworker.0 00000100:00100000:3.0:1786109787.911408:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933414784 00000100:00100000:3.0:1786109787.911416:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933414784 00000100:00100000:3.0:1786109787.911508:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7163 00000100:00100000:3.0:1786109787.911519:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933414784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109787.911577:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933414784:12345-0@lo:400:kworker.0 Request processed in 60us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109787.911584:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7163 00000100:00100000:3.0:1786109787.911612:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933414272 00000100:00100000:3.0:1786109787.911617:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933414272 00000100:00100000:1.0:1786109787.912120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109787.912201:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933414784:0@lo:400:kworker.0 00000100:00100000:1.0:1786109787.912242:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933414400 00000100:00100000:1.0:1786109787.912246:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933414400 00000004:00000024:0.0:1786109787.912405:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446019072 avail 1299779584 00010000:00000080:0.0:1786109787.912428:0:187904:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac1d3ed80 x1872862933413888/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:258/0 lens 224/368 e 0 to 0 dl 1786109798 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109787.912494:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933413888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2414us (2594us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109787.912505:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786109787.912523:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933414656 00000100:00100000:0.0:1786109787.912526:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933414656 00000100:00100000:0.0:1786109787.912548:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786109787.912556:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933414656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109787.912600:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933414656:12345-0@lo:400:kworker.0 Request processed in 45us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109787.912607:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786109787.913230:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933414144 00000100:00100000:1.0:1786109787.913237:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933414144 00000100:00100000:1.0:1786109787.913269:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1786109787.913292:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933414400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109787.913349:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933414400:12345-0@lo:400:kworker.0 Request processed in 59us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109787.913356:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1786109787.913372:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1786109787.913379:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933414144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109787.913409:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872862933414144:12345-0@lo:400:kworker.0 Request processed in 31us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109787.913415:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1786109787.913460:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933415296 00000100:00100000:1.0:1786109787.913464:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933415296 00000100:00100000:1.0:1786109787.913499:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7164 00000100:00100000:1.0:1786109787.913506:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933415296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109787.913549:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933415296:12345-0@lo:400:kworker.0 Request processed in 43us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109787.913555:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7164 00000100:00100000:1.0:1786109787.913591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109787.914365:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1786109787.914383:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933414272:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1786109787.914406:0:196401:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac17b9180 x1872862933414272/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:317/0 lens 224/224 e 0 to 0 dl 1786109857 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109787.914471:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872862933414272:12345-0@lo:400:kworker.0 Request processed in 96us (3951us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109787.914478:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00080000:3.0:1786109787.914518:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109787.914524:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786109787.914527:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109787.914531:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786109787.914546:0:151898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933414912 00000100:00100000:3.0:1786109787.914551:0:151898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933414912 00000100:00100000:3.0:1786109787.914588:0:151898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7165 00000100:00100000:3.0:1786109787.914595:0:151898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933414912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109787.915239:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933414016:0@lo:400:kworker.0 00000100:00100000:1.0:1786109787.917295:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933415424:0@lo:400:kworker.0 00000100:00100000:0.0:1786109787.917790:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109787.917870:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933414528:0@lo:400:kworker.0 00000100:00100000:0.0:1786109787.917907:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109787.917934:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933415040:0@lo:400:kworker.0 00000100:00100000:0.0:1786109787.917959:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109787.918018:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933413888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109787.918790:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933414016 00000100:00100000:0.0:1786109787.918803:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933414016 00000100:00100000:0.0:1786109787.918874:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1786109787.918887:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933414016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109787.918973:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3649:x1872862933414016:12345-0@lo:400:kworker.0 Request processed in 88us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109787.918982:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1786109787.919026:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933414528 00000100:00100000:0.0:1786109787.919030:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933414528 00000100:00100000:0.0:1786109787.919080:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933415040 00000100:00100000:0.0:1786109787.919084:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933415040 00000100:00100000:0.0:1786109787.919112:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1786109787.919119:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933414528:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1786109787.919137:0:187900:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ac0fbbb80 x1872862933414528/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:317/0 lens 224/224 e 0 to 0 dl 1786109857 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786109787.919171:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1872862933414528:12345-0@lo:400:kworker.0 Request processed in 53us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109787.919178:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1786109787.919191:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1786109787.919197:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933415040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109787.919227:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933415040:12345-0@lo:400:kworker.0 Request processed in 30us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109787.919233:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1786109787.919744:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3649:1872862933414016:0@lo:400:kworker.0 00000100:00100000:0.0:1786109787.919781:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1872862933414528:0@lo:400:kworker.0 00000100:00100000:0.0:1786109787.919794:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933415040:0@lo:400:kworker.0 00000100:00100000:3.0:1786109787.922314:0:151898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933414912:12345-0@lo:400:kworker.0 Request processed in 7705us (8708us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109787.922333:0:151898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7165 00000100:00080000:3.0:1786109787.922469:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786109787.922477:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786109787.922508:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109787.922605:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1872862933414144:0@lo:400:kworker.0 00000100:00100000:3.0:1786109787.922622:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933414656:0@lo:400:kworker.0 00000100:00100000:0.0:1786109787.922986:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933415168 00000100:00100000:0.0:1786109787.922995:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933415168 00000100:00100000:0.0:1786109787.923084:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7166 00000100:00100000:0.0:1786109787.923096:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933415168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109787.923334:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933415168:12345-0@lo:400:kworker.0 Request processed in 240us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109787.923342:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7166 00000100:00100000:0.0:1786109787.923380:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 38654705690 gen 2 00000100:00100000:0.0:1786109787.923396:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933415168:0@lo:400:kworker.0 00000100:00080000:3.0:1786109787.923479:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109787.923577:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1872862933414272:0@lo:400:kworker.0 00000100:00100000:0.0:1786109787.923592:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294975848 gen 2 00000100:00100000:0.0:1786109787.923603:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933415296:0@lo:400:kworker.0 00000100:00100000:1.0:1786109787.924088:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109787.924330:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933414400:0@lo:400:kworker.0 00000100:00100000:1.0:1786109787.924345:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933414912:0@lo:400:kworker.0 00000100:00100000:2.0:1786109787.927565:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933415424 00000100:00100000:2.0:1786109787.927585:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933415424 00000100:00100000:3.0:1786109787.927790:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1786109787.927805:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933415424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109787.927903:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933415424:12345-0@lo:400:kworker.0 Request processed in 102us (3816us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109787.927912:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1786109787.928186:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933415424:0@lo:400:kworker.0 00000100:00100000:1.0:1786109788.420672:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786109788.420697:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933415552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109788.420765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109788.421160:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109788.421170:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933415936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109788.421200:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109788.421256:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933415808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109788.421282:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933415680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109788.421336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109788.421468:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933415680 00000100:00100000:3.0:1786109788.421477:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933415680 00000100:00100000:3.0:1786109788.421585:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786109788.421594:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933415680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786109788.421628:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445642240 avail 1299402752 00000100:00100000:3.0:1786109788.421691:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3646:x1872862933415680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109788.421698:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1786109788.421827:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933416064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109788.421869:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109788.421938:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933415680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109788.421994:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933415552 00000100:00100000:0.0:1786109788.422000:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933415552 00000100:00100000:0.0:1786109788.422083:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933415936 00000100:00100000:0.0:1786109788.422086:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933415936 00000100:00100000:0.0:1786109788.422105:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5989 00000100:00100000:0.0:1786109788.422112:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933415552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786109788.422132:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109788.422170:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933415552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109788.422177:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5989 00000100:00100000:0.0:1786109788.422190:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5990 00000100:00100000:0.0:1786109788.422196:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933415936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786109788.422226:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581824 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109788.422255:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933415936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109788.422260:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5990 00000100:00100000:0.0:1786109788.422307:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933415552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786109788.422460:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933416064 00000100:00100000:0.0:1786109788.422465:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933416064 00000100:00100000:0.0:1786109788.422487:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5991 00000100:00100000:0.0:1786109788.422492:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933416064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109788.422503:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109788.422655:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933416064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109788.422661:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5991 00000100:00100000:1.0:1786109788.422737:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933416064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109788.422752:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933415936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786109788.422802:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109788.422913:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933415808 00000100:00100000:0.0:1786109788.422917:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933415808 00000100:00100000:0.0:1786109788.422980:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5992 00000100:00100000:0.0:1786109788.422988:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933415808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109788.423000:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581824 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109788.423043:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933415808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109788.423050:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5992 00000100:00100000:3.0:1786109788.423103:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933415808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786109788.552764:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109789.559052:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109789.559308:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922191872 00000100:00100000:0.0:1786109789.559317:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922191872 00000100:00080000:3.0:1786109789.559673:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109789.560309:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1327 00000100:00100000:1.0:1786109789.560324:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:166759:x1872862922191872:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:1.0:1786109789.560364:0:187899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445642240 avail 1299402752 00000100:00100000:1.0:1786109789.560932:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:166759:x1872862922191872:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 609us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109789.560940:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1327 00000100:00100000:1.0:1786109789.565824:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109789.566390:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922192000 00000100:00100000:3.0:1786109789.567686:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922192000 00000100:00100000:3.0:1786109789.569955:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1328 00000100:00100000:3.0:1786109789.569986:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+6:166759:x1872862922192000:12345-192.168.203.38@tcp:41:lfs.0 00000100:00080000:0.0:1786109789.570525:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1786109789.570885:0:196401:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446019072 avail 1299779584 00010000:00000080:3.0:1786109789.570910:0:196401:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff930ab7e5df80 x1872862922192000/t0(0) o41->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:319/0 lens 224/368 e 0 to 0 dl 1786109859 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109789.570988:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+6:166759:x1872862922192000:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 1016us (5175us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109789.570995:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1328 00010000:00010000:3.0:1786109789.572587:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109789.575058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109789.575205:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922192128 00000100:00100000:0.0:1786109789.575215:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922192128 00000100:00100000:0.0:1786109789.575373:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5993 00000100:00100000:0.0:1786109789.575384:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:166759:x1872862922192128:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:0.0:1786109789.575512:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109789.575578:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:166759:x1872862922192128:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 195us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109789.575585:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5993 00000100:00080000:2.0:1786109789.577029:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109789.579078:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109789.579175:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922192256 00000100:00100000:2.0:1786109789.579186:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922192256 00000100:00080000:3.0:1786109789.579238:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109789.579341:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5994 00000100:00100000:2.0:1786109789.579353:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:166759:x1872862922192256:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1786109789.579380:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581824 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109789.579894:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:166759:x1872862922192256:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 542us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109789.579902:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5994 00000100:00100000:3.0:1786109789.711190:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109789.711281:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922192384 00000100:00100000:0.0:1786109789.711292:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922192384 00000100:00100000:0.0:1786109789.711356:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:0.0:1786109789.711368:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922192384:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109789.711897:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922192384:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 529us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109789.711906:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 78 00010000:00010000:3.0:1786109790.598698:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1786109791.168809:0:201869:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1786109791.168867:0:201869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.168883:0:201869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.168891:0:201869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.168899:0:201869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.168920:0:201869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1786109791.168927:0:201869:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1786109791.168952:0:201869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109791.168957:0:201869:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1786109791.168962:0:201869:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1786109791.168986:0:201869:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1786109791.169065:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933416192:0@lo:39:umount.0 00000100:00100000:3.0:1786109791.169136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109791.169342:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933416192 00000100:00100000:1.0:1786109791.169351:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933416192 00000100:00100000:1.0:1786109791.169405:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1786109791.169414:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872862933416192:12345-0@lo:39:umount.0 00000020:00000080:1.0:1786109791.169466:0:187900:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca38c16 00000100:00080000:1.0:1786109791.169490:0:187900:0:(import.c:65:import_set_state_nolock()) ffff930ab2abd000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1786109791.170371:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109791.170381:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109791.170390:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413000 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:2.0:1786109791.170394:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109791.170402:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786109791.170409:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786109791.170414:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1786109791.170417:0:10402:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1786109791.170421:0:10402:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1786109791.170520:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109791.170527:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786109791.170548:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109791.170554:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9413000/0xdb52b77d7ca38b4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b52 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109791.170570:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109791.170572:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109791.170574:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109791.170587:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933416320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786109791.170627:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109791.170690:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933416320 00000100:00100000:2.0:1786109791.170694:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933416320 00000100:00100000:2.0:1786109791.170729:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4549 00000100:00100000:2.0:1786109791.170737:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933416320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786109791.170747:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786109791.170761:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9413600/0xdb52b77d7ca38b52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca38b4b expref: 24 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109791.170772:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786109791.170801:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3646:x1872862933416320:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109791.170809:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4549 00000100:00100000:2.0:1786109791.170847:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933416320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786109791.171079:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+1:3645:x1872862933416192:12345-0@lo:39:umount.0 Request processed in 1665us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109791.171087:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000020:00000080:1.0:1786109791.171096:0:187900:0:(genops.c:906:class_export_put()) final put ffff930ab2abb800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1786109791.171151:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786109791.171189:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab2abb800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1786109791.171238:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab2abd000 for lustre-MDT0000 00000100:00080000:3.0:1786109791.171313:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1786109791.171367:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933416192:0@lo:39:umount.0 00000100:00080000:0.0:1786109791.171416:0:201869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109791.171420:0:201869:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1786109791.171424:0:201869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1786109791.176031:0:201869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176049:0:201869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176056:0:201869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176064:0:201869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176078:0:201869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786109791.176082:0:201869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176088:0:201869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176093:0:201869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176096:0:201869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176109:0:201869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786109791.176115:0:201869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176121:0:201869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176126:0:201869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176132:0:201869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176133:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109791.176140:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176141:0:201869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786109791.176146:0:201869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176147:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930aa628b000 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:0.0:1786109791.176151:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176152:0:201869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176158:0:201869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176160:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786109791.176167:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176170:0:201869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109791.176178:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786109791.176180:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1786109791.176181:0:201869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1786109791.176184:0:201869:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1786109791.176187:0:201869:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1786109791.176209:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176213:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786109791.176215:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109791.176217:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176223:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412800 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:1.0:1786109791.176225:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.176232:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176327:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176335:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930aa628b000/0xdb52b77d7ca38b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b6e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176346:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786109791.176350:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176356:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9413200 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:0.0:1786109791.176359:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176366:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786109791.176372:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109791.176378:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1786109791.176380:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1786109791.176383:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1786109791.176402:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176408:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109791.176423:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176448:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9413200/0xdb52b77d7ca38b83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176457:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786109791.176460:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176465:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412c00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:0.0:1786109791.176468:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176474:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786109791.176479:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109791.176485:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1786109791.176486:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1786109791.176488:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1786109791.176501:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176582:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786109791.176590:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176667:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9412c00/0xdb52b77d7ca38b75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b7c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176679:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109791.176680:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109791.176682:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109791.176699:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933416576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109791.176757:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109791.176804:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109791.176810:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933416704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109791.176831:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109791.176866:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933416576 00000100:00100000:0.0:1786109791.176873:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933416576 00000100:00100000:0.0:1786109791.176906:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933416704 00000100:00100000:0.0:1786109791.176908:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933416704 00000100:00100000:0.0:1786109791.176926:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4550 00000100:00100000:0.0:1786109791.176933:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933416576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109791.176945:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109791.176960:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9361600/0xdb52b77d7ca38b8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca38b83 expref: 24 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.176972:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109791.177004:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:3648:x1872862933416576:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109791.177011:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4550 00000100:00100000:0.0:1786109791.177025:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4551 00000100:00100000:0.0:1786109791.177031:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:3648:x1872862933416704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109791.177038:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109791.177046:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9361c00/0xdb52b77d7ca38b7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca38b75 expref: 22 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.177054:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109791.177074:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3648:x1872862933416704:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109791.177080:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4551 00000100:00100000:0.0:1786109791.177116:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933416704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109791.177124:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933416576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109791.177143:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933416448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109791.177163:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109791.177191:0:177416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933416448 00000100:00100000:0.0:1786109791.177195:0:177416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933416448 00000100:00100000:0.0:1786109791.177218:0:177416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4552 00000100:00100000:0.0:1786109791.177225:0:177416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:3647:x1872862933416448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109791.177232:0:177416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:1.0:1786109791.177373:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109791.177379:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1786109791.177381:0:6515:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1786109791.177383:0:6515:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1786109791.177401:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.177406:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786109791.177419:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.177445:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9412800/0xdb52b77d7ca38b59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb52b77d7ca38b60 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109791.177456:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109791.177457:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109791.177459:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1786109791.177533:0:201869:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1786109791.177536:0:201869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:1.0:1786109791.177541:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1786109791.177546:0:201869:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0001 00010000:00010000:3.0:1786109791.178605:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109791.179399:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1786109791.180004:0:201869:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:1.0:1786109791.180217:0:201869:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1786109791.180225:0:201869:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff930ac0c8e800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786109791.180232:0:201869:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff93098e2bd000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786109791.180236:0:201869:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff93098e2b8800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786109791.180241:0:201869:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff930ab1994800 fac74500-4523-4794-af20-dfdcdfae19c1 192.168.203.38@tcp 5 (0 0 0) 0 0 0 0: 0000000000000000 30064771142 stale:0 00000020:00080000:1.0:1786109791.180246:0:201869:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff9309827299c0) has exports, disconnecting them 00000020:00080000:1.0:1786109791.180266:0:201869:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff930ac0c8e800), last request at 1786109772 00000020:00000080:1.0:1786109791.180273:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca38acd 00000100:00080000:1.0:1786109791.180282:0:201869:0:(import.c:65:import_set_state_nolock()) ffff930ac0c8b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1786109791.180357:0:201869:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff930ac0c8e800): rc 0 00000020:00000080:1.0:1786109791.180359:0:201869:0:(genops.c:906:class_export_put()) final put ffff930ac0c8e800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:1.0:1786109791.180379:0:201869:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93098e2bd000), last request at 1786109787 00000020:00000080:1.0:1786109791.180382:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca38077 00000100:00080000:1.0:1786109791.180386:0:201869:0:(import.c:65:import_set_state_nolock()) ffff93098e2be800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1786109791.180418:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930ac0c8e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1786109791.180489:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac0c8b000 for lustre-MDT0001 00010000:00010000:3.0:1786109791.180589:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1786109791.180698:0:201869:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93098e2bd000): rc 0 00000020:00000080:1.0:1786109791.180701:0:201869:0:(genops.c:906:class_export_put()) final put ffff93098e2bd000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00080000:1.0:1786109791.180709:0:201869:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93098e2b8800), last request at 1786109787 00000020:00000080:1.0:1786109791.180716:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca38070 00000100:00080000:1.0:1786109791.180722:0:201869:0:(import.c:65:import_set_state_nolock()) ffff93098e2ba800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1786109791.180931:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786109791.180939:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e2bd000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1786109791.180965:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098e2be800 for lustre-MDT0001 00000020:00080000:1.0:1786109791.181071:0:201869:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93098e2b8800): rc 0 00000020:00000080:1.0:1786109791.181074:0:201869:0:(genops.c:906:class_export_put()) final put ffff93098e2b8800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1786109791.181090:0:201869:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.203.38@tcp (ffff930ab1994800), last request at 1786109789 00000020:00000080:1.0:1786109791.181094:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37fac 00000100:00080000:1.0:1786109791.181106:0:201869:0:(import.c:65:import_set_state_nolock()) ffff93098e2bb800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1786109791.181138:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff93098e2b8800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1786109791.181158:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098e2ba800 for lustre-MDT0001 00010000:00010000:3.0:1786109791.181189:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1786109791.181270:0:201869:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.38@tcp (ffff930ab1994800): rc 0 00000020:00000080:1.0:1786109791.181273:0:201869:0:(genops.c:906:class_export_put()) final put ffff930ab1994800/fac74500-4523-4794-af20-dfdcdfae19c1 00000004:00000080:1.0:1786109791.181323:0:201869:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa66f01d6bae0 00000100:00080000:1.0:1786109791.181343:0:201869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786109791.181346:0:201869:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383708 gen 3 00010000:00010000:0.0:1786109791.181368:0:177416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930aa628a400/0xdb52b77d7ca38b6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca38b67 expref: 21 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.181383:0:177416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786109791.181491:0:201869:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0xdb52b77d7ca38cf6 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786109791.181500:0:201869:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0xdb52b77d7ca38cf6 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786109791.181539:0:201869:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1786109791.181564:0:201869:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1786109791.181573:0:201869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff930ab8f06a00/0xdb52b77d7ca381ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0xdb52b77d7ca38cf6 expref: -99 pid: 187901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109791.181775:0:177416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:3647:x1872862933416448:12345-0@lo:103:ldlm_bl.0 Request processed in 4549us (4609us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109791.181785:0:177416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4552 00010000:00010000:2.0:1786109791.181969:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786109791.182523:0:201869:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1786109791.182546:0:201869:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1786109791.182680:0:201869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1786109791.182684:0:201869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705689 gen 3 00000004:00080000:1.0:1786109791.182695:0:201869:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1786109791.182758:0:201869:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1786109791.182769:0:201869:0:(import.c:65:import_set_state_nolock()) ffff930a88c1b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1786109791.182775:0:201869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1786109791.182776:0:201869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975847 gen 3 00000004:00080000:1.0:1786109791.182784:0:201869:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1786109791.182855:0:201869:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1786109791.182863:0:201869:0:(import.c:65:import_set_state_nolock()) ffff930ac1259800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1786109791.182902:0:201869:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9309827299c0) has no exports 00000020:00000080:3.0:1786109791.183098:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930ab1994800/fac74500-4523-4794-af20-dfdcdfae19c1 for lustre-MDT0001 00000020:00000080:3.0:1786109791.183139:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098e2bb800 for lustre-MDT0001 00000020:00080000:3.0:1786109791.183152:0:198797:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff930a97f06cc0 refcount 1 committed 1 result 0 batchid 21474840727 00000020:00080000:3.0:1786109791.183157:0:198797:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a905e1100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 0 stopped 0 result 0 sub_th 0000000000000000 00000020:00080000:3.0:1786109791.183161:0:198797:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200026d32:0x1:0x0].3 00000020:00080000:3.0:1786109791.183164:0:198797:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930a8390e600 obd lustre-MDT0001-osd committed 1 started 0 stopped 0 result 0 sub_th 0000000000000000 00000020:00080000:3.0:1786109791.183166:0:198797:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002efa:0x1:0x0].3 00000020:00080000:3.0:1786109791.183174:0:198797:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff93098469fe40 refcount 1 committed 1 result -2 batchid 25769804643 00000020:00080000:3.0:1786109791.183178:0:198797:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aa6220800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result -2 sub_th ffff93098469f300 00000020:00080000:3.0:1786109791.183180:0:198797:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200027501:0x1:0x0].1 00000020:00080000:3.0:1786109791.183182:0:198797:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930aa6220600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930986230a00 00000020:00080000:3.0:1786109791.183185:0:198797:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400036c8:0x1:0x0].1 00000020:00080000:3.0:1786109791.183191:0:198797:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff930ab7cc43c0 refcount 1 committed 1 result -5 batchid 25769804644 00000020:00080000:3.0:1786109791.183194:0:198797:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab1d83400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result -5 sub_th ffff930ab7cc4180 00000020:00080000:3.0:1786109791.183196:0:198797:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200027501:0x1:0x0].2 00000020:00080000:3.0:1786109791.183198:0:198797:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ab1d83500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff930ac0b53200 00000020:00080000:3.0:1786109791.183200:0:198797:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400036c8:0x1:0x0].2 00000100:00100000:3.0:1786109791.183269:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933416960:0@lo:39:umount.0 00000100:00100000:3.0:1786109791.183328:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109791.183358:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933417088:0@lo:9:umount.0 00000100:00100000:3.0:1786109791.183378:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109791.183396:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933417216:0@lo:9:umount.0 00000100:00100000:3.0:1786109791.183416:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109791.183469:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933416960 00000100:00100000:3.0:1786109791.183490:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933416960 00000100:00100000:3.0:1786109791.183532:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786109791.183541:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3645:x1872862933416960:12345-0@lo:39:umount.0 00000020:00000080:3.0:1786109791.183566:0:199402:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca38a8e 00000020:00010000:3.0:1786109791.183575:0:199402:0:(genops.c:1942:obd_stale_export_put()) Put export ffff930981e10800: total 0 00000100:00080000:3.0:1786109791.183578:0:199402:0:(import.c:65:import_set_state_nolock()) ffff930ac09cd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786109791.183595:0:199402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 81, last_transno is 347892350977 00000100:00100000:3.0:1786109791.183732:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1872862933416960:12345-0@lo:39:umount.0 Request processed in 191us (402us total) trans 347892350978 rc 0/0 00000100:00100000:3.0:1786109791.183739:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000020:00010000:3.0:1786109791.183759:0:6514:0:(genops.c:1928:obd_stale_export_get()) Get export ffff930981e10800: total 0 00010000:00010000:3.0:1786109791.183798:0:6514:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff930981e10800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1786109791.183825:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0xf7117594 (ffff930a9a33e100) 00010000:00010000:3.0:1786109791.183829:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109791.183835:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361000/0xdb52b77d7ca38cef lrc: 0/0,0 mode: --/PW res: [0x200026d31:0x7:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3889d expref: 6 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109791.183859:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff930a9a33ec00) 00010000:00010000:3.0:1786109791.183861:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786109791.183864:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9360400/0xdb52b77d7ca38cf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca381ff expref: 5 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109791.183878:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200026d31:0x7:0x0].0x0 (ffff930a81356c00) 00010000:00010000:3.0:1786109791.183880:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786109791.183883:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff930ab9361a00/0xdb52b77d7ca38ce8 lrc: 0/0,0 mode: --/CW res: [0x200026d31:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca3888f expref: 4 pid: 201173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109791.183894:0:6514:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff930981e10800, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1786109791.183906:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109791.183908:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109791.183910:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786109791.183937:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a8a47d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1786109791.183943:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933416960:0@lo:39:umount.0 00000100:00100000:0.0:1786109791.184070:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933417088 00000100:00100000:0.0:1786109791.184075:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933417088 00000100:00100000:0.0:1786109791.184121:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933417216 00000100:00100000:0.0:1786109791.184125:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933417216 00000100:00100000:0.0:1786109791.184146:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23199 00000100:00100000:0.0:1786109791.184154:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3645:x1872862933417088:12345-0@lo:9:umount.0 00000020:00000080:0.0:1786109791.184168:0:179254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37feb 00000100:00080000:0.0:1786109791.184173:0:179254:0:(import.c:65:import_set_state_nolock()) ffff930a88c1e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786109791.184202:0:179254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705690 00000100:00100000:0.0:1786109791.184352:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+2:3645:x1872862933417088:12345-0@lo:9:umount.0 Request processed in 198us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109791.184359:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23199 00000100:00100000:0.0:1786109791.184371:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23200 00000100:00100000:0.0:1786109791.184378:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:3645:x1872862933417216:12345-0@lo:9:umount.0 00000020:00000080:0.0:1786109791.184389:0:179254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca38000 00000100:00080000:0.0:1786109791.184395:0:179254:0:(import.c:65:import_set_state_nolock()) ffff930a87b2a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786109791.184418:0:179254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975848 00000100:00100000:0.0:1786109791.184526:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+2:3645:x1872862933417216:12345-0@lo:9:umount.0 Request processed in 149us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109791.184533:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23200 00000100:00100000:0.0:1786109791.184574:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933416448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109791.184589:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109791.184596:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933416832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109791.184621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109791.184656:0:43921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933416832 00000100:00100000:0.0:1786109791.184660:0:43921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933416832 00000100:00100000:0.0:1786109791.184690:0:43921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4553 00000100:00100000:0.0:1786109791.184696:0:43921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:3647:x1872862933416832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109791.184705:0:43921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786109791.184717:0:43921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9412e00/0xdb52b77d7ca38b60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb52b77d7ca38b59 expref: 20 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109791.184728:0:43921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786109791.184751:0:43921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3647:x1872862933416832:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109791.184756:0:43921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4553 00000100:00100000:0.0:1786109791.184777:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933416832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786109791.184790:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786109791.184804:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a88c1b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1786109791.184813:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1786109791.184815:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109791.184817:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933417088:0@lo:9:umount.0 00000100:00080000:0.0:1786109791.184826:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ac1259800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1786109791.184832:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1786109791.184833:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109791.184836:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933417216:0@lo:9:umount.0 00000040:00080000:1.0:1786109791.185091:0:201869:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 10, last_idx 14 00000100:00080000:3.0:1786109791.185210:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109791.185214:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1786109791.185359:0:201869:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9309827299c0) has no exports 00010000:00010000:2.0:1786109791.187327:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1786109791.225877:0:201869:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9309836f9b40 - data ffff93098239c798/ffff930ac0aae800 00000020:01000000:1.0:1786109791.226049:0:201869:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9309836f94e0 - data ffff930abfa720d8/ffff930ac0aac000 00000100:00080000:3.0:1786109791.274000:0:201869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786109791.274013:0:201869:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383708 gen 4 00000100:00100000:3.0:1786109791.274710:0:201869:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff930a8909b100 x1872862933416960/t347892350978(347892350978) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109801 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109791.275067:0:201869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1786109791.280407:0:201869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1786109791.280415:0:201869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705689 gen 4 00000004:00080000:0.0:1786109791.280451:0:201869:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109791.280454:0:201869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1786109791.280830:0:198785:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1786109791.280835:0:198785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1c:0x0] index 11 count 1 00000040:00080000:1.0:1786109791.280847:0:198785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 7 count 2 00000100:00080000:0.0:1786109791.281397:0:201869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1786109791.281401:0:201869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975847 gen 4 00000004:00080000:0.0:1786109791.281419:0:201869:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109791.281421:0:201869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1786109791.281928:0:198787:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1786109791.281937:0:198787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1e:0x0] index 11 count 1 00000040:00080000:3.0:1786109791.281954:0:198787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 7 count 2 00000020:00000080:0.0:1786109791.287203:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37f7b 00000020:00000080:0.0:1786109791.287216:0:201869:0:(genops.c:906:class_export_put()) final put ffff930a8a47f000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1786109791.288017:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37f90 00000020:00000080:0.0:1786109791.288024:0:201869:0:(genops.c:906:class_export_put()) final put ffff930983edb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1786109791.288071:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a8a47f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1786109791.292394:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930983edb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1786109791.292837:0:201869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1786109791.292845:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109791.292854:0:201869:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1786109791.292859:0:201869:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff930982728000) has no exports 00000004:01000000:0.0:1786109791.293037:0:201869:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1786109791.293046:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37ff9 00000020:00000080:0.0:1786109791.293054:0:201869:0:(genops.c:906:class_export_put()) final put ffff930a88e3b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1786109791.293215:0:201869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1786109791.293220:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109791.293225:0:201869:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1786109791.293228:0:201869:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9309852119c0) has no exports 00000020:00000080:0.0:1786109791.293235:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37ff2 00000020:00000080:0.0:1786109791.293239:0:201869:0:(genops.c:906:class_export_put()) final put ffff930983c44800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1786109791.293647:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88e3b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:0.0:1786109791.294068:0:201869:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1786109791.294073:0:201869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1786109791.294077:0:201869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975847 gen 5 00000004:00080000:0.0:1786109791.294084:0:201869:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109791.294086:0:201869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786109791.294687:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930983c44800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1786109791.294802:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109791.294810:0:201869:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1786109791.294818:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37fdd 00000020:00000080:0.0:1786109791.294825:0:201869:0:(genops.c:906:class_export_put()) final put ffff930a88e3f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1786109791.295079:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac1259800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1786109791.295086:0:183576:0:(genops.c:906:class_export_put()) final put ffff930a88e38800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1786109791.295089:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88e38800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1786109791.295094:0:183576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1786109791.295231:0:201869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1786109791.295236:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109791.295241:0:201869:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1786109791.295244:0:201869:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff930ab1d48000) has no exports 00000020:00000080:0.0:1786109791.295259:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37fcf 00000020:00000080:0.0:1786109791.295264:0:201869:0:(genops.c:906:class_export_put()) final put ffff930a88c1a000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1786109791.295640:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88e3f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:0.0:1786109791.296048:0:201869:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1786109791.296052:0:201869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1786109791.296055:0:201869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705689 gen 5 00000004:00080000:0.0:1786109791.296060:0:201869:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786109791.296062:0:201869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786109791.296398:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88c1a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1786109791.296532:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109791.296539:0:201869:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1786109791.296553:0:201869:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1786109791.296559:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37fc1 00000020:00000080:0.0:1786109791.296565:0:201869:0:(genops.c:906:class_export_put()) final put ffff930a88e3c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1786109791.296839:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a88c1b000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1786109791.296846:0:183576:0:(genops.c:906:class_export_put()) final put ffff930a88e39800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1786109791.296848:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88e39800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1786109791.296853:0:183576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1786109791.296945:0:201869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:0.0:1786109791.296950:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109791.296956:0:201869:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1786109791.296959:0:201869:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9309835d19c0) has no exports 00000020:00000080:0.0:1786109791.296963:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37fba 00000020:00000080:0.0:1786109791.296967:0:201869:0:(genops.c:906:class_export_put()) final put ffff930a88c1a800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1786109791.297365:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88e3c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1786109791.297372:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88c1a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1786109791.299736:0:201869:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1786109791.299744:0:201869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786109791.299748:0:201869:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 343597383708 gen 5 00000100:00100000:1.0:1786109791.299757:0:201869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786109791.299811:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109791.299822:0:201869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1786109791.299855:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109791.299859:0:201869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1786109791.299864:0:201869:0:(genops.c:906:class_export_put()) final put ffff930985b7c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1786109791.299867:0:201869:0:(genops.c:865:class_export_destroy()) destroying export ffff930985b7c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1786109791.299874:0:201869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1786109791.299968:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37f97 00000020:00000080:1.0:1786109791.299975:0:201869:0:(genops.c:906:class_export_put()) final put ffff930983edb800/lustre-MDD0001_UUID 00000020:01000000:1.0:1786109791.299980:0:201869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1786109791.299983:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109791.299989:0:201869:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786109791.299992:0:201869:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff93098272b380) has no exports 00000020:00000080:1.0:1786109791.300014:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109791.300018:0:201869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1786109791.300021:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37f9e 00000020:00000080:1.0:1786109791.300025:0:201869:0:(genops.c:906:class_export_put()) final put ffff930983eda000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1786109791.300033:0:201869:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930ab1980800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1786109791.300036:0:201869:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab1980800 2 00000020:01000004:1.0:1786109791.300039:0:201869:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff930ab1980800 from lustre-MDT0001 00000020:00000080:1.0:1786109791.300056:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786109791.300060:0:201869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1786109791.300063:0:201869:0:(genops.c:906:class_export_put()) final put ffff930a8a47c800/lustre-MDT0001_UUID 00000020:00000080:1.0:1786109791.300065:0:201869:0:(genops.c:865:class_export_destroy()) destroying export ffff930a8a47c800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1786109791.300071:0:201869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1786109791.300101:0:201869:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1786109791.300104:0:201869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1786109791.300107:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786109791.300110:0:201869:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1786109791.300117:0:201869:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff93098365b800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786109791.300121:0:201869:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff930ab1d419c0) has exports, disconnecting them 00000020:00080000:1.0:1786109791.300126:0:201869:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff93098365b800), last request at 1786109695 00000020:00000080:1.0:1786109791.300130:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca38038 00000020:00080000:1.0:1786109791.300142:0:201869:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93098365b800): rc 0 00000020:00000080:1.0:1786109791.300145:0:201869:0:(genops.c:906:class_export_put()) final put ffff93098365b800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1786109791.300364:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a8a47d000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1786109791.300371:0:183576:0:(genops.c:906:class_export_put()) final put ffff930a88c1f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1786109791.300374:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88c1f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1786109791.300382:0:183576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1786109791.300457:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930983edb800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1786109791.300462:0:183576:0:(genops.c:906:class_export_put()) final put ffff930a8a645000/lustre-MDD0001_UUID 00000020:00000080:3.0:1786109791.300463:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a8a645000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1786109791.300467:0:183576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1786109791.300495:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930983eda000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1786109791.300499:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff93098365b800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1786109791.311550:0:201869:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1786109791.311560:0:201869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786109791.311564:0:201869:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1786109791.311571:0:201869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786109791.311706:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786109791.311716:0:201869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1786109791.311724:0:201869:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930ab1980800 1 00000020:00000080:0.0:1786109791.311731:0:201869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca37f51 00000020:00000080:0.0:1786109791.311739:0:201869:0:(genops.c:906:class_export_put()) final put ffff930986508000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1786109791.311745:0:201869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1786109791.311749:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786109791.311753:0:201869:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786109791.311757:0:201869:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff930985214d40) has no exports 00000020:00000080:3.0:1786109791.313376:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ab8da3000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1786109791.313388:0:183576:0:(genops.c:906:class_export_put()) final put ffff930a87b28800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1786109791.313391:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b28800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1786109791.313399:0:183576:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1786109791.313496:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930986508000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1786109791.346852:0:201869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786109791.346864:0:201869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1786109791.346870:0:201869:0:(genops.c:906:class_export_put()) final put ffff930981e11000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1786109791.346874:0:201869:0:(genops.c:865:class_export_destroy()) destroying export ffff930981e11000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1786109791.346886:0:201869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1786109791.347000:0:201869:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff930ab31ee800 00000020:02000400:3.0:1786109791.347063:0:201869:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1786109791.621926:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109792.644726:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109793.028883:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786109793.028905:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933417344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786109793.028974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109793.030039:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933417472:0@lo:400:kworker.0 00000100:00100000:0.0:1786109793.030087:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109793.030122:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933417984:0@lo:400:kworker.0 00000100:00100000:0.0:1786109793.030610:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109793.030740:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933417344 00000100:00100000:3.0:1786109793.030749:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933417344 00000100:00100000:3.0:1786109793.030787:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1786109793.030795:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1872862933417344:12345-0@lo:41:osp-pre-1-0.0 00000020:00080000:3.0:1786109793.030804:0:187904:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1786109793.030846:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1872862933417344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (1871us total) trans 0 rc -107/-107 00000100:00100000:3.0:1786109793.030853:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1786109793.031000:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933417472 00000100:00100000:3.0:1786109793.031004:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933417472 00000100:00100000:1.0:1786109793.031572:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933417856:0@lo:400:kworker.0 00000100:00100000:0.0:1786109793.031968:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786109793.031976:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933417600:0@lo:400:kworker.0 00000100:00100000:0.0:1786109793.032004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109793.032023:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933418112:0@lo:400:kworker.0 00000100:00100000:0.0:1786109793.032046:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109793.032074:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933417984 00000100:00100000:0.0:1786109793.032079:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933417984 00000100:00100000:0.0:1786109793.032108:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933417600 00000100:00100000:0.0:1786109793.032110:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933417600 00000100:00100000:1.0:1786109793.032293:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109793.032495:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1786109793.032505:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3648:x1872862933417472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109793.032562:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3648:x1872862933417472:12345-0@lo:400:kworker.0 Request processed in 59us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109793.032569:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1786109793.032609:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933417728:0@lo:400:kworker.0 00000100:00100000:3.0:1786109793.032656:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933418112 00000100:00100000:3.0:1786109793.032660:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933418112 00000100:00100000:3.0:1786109793.032691:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7167 00000100:00100000:3.0:1786109793.032699:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933418112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109793.032732:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933418112:12345-0@lo:400:kworker.0 Request processed in 34us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109793.032738:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7167 00000100:00100000:1.0:1786109793.032934:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933418368:0@lo:400:kworker.0 00000100:00100000:1.0:1786109793.032957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109793.033017:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933417856 00000100:00100000:0.0:1786109793.033021:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933417856 00000100:00100000:0.0:1786109793.033047:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1786109793.033053:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933417600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109793.033082:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933417600:12345-0@lo:400:kworker.0 Request processed in 29us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109793.033087:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1786109793.033098:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1786109793.033103:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933417856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109793.033123:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933417856:12345-0@lo:400:kworker.0 Request processed in 21us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109793.033128:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1786109793.033274:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1786109793.033281:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1872862933417984:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1786109793.033287:0:187899:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1786109793.033311:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1872862933417984:12345-0@lo:400:kworker.0 Request processed in 29us (2702us total) trans 0 rc -107/-107 00000100:00100000:0.0:1786109793.033319:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00080000:0.0:1786109793.033337:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109793.033341:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109793.033369:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933417600:0@lo:400:kworker.0 00000100:00100000:0.0:1786109793.033379:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933418112:0@lo:400:kworker.0 00000100:00100000:0.0:1786109793.033387:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933417472:0@lo:400:kworker.0 00000100:00080000:0.0:1786109793.033396:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1786109793.033401:0:3648:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1786109793.033405:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1786109793.033410:0:3648:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109793.033414:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8557 00000100:00080000:0.0:1786109793.033419:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109793.033469:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0cece00 x1872862933418496/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109793.033489:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933417984:0@lo:400:kworker.0 00000100:00100000:0.0:1786109793.033513:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933418496:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1786109793.044103:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933417856:0@lo:400:kworker.0 00000100:00100000:2.0:1786109793.048031:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933418368 00000100:00100000:2.0:1786109793.048046:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933418368 00000100:00100000:2.0:1786109793.048135:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1786109793.048147:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933418368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109793.051270:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933418368:12345-0@lo:400:kworker.0 Request processed in 3115us (18300us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109793.051286:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1786109793.051443:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933418368:0@lo:400:kworker.0 00000100:00100000:1.0:1786109793.051996:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109793.052297:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109793.053018:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933418240:0@lo:400:kworker.0 00000100:00100000:3.0:1786109793.053069:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02020000:3.0:1786109793.053105:0:3646:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1786109793.053110:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1786109793.053114:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1786109793.053118:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1786109793.053123:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786109793.053127:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8628 00000100:00080000:3.0:1786109793.053134:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930a88c1d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109793.053163:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab1c23480 x1872862933418624/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109793.056332:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933418240 00000100:00100000:3.0:1786109793.056347:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933418240 00000100:00100000:3.0:1786109793.056422:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7168 00000100:00100000:3.0:1786109793.056448:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933418240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109793.056556:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933418240:12345-0@lo:400:kworker.0 Request processed in 124us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109793.056564:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7168 00000100:00100000:3.0:1786109793.056628:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933418240:0@lo:400:kworker.0 00000100:00080000:3.0:1786109793.056678:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109793.059290:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933418496 00000100:00100000:0.0:1786109793.062491:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933418496 00000100:00100000:1.0:1786109793.062688:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933417728 00000100:00100000:1.0:1786109793.062694:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933417728 00000100:00100000:1.0:1786109793.062737:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1786109793.062745:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933418496:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1786109793.062769:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109793.062843:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933418496:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 97us (10847us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109793.062853:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1786109793.062869:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1786109793.063282:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1872862933417728:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1786109793.063292:0:188678:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1786109793.063332:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1872862933417728:12345-0@lo:400:kworker.0 Request processed in 456us (11034us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786109793.063339:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1786109793.063368:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933418624:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1786109793.063406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786109793.063477:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109793.063483:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109793.063487:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933418496:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1786109793.063526:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933418624 00000100:00100000:1.0:1786109793.063529:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933418624 00000100:00100000:1.0:1786109793.063550:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786109793.063555:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1872862933418624:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1786109793.063569:0:187905:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109793.063600:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1872862933418624:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 43us (192us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109793.063606:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1786109793.063630:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109793.063634:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109793.063637:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933418624:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1786109793.063662:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1786109793.063666:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1786109793.063670:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1786109793.063675:0:3646:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786109793.063679:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8557 00000100:00080000:1.0:1786109793.063686:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff930983499000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109793.063712:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a89099500 x1872862933418752/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109793.063730:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933417728:0@lo:400:kworker.0 00000100:00100000:1.0:1786109793.063749:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933418752:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1786109793.063772:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109793.063962:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933418752 00000100:00100000:2.0:1786109793.063967:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933418752 00000100:00100000:2.0:1786109793.063998:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1786109793.064006:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933418752:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1786109793.064017:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109793.064056:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933418752:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 50us (282us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109793.064062:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00080000:2.0:1786109793.064088:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109793.064092:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109793.064095:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933418752:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1786109793.540703:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933418880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109793.540773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109793.540899:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933418880 00000100:00100000:0.0:1786109793.540906:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933418880 00000100:00100000:0.0:1786109793.540954:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5995 00000100:00100000:2.0:1786109793.541013:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109793.541023:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933419008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109793.541052:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109793.541112:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933418880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109793.541144:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109793.541249:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933418880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 285us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109793.541258:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5995 00000100:00100000:0.0:1786109793.541277:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933419008 00000100:00100000:0.0:1786109793.541281:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933419008 00000100:00100000:2.0:1786109793.541350:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933418880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109793.541482:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5996 00000100:00100000:0.0:1786109793.541490:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933419008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109793.541506:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581824 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109793.541535:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933419008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109793.541541:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5996 00000100:00100000:2.0:1786109793.541600:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933419008:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786109793.668847:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109794.692805:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109794.836093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109794.836333:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109794.836379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109794.836418:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109794.836463:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922192896 00000100:00100000:0.0:1786109794.836472:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922192896 00000100:00100000:0.0:1786109794.836532:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7169 00000100:00100000:0.0:1786109794.836542:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922192896:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109794.836609:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922192896:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 69us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109794.836615:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7169 00000100:00080000:0.0:1786109794.836646:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109794.836729:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922192512 00000100:00100000:2.0:1786109794.836734:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922192512 00000100:00100000:2.0:1786109794.836772:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:2.0:1786109794.836780:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922192512:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109794.836809:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922192512:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109794.836815:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:3.0:1786109794.837324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109794.837411:0:43920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922193024 00000100:00100000:0.0:1786109794.837415:0:43920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922193024 00000100:00100000:0.0:1786109794.837481:0:43920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7170 00000100:00100000:0.0:1786109794.837490:0:43920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922193024:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109794.837531:0:43920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922193024:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 42us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109794.837538:0:43920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7170 00000100:00080000:3.0:1786109794.837784:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109794.837991:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922192640 00000100:00100000:1.0:1786109794.837996:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922192640 00000100:00100000:1.0:1786109794.838082:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922192768 00000100:00100000:1.0:1786109794.838086:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922192768 00000100:00080000:3.0:1786109794.838115:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109794.838175:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 500 00000100:00100000:2.0:1786109794.838185:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922192640:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109794.838239:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922192640:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 56us (2155us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109794.838246:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 500 00000100:00100000:2.0:1786109794.838261:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1334 00000100:00100000:2.0:1786109794.838265:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1872862922192768:12345-192.168.203.38@tcp:400:kworker.0 00000020:00080000:2.0:1786109794.838271:0:189813:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.38@tcp 00000100:00100000:2.0:1786109794.838291:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1872862922192768:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (1873us total) trans 0 rc -107/-107 00000100:00100000:2.0:1786109794.838297:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1334 00000100:00100000:1.0:1786109794.841242:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109794.841344:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922193152 00000100:00100000:3.0:1786109794.841353:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922193152 00000100:00100000:3.0:1786109794.841471:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1335 00000100:00100000:3.0:1786109794.841479:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1872862922193152:12345-192.168.203.38@tcp:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1786109794.841502:0:188678:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1786109794.841559:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1872862922193152:12345-192.168.203.38@tcp:38:ptlrpcd_00_00.0 Request processed in 79us (337us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109794.841567:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1335 00010000:00010000:2.0:1786109795.716943:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109796.740901:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786109797.126656:0:201141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1786109797.126671:0:201141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350978 is committed 00000020:00000080:3.0:1786109797.126676:0:201141:0:(genops.c:906:class_export_put()) final put ffff930981e10800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1786109797.127126:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1786109797.127131:0:9518:0:(genops.c:906:class_export_put()) final put ffff930a87b29000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1786109797.127163:0:183576:0:(genops.c:865:class_export_destroy()) destroying export ffff930981e10800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1786109797.127243:0:183576:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930ac09cd800 for lustre-MDT0000 00000020:00000080:2.0:1786109797.127380:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930a87b29000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1786109797.127631:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a87b2a000 for lustre-OST0001 00000001:00100000:0.0:1786109797.132911:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1786109797.132921:0:194579:0:(genops.c:906:class_export_put()) final put ffff930a88c19800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1786109797.133015:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930a88c19800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1786109797.133170:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff930a88c1e800 for lustre-OST0000 00010000:00010000:0.0:1786109797.766583:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109798.170688:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109798.170695:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109798.170698:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109798.170707:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8649 00000100:00080000:2.0:1786109798.170713:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109798.170719:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff930983499000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109798.170739:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098d89b800 x1872862933419392/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109798.170771:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109798.170774:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109798.170776:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109798.170780:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8649 00000100:00080000:2.0:1786109798.170783:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109798.170787:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109798.170816:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098d899180 x1872862933419648/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109798.170825:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109798.170828:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109798.170830:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109798.170832:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8649 00000100:00080000:2.0:1786109798.170835:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1786109798.170838:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930a88c1d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109798.170850:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098d899500 x1872862933419776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109798.170895:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933419264:0@lo:400:kworker.0 00000100:00100000:2.0:1786109798.170962:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109798.171017:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933420160:0@lo:400:kworker.0 00000100:00100000:0.0:1786109798.171267:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933419264 00000100:00100000:0.0:1786109798.171276:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933419264 00000100:00100000:0.0:1786109798.171332:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1786109798.171342:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933419264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109798.171396:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933419264:12345-0@lo:400:kworker.0 Request processed in 56us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109798.171403:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00080000:0.0:1786109798.171422:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109798.171475:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933419520:0@lo:400:kworker.0 00000100:00100000:0.0:1786109798.171502:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109798.172463:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109798.172474:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933419904:0@lo:400:kworker.0 00000100:00100000:0.0:1786109798.172600:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109798.172635:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933419392:0@lo:38:kworker.0 00000100:00100000:0.0:1786109798.172664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109798.172683:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933419648:0@lo:38:kworker.0 00000100:00100000:0.0:1786109798.172707:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109798.172725:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933419776:0@lo:38:kworker.0 00000100:00100000:0.0:1786109798.172809:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109798.172843:0:43916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933419904 00000100:00100000:0.0:1786109798.172849:0:43916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933419904 00000100:00100000:0.0:1786109798.172892:0:43916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7171 00000100:00100000:0.0:1786109798.172902:0:43916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933419904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109798.172948:0:43916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933419904:12345-0@lo:400:kworker.0 Request processed in 48us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109798.172955:0:43916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7171 00000100:00100000:0.0:1786109798.172976:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933419520 00000100:00100000:0.0:1786109798.172980:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933419520 00000100:00100000:0.0:1786109798.173005:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933419392 00000100:00100000:0.0:1786109798.173009:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933419392 00000100:00100000:0.0:1786109798.173692:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933419648 00000100:00100000:0.0:1786109798.173698:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933419648 00000100:00100000:0.0:1786109798.173721:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1786109798.173731:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933419520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109798.173777:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933419520:12345-0@lo:400:kworker.0 Request processed in 48us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109798.173784:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1786109798.174239:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109798.174299:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933419264:0@lo:400:kworker.0 00000100:00100000:2.0:1786109798.174316:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786109798.174325:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933419136:0@lo:400:kworker.0 00000100:00100000:2.0:1786109798.174356:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109798.174383:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933420032:0@lo:400:kworker.0 00000100:00100000:2.0:1786109798.174405:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109798.174453:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933420160 00000100:00100000:2.0:1786109798.174458:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933420160 00000100:00100000:2.0:1786109798.174484:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1786109798.174492:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933420160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109798.174993:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1786109798.175000:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933419392:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109798.175021:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109798.175291:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933419392:12345-0@lo:38:kworker.0 Request processed in 290us (2625us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109798.175298:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1786109798.175315:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1786109798.175320:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933419648:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1786109798.175331:0:187899:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109798.175356:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933419648:12345-0@lo:38:kworker.0 Request processed in 34us (2648us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109798.175362:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1786109798.175382:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933420032 00000100:00100000:0.0:1786109798.175386:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933420032 00000100:00100000:0.0:1786109798.175416:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7172 00000100:00100000:0.0:1786109798.175423:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933420032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109798.175477:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933420032:12345-0@lo:400:kworker.0 Request processed in 55us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109798.175484:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7172 00000100:00100000:2.0:1786109798.176672:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933420160:12345-0@lo:400:kworker.0 Request processed in 2176us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109798.176683:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1786109798.176719:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933419136 00000100:00100000:2.0:1786109798.176725:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933419136 00000100:00100000:2.0:1786109798.176757:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1786109798.176764:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3647:x1872862933419136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109798.177642:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3647:x1872862933419136:12345-0@lo:400:kworker.0 Request processed in 873us (3280us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109798.177653:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1786109798.177747:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933419136:0@lo:400:kworker.0 00000100:00100000:2.0:1786109798.177763:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933420032:0@lo:400:kworker.0 00000100:00100000:2.0:1786109798.177777:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933420160:0@lo:400:kworker.0 00000100:00100000:2.0:1786109798.178141:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933419776 00000100:00100000:2.0:1786109798.178148:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933419776 00000100:00100000:2.0:1786109798.178653:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1786109798.178660:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1872862933419776:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109798.178684:0:199402:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109798.178745:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1872862933419776:12345-0@lo:38:kworker.0 Request processed in 84us (5951us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109798.178752:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1786109798.178950:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109798.178956:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786109798.178959:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109798.178990:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109798.178996:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109798.178999:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933419392:0@lo:38:kworker.0 00000100:00080000:1.0:1786109798.179008:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109798.179011:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109798.179013:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933419648:0@lo:38:kworker.0 00000100:00080000:1.0:1786109798.179021:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1786109798.179647:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933419904:0@lo:400:kworker.0 00000100:00100000:0.0:1786109798.179667:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933419520:0@lo:400:kworker.0 00000100:00080000:1.0:1786109798.180120:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109798.180124:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933419776:0@lo:38:kworker.0 00000100:00100000:3.0:1786109798.661083:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786109798.661108:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933420288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109798.661179:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109798.661335:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933420288 00000100:00100000:2.0:1786109798.661344:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933420288 00000100:00100000:2.0:1786109798.661397:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5997 00000100:00100000:2.0:1786109798.661406:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933420288:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109798.661463:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933420416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109798.661491:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109798.661554:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933420416 00000100:00100000:0.0:1786109798.661559:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933420416 00000100:00100000:0.0:1786109798.661592:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5998 00000100:00100000:0.0:1786109798.661599:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933420416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109798.661618:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581824 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109798.661661:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933420416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109798.661674:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5998 00000100:00100000:3.0:1786109798.661745:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a89099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933420416:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786109798.661917:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109798.662059:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933420288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 652us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109798.662067:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5997 00000100:00100000:3.0:1786109798.662874:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933420288:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786109798.788716:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109799.812593:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109799.953745:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109799.953789:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109799.953827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109799.953865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109799.953908:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922193280 00000100:00100000:0.0:1786109799.953918:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922193280 00000100:00100000:0.0:1786109799.953975:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:0.0:1786109799.953986:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922193280:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109799.954047:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922193280:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 63us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109799.954054:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:1.0:1786109799.954130:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922193408 00000100:00100000:1.0:1786109799.954135:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922193408 00000100:00100000:1.0:1786109799.954185:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 504 00000100:00100000:1.0:1786109799.954207:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922193408:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109799.954242:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:2402:x1872862922193408:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 50us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109799.954250:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 504 00000100:00100000:1.0:1786109799.954288:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922193792 00000100:00100000:1.0:1786109799.954292:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922193792 00000100:00100000:1.0:1786109799.954321:0:43915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922193664 00000100:00100000:1.0:1786109799.954324:0:43915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922193664 00000100:00100000:1.0:1786109799.954347:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7173 00000100:00100000:1.0:1786109799.954354:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922193792:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109799.954382:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922193792:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109799.954388:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7173 00000100:00100000:1.0:1786109799.954400:0:43915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7174 00000100:00100000:1.0:1786109799.954406:0:43915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922193664:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109799.954427:0:43915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922193664:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 21us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109799.954461:0:43915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7174 00000100:00080000:0.0:1786109799.954592:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109799.954596:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109799.954599:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109799.955651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109799.955751:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922193536 00000100:00100000:2.0:1786109799.955757:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922193536 00000100:00100000:2.0:1786109799.955840:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1338 00000100:00100000:2.0:1786109799.955847:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922193536:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:2.0:1786109799.955869:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109799.955960:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922193536:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 112us (316us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109799.955968:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1338 00010000:00010000:0.0:1786109800.837038:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109801.860735:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109802.886109:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786109803.268699:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109803.268705:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109803.268709:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109803.268717:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8654 00000100:00080000:2.0:1786109803.268723:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109803.268730:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff930983499000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109803.268751:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098d899180 x1872862933420800/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109803.268797:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109803.268801:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109803.268802:0:171804:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109803.268806:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8654 00000100:00080000:2.0:1786109803.268809:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109803.268826:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109803.268837:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098d89a300 x1872862933421056/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109803.268845:0:171804:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109803.268848:0:171804:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109803.268849:0:171804:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109803.268852:0:171804:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8654 00000100:00080000:2.0:1786109803.268855:0:171804:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786109803.268858:0:171804:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930a88c1d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109803.268870:0:171804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93098d899f80 x1872862933421184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109803.268949:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933421312:0@lo:400:kworker.0 00000100:00100000:2.0:1786109803.269042:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109803.269115:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109803.269135:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933420928:0@lo:400:kworker.0 00000100:00100000:2.0:1786109803.269189:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109803.269230:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933420928 00000100:00100000:2.0:1786109803.269237:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933420928 00000100:00100000:2.0:1786109803.269287:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1786109803.269298:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933420928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109803.269579:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933420928:12345-0@lo:400:kworker.0 Request processed in 282us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109803.269586:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1786109803.269628:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933420928:0@lo:400:kworker.0 00000100:00100000:0.0:1786109803.279355:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933420672:0@lo:400:kworker.0 00000100:00100000:0.0:1786109803.279452:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109803.279497:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109803.279506:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933421568:0@lo:400:kworker.0 00000100:00100000:0.0:1786109803.279531:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109803.279584:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786109803.279591:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933420544:0@lo:400:kworker.0 00000100:00100000:0.0:1786109803.279620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109803.279646:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933421440:0@lo:400:kworker.0 00000100:00100000:0.0:1786109803.279670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109803.279685:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933420544 00000100:00100000:2.0:1786109803.279694:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933420544 00000100:00100000:2.0:1786109803.279748:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1786109803.279759:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3647:x1872862933420544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109803.279827:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3647:x1872862933420544:12345-0@lo:400:kworker.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109803.279835:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1786109803.280145:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933420544:0@lo:400:kworker.0 00000100:00100000:1.0:1786109803.283346:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933420800:0@lo:38:kworker.0 00000100:00100000:1.0:1786109803.283484:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109803.283536:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933421056:0@lo:38:kworker.0 00000100:00100000:1.0:1786109803.283560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109803.283630:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933421184:0@lo:38:kworker.0 00000100:00100000:1.0:1786109803.283656:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109803.283703:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933421312 00000100:00100000:1.0:1786109803.283710:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933421312 00000100:00100000:1.0:1786109803.283761:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933421440 00000100:00100000:1.0:1786109803.283765:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933421440 00000100:00100000:1.0:1786109803.283789:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7175 00000100:00100000:1.0:1786109803.283798:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933421312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109803.283854:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933421312:12345-0@lo:400:kworker.0 Request processed in 57us (14812us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109803.283860:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7175 00000100:00100000:1.0:1786109803.283875:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7176 00000100:00100000:1.0:1786109803.283883:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933421440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109803.284079:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933420672 00000100:00100000:2.0:1786109803.284085:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933420672 00000100:00100000:2.0:1786109803.284122:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933421568 00000100:00100000:2.0:1786109803.284126:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933421568 00000100:00100000:2.0:1786109803.284139:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933420800 00000100:00100000:2.0:1786109803.284142:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933420800 00000100:00100000:2.0:1786109803.284151:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933421056 00000100:00100000:2.0:1786109803.284154:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933421056 00000100:00100000:2.0:1786109803.284165:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1786109803.284186:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933420672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109803.284240:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933420672:12345-0@lo:400:kworker.0 Request processed in 56us (4787us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109803.284246:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1786109803.284263:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1786109803.284269:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933421568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109803.284301:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872862933421568:12345-0@lo:400:kworker.0 Request processed in 32us (4769us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109803.284306:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1786109803.284319:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1786109803.284323:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933420800:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109803.285457:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109803.285510:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933420800:12345-0@lo:38:kworker.0 Request processed in 1184us (2025us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109803.285520:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1786109803.285546:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:2.0:1786109803.285551:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933421056:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1786109803.285564:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109803.285589:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1872862933421056:12345-0@lo:38:kworker.0 Request processed in 37us (2028us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109803.285598:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1786109803.285640:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933421440:12345-0@lo:400:kworker.0 Request processed in 1758us (5969us total) trans 0 rc 0/0 00000100:00080000:2.0:1786109803.285644:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1786109803.285647:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7176 00000100:00080000:2.0:1786109803.285649:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109803.285653:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933420800:0@lo:38:kworker.0 00000100:00080000:2.0:1786109803.285661:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786109803.285665:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786109803.285668:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933421056:0@lo:38:kworker.0 00000100:00080000:1.0:1786109803.285698:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786109803.285703:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109803.285706:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109803.285721:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933421312:0@lo:400:kworker.0 00000100:00100000:0.0:1786109803.287992:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933421440:0@lo:400:kworker.0 00000100:00100000:0.0:1786109803.288009:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933420672:0@lo:400:kworker.0 00000100:00100000:2.0:1786109803.288327:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933421184 00000100:00100000:2.0:1786109803.288335:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933421184 00000100:00100000:2.0:1786109803.288375:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786109803.288383:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1872862933421184:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1786109803.288488:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872862933421568:0@lo:400:kworker.0 00010000:00020000:2.0:1786109803.288731:0:199402:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109803.288918:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1872862933421184:12345-0@lo:38:kworker.0 Request processed in 533us (5259us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109803.288926:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1786109803.288986:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109803.288992:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109803.288996:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933421184:0@lo:38:kworker.0 00000100:00100000:2.0:1786109803.780834:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933421696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109803.780943:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109803.782396:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109803.782410:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933421824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109803.782479:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109803.783403:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933421696 00000100:00100000:3.0:1786109803.783415:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933421696 00000100:00100000:1.0:1786109803.783653:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933421824 00000100:00100000:1.0:1786109803.783658:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933421824 00000100:00100000:1.0:1786109803.783697:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5999 00000100:00100000:1.0:1786109803.783706:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933421696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786109803.783738:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109803.783799:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933421696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109803.783806:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5999 00000100:00100000:1.0:1786109803.783824:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6000 00000100:00100000:1.0:1786109803.783830:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933421824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109803.783883:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581824 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109803.783913:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933421824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109803.783919:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6000 00000100:00100000:2.0:1786109803.784469:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a8909b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933421824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109803.784488:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933421696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786109803.909384:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109804.941481:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109805.133636:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109805.133670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109805.133692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109805.133714:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109805.133734:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109805.133759:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922193920 00000100:00100000:3.0:1786109805.133769:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922193920 00000100:00100000:3.0:1786109805.133818:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:3.0:1786109805.133827:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922193920:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109805.133897:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2402:x1872862922193920:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109805.133904:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:3.0:1786109805.133938:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922194304 00000100:00100000:3.0:1786109805.133941:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922194304 00000100:00100000:3.0:1786109805.133972:0:43918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922194432 00000100:00100000:3.0:1786109805.133975:0:43918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922194432 00000100:00100000:3.0:1786109805.133995:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7177 00000100:00100000:3.0:1786109805.134002:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922194304:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109805.134029:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fac74500-4523-4794-af20-dfdcdfae19c1+5:2402:x1872862922194304:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109805.134036:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7177 00000100:00100000:3.0:1786109805.134049:0:43918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7178 00000100:00100000:3.0:1786109805.134055:0:43918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922194432:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109805.134079:0:43918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fac74500-4523-4794-af20-dfdcdfae19c1+5:2403:x1872862922194432:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109805.134085:0:43918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7178 00000100:00100000:2.0:1786109805.135238:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922194048 00000100:00100000:2.0:1786109805.135248:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922194048 00000100:00100000:2.0:1786109805.135297:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922194176 00000100:00100000:2.0:1786109805.135301:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922194176 00000100:00100000:2.0:1786109805.135323:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 508 00000100:00100000:2.0:1786109805.135332:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+7:2403:x1872862922194048:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109805.135379:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+7:2403:x1872862922194048:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 49us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109805.135386:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 508 00000100:00100000:2.0:1786109805.135401:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1341 00000100:00100000:2.0:1786109805.135405:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922194176:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:2.0:1786109805.135424:0:189813:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786109805.135468:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1872862922194176:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 60us (1775us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786109805.135474:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1341 00000100:00080000:2.0:1786109805.135514:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786109805.135518:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786109805.135520:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786109805.974491:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109806.981602:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109808.005005:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109808.388843:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933421952:0@lo:400:kworker.0 00000100:00100000:0.0:1786109808.388922:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109808.388981:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109808.388986:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109808.388989:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109808.388995:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8659 00000100:00080000:2.0:1786109808.389000:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786109808.389006:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff930983499000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109808.389027:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab8f2b800 x1872862933422208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109808.389061:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109808.389066:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109808.389067:0:192991:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109808.389071:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8659 00000100:00080000:2.0:1786109808.389074:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1786109808.389078:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109808.389089:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab8f29180 x1872862933422464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109808.389099:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109808.389101:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109808.389103:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109808.389106:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8659 00000100:00080000:2.0:1786109808.389108:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:1.0:1786109808.389260:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933422080:0@lo:400:kworker.0 00000100:00100000:1.0:1786109808.389295:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109808.389335:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933422208:0@lo:38:kworker.0 00000100:00100000:1.0:1786109808.389360:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109808.389379:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933422464:0@lo:38:kworker.0 00000100:00100000:1.0:1786109808.389400:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109808.389457:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933422080 00000100:00100000:1.0:1786109808.389464:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933422080 00000100:00100000:1.0:1786109808.389514:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933422208 00000100:00100000:1.0:1786109808.389518:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933422208 00000100:00100000:1.0:1786109808.389535:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933422464 00000100:00100000:1.0:1786109808.389538:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933422464 00000100:00100000:1.0:1786109808.389555:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1786109808.389564:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933422080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109808.389617:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933422080:12345-0@lo:400:kworker.0 Request processed in 55us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109808.389625:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1786109808.389641:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1786109808.389646:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933422208:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109808.389666:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109808.389699:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a89099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933422208:12345-0@lo:38:kworker.0 Request processed in 52us (338us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109808.389705:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1786109808.389717:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1786109808.389722:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a8909b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933422464:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1786109808.389730:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1786109808.389754:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a8909b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933422464:12345-0@lo:38:kworker.0 Request processed in 31us (353us total) trans 0 rc -19/-19 00000100:00100000:1.0:1786109808.389759:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00080000:1.0:1786109808.389778:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109808.389818:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933422080:0@lo:400:kworker.0 00000100:00080000:1.0:1786109808.389849:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109808.389854:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109808.389857:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933422208:0@lo:38:kworker.0 00000100:00080000:1.0:1786109808.389866:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109808.389869:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109808.389871:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933422464:0@lo:38:kworker.0 00000100:00100000:1.0:1786109808.389913:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933422336:0@lo:400:kworker.0 00000100:00100000:1.0:1786109808.389939:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109808.389965:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933422336 00000100:00100000:1.0:1786109808.389968:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933422336 00000100:00100000:1.0:1786109808.389995:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1786109808.390002:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933422336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109808.390035:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933422336:12345-0@lo:400:kworker.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109808.390041:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00080000:1.0:1786109808.390056:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109808.390073:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933422336:0@lo:400:kworker.0 00000100:00080000:2.0:1786109808.390163:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930a88c1d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1786109808.390238:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933421952 00000100:00100000:3.0:1786109808.390243:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933421952 00000100:00100000:3.0:1786109808.390286:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1786109808.390293:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a86928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3646:x1872862933421952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109808.390330:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a86928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:3646:x1872862933421952:12345-0@lo:400:kworker.0 Request processed in 38us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109808.390336:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1786109808.390536:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933421952:0@lo:400:kworker.0 00000100:00100000:2.0:1786109808.390652:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab8f2a680 x1872862933422592/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109808.390700:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933422592:0@lo:38:kworker.0 00000100:00100000:1.0:1786109808.390730:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109808.390795:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933422592 00000100:00100000:3.0:1786109808.390799:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933422592 00000100:00100000:3.0:1786109808.390833:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786109808.390839:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1872862933422592:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1786109808.390853:0:187904:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109808.390973:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933422720:0@lo:400:kworker.0 00000100:00100000:0.0:1786109808.391005:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109808.391083:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933422848:0@lo:400:kworker.0 00000100:00100000:2.0:1786109808.391111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109808.391146:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109808.391153:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933422976:0@lo:400:kworker.0 00000100:00100000:2.0:1786109808.391176:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109808.391213:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933422720 00000100:00100000:2.0:1786109808.391218:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933422720 00000100:00100000:2.0:1786109808.391252:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933422848 00000100:00100000:2.0:1786109808.391255:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933422848 00000100:00100000:2.0:1786109808.391275:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7179 00000100:00100000:2.0:1786109808.391281:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933422720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109808.391363:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1872862933422592:12345-0@lo:38:kworker.0 Request processed in 522us (631us total) trans 0 rc -19/-19 00000100:00100000:3.0:1786109808.391370:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786109808.391392:0:179239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7180 00000100:00100000:3.0:1786109808.391400:0:179239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933422848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786109808.391453:0:179239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_021:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933422848:12345-0@lo:400:kworker.0 Request processed in 55us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109808.391460:0:179239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7180 00000100:00100000:3.0:1786109808.391493:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933422848:0@lo:400:kworker.0 00000100:00100000:2.0:1786109808.391612:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933422720:12345-0@lo:400:kworker.0 Request processed in 330us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109808.391620:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7179 00000100:00100000:2.0:1786109808.391646:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933422976 00000100:00100000:2.0:1786109808.391650:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933422976 00000100:00100000:2.0:1786109808.391721:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1786109808.391729:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933422976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109808.391766:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933422976:12345-0@lo:400:kworker.0 Request processed in 38us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109808.391772:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1786109808.391825:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933422976:0@lo:400:kworker.0 00000100:00080000:3.0:1786109808.391849:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109808.391853:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109808.391916:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786109808.391921:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786109808.391924:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933422592:0@lo:38:kworker.0 00000100:00100000:0.0:1786109808.391994:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933422720:0@lo:400:kworker.0 00000100:00100000:2.0:1786109808.901938:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933423104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109808.902005:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109808.902068:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933423104 00000100:00100000:2.0:1786109808.902075:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933423104 00000100:00100000:2.0:1786109808.902118:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6001 00000100:00100000:2.0:1786109808.902127:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933423104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786109808.902167:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109808.902212:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933423104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109808.902219:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6001 00000100:00100000:2.0:1786109808.902263:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933423104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786109808.902462:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786109808.902472:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933423232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109808.902504:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109808.902832:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933423232 00000100:00100000:0.0:1786109808.902837:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933423232 00000100:00100000:0.0:1786109808.902877:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6002 00000100:00100000:0.0:1786109808.902884:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab2fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933423232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109808.902901:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8581824 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109808.902934:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab2fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933423232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109808.902940:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6002 00000100:00100000:3.0:1786109808.903202:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933423232:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786109809.034622:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786109810.057089:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109810.191407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109810.191514:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109810.191539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109810.191639:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109810.191669:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922194816 00000100:00100000:0.0:1786109810.191677:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922194816 00000100:00100000:0.0:1786109810.191711:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922194688 00000100:00100000:0.0:1786109810.191714:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922194688 00000100:00100000:0.0:1786109810.191755:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 512 00000100:00100000:0.0:1786109810.191767:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2404:x1872862922194688:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109810.191834:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2404:x1872862922194688:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109810.191841:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 512 00000100:00100000:0.0:1786109810.191856:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1344 00000100:00100000:0.0:1786109810.191861:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922194816:12345-192.168.203.38@tcp:38:kworker.0 00010000:00020000:0.0:1786109810.191884:0:187900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1786109810.191908:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1872862922194816:12345-192.168.203.38@tcp:38:kworker.0 Request processed in 46us (513us total) trans 0 rc -19/-19 00000100:00100000:0.0:1786109810.191915:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1344 00000100:00080000:0.0:1786109810.191951:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109810.192183:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922194560 00000100:00100000:2.0:1786109810.192188:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922194560 00000100:00100000:2.0:1786109810.192229:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:2.0:1786109810.192236:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2404:x1872862922194560:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109810.192277:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2404:x1872862922194560:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 42us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109810.192284:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:1.0:1786109810.192951:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109810.193048:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922194944 00000100:00100000:3.0:1786109810.193053:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922194944 00000100:00100000:3.0:1786109810.193110:0:43913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922195072 00000100:00100000:3.0:1786109810.193114:0:43913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922195072 00000100:00100000:3.0:1786109810.193150:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23201 00000100:00100000:3.0:1786109810.193159:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fac74500-4523-4794-af20-dfdcdfae19c1+5:2401:x1872862922194944:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:3.0:1786109810.193178:0:43913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca38ecb 00000100:00080000:3.0:1786109810.193186:0:43913:0:(import.c:65:import_set_state_nolock()) ffff93098666e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786109810.193223:0:43913:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 9, last_transno is 38654705690 00000100:00100000:3.0:1786109810.193361:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fac74500-4523-4794-af20-dfdcdfae19c1+2:2401:x1872862922194944:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 204us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109810.193368:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23201 00000100:00100000:3.0:1786109810.193383:0:43913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23202 00000100:00100000:3.0:1786109810.193390:0:43913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fac74500-4523-4794-af20-dfdcdfae19c1+5:2401:x1872862922195072:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:3.0:1786109810.193401:0:43913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb52b77d7ca38ed2 00000100:00080000:3.0:1786109810.193406:0:43913:0:(import.c:65:import_set_state_nolock()) ffff93098666a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786109810.193449:0:43913:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294975848 00000100:00100000:3.0:1786109810.193516:0:43913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fac74500-4523-4794-af20-dfdcdfae19c1+2:2401:x1872862922195072:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 125us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109810.193523:0:43913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23202 00010000:00010000:3.0:1786109810.193541:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109810.193546:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786109810.193706:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109810.193710:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786109811.077728:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1786109811.977939:0:202488:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1786109811.977945:0:202488:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1786109811.977947:0:202488:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1786109811.978080:0:202488:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff930a89103000 00000020:01000004:3.0:1786109811.978101:0:202488:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1786109811.979419:0:202488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1786109811.979470:0:202488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff930ab7c4cd40) 00000020:00000080:3.0:1786109811.979503:0:202488:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1786109812.076141:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1786109812.077494:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1786109812.078026:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1786109812.078239:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1786109812.078418:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1786109812.079029:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1786109812.079248:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1786109812.079493:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1786109812.079703:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1786109812.079922:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1786109812.080161:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1786109812.080382:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1786109812.080760:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1786109812.080956:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1786109812.086566:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.086795:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.087309:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.087538:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.087725:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.087918:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.088099:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.088495:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.088695:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.088881:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.089062:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.089354:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.089582:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.089809:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.090045:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.090273:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.090502:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.090707:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.090908:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.091100:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.091337:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.091569:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.091799:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.091990:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.092191:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.092395:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.092662:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.092819:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.093008:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.093230:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1786109812.093421:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1786109812.093663:0:202488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00080000:01000000:2.0:1786109812.094427:0:202488:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1786109812.094761:0:202488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1786109812.094770:0:202488:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786109812.094782:0:202488:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdb52b77d7ca38ee0 00000020:01000004:2.0:1786109812.094788:0:202488:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1786109812.094812:0:202488:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1786109812.094816:0:202488:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1786109812.094821:0:202488:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1786109812.094846:0:202488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1786109812.094850:0:202488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1786109812.099303:0:202488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786109812.099401:0:202488:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.138@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1786109812.099407:0:202488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786109812.099408:0:202488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1786109812.099410:0:202488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109812.099411:0:202488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109812.099412:0:202488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109812.099413:0:202488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109812.099414:0:202488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109812.099416:0:202488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109812.099417:0:202488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786109812.099421:0:202488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1786109812.099423:0:202488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786109812.099425:0:202488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1786109812.099426:0:202488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109812.099427:0:202488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109812.099450:0:202488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109812.099451:0:202488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109812.099452:0:202488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109812.099453:0:202488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109812.099454:0:202488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786109812.099479:0:202488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1786109812.099498:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933423360:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786109812.099562:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.099669:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309865463c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109812.099719:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933423360 00000100:00100000:1.0:1786109812.099726:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933423360 00000100:00100000:1.0:1786109812.099808:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1786109812.099818:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:202488:x1872862933423360:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1786109812.099846:0:201148:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1786109812.099849:0:201148:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1786109812.099857:0:201148:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1786109812.100204:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:202488:x1872862933423360:12345-0@lo:253:mount.lustre.0 Request processed in 386us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109812.100212:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1786109812.100296:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933423360:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786109812.100306:0:202488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1786109812.100309:0:202488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786109812.100310:0:202488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1786109812.100311:0:202488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786109812.100312:0:202488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786109812.100313:0:202488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786109812.100314:0:202488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786109812.100316:0:202488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786109812.100317:0:202488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786109812.100318:0:202488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1786109812.100346:0:202488:0:(tgt_mount.c:101:server_register_mount()) register mount ffff930a89103000 from lustre-MDT0001 10000000:01000000:0.0:1786109812.100369:0:202488:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1786109812.100372:0:202488:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1786109812.100380:0:202488:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff930a8a73cd40 local copy 00010000:00010000:0.0:1786109812.100389:0:202488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361800/0xdb52b77d7ca38bf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bfa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109812.100485:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933423488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109812.100511:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786109812.100681:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109812.100734:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933423488 00000100:00100000:2.0:1786109812.100740:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933423488 00000100:00100000:2.0:1786109812.100764:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786109812.100772:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:202488:x1872862933423488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109812.100829:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:202488:x1872862933423488:12345-0@lo:501:mount.lustre.0 Request processed in 58us (316us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786109812.100835:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1786109812.100923:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1786109812.100937:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933423488:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1786109812.100949:0:202488:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1786109812.100966:0:202488:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1786109812.100972:0:202488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9361800/0xdb52b77d7ca38bf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bfa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.100979:0:202488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9361800/0xdb52b77d7ca38bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38bfa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109812.101008:0:202488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff930a89103000 10000000:01000000:0.0:1786109812.101012:0:202488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1786109812.101017:0:202488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff930a89103000 10000000:01000000:0.0:1786109812.101020:0:202488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1786109812.101022:0:202488:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff930a89103000 from 1 10000000:01000000:0.0:1786109812.101025:0:202488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1786109812.101045:0:202488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3000/0xdb52b77d7ca38ee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.101052:0:202488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3000/0xdb52b77d7ca38ee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.101061:0:202488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3000/0xdb52b77d7ca38ee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109812.101074:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933423616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109812.101098:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.101157:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.101199:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933423616 00000100:00100000:2.0:1786109812.101203:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933423616 00000100:00100000:2.0:1786109812.101268:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786109812.101275:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+19:202488:x1872862933423616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109812.101284:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109812.101296:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930a97836e00/0xdb52b77d7ca38eee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38ee7 expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.101316:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a97836e00/0xdb52b77d7ca38eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38ee7 expref: 20 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.101326:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930a97836e00/0xdb52b77d7ca38eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38ee7 expref: 20 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.101345:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a97836e00, rc 0) 00000100:00100000:2.0:1786109812.101484:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:202488:x1872862933423616:12345-0@lo:101:mount.lustre.0 Request processed in 209us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.101490:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1786109812.101571:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933423616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109812.101582:0:202488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3000/0xdb52b77d7ca38ee7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38eee expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.101590:0:202488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3000/0xdb52b77d7ca38ee7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38eee expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109812.101603:0:202488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1786109812.101618:0:202488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3000/0xdb52b77d7ca38ee7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38eee expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.101625:0:202488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3000/0xdb52b77d7ca38ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38eee expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109812.101631:0:202488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1786109812.101635:0:202488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786109812.101640:0:202488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff930a89103000 10000000:01000000:0.0:1786109812.101642:0:202488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1786109812.101645:0:202488:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1786109812.101648:0:202488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1786109812.101661:0:202488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca38ef5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.101667:0:202488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca38ef5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.101674:0:202488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca38ef5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109812.101685:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933423744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109812.101709:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.101773:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.101811:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933423744 00000100:00100000:2.0:1786109812.101815:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933423744 00000100:00100000:2.0:1786109812.101845:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1786109812.101851:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+20:202488:x1872862933423744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109812.101858:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109812.101866:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930a97836c00/0xdb52b77d7ca38efc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38ef5 expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.101879:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a97836c00/0xdb52b77d7ca38efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38ef5 expref: 21 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.101886:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930a97836c00/0xdb52b77d7ca38efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38ef5 expref: 21 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.101892:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a97836c00, rc 0) 00000100:00100000:2.0:1786109812.101932:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:202488:x1872862933423744:12345-0@lo:101:mount.lustre.0 Request processed in 81us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.101937:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786109812.101999:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933423744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109812.102014:0:202488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca38ef5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38efc expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.102021:0:202488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca38ef5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38efc expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109812.102195:0:202488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 46 count 46 00000040:00080000:0.0:1786109812.102648:0:202488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786109812.106156:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].1, 224 off8416 00000040:00080000:0.0:1786109812.106213:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].2, 136 off8552 00000040:00080000:0.0:1786109812.106232:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].3, 176 off8728 00000040:00080000:0.0:1786109812.106250:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].4, 224 off8952 00000040:00080000:0.0:1786109812.106266:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].5, 224 off9176 00000040:00080000:0.0:1786109812.106284:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].6, 120 off9296 00000040:00080000:0.0:1786109812.106300:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].7, 112 off9408 00000040:00080000:0.0:1786109812.106314:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].8, 160 off9568 00000040:00080000:0.0:1786109812.106329:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].9, 224 off9792 00000040:00080000:0.0:1786109812.106420:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].10, 224 off10016 00000040:00080000:0.0:1786109812.106512:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].11, 88 off10104 00000040:00080000:0.0:1786109812.106532:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].12, 144 off10248 00000040:00080000:0.0:1786109812.106546:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].13, 152 off10400 00000040:00080000:0.0:1786109812.106560:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].14, 168 off10568 00000040:00080000:0.0:1786109812.106575:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].15, 224 off10792 00000040:00080000:0.0:1786109812.106589:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].16, 224 off11016 00000040:00080000:0.0:1786109812.106604:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].17, 80 off11096 00000040:00080000:0.0:1786109812.106617:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].18, 224 off11320 00000040:00080000:0.0:1786109812.106631:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].19, 224 off11544 00000040:00080000:0.0:1786109812.106644:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].20, 160 off11704 00000040:00080000:0.0:1786109812.106659:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].21, 224 off11928 00000040:00080000:0.0:1786109812.106674:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].22, 224 off12152 00000040:00080000:0.0:1786109812.106687:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].23, 80 off12232 00000040:00080000:0.0:1786109812.106701:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].24, 224 off12456 00000040:00080000:0.0:1786109812.106714:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].25, 224 off12680 00000040:00080000:0.0:1786109812.106727:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].26, 88 off12768 00000040:00080000:0.0:1786109812.106742:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].27, 144 off12912 00000040:00080000:0.0:1786109812.106755:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].28, 152 off13064 00000040:00080000:0.0:1786109812.106769:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].29, 136 off13200 00000040:00080000:0.0:1786109812.106784:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].30, 224 off13424 00000040:00080000:0.0:1786109812.106799:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].31, 224 off13648 00000040:00080000:0.0:1786109812.106813:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].32, 80 off13728 00000040:00080000:0.0:1786109812.106828:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].33, 224 off13952 00000040:00080000:0.0:1786109812.106841:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].34, 224 off14176 00000040:00080000:0.0:1786109812.106855:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].35, 88 off14264 00000040:00080000:0.0:1786109812.106869:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].36, 144 off14408 00000040:00080000:0.0:1786109812.106883:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].37, 152 off14560 00000040:00080000:0.0:1786109812.106895:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].38, 136 off14696 00000040:00080000:0.0:1786109812.106909:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].39, 224 off14920 00000040:00080000:0.0:1786109812.106923:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].40, 224 off15144 00000040:00080000:0.0:1786109812.106938:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].41, 80 off15224 00000040:00080000:0.0:1786109812.106952:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].42, 224 off15448 00000040:00080000:0.0:1786109812.106966:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].43, 224 off15672 00000040:00080000:0.0:1786109812.106981:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].44, 120 off15792 00000040:00080000:0.0:1786109812.107009:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2b:0x0].45, 224 off16016 00000040:00080000:0.0:1786109812.107016:0:202488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 45 count 46 00000100:00100000:0.0:1786109812.107137:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933423872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109812.107203:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.107283:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.107326:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933423872 00000100:00100000:2.0:1786109812.107393:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933423872 00000100:00100000:2.0:1786109812.107651:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1786109812.107662:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97c44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:202488:x1872862933423872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786109812.107826:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97c44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:202488:x1872862933423872:12345-0@lo:501:mount.lustre.0 Request processed in 165us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.107834:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786109812.108049:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933423872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109812.108081:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933424000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109812.108137:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.108200:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.108232:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933424000 00000100:00100000:2.0:1786109812.108237:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933424000 00000100:00100000:2.0:1786109812.108270:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1786109812.108278:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930983472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:202488:x1872862933424000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109812.108574:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930983472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:202488:x1872862933424000:12345-0@lo:503:mount.lustre.0 Request processed in 297us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.108582:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1786109812.108664:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933424000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1786109812.109058:0:202488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786109812.109134:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933424128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786109812.109174:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.109247:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1786109812.109281:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933424128 00000100:00100000:3.0:1786109812.109286:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933424128 00000100:00100000:3.0:1786109812.109422:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1786109812.109466:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:202488:x1872862933424128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109812.110199:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:202488:x1872862933424128:12345-0@lo:502:mount.lustre.0 Request processed in 767us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109812.110207:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1786109812.110293:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933424128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786109812.110559:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].1, 224 off8416 00000040:00080000:0.0:1786109812.110592:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].2, 136 off8552 00000040:00080000:0.0:1786109812.110608:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].3, 176 off8728 00000040:00080000:0.0:1786109812.110621:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].4, 224 off8952 00000040:00080000:0.0:1786109812.110636:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].5, 224 off9176 00000040:00080000:0.0:1786109812.110649:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].6, 120 off9296 00000040:00080000:0.0:1786109812.110664:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].7, 112 off9408 00000040:00080000:0.0:1786109812.110678:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].8, 160 off9568 00000040:00080000:0.0:1786109812.110690:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].9, 224 off9792 00000040:00080000:0.0:1786109812.110703:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].10, 224 off10016 00000040:00080000:0.0:1786109812.110717:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].11, 88 off10104 00000040:00080000:0.0:1786109812.110732:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].12, 144 off10248 00000040:00080000:0.0:1786109812.110745:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].13, 152 off10400 00000040:00080000:0.0:1786109812.110757:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].14, 168 off10568 00000040:00080000:0.0:1786109812.110771:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].15, 224 off10792 00000040:00080000:0.0:1786109812.110788:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].16, 224 off11016 00000040:00080000:0.0:1786109812.110802:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].17, 80 off11096 00000040:00080000:0.0:1786109812.110816:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].18, 224 off11320 00000040:00080000:0.0:1786109812.110830:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].19, 224 off11544 00000040:00080000:0.0:1786109812.110843:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].20, 160 off11704 00000040:00080000:0.0:1786109812.110856:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].21, 224 off11928 00000040:00080000:0.0:1786109812.110871:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].22, 224 off12152 00000040:00080000:0.0:1786109812.110886:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].23, 80 off12232 00000040:00080000:0.0:1786109812.110902:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].24, 224 off12456 00000040:00080000:0.0:1786109812.110916:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].25, 224 off12680 00000040:00080000:0.0:1786109812.110931:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].26, 88 off12768 00000040:00080000:0.0:1786109812.110945:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].27, 144 off12912 00000040:00080000:0.0:1786109812.110961:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].28, 152 off13064 00000040:00080000:0.0:1786109812.110975:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].29, 136 off13200 00000040:00080000:0.0:1786109812.110988:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].30, 224 off13424 00000040:00080000:0.0:1786109812.111002:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].31, 224 off13648 00000040:00080000:0.0:1786109812.111017:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].32, 80 off13728 00000040:00080000:0.0:1786109812.111033:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].33, 224 off13952 00000040:00080000:0.0:1786109812.111048:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].34, 224 off14176 00000040:00080000:0.0:1786109812.111062:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].35, 88 off14264 00000040:00080000:0.0:1786109812.111076:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].36, 144 off14408 00000040:00080000:0.0:1786109812.111090:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].37, 152 off14560 00000040:00080000:0.0:1786109812.111103:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].38, 136 off14696 00000040:00080000:0.0:1786109812.111133:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].39, 224 off14920 00000040:00080000:0.0:1786109812.111150:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].40, 224 off15144 00000040:00080000:0.0:1786109812.111165:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].41, 80 off15224 00000040:00080000:0.0:1786109812.111180:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].42, 224 off15448 00000040:00080000:0.0:1786109812.111194:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].43, 224 off15672 00000040:00080000:0.0:1786109812.111208:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].44, 120 off15792 00000100:00100000:0.0:1786109812.111242:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933424256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786109812.111294:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.111322:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.111469:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933424256 00000100:00100000:2.0:1786109812.111476:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933424256 00000100:00100000:2.0:1786109812.111523:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1786109812.111531:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:202488:x1872862933424256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786109812.111627:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:202488:x1872862933424256:12345-0@lo:502:mount.lustre.0 Request processed in 96us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.111635:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1786109812.111781:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1f3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933424256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786109812.111823:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2c:0x0].45, 224 off16016 00000040:00080000:0.0:1786109812.111834:0:202488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1786109812.112629:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109812.112639:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109812.112640:0:202492:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1786109812.112644:0:202492:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1786109812.112646:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786109812.112657:0:202492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff930ab1d4b380) 00000020:00000080:2.0:1786109812.112680:0:202492:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:2.0:1786109812.112684:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1786109812.112747:0:202492:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1786109812.112753:0:202492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdb52b77d7ca38f0a 00000020:00000080:2.0:1786109812.112946:0:202492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1786109812.112950:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786109812.112954:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109812.112955:0:202492:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1786109812.112958:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786109812.112961:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786109812.112963:0:202492:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1786109812.112966:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786109812.112973:0:202492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff930ab1d48000) 00000020:00000080:2.0:1786109812.112985:0:202492:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:2.0:1786109812.112989:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1786109812.112991:0:202492:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1786109812.112993:0:202492:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1786109812.112999:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1786109812.113041:0:202492:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930a89103000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1786109812.113053:0:202492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9309835d19c0) 00000020:00000080:2.0:1786109812.113063:0:202492:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:2.0:1786109812.113129:0:202492:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1786109812.113135:0:202492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca38f1f 00000020:00000080:2.0:1786109812.113238:0:202492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1786109812.113245:0:202492:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1786109812.113250:0:202492:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xdb52b77d7ca38f26 00080000:01000000:2.0:1786109812.113254:0:202492:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1786109812.113257:0:202492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdb52b77d7ca38f2d 00010000:00010000:3.0:1786109812.160283:0:202492:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00080000:3.0:1786109812.160411:0:202492:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 30064771072 lx: 0 gen 85 00000001:00080000:3.0:1786109812.160544:0:202492:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: fac74500-4523-4794-af20-dfdcdfae19c1 idx: 1 lr: 25769804642 srv lr: 30064771072 lx: 0 gen 84 00000001:00000004:3.0:1786109812.160568:0:202492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 8, last_transno is 30064771072 00000001:00080000:3.0:1786109812.160801:0:202492:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1786109812.160871:0:202492:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff930a83943e40: xid 1872862922179968, transno 30064771142, client gen 84, slot idx 0 00000001:00080000:3.0:1786109812.160879:0:202492:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff930a83943600: xid 1872862922176384, transno 30064771141, client gen 84, slot idx 1 00000020:00000080:3.0:1786109812.161535:0:202492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1786109812.161547:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786109812.161553:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109812.161555:0:202492:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1786109812.161559:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786109812.161563:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786109812.161565:0:202492:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1786109812.161568:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1786109812.161573:0:202492:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:00000080:3.0:1786109812.161609:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786109812.161624:0:202492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff930ab7c48000) 00000020:00000080:3.0:1786109812.161644:0:202492:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1786109812.161813:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1786109812.161879:0:202492:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1786109812.161884:0:202492:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1786109812.161891:0:202492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdb52b77d7ca38f49 00010000:00080000:3.0:1786109812.161923:0:202492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930aa6614800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1786109812.164284:0:202492:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:2.0:1786109812.165748:0:202492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1786109812.165762:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1786109812.165796:0:202492:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1786109812.165812:0:202492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca38f50 00000100:00080000:2.0:1786109812.165822:0:202492:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786109812.165828:0:202492:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff930aa6614800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109812.165861:0:202492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab8f2a680 x1872862933424384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109812.165917:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933424384:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786109812.166053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109812.166123:0:202492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1786109812.166171:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109812.166175:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109812.166178:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109812.166182:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 8665 00000100:00080000:2.0:1786109812.166186:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1786109812.166190:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff930983499000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109812.166204:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab8f2ad80 x1872862933424640/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109812.166259:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933424384 00000100:00100000:3.0:1786109812.166266:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933424384 00000100:00100000:3.0:1786109812.166361:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786109812.166369:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1872862933424384:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1786109812.166395:0:199402:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8668 last 0 00000020:00000080:3.0:1786109812.166424:0:199402:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca38f57 00000004:00100000:3.0:1786109812.166457:0:199402:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1786109812.166553:0:199402:0:(import.c:65:import_set_state_nolock()) ffff930ac0ecd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109812.167396:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933424640:0@lo:38:kworker.0 00000100:00100000:0.0:1786109812.167451:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786109812.170029:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786109812.170035:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109812.170038:0:192991:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786109812.170044:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 8665 00000100:00080000:2.0:1786109812.170048:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1786109812.170054:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109812.170058:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933424768:0@lo:400:kworker.0 00000100:00100000:1.0:1786109812.170138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.170159:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab8f29c00 x1872862933424896/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786109812.170171:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1786109812.170172:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1786109812.170175:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1786109812.170177:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1786109812.170178:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933424512:0@lo:400:kworker.0 00000100:00080000:2.0:1786109812.170180:0:192991:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 8665 00000100:00080000:2.0:1786109812.170182:0:192991:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1786109812.170186:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930a88c1d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1786109812.170197:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab8f29500 x1872862933425024/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109812.170199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109812.170251:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933424640 00000100:00100000:2.0:1786109812.170254:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933425408:0@lo:400:kworker.0 00000100:00100000:1.0:1786109812.170257:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933424640 00000100:00100000:2.0:1786109812.170279:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.170316:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933424768 00000100:00100000:2.0:1786109812.170320:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933424768 00000100:00100000:2.0:1786109812.170359:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933424512 00000100:00100000:2.0:1786109812.170362:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933424512 00000100:00100000:1.0:1786109812.170543:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933425408 00000100:00100000:1.0:1786109812.170548:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933425408 00000100:00100000:1.0:1786109812.170569:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1786109812.170577:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933424768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109812.170622:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1786109812.170624:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933424768:12345-0@lo:400:kworker.0 Request processed in 48us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.170630:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933424512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109812.170631:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1786109812.170652:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1786109812.170658:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933425408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109812.170661:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933424512:12345-0@lo:400:kworker.0 Request processed in 33us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.170666:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:2.0:1786109812.170678:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:2.0:1786109812.170683:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933424640:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1786109812.170685:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933425408:12345-0@lo:400:kworker.0 Request processed in 29us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109812.170690:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1786109812.170721:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1872862933424640:12345-0@lo:38:kworker.0 Request processed in 36us (3269us total) trans 0 rc -11/-11 00000100:00100000:2.0:1786109812.170727:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00080000:1.0:1786109812.170727:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786109812.170740:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933425280:0@lo:400:kworker.0 00000100:00100000:2.0:1786109812.170760:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933425408:0@lo:400:kworker.0 00000100:00100000:1.0:1786109812.170765:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109812.170783:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109812.170789:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933425152:0@lo:400:kworker.0 00000100:00100000:1.0:1786109812.170809:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109812.170840:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933424512:0@lo:400:kworker.0 00000100:00100000:1.0:1786109812.170851:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933424768:0@lo:400:kworker.0 00000020:01000000:1.0:1786109812.170920:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109812.170926:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.170928:0:202492:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1786109812.170931:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1786109812.170934:0:202492:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1786109812.170935:0:202492:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786109812.170937:0:202492:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786109812.170939:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1786109812.170941:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.170942:0:202492:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1786109812.170944:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109812.170963:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.170965:0:202492:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1786109812.170970:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1786109812.171012:0:202492:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1786109812.171029:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109812.171031:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.171033:0:202492:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1786109812.171035:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1786109812.171037:0:202492:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1786109812.171038:0:202492:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786109812.171039:0:202492:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786109812.171041:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1786109812.171044:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.171045:0:202492:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1786109812.171047:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786109812.171050:0:202492:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1786109812.171053:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.171054:0:202492:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1786109812.171057:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1786109812.171060:0:202492:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:1.0:1786109812.171079:0:202492:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1786109812.171082:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786109812.171095:0:202492:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff930a97cb99c0) 00000020:00000080:1.0:1786109812.171126:0:202492:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1786109812.171131:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1786109812.171193:0:202492:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1786109812.171198:0:202492:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:1.0:1786109812.171203:0:202492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdb52b77d7ca38f65 00010000:00080000:1.0:1786109812.171227:0:202492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930ac1367800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1786109812.171413:0:202492:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000100:00100000:1.0:1786109812.171698:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933425280 00000100:00100000:1.0:1786109812.171703:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933425280 00000100:00100000:1.0:1786109812.171746:0:43919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933425152 00000100:00100000:1.0:1786109812.171749:0:43919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933425152 00000100:00100000:1.0:1786109812.171766:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7181 00000100:00100000:1.0:1786109812.171772:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933425280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109812.171816:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933425280:12345-0@lo:400:kworker.0 Request processed in 43us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109812.171823:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7181 00000100:00100000:1.0:1786109812.171836:0:43919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7182 00000100:00080000:2.0:1786109812.171837:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786109812.171840:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786109812.171842:0:43919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933425152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109812.171869:0:43919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933425152:12345-0@lo:400:kworker.0 Request processed in 28us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109812.171875:0:43919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7182 00000100:00100000:3.0:1786109812.172023:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933424384:12345-0@lo:38:llog_process_th.0 Request processed in 5651us (5967us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109812.172032:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1786109812.172083:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786109812.172092:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 81 00000100:00080000:0.0:1786109812.172098:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1786109812.172103:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786109812.172107:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930aa6614800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786109812.172130:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933424384:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786109812.172151:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933424896:0@lo:38:kworker.0 00000100:00100000:0.0:1786109812.172181:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.172215:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933425024:0@lo:38:kworker.0 00000100:00100000:1.0:1786109812.172240:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933425152:0@lo:400:kworker.0 00000100:00100000:0.0:1786109812.172243:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109812.172254:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933425280:0@lo:400:kworker.0 00000100:00100000:2.0:1786109812.172368:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933424896 00000100:00100000:2.0:1786109812.172372:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933424896 00000100:00100000:2.0:1786109812.172399:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1786109812.172404:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933424896:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1786109812.172457:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1872862933424896:12345-0@lo:38:kworker.0 Request processed in 51us (275us total) trans 0 rc -11/-11 00000100:00100000:2.0:1786109812.172468:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00080000:0.0:1786109812.172529:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109812.172535:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1786109812.172538:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933424640:0@lo:38:kworker.0 00000100:00080000:0.0:1786109812.172558:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786109812.172561:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1786109812.172563:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933424896:0@lo:38:kworker.0 00000100:00100000:3.0:1786109812.172647:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933425024 00000100:00100000:3.0:1786109812.172651:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933425024 00000100:00100000:3.0:1786109812.172680:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786109812.172685:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1872862933425024:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1786109812.172724:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1872862933425024:12345-0@lo:38:kworker.0 Request processed in 37us (480us total) trans 0 rc -11/-11 00000100:00100000:3.0:1786109812.172730:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1786109812.172753:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786109812.172757:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1786109812.172760:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933425024:0@lo:38:kworker.0 00000040:01000000:3.0:1786109812.172881:0:202492:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1786109812.172909:0:202492:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1786109812.173065:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933425536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786109812.173098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.173183:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933425536 00000100:00100000:0.0:1786109812.173188:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933425536 00000100:00100000:0.0:1786109812.173230:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1786109812.173237:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933425536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786109812.173260:0:199402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445642240 avail 1299402752 00000100:00100000:0.0:1786109812.173541:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1872862933425536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 304us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109812.173548:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786109812.173757:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933425536:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1786109812.174099:0:202492:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 6, last_idx 7 00000040:00080000:3.0:1786109812.175231:0:202492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109812.175263:0:202492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].8, 64 off8704 00000040:00080000:3.0:1786109812.175643:0:202492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].1, 64 off8256 00000040:00080000:0.0:1786109812.176702:0:202497:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 8 synced_idx: 0 lgh_last_idx: 8 00000040:00080000:0.0:1786109812.176707:0:202497:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1c:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1786109812.176831:0:202497:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 7, last_idx 8 00000040:00080000:0.0:1786109812.176850:0:202497:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x1c:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1786109812.176974:0:202497:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:0.0:1786109812.176977:0:202497:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 8 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1786109812.178805:0:202492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1786109812.178818:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1786109812.178855:0:202492:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1786109812.178873:0:202492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca38f6c 00000100:00080000:1.0:1786109812.178884:0:202492:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786109812.178890:0:202492:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff930ac1367800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109812.178925:0:202492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a893c0a80 x1872862933425664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109812.178987:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933425664:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1786109812.179050:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.179133:0:43911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933425664 00000100:00100000:0.0:1786109812.179140:0:43911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933425664 00000100:00100000:0.0:1786109812.179176:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23203 00000100:00100000:0.0:1786109812.179184:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab928ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3645:x1872862933425664:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1786109812.179207:0:43911:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8668 last 0 00000020:00000080:0.0:1786109812.179228:0:43911:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca38f73 00002000:00100000:0.0:1786109812.179239:0:43911:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93098e2be800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1786109812.179243:0:43911:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1786109812.179246:0:43911:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1786109812.179300:0:43911:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1786109812.179319:0:43911:0:(import.c:65:import_set_state_nolock()) ffff93098e2bb000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1786109812.179380:0:202492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1786109812.179447:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109812.179453:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.179455:0:202492:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1786109812.179459:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1786109812.179462:0:202492:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1786109812.179463:0:202492:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786109812.179465:0:202492:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786109812.179466:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1786109812.179469:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.179471:0:202492:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1786109812.179473:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786109812.179477:0:202492:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1786109812.179481:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.179482:0:202492:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1786109812.179486:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1786109812.179489:0:202492:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:1.0:1786109812.179506:0:202492:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1786109812.179508:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786109812.179518:0:202492:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff930a97cbb380) 00000020:00000080:1.0:1786109812.179531:0:202492:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1786109812.179535:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1786109812.179580:0:202492:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1786109812.179585:0:202492:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1786109812.179589:0:202492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdb52b77d7ca38f81 00010000:00080000:1.0:1786109812.179610:0:202492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930982c91000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:1.0:1786109812.179761:0:202492:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1786109812.179813:0:202492:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1786109812.179900:0:202492:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1786109812.180316:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab928ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933425664:12345-0@lo:8:llog_process_th.0 Request processed in 1130us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109812.180325:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23203 00000040:00080000:1.0:1786109812.180380:0:202492:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 6, last_idx 7 00000100:00100000:3.0:1786109812.180387:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786109812.180396:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 9 00000100:00080000:3.0:1786109812.180403:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1786109812.180408:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1786109812.180410:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ac1367800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1786109812.180532:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1786109812.180539:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933425664:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1786109812.180657:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933425792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109812.180699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109812.180791:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933425792 00000100:00100000:3.0:1786109812.180795:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933425792 00000100:00100000:3.0:1786109812.180852:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6003 00000100:00100000:3.0:1786109812.180860:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933425792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786109812.180884:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786109812.180920:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933425792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109812.180927:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6003 00000100:00080000:2.0:1786109812.180991:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109812.181019:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933425792:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1786109812.181286:0:202492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109812.181317:0:202492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].8, 64 off8704 00000040:00080000:3.0:1786109812.181472:0:202492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].1, 64 off8256 00000040:00080000:3.0:1786109812.181870:0:202499:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 8 synced_idx: 0 lgh_last_idx: 8 00000040:00080000:3.0:1786109812.181874:0:202499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 7 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1786109812.181981:0:202499:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 7, last_idx 8 00000040:00080000:3.0:1786109812.181994:0:202499:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x1e:0x0] at index 7 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1786109812.182103:0:202499:0:(llog.c:805:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:3.0:1786109812.182106:0:202499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x22:0x0] at index 8 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1786109812.182623:0:202497:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1786109812.182669:0:202497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8668849237732ns, next at 0ns, rc = 0 00080000:00080000:0.0:1786109812.182675:0:202497:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:00000080:1.0:1786109812.183037:0:202492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1786109812.183048:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1786109812.183083:0:202492:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1786109812.183101:0:202492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca38f88 00000100:00080000:1.0:1786109812.183222:0:202492:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786109812.183228:0:202492:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff930982c91000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1786109812.183260:0:202492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930a893c0a80 x1872862933425920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786109812.183316:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933425920:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1786109812.183375:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786109812.183462:0:202492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1786109812.183513:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109812.183517:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.183519:0:202492:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1786109812.183521:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109812.183525:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.183526:0:202492:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1786109812.183529:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786109812.183530:0:202492:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1786109812.183532:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109812.183535:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.183536:0:202492:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1786109812.183538:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109812.183539:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.183541:0:202492:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1786109812.183543:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1786109812.183566:0:202492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109812.183570:0:202492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.183571:0:202492:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1786109812.183574:0:202492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2c:0x0] index 46 count 46 00000100:00100000:0.0:1786109812.184256:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933425920 00000100:00100000:0.0:1786109812.184263:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933425920 00000100:00100000:0.0:1786109812.184333:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23204 00000100:00100000:0.0:1786109812.184341:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab9288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3645:x1872862933425920:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1786109812.184370:0:43912:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8668 last 0 00000020:00000080:0.0:1786109812.184397:0:43912:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdb52b77d7ca38f8f 00002000:00100000:0.0:1786109812.184411:0:43912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93098e2ba800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1786109812.184415:0:43912:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1786109812.184418:0:43912:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1786109812.184512:0:43912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1786109812.184534:0:43912:0:(import.c:65:import_set_state_nolock()) ffff93098e2ba000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109812.184598:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab9288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3645:x1872862933425920:12345-0@lo:8:llog_process_th.0 Request processed in 256us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109812.184606:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23204 00000100:00100000:3.0:1786109812.184754:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786109812.184763:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1786109812.184769:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1786109812.184774:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1786109812.184777:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930982c91000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1786109812.184788:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1786109812.184794:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1872862933425920:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1786109812.184815:0:202499:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1786109812.184937:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109812.184948:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933426048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109812.184983:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.185016:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933426048 00000100:00100000:2.0:1786109812.185020:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933426048 00000100:00100000:2.0:1786109812.185058:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6004 00000100:00100000:2.0:1786109812.185065:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933426048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786109812.185083:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 144064 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109812.185132:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933426048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.185139:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6004 00000100:00080000:2.0:1786109812.185157:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109812.185182:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933426048:0@lo:13:osp-pre-1-1.0 00000020:01000000:0.0:1786109812.185500:0:202488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1786109812.185540:0:202488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1786109812.185565:0:202488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca38ef5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38efc expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.185576:0:202488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c2200/0xdb52b77d7ca38ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38efc expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109812.185585:0:202488:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930a89103000 from 1 10000000:01000000:0.0:1786109812.185588:0:202488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786109812.185617:0:202488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.185624:0:202488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.185633:0:202488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109812.185647:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109812.185679:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.185702:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6a780 going to sleep for 11 seconds 00000004:00080000:3.0:1786109812.185806:0:202499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8668852373895ns, next at 0ns, rc = 0 00080000:00080000:3.0:1786109812.185812:0:202499:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1786109812.186034:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933426176 00000100:00100000:2.0:1786109812.186040:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933426176 00000100:00100000:2.0:1786109812.186150:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1786109812.186159:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+21:202488:x1872862933426176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109812.186169:0:201147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109812.186181:0:201147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930a97836600/0xdb52b77d7ca38f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38f96 expref: -99 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.186201:0:201147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a97836600/0xdb52b77d7ca38f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38f96 expref: 22 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.186211:0:201147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930a97836600/0xdb52b77d7ca38f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38f96 expref: 22 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.186219:0:201147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a97836600, rc 0) 00000100:00100000:2.0:1786109812.186265:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:202488:x1872862933426176:12345-0@lo:101:mount.lustre.0 Request processed in 107us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.186272:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1786109812.186336:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109812.186351:0:202488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38f9d expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.186359:0:202488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38f9d expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109812.187034:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426304:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1786109812.187076:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.187518:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6a780 going to sleep for 11 seconds 00000100:00100000:3.0:1786109812.187658:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933426304 00000100:00100000:3.0:1786109812.187664:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933426304 00000100:00100000:3.0:1786109812.187697:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1786109812.187704:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:202488:x1872862933426304:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1786109812.187730:0:201148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1786109812.187749:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1786109812.187753:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1786109812.187756:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1786109812.187759:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1786109812.187761:0:201148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 337 00000100:00100000:3.0:1786109812.187858:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:202488:x1872862933426304:12345-0@lo:256:mount.lustre.0 Request processed in 153us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109812.187865:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1786109812.187950:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426304:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1786109812.188637:0:202488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786109812.188656:0:202488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38f9d expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.188666:0:202488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38f9d expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786109812.188674:0:202488:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff930a89103000 from 1 10000000:01000000:0.0:1786109812.188677:0:202488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786109812.188703:0:202488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3600/0xdb52b77d7ca38fa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.188711:0:202488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3600/0xdb52b77d7ca38fa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.188725:0:202488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3600/0xdb52b77d7ca38fa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109812.188741:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786109812.188774:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.188804:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6a780 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.188836:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933426432 00000100:00100000:2.0:1786109812.188843:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933426432 00000100:00100000:2.0:1786109812.188875:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1786109812.188884:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:202488:x1872862933426432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786109812.188895:0:201148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109812.188907:0:201148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930a97837400/0xdb52b77d7ca38fab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38fa4 expref: -99 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.189007:0:201148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a97837400/0xdb52b77d7ca38fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38fa4 expref: 23 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.189020:0:201148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930a97837400/0xdb52b77d7ca38fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38fa4 expref: 23 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.189029:0:201148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a97837400, rc 0) 00000100:00100000:2.0:1786109812.189068:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:202488:x1872862933426432:12345-0@lo:101:mount.lustre.0 Request processed in 184us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.189076:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1786109812.189094:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109812.189157:0:202488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3600/0xdb52b77d7ca38fa4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38fab expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.189168:0:202488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3600/0xdb52b77d7ca38fa4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38fab expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109812.189350:0:202488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 7 count 7 00000040:00080000:0.0:1786109812.189636:0:202488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786109812.189821:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].1, 224 off8416 00000040:00080000:0.0:1786109812.189856:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].2, 112 off8528 00000040:00080000:0.0:1786109812.189879:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].3, 224 off8752 00000040:00080000:0.0:1786109812.189900:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].4, 224 off8976 00000004:00080000:2.0:1786109812.189909:0:202489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000040:00080000:0.0:1786109812.189920:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].5, 112 off9088 00000040:00080000:0.0:1786109812.189945:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2d:0x0].6, 224 off9312 00000040:00080000:0.0:1786109812.189953:0:202488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 6 count 7 00000100:00100000:0.0:1786109812.190042:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109812.190081:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.190187:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6a180 going to sleep for 11 seconds 00000100:00100000:0.0:1786109812.190209:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933426560 00000100:00100000:0.0:1786109812.190214:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933426560 00000100:00100000:0.0:1786109812.190256:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786109812.190265:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:202488:x1872862933426560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109812.190349:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:202488:x1872862933426560:12345-0@lo:501:mount.lustre.0 Request processed in 85us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109812.190356:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786109812.190391:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786109812.190416:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426688:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786109812.190472:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.190485:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930984d6a180 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.191625:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933426688 00000100:00100000:2.0:1786109812.191634:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933426688 00000100:00100000:2.0:1786109812.191675:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1786109812.191683:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:202488:x1872862933426688:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786109812.191805:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:202488:x1872862933426688:12345-0@lo:503:mount.lustre.0 Request processed in 123us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.191813:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1786109812.192301:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426688:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1786109812.192992:0:202488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786109812.193072:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426816:0@lo:502:mount.lustre.0 00000004:00080000:0.0:1786109812.193649:0:202489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1786109812.193743:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109812.193791:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098661a840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.193983:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933426816 00000100:00100000:2.0:1786109812.193990:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933426816 00000100:00100000:2.0:1786109812.194036:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1786109812.194045:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:202488:x1872862933426816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786109812.194180:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:202488:x1872862933426816:12345-0@lo:502:mount.lustre.0 Request processed in 136us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.194188:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1786109812.196124:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786109812.196372:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].1, 224 off8416 00000040:00080000:3.0:1786109812.196403:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].2, 112 off8528 00000040:00080000:3.0:1786109812.196418:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].3, 224 off8752 00000040:00080000:3.0:1786109812.196453:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].4, 224 off8976 00000040:00080000:3.0:1786109812.196470:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].5, 112 off9088 00000100:00100000:3.0:1786109812.196506:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109812.196575:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109812.196608:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098661a840 going to sleep for 11 seconds 00000100:00100000:0.0:1786109812.196696:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933426944 00000100:00100000:0.0:1786109812.196702:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933426944 00000100:00100000:0.0:1786109812.196769:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1786109812.196781:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:202488:x1872862933426944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786109812.196943:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:202488:x1872862933426944:12345-0@lo:502:mount.lustre.0 Request processed in 166us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109812.196951:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1786109812.197195:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933426944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786109812.197249:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2e:0x0].6, 224 off9312 00000040:00080000:3.0:1786109812.197258:0:202488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1786109812.198074:0:202501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109812.198084:0:202501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.198086:0:202501:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1786109812.198092:0:202501:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff930a89103000 00000020:00000080:1.0:1786109812.198095:0:202501:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786109812.198102:0:202501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109812.198105:0:202501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.198106:0:202501:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1786109812.198118:0:202501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786109812.198122:0:202501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.198123:0:202501:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786109812.198127:0:202501:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff930a89103000 00000020:00000080:1.0:1786109812.198130:0:202501:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786109812.198236:0:202501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786109812.198242:0:202501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786109812.198243:0:202501:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1786109812.198245:0:202501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2e:0x0] index 7 count 7 00000020:01000000:3.0:1786109812.198373:0:202488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1786109812.198403:0:202488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786109812.198578:0:202488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3600/0xdb52b77d7ca38fa4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38fab expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.198590:0:202488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3600/0xdb52b77d7ca38fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38fab expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109812.198632:0:202488:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1786109812.198634:0:202488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff930a89103000 10000000:01000000:3.0:1786109812.198637:0:202488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff930a89103000 10000000:01000000:3.0:1786109812.198641:0:202488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786109812.198646:0:202488:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff930a89103000 from 1 10000000:01000000:3.0:1786109812.198648:0:202488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786109812.198678:0:202488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca38fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.198685:0:202488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca38fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.198695:0:202488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca38fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109812.198713:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786109812.198763:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109812.198836:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098661a180 going to sleep for 11 seconds 00000100:00100000:0.0:1786109812.199551:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933427072 00000100:00100000:0.0:1786109812.199558:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933427072 00000100:00100000:0.0:1786109812.199643:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1786109812.199655:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:202488:x1872862933427072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786109812.199668:0:201148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786109812.199680:0:201148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ac16c2600/0xdb52b77d7ca38fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38fb2 expref: -99 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.199703:0:201148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ac16c2600/0xdb52b77d7ca38fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38fb2 expref: 24 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.199716:0:201148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ac16c2600/0xdb52b77d7ca38fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38fb2 expref: 24 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109812.199724:0:201148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ac16c2600, rc 0) 00000100:00100000:0.0:1786109812.199785:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:202488:x1872862933427072:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109812.199793:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1786109812.202210:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786109812.202237:0:202488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca38fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38fb9 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.202249:0:202488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca38fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38fb9 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786109812.202482:0:202488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 52 count 51 00000040:00080000:3.0:1786109812.202720:0:202488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786109812.202894:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].1, 224 off8416 00000040:00080000:3.0:1786109812.202919:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].2, 120 off8536 00000040:00080000:3.0:1786109812.202933:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].3, 168 off8704 00000040:00080000:3.0:1786109812.202946:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].4, 224 off8928 00000040:00080000:3.0:1786109812.202959:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].5, 224 off9152 00000040:00080000:3.0:1786109812.202972:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].6, 120 off9272 00000040:00080000:3.0:1786109812.202988:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].7, 168 off9440 00000040:00080000:3.0:1786109812.203002:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].8, 224 off9664 00000040:00080000:3.0:1786109812.203013:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].9, 224 off9888 00000040:00080000:3.0:1786109812.203026:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].10, 120 off10008 00000040:00080000:3.0:1786109812.203039:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].11, 224 off10232 00000040:00080000:3.0:1786109812.203054:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].12, 224 off10456 00000040:00080000:3.0:1786109812.203067:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].13, 88 off10544 00000040:00080000:3.0:1786109812.203080:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].14, 128 off10672 00000040:00080000:3.0:1786109812.203092:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].15, 144 off10816 00000040:00080000:3.0:1786109812.203104:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].16, 160 off10976 00000040:00080000:3.0:1786109812.203135:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].17, 224 off11200 00000040:00080000:3.0:1786109812.203151:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].18, 224 off11424 00000040:00080000:3.0:1786109812.203164:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].19, 80 off11504 00000040:00080000:3.0:1786109812.203177:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].20, 224 off11728 00000040:00080000:3.0:1786109812.203190:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].21, 224 off11952 00000040:00080000:3.0:1786109812.203204:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].22, 88 off12040 00000040:00080000:3.0:1786109812.203219:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].23, 128 off12168 00000040:00080000:3.0:1786109812.203234:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].24, 144 off12312 00000040:00080000:3.0:1786109812.203248:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].25, 160 off12472 00000040:00080000:3.0:1786109812.203261:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].26, 224 off12696 00000040:00080000:3.0:1786109812.203273:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].27, 224 off12920 00000040:00080000:3.0:1786109812.203286:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].28, 80 off13000 00000040:00080000:3.0:1786109812.203298:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].29, 224 off13224 00000040:00080000:3.0:1786109812.203311:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].30, 224 off13448 00000040:00080000:3.0:1786109812.203323:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].31, 88 off13536 00000040:00080000:3.0:1786109812.203337:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].32, 128 off13664 00000040:00080000:3.0:1786109812.203350:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].33, 144 off13808 00000040:00080000:3.0:1786109812.203363:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].34, 128 off13936 00000040:00080000:3.0:1786109812.203376:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].35, 224 off14160 00000040:00080000:3.0:1786109812.203391:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].36, 224 off14384 00000040:00080000:3.0:1786109812.203404:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].37, 80 off14464 00000040:00080000:3.0:1786109812.203416:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].38, 224 off14688 00000040:00080000:3.0:1786109812.203450:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].39, 224 off14912 00000040:00080000:3.0:1786109812.203468:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].40, 88 off15000 00000040:00080000:3.0:1786109812.203481:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].41, 128 off15128 00000040:00080000:3.0:1786109812.203493:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].42, 144 off15272 00000040:00080000:3.0:1786109812.203504:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].43, 128 off15400 00000040:00080000:3.0:1786109812.203517:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].44, 224 off15624 00000040:00080000:3.0:1786109812.203529:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].45, 224 off15848 00000040:00080000:3.0:1786109812.203541:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].46, 80 off15928 00000040:00080000:3.0:1786109812.203553:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].47, 224 off16152 00000040:00080000:3.0:1786109812.203567:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].48, 232 off16384 00000040:00080000:3.0:1786109812.203686:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].49, 224 off16608 00000040:00080000:3.0:1786109812.203706:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].50, 120 off16728 00000040:00080000:3.0:1786109812.203722:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2f:0x0].51, 224 off16952 00000040:00080000:3.0:1786109812.203726:0:202488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2a:0x0] index 51 count 51 00000100:00100000:3.0:1786109812.203828:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109812.203890:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109812.208170:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098661ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109812.208272:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933427200 00000100:00100000:1.0:1786109812.208282:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933427200 00000100:00100000:1.0:1786109812.208328:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1786109812.208337:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1d06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:202488:x1872862933427200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786109812.208509:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1d06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:202488:x1872862933427200:12345-0@lo:501:mount.lustre.0 Request processed in 173us (4618us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109812.208518:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1786109812.208685:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786109812.208734:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786109812.208780:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109812.208809:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098661ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1786109812.208847:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933427328 00000100:00100000:1.0:1786109812.208851:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933427328 00000100:00100000:1.0:1786109812.208868:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1786109812.208874:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:202488:x1872862933427328:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786109812.208961:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:202488:x1872862933427328:12345-0@lo:503:mount.lustre.0 Request processed in 86us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109812.208969:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786109812.209035:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427328:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1786109812.210188:0:202488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786109812.210264:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109812.210321:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109812.210357:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933427456 00000100:00100000:3.0:1786109812.210362:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933427456 00000100:00100000:3.0:1786109812.210390:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786109812.210398:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:202488:x1872862933427456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109812.210516:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:202488:x1872862933427456:12345-0@lo:502:mount.lustre.0 Request processed in 117us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109812.210523:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1786109812.210566:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098661a180 going to sleep for 11 seconds 00000100:00100000:3.0:1786109812.210583:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786109812.210758:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].1, 224 off8416 00000040:00080000:3.0:1786109812.210784:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].2, 120 off8536 00000040:00080000:3.0:1786109812.210799:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].3, 168 off8704 00000040:00080000:3.0:1786109812.210811:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].4, 224 off8928 00000040:00080000:3.0:1786109812.210824:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].5, 224 off9152 00000040:00080000:3.0:1786109812.210839:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].6, 120 off9272 00000040:00080000:3.0:1786109812.210854:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].7, 168 off9440 00000040:00080000:3.0:1786109812.210868:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].8, 224 off9664 00000040:00080000:3.0:1786109812.210884:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].9, 224 off9888 00000040:00080000:3.0:1786109812.210898:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].10, 120 off10008 00000040:00080000:3.0:1786109812.210911:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].11, 224 off10232 00000040:00080000:3.0:1786109812.210926:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].12, 224 off10456 00000040:00080000:3.0:1786109812.210940:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].13, 88 off10544 00000040:00080000:3.0:1786109812.210955:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].14, 128 off10672 00000040:00080000:3.0:1786109812.210970:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].15, 144 off10816 00000040:00080000:3.0:1786109812.212209:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].16, 160 off10976 00000040:00080000:3.0:1786109812.212229:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].17, 224 off11200 00000040:00080000:3.0:1786109812.212243:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].18, 224 off11424 00000040:00080000:3.0:1786109812.212258:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].19, 80 off11504 00000040:00080000:3.0:1786109812.212273:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].20, 224 off11728 00000040:00080000:3.0:1786109812.212292:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].21, 224 off11952 00000040:00080000:3.0:1786109812.212304:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].22, 88 off12040 00000040:00080000:3.0:1786109812.212318:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].23, 128 off12168 00000040:00080000:3.0:1786109812.212333:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].24, 144 off12312 00000040:00080000:3.0:1786109812.212346:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].25, 160 off12472 00000040:00080000:3.0:1786109812.212360:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].26, 224 off12696 00000040:00080000:3.0:1786109812.212373:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].27, 224 off12920 00000040:00080000:3.0:1786109812.212386:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].28, 80 off13000 00000040:00080000:3.0:1786109812.212399:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].29, 224 off13224 00000040:00080000:3.0:1786109812.212414:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].30, 224 off13448 00000040:00080000:3.0:1786109812.212443:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].31, 88 off13536 00000040:00080000:3.0:1786109812.212463:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].32, 128 off13664 00000040:00080000:3.0:1786109812.212478:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].33, 144 off13808 00000040:00080000:3.0:1786109812.212493:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].34, 128 off13936 00000040:00080000:3.0:1786109812.212506:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].35, 224 off14160 00000040:00080000:3.0:1786109812.212518:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].36, 224 off14384 00000040:00080000:3.0:1786109812.212530:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].37, 80 off14464 00000040:00080000:3.0:1786109812.212543:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].38, 224 off14688 00000040:00080000:3.0:1786109812.212555:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].39, 224 off14912 00000040:00080000:3.0:1786109812.212569:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].40, 88 off15000 00000040:00080000:3.0:1786109812.212582:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].41, 128 off15128 00000040:00080000:3.0:1786109812.212595:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].42, 144 off15272 00000040:00080000:3.0:1786109812.212607:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].43, 128 off15400 00000040:00080000:3.0:1786109812.212622:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].44, 224 off15624 00000040:00080000:3.0:1786109812.212636:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].45, 224 off15848 00000040:00080000:3.0:1786109812.212650:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].46, 80 off15928 00000040:00080000:3.0:1786109812.212663:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].47, 224 off16152 00000040:00080000:3.0:1786109812.212677:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].48, 232 off16384 00000100:00100000:3.0:1786109812.212728:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109812.212797:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109812.212846:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933427584 00000100:00100000:3.0:1786109812.212853:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933427584 00000100:00100000:3.0:1786109812.212887:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786109812.212894:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:202488:x1872862933427584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109812.213004:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:202488:x1872862933427584:12345-0@lo:502:mount.lustre.0 Request processed in 109us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109812.213011:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786109812.213055:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098661a180 going to sleep for 11 seconds 00000100:00100000:3.0:1786109812.213073:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786109812.213314:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].49, 224 off16608 00000040:00080000:3.0:1786109812.213338:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].50, 120 off16728 00000100:00100000:3.0:1786109812.213358:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786109812.213390:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109812.214235:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098661a180 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.215257:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933427712 00000100:00100000:2.0:1786109812.215267:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933427712 00000100:00100000:0.0:1786109812.216178:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1786109812.216199:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:202488:x1872862933427712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786109812.216356:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:202488:x1872862933427712:12345-0@lo:502:mount.lustre.0 Request processed in 166us (2964us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109812.216364:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1786109812.217219:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786109812.217309:0:202488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x30:0x0].51, 224 off16952 00000040:00080000:3.0:1786109812.217325:0:202488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1786109812.219053:0:202504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1786109812.219069:0:202504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9309824819c0) 00000020:00000080:0.0:1786109812.219095:0:202504:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1786109812.219662:0:202504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff930a89103000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1786109812.219667:0:202504:0:(tgt_mount.c:187:server_put_mount()) put mount ffff930a89103000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1786109812.219669:0:202504:0:(obd_mount.c:710:lustre_put_lsi()) put ffff930a89103000 3 00010000:00080000:0.0:1786109812.219695:0:202504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff930ab8da3000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1786109812.221499:0:202504:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:0.0:1786109812.221598:0:202504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1786109812.221634:0:202504:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786109812.221644:0:202504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xdb52b77d7ca38fc7 00000100:00080000:0.0:1786109812.221653:0:202504:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786109812.221658:0:202504:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff930ab8da3000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109812.221688:0:202504:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ab7e5ea00 x1872862933427840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109812.221721:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933427840:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786109812.221780:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786109812.221829:0:202504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1786109812.221896:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933427840 00000100:00100000:1.0:1786109812.221903:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933427840 00000100:00100000:1.0:1786109812.221934:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1786109812.221942:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3645:x1872862933427840:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1786109812.221967:0:196401:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 8668 last 0 00000020:00000080:1.0:1786109812.221996:0:196401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdb52b77d7ca38fce 00000004:00100000:1.0:1786109812.222010:0:196401:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786109812.222036:0:196401:0:(import.c:65:import_set_state_nolock()) ffff930a87b29000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786109812.222094:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872862933427840:12345-0@lo:38:llog_process_th.0 Request processed in 151us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109812.222101:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1786109812.222266:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786109812.222275:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 81 00000100:00080000:0.0:1786109812.222281:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1786109812.222285:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786109812.222287:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930ab8da3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786109812.222292:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872862933427840:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1786109812.225653:0:202504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x30:0x0] index 52 count 51 00000020:01000000:2.0:1786109812.225765:0:202488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1786109812.225807:0:202488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786109812.225824:0:202488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca38fb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38fb9 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109812.225835:0:202488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab8f6c600/0xdb52b77d7ca38fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38fb9 expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1786109812.225891:0:202488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1786109812.225893:0:202488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1786109812.225895:0:202488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109812.225896:0:202488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109812.225897:0:202488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109812.225898:0:202488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109812.225900:0:202488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109812.225902:0:202488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109812.225903:0:202488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786109812.225906:0:202488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1786109812.225909:0:202488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786109812.225910:0:202488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1786109812.225912:0:202488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109812.225913:0:202488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109812.225914:0:202488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109812.225915:0:202488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109812.225916:0:202488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109812.225917:0:202488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109812.225918:0:202488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786109812.225942:0:202488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1786109812.225961:0:202488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427968:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786109812.226026:0:202488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.226064:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933427968 00000100:00100000:2.0:1786109812.226071:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933427968 00000100:00100000:2.0:1786109812.226130:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1786109812.226140:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:202488:x1872862933427968:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1786109812.226168:0:201147:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1786109812.226180:0:201147:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1786109812.227996:0:202488:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab8c34b40 going to sleep for 11 seconds 00000001:00100000:2.0:1786109812.233308:0:201141:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1786109812.234122:0:201147:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786109812.234142:0:201147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1786109812.234538:0:201149:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786109812.234544:0:201149:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786109812.234567:0:201149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109812.234586:0:201149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca38b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38b3d expref: 24 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109812.234596:0:201149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930ab9412000/0xdb52b77d7ca38c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a191b expref: 9 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109812.234603:0:201149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff930a97836600/0xdb52b77d7ca38f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38f96 expref: 24 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109812.234610:0:201149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109812.234649:0:201149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930a97836600/0xdb52b77d7ca38f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca38f96 expref: 24 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109812.234683:0:201149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930a97836600/0xdb52b77d7ca38f9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb52b77d7ca38f96 expref: 24 pid: 201147 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109812.234699:0:201149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201149:1872862933428096:0@lo:104: 00000100:00100000:1.0:1786109812.234764:0:201149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786109812.234832:0:201149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ab9412000/0xdb52b77d7ca38c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a191b expref: 9 pid: 201147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109812.234842:0:201149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ab9412000/0xdb52b77d7ca38c01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a191b expref: 9 pid: 201147 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109812.234852:0:201149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a893c0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201149:1872862933428224:192.168.203.38@tcp:104: 00010000:00010000:1.0:1786109812.234910:0:201149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca38b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb52b77d7ca38b3d expref: 24 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109812.234918:0:201149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca38b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb52b77d7ca38b3d expref: 24 pid: 201146 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109812.234926:0:201149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201149:1872862933428352:0@lo:104: 00000100:00100000:1.0:1786109812.234951:0:201149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109812.234969:0:201149:0:(client.c:2702:ptlrpc_set_wait()) set ffff930983e3f180 going to sleep for 11 seconds 00000100:00100000:0.0:1786109812.235034:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933428096 00000100:00100000:0.0:1786109812.235042:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933428096 00000100:00100000:0.0:1786109812.235082:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933428352 00000100:00100000:0.0:1786109812.235085:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933428352 00000100:00100000:0.0:1786109812.235101:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5274 00000100:00100000:3.0:1786109812.235131:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5275 00000100:00100000:3.0:1786109812.235141:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+4:201149:x1872862933428352:12345-0@lo:104: 00010000:00010000:3.0:1786109812.235154:0:6510:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca38b44 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235207:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786109812.235213:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+4:201149:x1872862933428352:12345-0@lo:104: Request processed in 74us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109812.235220:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5275 00010000:00010000:3.0:1786109812.235249:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109812.235255:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca38b44 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235263:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9412600 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109812.235266:0:6515:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb52b77d7ca38b44 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235274:0:6515:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca38b44 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109812.235281:0:6515:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca38b44 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109812.235285:0:6515:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109812.235314:0:6515:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca38b44 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235321:0:6515:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109812.235339:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca38b44 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235346:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ab9412600/0xdb52b77d7ca38b3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca38b44 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235357:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109812.235359:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109812.235361:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109812.235379:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933428480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786109812.235394:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:201149:x1872862933428096:12345-0@lo:104: 00010000:00010000:0.0:1786109812.235405:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca38f9d expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109812.235416:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109812.235479:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933428480 00010000:00010000:0.0:1786109812.235481:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786109812.235483:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933428480 00000100:00100000:0.0:1786109812.235490:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+3:201149:x1872862933428096:12345-0@lo:104: Request processed in 380us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109812.235498:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5274 00010000:00010000:3.0:1786109812.235505:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca38b44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca38b3d expref: 25 pid: 201146 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109812.235532:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12656 00000100:00100000:3.0:1786109812.235540:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a90736450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+25:3646:x1872862933428480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109812.235551:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109812.235557:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca38b44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca38b3d expref: 25 pid: 201146 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235569:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca38b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb52b77d7ca38b3d expref: 25 pid: 201146 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109812.235570:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+25:202488:x1872862933427968:12345-0@lo:253:mount.lustre.0 Request processed in 9429us (9542us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109812.235591:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:3.0:1786109812.235593:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109812.235629:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a90736450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933428480:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109812.235636:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12656 00010000:00010000:3.0:1786109812.235673:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786109812.235678:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb52b77d7ca38f9d expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235685:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c3e00 already unused, calling callback (ffffffffc1476c20) 10000000:00010000:3.0:1786109812.235688:0:10402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb52b77d7ca38f9d expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235695:0:10402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb52b77d7ca38f9d expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786109812.235702:0:10402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb52b77d7ca38f9d expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786109812.235707:0:10402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1786109812.235744:0:10402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca38f9d expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235751:0:10402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786109812.235764:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca38f9d expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235771:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38f96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb52b77d7ca38f9d expref: -99 pid: 202488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235786:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109812.235788:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109812.235791:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109812.235805:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933428608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109812.235838:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109812.235880:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933428608 00000100:00100000:3.0:1786109812.235885:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933428608 00010000:00010000:3.0:1786109812.235903:0:6513:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930a97836600/0xdb52b77d7ca38f9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca38f96 expref: 24 pid: 201147 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109812.235929:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12657 00000100:00100000:3.0:1786109812.235937:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933428608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109812.235945:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109812.235950:0:6513:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff930a97836600/0xdb52b77d7ca38f9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb52b77d7ca38f96 expref: 24 pid: 201147 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.235959:0:6513:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930a97836600/0xdb52b77d7ca38f9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb52b77d7ca38f96 expref: 24 pid: 201147 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109812.235967:0:202488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aeab97cc-8463-4daa-a678-1bb2ad93cc69:202488:1872862933427968:0@lo:253:mount.lustre.0 00010000:00010000:3.0:1786109812.235970:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:2.0:1786109812.235981:0:202488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1786109812.235985:0:202488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786109812.235987:0:202488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1786109812.235989:0:202488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786109812.235990:0:202488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786109812.235992:0:202488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786109812.235994:0:202488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786109812.235995:0:202488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786109812.235997:0:202488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786109812.235999:0:202488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1786109812.236004:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933428608:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109812.236012:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12657 00000020:02000000:2.0:1786109812.236014:0:202488:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1786109812.236042:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933428608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786109812.236065:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab9289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933428480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786109812.236091:0:201149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930a97836600/0xdb52b77d7ca38f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca38f96 expref: 23 pid: 201147 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109812.236100:0:201149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201149:1872862933428096:0@lo:104: 00010000:00010000:3.0:1786109812.236689:0:201149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ac16c2c00/0xdb52b77d7ca38b44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb52b77d7ca38b3d expref: 22 pid: 201146 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109812.236700:0:201149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201149:1872862933428352:0@lo:104: 00000020:00080000:2.0:1786109812.240331:0:202488:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 21474840726 00000040:01000000:2.0:1786109812.240856:0:202488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1786109812.241073:0:202510:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1786109812.241185:0:202488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1786109812.241914:0:202511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff0e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933428736:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1786109812.241981:0:202511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109812.242055:0:202511:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098661a240 going to sleep for 11 seconds 00000040:01000000:0.0:1786109812.242200:0:202488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1786109812.242233:0:202488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1786109812.242698:0:202488:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1786109812.242706:0:202488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1786109812.242742:0:202488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786109812.243717:0:202488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:1.0:1786109812.244344:0:202509:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 21474840726 00000020:00080000:1.0:1786109812.244350:0:202509:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840726 00000100:00100000:3.0:1786109812.244553:0:201149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a893c0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:201149:1872862933428224:192.168.203.38@tcp:104: 00010000:00010000:3.0:1786109812.244590:0:201149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786109812.244814:0:202488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1786109812.244856:0:202488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1786109812.244956:0:202488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1786109812.245571:0:202488:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x35:0x0] (8/32) registered 00000100:00100000:2.0:1786109812.245846:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933428736 00000100:00100000:2.0:1786109812.245854:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933428736 00000100:00100000:2.0:1786109812.245895:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1786109812.245905:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933428736:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.246021:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933428736:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 117us (4038us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.246028:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1786109812.246197:0:202511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff0e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933428736:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1786109812.246239:0:202511:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1786109812.246282:0:202511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933428864:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1786109812.246322:0:202511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.246357:0:202511:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2e600 going to sleep for 11 seconds 00000100:00100000:1.0:1786109812.246407:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933428864 00000100:00100000:1.0:1786109812.246412:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933428864 00000100:00100000:1.0:1786109812.246468:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786109812.246478:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933428864:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109812.246573:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933428864:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 97us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109812.246580:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1786109812.247316:0:202511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933428864:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1786109812.247377:0:202511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:202511:1872862933428992:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1786109812.247419:0:202511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.247472:0:202511:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2e300 going to sleep for 11 seconds 00000100:00100000:1.0:1786109812.247531:0:187911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933428992 00000100:00100000:1.0:1786109812.247537:0:187911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933428992 00000100:00100000:1.0:1786109812.247580:0:187911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786109812.247590:0:187911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0a27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:202511:x1872862933428992:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1786109812.247639:0:187911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0a27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:202511:x1872862933428992:12345-0@lo:900:lod0001_rec0000.0 Request processed in 51us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109812.247651:0:187911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786109812.247785:0:202511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:202511:1872862933428992:0@lo:900:lod0001_rec0000.0 00010000:00080000:2.0:1786109812.247828:0:202488:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-MDT0001, 2 recoverable clients, last_transno 30064771142 00000100:00100000:0.0:1786109812.247831:0:202511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933429120:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1786109812.247861:0:202511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.247887:0:202511:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2e600 going to sleep for 11 seconds 00000100:00100000:1.0:1786109812.247934:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933429120 00000100:00100000:1.0:1786109812.247938:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933429120 00000100:00100000:1.0:1786109812.247974:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1786109812.247981:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933429120:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109812.248030:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933429120:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 49us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109812.248037:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1786109812.248099:0:202511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933429120:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1786109812.248171:0:202511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933429248:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1786109812.248220:0:202511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.248243:0:202511:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.248280:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933429248 00000100:00100000:2.0:1786109812.248285:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933429248 00000100:00100000:2.0:1786109812.248378:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1786109812.248389:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933429248:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:0.0:1786109812.248913:0:202512:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 202512 00010000:02000000:0.0:1786109812.248972:0:202512:0:(ldlm_lib.c:2336:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1786109812.248976:0:202512:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1786109812.248979:0:202512:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1786109812.249095:0:202488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1786109812.249134:0:202488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1786109812.249152:0:202488:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1786109812.249168:0:202488:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1786109812.250375:0:202488:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1786109812.250731:0:202488:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1786109812.255687:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933429248:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 7296us (7460us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.255700:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1786109812.259251:0:202511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933429248:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1786109812.259301:0:202511:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 10, last_idx 14 00000100:00100000:1.0:1786109812.261296:0:202511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2ad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933429376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109812.261402:0:202511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.261444:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933429376 00000100:00100000:1.0:1786109812.261452:0:202511:0:(client.c:2702:ptlrpc_set_wait()) set ffff930983e3fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109812.261452:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933429376 00000100:00100000:0.0:1786109812.261494:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1786109812.261503:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933429376:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1786109812.262201:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933429376:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 698us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109812.262210:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1786109812.264266:0:202511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2ad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933429376:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1786109812.264325:0:202511:0:(llog.c:805:llog_process_thread()) index: 11, lh_last_idx: 14 synced_idx: 0 lgh_last_idx: 14 00000040:00080000:1.0:1786109812.264329:0:202511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200026d32:0x1:0x0] at index 11 of catalog [0x200000401:0x1:0x0] 00000100:00100000:1.0:1786109812.264397:0:202511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2ad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933429504:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1786109812.264466:0:202511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109812.264493:0:202511:0:(client.c:2702:ptlrpc_set_wait()) set ffff930983e3f840 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.267736:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933429504 00000100:00100000:2.0:1786109812.267750:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933429504 00000100:00100000:2.0:1786109812.267803:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1786109812.267814:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933429504:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.267932:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933429504:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.267939:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1786109812.267986:0:202511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2ad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933429504:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.268080:0:202511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933429632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.270259:0:202511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.270303:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933429632 00000100:00100000:2.0:1786109812.270310:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933429632 00000100:00100000:2.0:1786109812.270550:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1786109812.270561:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933429632:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.270765:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933429632:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 206us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.270773:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1786109812.270797:0:202511:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab7e42e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.270816:0:202511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933429632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.270923:0:202511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933429760:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.270949:0:202511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.270971:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933429760 00000100:00100000:2.0:1786109812.270974:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933429760 00000100:00100000:2.0:1786109812.270995:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1786109812.271000:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933429760:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.271042:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202511:x1872862933429760:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 42us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.271047:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1786109812.271061:0:202511:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c531000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.271071:0:202511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933429760:0@lo:1000:lod0001_rec0000.0 00000004:00080000:2.0:1786109812.271105:0:202511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9309855a7840 with version 1 00000040:00080000:2.0:1786109812.271182:0:202511:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 12, last_idx 14 00000004:00080000:2.0:1786109812.271193:0:202511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930985db9240 with version 2 00000040:00080000:2.0:1786109812.271196:0:202511:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200026d32:0x1:0x0] at index 11 of catalog [0x200000401:0x1:0x0] 00000040:00080000:2.0:1786109812.271213:0:202511:0:(llog.c:805:llog_process_thread()) index: 13, lh_last_idx: 14 synced_idx: 0 lgh_last_idx: 14 00000040:00080000:2.0:1786109812.271217:0:202511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200027501:0x1:0x0] at index 13 of catalog [0x200000401:0x1:0x0] 00000004:00080000:0.0:1786109812.271342:0:202495:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a83943180 version 1 rpc_version 1 00000020:00100000:0.0:1786109812.271362:0:202495:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109812.271370:0:202495:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab7e5ea00 x1872862933430016/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109812.271385:0:202495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933430016:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109812.271415:0:202495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.271450:0:202495:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2e480 going to sleep for 11 seconds 00000040:00080000:1.0:1786109812.272064:0:202510:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x240000400:0x1:0x0] first idx 5, last_idx 7 00000040:00080000:1.0:1786109812.272154:0:202510:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:1.0:1786109812.272157:0:202510:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x240002efa:0x1:0x0] at index 6 of catalog [0x240000400:0x1:0x0] 00000100:00100000:2.0:1786109812.278198:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933430016 00000100:00100000:2.0:1786109812.278211:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933430016 00000100:00100000:2.0:1786109812.278261:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1786109812.278269:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202495:x1872862933430016:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109812.278542:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:202495:x1872862933430016:12345-0@lo:1000:osp_up0-1.0 Request processed in 271us (7124us total) trans 347892350979 rc 0/0 00000100:00100000:2.0:1786109812.278550:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1786109812.278627:0:202511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933430144:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.278661:0:202511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.278687:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933430144 00000100:00100000:2.0:1786109812.278690:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933430144 00000100:00100000:2.0:1786109812.278709:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1786109812.278715:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202511:x1872862933430144:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.278755:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202511:x1872862933430144:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 40us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.278761:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1786109812.278775:0:202511:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985db9480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.278793:0:202511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933430144:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1786109812.278840:0:202511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1786109812.278870:0:202511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930985db9c00 with version 3 00000040:00080000:2.0:1786109812.278882:0:202511:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 13, last_idx 14 00000004:00080000:2.0:1786109812.278891:0:202511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930985db9e40 with version 4 00000040:00080000:2.0:1786109812.278894:0:202511:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200027501:0x1:0x0] at index 13 of catalog [0x200000401:0x1:0x0] 00000100:00100000:0.0:1786109812.279213:0:202495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7e5ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933430016:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1786109812.279223:0:202495:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a83943180 version 2 rpc_version 2 00000020:00100000:0.0:1786109812.279238:0:202495:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109812.279245:0:202495:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac0cec700 x1872862933430400/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109812.279264:0:202495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0cec700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933430400:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109812.279293:0:202495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.279327:0:202495:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2e480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.280630:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933430400 00000100:00100000:2.0:1786109812.280638:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933430400 00000100:00100000:2.0:1786109812.280680:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1786109812.280689:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:202495:x1872862933430400:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109812.280842:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:202495:x1872862933430400:12345-0@lo:1000:osp_up0-1.0 Request processed in 154us (1547us total) trans 347892350980 rc 0/0 00000100:00100000:2.0:1786109812.280850:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1786109812.281500:0:202495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0cec700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933430400:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1786109812.281513:0:202495:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a83943180 version 3 rpc_version 3 00000020:00100000:0.0:1786109812.281533:0:202495:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109812.281540:0:202495:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ab1c23100 x1872862933430656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109812.281558:0:202495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933430656:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109812.281592:0:202495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109812.281612:0:202495:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2e480 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.283199:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933430656 00000100:00100000:2.0:1786109812.283210:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933430656 00000100:00100000:2.0:1786109812.283251:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786109812.283260:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:202495:x1872862933430656:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109812.283489:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202495:x1872862933430656:12345-0@lo:1000:osp_up0-1.0 Request processed in 230us (1896us total) trans 347892350981 rc 0/0 00000100:00100000:2.0:1786109812.283497:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786109812.283539:0:202495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933430656:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786109812.283549:0:202495:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a83943180 version 4 rpc_version 4 00000020:00100000:2.0:1786109812.283565:0:202495:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109812.283571:0:202495:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098d899500 x1872862933430912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109812.283586:0:202495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933430912:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109812.283612:0:202495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.283629:0:202495:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985db99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.283639:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933430912 00000100:00100000:2.0:1786109812.283643:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933430912 00000100:00100000:2.0:1786109812.283661:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786109812.283667:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:202495:x1872862933430912:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109812.283736:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:202495:x1872862933430912:12345-0@lo:1000:osp_up0-1.0 Request processed in 69us (123us total) trans 347892350982 rc 0/0 00000100:00100000:2.0:1786109812.283743:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1786109812.283769:0:202495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d899500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933430912:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109812.283803:0:202511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933431040:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.283875:0:202511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.283892:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933431040 00000100:00100000:2.0:1786109812.283894:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933431040 00000100:00100000:2.0:1786109812.283911:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1786109812.283916:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:202511:x1872862933431040:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.284017:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:202511:x1872862933431040:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 100us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.284023:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1786109812.284039:0:202511:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985db9780 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.284050:0:202511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933431040:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1786109812.284089:0:202511:0:(llog.c:805:llog_process_thread()) index: 14, lh_last_idx: 14 synced_idx: 14 lgh_last_idx: 14 00000040:00080000:2.0:1786109812.284093:0:202511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x200027501:0x2:0x0] at index 14 of catalog [0x200000401:0x1:0x0] 00000100:00100000:2.0:1786109812.284151:0:202511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098d89b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933431168:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.284178:0:202511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.284198:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933431168 00000100:00100000:2.0:1786109812.284201:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933431168 00000100:00100000:2.0:1786109812.284222:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1786109812.284228:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202511:x1872862933431168:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1786109812.284271:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202511:x1872862933431168:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 43us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109812.284277:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1786109812.284293:0:202511:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985db9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.284305:0:202511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098d89b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:202511:1872862933431168:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1786109812.284339:0:202511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1786109812.284367:0:202511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930985db99c0 with version 5 00000004:00080000:2.0:1786109812.284377:0:202495:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a83943180 version 5 rpc_version 5 00000020:00100000:2.0:1786109812.284389:0:202495:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109812.284395:0:202495:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930aa5c54380 x1872862933431424/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109812.284408:0:202495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933431424:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109812.284456:0:202495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.284469:0:202495:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985db9780 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.284479:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933431424 00000100:00100000:2.0:1786109812.284482:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933431424 00000100:00100000:2.0:1786109812.284500:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1786109812.284505:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:202495:x1872862933431424:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109812.284601:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:202495:x1872862933431424:12345-0@lo:1000:osp_up0-1.0 Request processed in 95us (170us total) trans 347892350983 rc 0/0 00000100:00100000:2.0:1786109812.284607:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1786109812.284630:0:202495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933431424:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786109812.284662:0:202511:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930985db9780 with version 6 00000040:00080000:2.0:1786109812.284668:0:202511:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200027501:0x2:0x0] at index 14 of catalog [0x200000401:0x1:0x0] 00000040:00080000:2.0:1786109812.284684:0:202511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 14 count 1 00000004:00080000:2.0:1786109812.284735:0:202511:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1786109812.284761:0:202495:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a83943180 version 6 rpc_version 6 00000020:00100000:2.0:1786109812.284771:0:202495:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109812.284776:0:202495:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930aa5c54e00 x1872862933431680/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109812.284788:0:202495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933431680:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109812.284809:0:202495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109812.284821:0:202495:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985db9000 going to sleep for 11 seconds 00000100:00100000:2.0:1786109812.284829:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933431680 00000100:00100000:2.0:1786109812.284832:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933431680 00000100:00100000:2.0:1786109812.284849:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1786109812.284854:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:202495:x1872862933431680:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109812.284919:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:202495:x1872862933431680:12345-0@lo:1000:osp_up0-1.0 Request processed in 64us (108us total) trans 347892350984 rc 0/0 00000100:00100000:2.0:1786109812.284925:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1786109812.284948:0:202495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933431680:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1786109812.304582:0:202510:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x240002efa:0x1:0x0].3 00000020:00080000:0.0:1786109812.304593:0:202510:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 21474840727 transno = 0 mdt_index 1 00000040:00080000:0.0:1786109812.304604:0:202510:0:(llog.c:862:llog_process_thread()) stop processing plain [0x240002efa:0x1:0x0] index 4 count 2 00000040:00080000:0.0:1786109812.304645:0:202510:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1786109812.304648:0:202510:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x2400036c8:0x1:0x0] at index 7 of catalog [0x240000400:0x1:0x0] 00000004:00080000:0.0:1786109812.304726:0:202510:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x2400036c8:0x1:0x0].1 00000020:00080000:0.0:1786109812.304730:0:202510:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 25769804643 transno = 0 mdt_index 1 00000004:00080000:0.0:1786109812.304741:0:202510:0:(lod_dev.c:318:lod_process_recovery_updates()) lustre-MDT0001-mdtlov: process recovery updates [0x2400036c8:0x1:0x0].2 00000020:00080000:0.0:1786109812.304744:0:202510:0:(update_recovery.c:366:insert_update_records_to_replay_list()) lustre-MDT0001: insert record batchid = 25769804644 transno = 0 mdt_index 1 00000040:00080000:0.0:1786109812.304749:0:202510:0:(llog.c:862:llog_process_thread()) stop processing plain [0x2400036c8:0x1:0x0] index 3 count 3 00000040:00080000:0.0:1786109812.304763:0:202510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 8 count 3 00000004:00080000:0.0:1786109812.304819:0:202510:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1786109812.304824:0:202510:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00080000:1.0:1786109812.305005:0:202512:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1786109812.504518:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109812.504621:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922195200 00000100:00100000:3.0:1786109812.504629:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922195200 00010000:00010000:3.0:1786109812.504663:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff930ab9412000/0xdb52b77d7ca38c01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a191b expref: 10 pid: 201147 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786109812.504698:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12658 00000100:00100000:3.0:1786109812.504708:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922195200:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786109812.504722:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786109812.504728:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff930ab9412000/0xdb52b77d7ca38c01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a191b expref: 10 pid: 201147 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.504740:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff930ab9412000/0xdb52b77d7ca38c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a191b expref: 10 pid: 201147 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.504758:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9412000/0xdb52b77d7ca38c01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a191b expref: 10 pid: 201147 timeout: 8768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.507104:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.509864:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1786109812.510699:0:9538:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.276154823s 00010000:00010000:3.0:1786109812.510708:0:9538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.510718:0:9538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.510726:0:9538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.510734:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.510740:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab9361000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109812.510745:0:9538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.510752:0:9538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.510791:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109812.510804:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786109812.510964:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:2403:x1872862922195200:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 6172us (6447us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109812.510976:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12658 00010000:00010000:1.0:1786109812.512473:0:201149:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109812.512487:0:201149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109812.512494:0:201149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff930ab9361000/0xdb52b77d7ca38fd5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 201149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109813.127826:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786109813.585248:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1786109813.585257:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff930a89103000 from 338 10000000:01000000:0.0:1786109813.585262:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786109813.585311:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109813.585323:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109813.585334:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786109813.585360:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933431808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786109813.586533:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109813.586638:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933431808 00000100:00100000:2.0:1786109813.586647:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933431808 00000100:00100000:3.0:1786109813.586818:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930a97c2e600 going to sleep for 11 seconds 00000100:00100000:3.0:1786109813.586880:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1786109813.586890:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+22:6524:x1872862933431808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786109813.586904:0:201146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786109813.586920:0:201146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930ab8f6d800/0xdb52b77d7ca38fe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38fdc expref: -99 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109813.586943:0:201146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930ab8f6d800/0xdb52b77d7ca38fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38fdc expref: 23 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109813.586952:0:201146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930ab8f6d800/0xdb52b77d7ca38fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38fdc expref: 23 pid: 201146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109813.586961:0:201146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930ab8f6d800, rc 0) 00000100:00100000:3.0:1786109813.587172:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933431808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 282us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109813.587176:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933431808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786109813.587184:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:1.0:1786109813.587197:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38fdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38fe3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109813.587208:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38fdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38fe3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109813.587276:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933431936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1786109813.587318:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109813.587344:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9ebef00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109813.587371:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933431936 00000100:00100000:0.0:1786109813.587376:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933431936 00000100:00100000:0.0:1786109813.587459:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1786109813.587467:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933431936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786109813.587480:0:201147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786109813.587499:0:201147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786109813.587502:0:201147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 338 00000100:00100000:0.0:1786109813.587637:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933431936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 171us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109813.587644:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1786109813.587760:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933431936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1786109813.587803:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786109813.587810:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38fdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38fe3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109813.587817:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ac16c3e00/0xdb52b77d7ca38fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38fe3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786109813.587826:0:6524:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786109813.587828:0:6524:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93098617c000 from 338 10000000:01000000:1.0:1786109813.587831:0:6524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786109813.587847:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360400/0xdb52b77d7ca38fea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109813.587854:0:6524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff930ab9360400/0xdb52b77d7ca38fea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109813.587861:0:6524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff930ab9360400/0xdb52b77d7ca38fea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109813.587872:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933432064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786109813.587894:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109813.588013:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9ebef00 going to sleep for 11 seconds 00000100:00100000:2.0:1786109813.588085:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933432064 00000100:00100000:2.0:1786109813.588089:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933432064 00000100:00100000:2.0:1786109813.588122:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1786109813.588129:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+23:6524:x1872862933432064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109813.588136:0:201148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109813.588145:0:201148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930a97837c00/0xdb52b77d7ca38ff1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb52b77d7ca38fea expref: -99 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109813.588161:0:201148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a97837c00/0xdb52b77d7ca38ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb52b77d7ca38fea expref: 24 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109813.588169:0:201148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930a97837c00/0xdb52b77d7ca38ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb52b77d7ca38fea expref: 24 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109813.588175:0:201148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a97837c00, rc 0) 00000100:00100000:2.0:1786109813.588807:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933432064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 674us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109813.588814:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1786109813.588909:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933432064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786109813.588923:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff930ab9360400/0xdb52b77d7ca38fea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38ff1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109813.588932:0:6524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff930ab9360400/0xdb52b77d7ca38fea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb52b77d7ca38ff1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109813.588980:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933432192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1786109813.589015:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109813.589160:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab9ebef00 going to sleep for 11 seconds 00000100:00100000:2.0:1786109813.589289:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933432192 00000100:00100000:2.0:1786109813.589294:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933432192 00000100:00100000:2.0:1786109813.589319:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1786109813.589327:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933432192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1786109813.589341:0:201148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1786109813.589358:0:201148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786109813.589361:0:201148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 338 00000100:00100000:2.0:1786109813.589465:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:6524:x1872862933432192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109813.589472:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1786109813.589551:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aeab97cc-8463-4daa-a678-1bb2ad93cc69:6524:1872862933432192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1786109813.589605:0:6524:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786109813.589611:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff930ab9360400/0xdb52b77d7ca38fea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38ff1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786109813.589626:0:6524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff930ab9360400/0xdb52b77d7ca38fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb52b77d7ca38ff1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786109813.840760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109813.840879:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922195328 00000100:00100000:2.0:1786109813.840893:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922195328 00000100:00100000:2.0:1786109813.840978:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:2.0:1786109813.840990:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+9:161855:x1872862922195328:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786109813.841013:0:201148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786109813.841037:0:201148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff930a97837e00/0xdb52b77d7ca38ff8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1707b86ffc4a1929 expref: -99 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109813.841075:0:201148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff930a97837e00/0xdb52b77d7ca38ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1929 expref: 10 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109813.841090:0:201148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff930a97837e00/0xdb52b77d7ca38ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x1707b86ffc4a1929 expref: 10 pid: 201148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109813.841172:0:201148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff930a97837e00, rc 0) 00000100:00100000:2.0:1786109813.841252:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922195328:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 264us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109813.841260:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:3.0:1786109813.851582:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109813.851797:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922195456 00000100:00100000:2.0:1786109813.851861:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922195456 00000100:00100000:2.0:1786109813.851994:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:2.0:1786109813.852008:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922195456:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1786109813.852046:0:201146:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1786109813.852078:0:201146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1786109813.852082:0:201146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 338 00000100:00100000:2.0:1786109813.859179:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:161855:x1872862922195456:12345-192.168.203.38@tcp:256:ll_cfg_requeue.0 Request processed in 7155us (7591us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109813.859198:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:3.0:1786109813.868478:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109813.869396:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922195584 00000100:00100000:1.0:1786109813.869412:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922195584 00000100:00100000:1.0:1786109813.869503:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1348 00000100:00100000:1.0:1786109813.869515:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930984ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1872862922195584:12345-192.168.203.38@tcp:38:ll_cfg_requeue.0 00010000:00080000:1.0:1786109813.869555:0:187901:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'fac74500-4523-4794-af20-dfdcdfae19c1' at ffff930a90aa3000, cookie 0xdb52b77d7ca38f3b 00010000:00080000:1.0:1786109813.869566:0:187901:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp recovering/t30064771142 exp ffff930a90aa3000 cur 8670 last 1786109812 00010000:02000400:1.0:1786109813.869576:0:187901:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1786109813.869584:0:187901:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1786109813.869617:0:187901:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1786109813.871155:0:187901:0:(import.c:65:import_set_state_nolock()) ffff930ac1364800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786109813.871270:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930984ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922195584:12345-192.168.203.38@tcp:38:ll_cfg_requeue.0 Request processed in 1752us (2842us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109813.871282:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1348 00000100:00100000:1.0:1786109813.876560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109813.879195:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922195712 00000100:00100000:2.0:1786109813.879215:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922195712 00000100:00100000:2.0:1786109813.881856:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 516 00000100:00100000:2.0:1786109813.881892:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922195712:12345-192.168.203.38@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1786109813.881930:0:187900:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ab8f29880 x1872862922195712/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:284/0 lens 224/0 e 0 to 0 dl 1786109824 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109813.881969:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922195712:12345-192.168.203.38@tcp:400:ldlm_lock_repla.0 Request processed in 94us (5422us total) trans 0 rc 0/-999 00000100:00100000:2.0:1786109813.881978:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 516 00010000:00080000:0.0:1786109813.882400:0:202512:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1786109814.021009:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786109814.021032:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933432320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109814.021096:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109814.021152:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933432320 00000100:00100000:1.0:1786109814.021160:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933432320 00000100:00100000:1.0:1786109814.021213:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6005 00000100:00100000:1.0:1786109814.021222:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933432320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786109814.021252:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109814.021299:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933432320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109814.021306:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6005 00000100:00080000:1.0:1786109814.021326:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109814.021361:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933432320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109814.021564:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786109814.021574:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933432448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786109814.021604:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109814.021631:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933432448 00000100:00100000:0.0:1786109814.021635:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933432448 00000100:00100000:0.0:1786109814.021669:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6006 00000100:00100000:0.0:1786109814.021677:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933432448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786109814.021694:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 144064 pending 0 free 3923496960 avail 3691974656 00000100:00100000:0.0:1786109814.021727:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933432448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109814.021734:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6006 00000100:00100000:0.0:1786109814.021768:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933432448:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786109814.021782:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786109814.148776:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786109815.175505:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109815.312213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109815.312334:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922195968 00000100:00100000:3.0:1786109815.312343:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922195968 00000100:00100000:3.0:1786109815.312517:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 517 00000100:00080000:0.0:1786109815.312571:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786109815.312672:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922195968:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109815.312784:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922195968:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 257us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109815.312792:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 517 00000100:00100000:0.0:1786109815.312867:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109815.312958:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922195840 00000100:00100000:0.0:1786109815.312963:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922195840 00000100:00100000:0.0:1786109815.312993:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:0.0:1786109815.313001:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922195840:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109815.313034:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922195840:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 34us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109815.313041:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 115 00000001:00100000:3.0:1786109816.081568:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1786109816.081583:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:3.0:1786109816.081587:0:9518:0:(genops.c:906:class_export_put()) final put ffff93098666c000/fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:3.0:1786109816.081626:0:192991:0:(genops.c:865:class_export_destroy()) destroying export ffff93098666c000/fac74500-4523-4794-af20-dfdcdfae19c1 for lustre-OST0001 00000020:00000080:3.0:1786109816.081671:0:192991:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098666a800 for lustre-OST0001 00000001:00100000:1.0:1786109816.083690:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1786109816.083702:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:1.0:1786109816.083705:0:194579:0:(genops.c:906:class_export_put()) final put ffff930981dbd000/fac74500-4523-4794-af20-dfdcdfae19c1 00000020:00000080:1.0:1786109816.083737:0:171804:0:(genops.c:865:class_export_destroy()) destroying export ffff930981dbd000/fac74500-4523-4794-af20-dfdcdfae19c1 for lustre-OST0000 00000020:00000080:1.0:1786109816.083776:0:171804:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93098666e800 for lustre-OST0000 00010000:00010000:2.0:1786109816.319976:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786109816.560181:0:202754:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1786109817.221008:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1786109817.495209:0:202806:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1786109817.495578:0:202806:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1786109817.631695:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786109817.631718:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933432576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109817.631786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109817.659329:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933432576 00000100:00100000:2.0:1786109817.659343:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933432576 00000100:00100000:2.0:1786109817.659402:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1786109817.659412:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab1c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:3647:x1872862933432576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109817.659475:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445679104 avail 1299439616 00000100:00100000:2.0:1786109817.659559:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab1c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:3647:x1872862933432576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (27772us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109817.659565:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1786109817.660275:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109817.660280:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1786109817.660283:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109817.660290:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff930983499000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109817.660310:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0fb9c00 x1872862933432960/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109817.660334:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109817.660338:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1786109817.660340:0:192991:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109817.660344:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93098349d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109817.660355:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff930ac0fbaa00 x1872862933433216/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786109817.660363:0:192991:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786109817.660367:0:192991:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1786109817.660368:0:192991:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786109817.660373:0:192991:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff930a88c1d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1786109817.660386:0:192991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9309825ae300 x1872862933433344/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109817.660459:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933432832:0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.660505:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.660547:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933433728:0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.660568:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.660596:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786109817.660602:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933433088:0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.660624:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.660642:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933433856:0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.660669:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.660699:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933432960:0@lo:38:kworker.0 00000100:00100000:0.0:1786109817.660722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.660739:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933433216:0@lo:38:kworker.0 00000100:00100000:0.0:1786109817.660758:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.660773:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933433344:0@lo:38:kworker.0 00000100:00100000:0.0:1786109817.660793:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.660837:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933432832 00000100:00100000:0.0:1786109817.660843:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933432832 00000100:00100000:0.0:1786109817.660886:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933433728 00000100:00100000:0.0:1786109817.660889:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933433728 00000100:00100000:0.0:1786109817.660903:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933433088 00000100:00100000:0.0:1786109817.660905:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933433088 00000100:00100000:0.0:1786109817.660919:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933432960 00000100:00100000:0.0:1786109817.660921:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933432960 00000100:00100000:0.0:1786109817.660930:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933433216 00000100:00100000:0.0:1786109817.660932:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933433216 00000100:00100000:0.0:1786109817.660946:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1786109817.660954:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933432832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.660997:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1872862933432832:12345-0@lo:400:kworker.0 Request processed in 44us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.661003:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1786109817.661019:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1786109817.661025:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933433728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.661048:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933433728:12345-0@lo:400:kworker.0 Request processed in 24us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.661053:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1786109817.661065:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1786109817.661070:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933433088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.661198:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1872862933433088:12345-0@lo:400:kworker.0 Request processed in 127us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.661205:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1786109817.661223:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1786109817.661228:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933432960:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109817.661248:0:187899:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8674 last 0 00000020:00000080:0.0:1786109817.661278:0:187899:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xdb52b77d7ca38fff 00000004:00100000:0.0:1786109817.661292:0:187899:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109817.661405:0:187899:0:(import.c:65:import_set_state_nolock()) ffff930a8a47c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109817.661466:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872862933432960:12345-0@lo:38:kworker.0 Request processed in 236us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.661473:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1786109817.661492:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1786109817.661496:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1872862933433216:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109817.661507:0:187899:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8674 last 0 00000020:00000080:0.0:1786109817.661528:0:187899:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xdb52b77d7ca39006 00000004:00100000:0.0:1786109817.661535:0:187899:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109817.661552:0:187899:0:(import.c:65:import_set_state_nolock()) ffff930a8a479800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109817.661579:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872862933433216:12345-0@lo:38:kworker.0 Request processed in 81us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.661585:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1786109817.661614:0:179241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933433856 00000100:00100000:0.0:1786109817.661618:0:179241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933433856 00000100:00100000:0.0:1786109817.661644:0:179241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7183 00000100:00100000:0.0:1786109817.661650:0:179241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933433856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.661681:0:179241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933433856:12345-0@lo:400:kworker.0 Request processed in 32us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.661687:0:179241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7183 00000100:00100000:0.0:1786109817.661710:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933433344 00000100:00100000:0.0:1786109817.661714:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933433344 00000100:00100000:0.0:1786109817.661730:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1786109817.661734:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1872862933433344:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1786109817.661746:0:187904:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff930a90aa6000, cookie 0xdb52b77d7ca38f34 00010000:00080000:0.0:1786109817.661750:0:187904:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff930a90aa6000 cur 8674 last 1786109812 00000004:00100000:0.0:1786109817.661758:0:187904:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786109817.661770:0:187904:0:(import.c:65:import_set_state_nolock()) ffff930a8a47b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109817.661801:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933433344:12345-0@lo:38:kworker.0 Request processed in 65us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.661807:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1786109817.661822:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786109817.661826:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786109817.661840:0:202512:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1786109817.661845:0:202512:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 30064771143 00000020:00080000:0.0:1786109817.661849:0:202512:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 30064771142 00010000:00080000:0.0:1786109817.661852:0:202512:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 30064771143 00010000:00080000:0.0:1786109817.661855:0:202512:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (30064771143) 00000020:00080000:0.0:1786109817.661857:0:202512:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 30064771142 00000020:00080000:0.0:1786109817.661867:0:202512:0:(update_records.c:53:update_records_dump()) master transno = 30064771142 batchid = 21474840727 flags = 0 ops = 10 params = 16 00000020:00080000:0.0:1786109817.661871:0:202512:0:(update_records.c:72:update_records_dump()) update 0th [0x240002ef9:0x16:0x0] create params_count = 2 00000020:00080000:0.0:1786109817.661874:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce8122 0th off = 0 size = 208 00000020:00080000:0.0:1786109817.661876:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce81fa 1th off = 1 size = 16 00000020:00080000:0.0:1786109817.661878:0:202512:0:(update_records.c:72:update_records_dump()) update 1th [0x240002ef9:0x16:0x0] ref_add params_count = 0 00000020:00080000:0.0:1786109817.661881:0:202512:0:(update_records.c:72:update_records_dump()) update 2th [0x240002ef9:0x16:0x0] insert params_count = 3 00000020:00080000:0.0:1786109817.661883:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce8212 0th off = 2 size = 2 00000020:00080000:0.0:1786109817.661885:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce8222 1th off = 3 size = 16 00000020:00080000:0.0:1786109817.661887:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce823a 2th off = 4 size = 4 00000020:00080000:0.0:1786109817.661889:0:202512:0:(update_records.c:72:update_records_dump()) update 3th [0x240002ef9:0x16:0x0] insert params_count = 3 00000020:00080000:0.0:1786109817.661890:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce824a 0th off = 5 size = 3 00000020:00080000:0.0:1786109817.661892:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce81fa 1th off = 1 size = 16 00000020:00080000:0.0:1786109817.661894:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce823a 2th off = 4 size = 4 00000020:00080000:0.0:1786109817.661895:0:202512:0:(update_records.c:72:update_records_dump()) update 4th [0x240002ef9:0x16:0x0] xattr_set params_count = 3 00000020:00080000:0.0:1786109817.661898:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce825a 0th off = 6 size = 12 00000020:00080000:0.0:1786109817.661900:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce8272 1th off = 7 size = 48 00000020:00080000:0.0:1786109817.661901:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce82aa 2th off = 8 size = 4 00000020:00080000:0.0:1786109817.661903:0:202512:0:(update_records.c:72:update_records_dump()) update 5th [0x240002ef9:0x16:0x0] xattr_set params_count = 3 00000020:00080000:0.0:1786109817.661905:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce82ba 0th off = 9 size = 9 00000020:00080000:0.0:1786109817.661907:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce82d2 1th off = 10 size = 5 00000020:00080000:0.0:1786109817.661909:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce82aa 2th off = 8 size = 4 00000020:00080000:0.0:1786109817.661911:0:202512:0:(update_records.c:72:update_records_dump()) update 6th [0x200026d31:0x4:0x0] insert params_count = 3 00000020:00080000:0.0:1786109817.661913:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce82e2 0th off = 11 size = 11 00000020:00080000:0.0:1786109817.661915:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce8222 1th off = 3 size = 16 00000020:00080000:0.0:1786109817.661916:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce82fa 2th off = 12 size = 4 00000020:00080000:0.0:1786109817.661918:0:202512:0:(update_records.c:72:update_records_dump()) update 7th [0x200026d31:0x4:0x0] ref_add params_count = 0 00000020:00080000:0.0:1786109817.661920:0:202512:0:(update_records.c:72:update_records_dump()) update 8th [0x240002ef9:0x16:0x0] xattr_set params_count = 3 00000020:00080000:0.0:1786109817.661921:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce830a 0th off = 13 size = 13 00000020:00080000:0.0:1786109817.661923:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce8322 1th off = 14 size = 52 00000020:00080000:0.0:1786109817.661925:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce82aa 2th off = 8 size = 4 00000020:00080000:0.0:1786109817.661927:0:202512:0:(update_records.c:72:update_records_dump()) update 9th [0x200026d31:0x4:0x0] attr_set params_count = 1 00000020:00080000:0.0:1786109817.661929:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7ce8362 0th off = 15 size = 208 00000100:00100000:0.0:1786109817.662092:0:202512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fded80 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202512:1872862933434240:0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1786109817.662199:0:202512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.662220:0:202512:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac0858000 going to sleep for 11 seconds 00000100:00100000:0.0:1786109817.662236:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933434240 00000100:00100000:0.0:1786109817.662239:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933434240 00000100:00100000:0.0:1786109817.662262:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1786109817.662269:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:202512:x1872862933434240:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1786109817.662346:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:202512:x1872862933434240:12345-0@lo:1000:tgt_recover_1.0 Request processed in 76us (146us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786109817.662353:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1786109817.662374:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933433472:0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.662400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.662420:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933433984:0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.662467:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.662497:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1786109817.662503:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933432704:0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.662527:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.662552:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933433600:0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.662572:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.662591:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933434112:0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.662612:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.662636:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933433472 00000100:00100000:0.0:1786109817.662640:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933433472 00000100:00100000:0.0:1786109817.662666:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933433984 00000100:00100000:0.0:1786109817.662668:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933433984 00000100:00100000:0.0:1786109817.662684:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933433600 00000100:00100000:0.0:1786109817.662687:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933433600 00000100:00100000:0.0:1786109817.662705:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7184 00000100:00100000:0.0:1786109817.662711:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933433472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.662747:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933433472:12345-0@lo:400:kworker.0 Request processed in 37us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.662752:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7184 00000100:00100000:0.0:1786109817.662763:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7185 00000100:00100000:0.0:1786109817.662768:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933433984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.662791:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1872862933433984:12345-0@lo:400:kworker.0 Request processed in 24us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.662796:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7185 00000100:00100000:0.0:1786109817.662805:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7186 00000100:00100000:0.0:1786109817.662810:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933433600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.662830:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1872862933433600:12345-0@lo:400:kworker.0 Request processed in 20us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.662835:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7186 00000100:00100000:0.0:1786109817.662850:0:201146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933432704 00000100:00100000:0.0:1786109817.662853:0:201146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933432704 00000100:00100000:0.0:1786109817.662874:0:201146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1786109817.662879:0:201146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933432704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109817.662906:0:201146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3646:x1872862933432704:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.662912:0:201146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1786109817.662949:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786109817.662952:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786109817.662981:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac0fb9c00 x1872862933432960/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109817.662995:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 8 00000100:00080000:0.0:1786109817.663907:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff930ac0fb9c00 x1872862933432960/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109842 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109817.663917:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109817.663922:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930983499000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109817.663925:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109817.663930:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1872862933432960:0@lo:38:kworker.0 00010000:00080000:0.0:1786109817.663953:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac0fbaa00 x1872862933433216/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109817.663962:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 8 00000100:00100000:1.0:1786109817.665816:0:202512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fded80 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202512:1872862933434240:0@lo:1000:tgt_recover_1.0 00000020:00080000:1.0:1786109817.665859:0:202512:0:(update_recovery.c:695:update_is_committed()) Update of [0x200026d31:0x4:0x0]on MDT0 is not committed 00000020:00080000:1.0:1786109817.665865:0:202512:0:(update_recovery.c:1202:update_recovery_exec()) replay 6th update 00000020:00080000:1.0:1786109817.665886:0:202512:0:(update_recovery.c:1202:update_recovery_exec()) replay 7th update 00000020:00080000:1.0:1786109817.665944:0:202512:0:(update_recovery.c:1202:update_recovery_exec()) replay 9th update 00000100:00100000:1.0:1786109817.665993:0:202512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab8f29500 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202512:1872862933434368:0@lo:700:tgt_recover_1.0 00000100:00100000:1.0:1786109817.666048:0:202512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109817.666095:0:202512:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab967c180 going to sleep for 11 seconds 00000100:00100000:1.0:1786109817.666209:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933432576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109817.666257:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1872862933433088:0@lo:400:kworker.0 00000100:00100000:1.0:1786109817.666276:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933433856:0@lo:400:kworker.0 00000100:00100000:1.0:1786109817.666288:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1872862933432832:0@lo:400:kworker.0 00000100:00100000:1.0:1786109817.666301:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933433728:0@lo:400:kworker.0 00000100:00100000:1.0:1786109817.666358:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3646:1872862933432704:0@lo:400:kworker.0 00000100:00100000:1.0:1786109817.666369:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933433600:0@lo:400:kworker.0 00000100:00100000:1.0:1786109817.666381:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933433472:0@lo:400:kworker.0 00000100:00100000:1.0:1786109817.666396:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933433984:0@lo:400:kworker.0 00000100:00100000:1.0:1786109817.666470:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933434112 00000100:00100000:1.0:1786109817.666477:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933434112 00000100:00100000:1.0:1786109817.666522:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1786109817.666533:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933434112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109817.666588:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872862933434112:12345-0@lo:400:kworker.0 Request processed in 56us (3973us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109817.666595:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1786109817.666630:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872862933434112:0@lo:400:kworker.0 00000100:00100000:1.0:1786109817.666926:0:187908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933434368 00000100:00100000:1.0:1786109817.666931:0:187908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933434368 00000100:00100000:1.0:1786109817.666960:0:187908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786109817.666968:0:187908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+11:202512:x1872862933434368:12345-0@lo:700:tgt_recover_1.0 00000100:00100000:1.0:1786109817.667014:0:187908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+11:202512:x1872862933434368:12345-0@lo:700:tgt_recover_1.0 Request processed in 46us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109817.667021:0:187908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786109817.667046:0:202512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab8f29500 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202512:1872862933434368:0@lo:700:tgt_recover_1.0 00000100:00080000:0.0:1786109817.667939:0:3645:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff930ac0fbaa00 x1872862933433216/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786109842 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786109817.667952:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1786109817.667957:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93098349d800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1786109817.667961:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1786109817.667967:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1872862933433216:0@lo:38:kworker.0 00000100:00080000:0.0:1786109817.668007:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 8 00000100:00080000:0.0:1786109817.668016:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1786109817.668021:0:3645:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0001_UUID 00000100:00080000:0.0:1786109817.668023:0:3645:0:(recover.c:53:ptlrpc_replay_next()) import ffff930a88c1d800 from lustre-MDT0001_UUID committed 0 last 0 00000100:00080000:0.0:1786109817.668027:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000040:00080000:0.0:1786109817.668910:0:202512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786109817.668929:0:202512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].15, 64 off33728 00000004:00080000:0.0:1786109817.668937:0:202512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930ab967c180 with version 7 00000040:00080000:0.0:1786109817.669011:0:202512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786109817.669022:0:202512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].16, 64 off33792 00000004:00080000:0.0:1786109817.669027:0:202512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930ac0858000 with version 8 00000020:00000400:0.0:1786109817.669038:0:202512:0:(update_recovery.c:1391:distribute_txn_replay_handle()) lustre-MDT0001-mdtlov: error during execution of #0 from /home/green/git/lustre-release/lustre/ptlrpc/../target/update_recovery.c:946: rc = -116 00000004:00080000:1.0:1786109817.670228:0:202495:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a83943180 version 7 rpc_version 7 00000020:00100000:1.0:1786109817.670271:0:202495:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786109817.670282:0:202495:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930ac1705880 x1872862933434624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786109817.670306:0:202495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1705880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933434624:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786109817.670370:0:202495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109817.670403:0:202495:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ab967c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786109817.670472:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933434624 00000100:00100000:1.0:1786109817.670479:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933434624 00000100:00100000:1.0:1786109817.670524:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1786109817.670533:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:202495:x1872862933434624:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1786109817.683826:0:201141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350985 is committed 00000100:00100000:2.0:1786109817.683980:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202495:x1872862933434624:12345-0@lo:1000:osp_up0-1.0 Request processed in 13443us (13604us total) trans 347892350985 rc 0/0 00000100:00100000:2.0:1786109817.683992:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000004:00080000:2.0:1786109817.684044:0:202495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350985 committed transno 347892350985 00000100:00100000:2.0:1786109817.684049:0:202495:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350985 gen 2 00000004:00080000:2.0:1786109817.684053:0:202495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350979 committed transno 347892350985 00000004:00080000:2.0:1786109817.684070:0:202495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350980 committed transno 347892350985 00000004:00080000:2.0:1786109817.684095:0:202495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350981 committed transno 347892350985 00000004:00080000:2.0:1786109817.684103:0:202495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350982 committed transno 347892350985 00000004:00080000:2.0:1786109817.684113:0:202495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350983 committed transno 347892350985 00000004:00080000:2.0:1786109817.684196:0:202495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350984 committed transno 347892350985 00000100:00100000:2.0:1786109817.684220:0:202495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1705880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933434624:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786109817.684246:0:202495:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a83943180 version 8 rpc_version 8 00000020:00100000:2.0:1786109817.684270:0:202495:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786109817.684277:0:202495:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff930aa5c54e00 x1872862933434880/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786109817.684309:0:202495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933434880:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786109817.684349:0:202495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109817.684376:0:202495:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c160540 going to sleep for 11 seconds 00000100:00100000:2.0:1786109817.684392:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933434880 00000100:00100000:2.0:1786109817.684399:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933434880 00000100:00100000:2.0:1786109817.684456:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1786109817.684465:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202495:x1872862933434880:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786109817.689239:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933433344:0@lo:38:kworker.0 00010000:00080000:2.0:1786109817.689542:0:202810:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0001-osp-MDT0000 to lustre-MDT0001_UUID@0@lo 00010000:00010000:2.0:1786109817.689548:0:202810:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0001-osp-MDT0000 (0) 00010000:00010000:2.0:1786109817.689553:0:202810:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0001-osp-MDT0000 00000100:00080000:2.0:1786109817.689984:0:202810:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1786109817.691930:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933435008:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1786109817.691999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109817.692151:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933435008 00000100:00100000:1.0:1786109817.692159:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933435008 00000100:00100000:1.0:1786109817.692198:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1786109817.692206:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933435008:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1786109817.692225:0:199402:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff930ac1707800 x1872862933435008/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:288/0 lens 224/0 e 0 to 0 dl 1786109828 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109817.692236:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1872862933435008:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 31us (238us total) trans 0 rc 0/-999 00000100:00100000:1.0:1786109817.692243:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000004:00080000:0.0:1786109817.701498:0:202512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930ab967cf00 with version 0 00000020:00080000:0.0:1786109817.701511:0:202512:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff930a97c2e480 refcount 3 committed 0 result -116 batchid 21474840727 00000020:00080000:0.0:1786109817.701516:0:202512:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff930ac1fc1700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result -116 sub_th ffff930ab967cf00 00000020:00080000:0.0:1786109817.701519:0:202512:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9309858eab00 obd lustre-MDT0001-osd committed 1 started 0 stopped 0 result 0 sub_th 0000000000000000 00000020:00080000:0.0:1786109817.701522:0:202512:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240002efa:0x1:0x0].3 00010000:00080000:0.0:1786109817.701735:0:202512:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 66 seconds 00000020:00080000:0.0:1786109817.701738:0:202512:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t30064771142 00000020:00080000:0.0:1786109817.701745:0:202512:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 30064771142 00010000:00080000:0.0:1786109817.701749:0:202512:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 30064771143 00010000:00080000:0.0:1786109817.701752:0:202512:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (30064771143) 00000020:00080000:0.0:1786109817.701754:0:202512:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 30064771142 00000020:00080000:0.0:1786109817.701770:0:202512:0:(update_records.c:53:update_records_dump()) master transno = 30064771142 batchid = 25769804643 flags = 0 ops = 6 params = 2 00000020:00080000:0.0:1786109817.701774:0:202512:0:(update_records.c:72:update_records_dump()) update 0th [0x200026d31:0x4:0x0] delete params_count = 1 00000020:00080000:0.0:1786109817.701777:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab2c430ac 0th off = 0 size = 11 00000020:00080000:0.0:1786109817.701779:0:202512:0:(update_records.c:72:update_records_dump()) update 1th [0x200026d31:0x4:0x0] ref_del params_count = 0 00000020:00080000:0.0:1786109817.701782:0:202512:0:(update_records.c:72:update_records_dump()) update 2th [0x240002ef9:0x16:0x0] ref_del params_count = 0 00000020:00080000:0.0:1786109817.701784:0:202512:0:(update_records.c:72:update_records_dump()) update 3th [0x240002ef9:0x16:0x0] ref_del params_count = 0 00000020:00080000:0.0:1786109817.701786:0:202512:0:(update_records.c:72:update_records_dump()) update 4th [0x200026d31:0x4:0x0] attr_set params_count = 1 00000020:00080000:0.0:1786109817.701788:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab2c430c4 0th off = 1 size = 208 00000020:00080000:0.0:1786109817.701790:0:202512:0:(update_records.c:72:update_records_dump()) update 5th [0x240002ef9:0x16:0x0] destroy params_count = 0 00000100:00100000:0.0:1786109817.701867:0:202512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202512:1872862933435136:0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1786109817.701925:0:202512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.701956:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933435136 00000100:00100000:0.0:1786109817.701962:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933435136 00000100:00100000:0.0:1786109817.701993:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1786109817.702000:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:202512:x1872862933435136:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:2.0:1786109817.705551:0:202512:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac10c1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786109817.706362:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:202512:x1872862933435136:12345-0@lo:1000:tgt_recover_1.0 Request processed in 4356us (4430us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786109817.706374:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1786109817.706884:0:202512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202512:1872862933435136:0@lo:1000:tgt_recover_1.0 00000020:00080000:0.0:1786109817.706922:0:202512:0:(update_recovery.c:695:update_is_committed()) Update of [0x200026d31:0x4:0x0]on MDT0 is not committed 00000020:00080000:0.0:1786109817.706927:0:202512:0:(update_recovery.c:1202:update_recovery_exec()) replay 0th update 00000020:00020000:0.0:1786109817.706940:0:202512:0:(update_trans.c:1080:top_trans_stop()) lustre-MDT0000-osp-MDT0001: stop trans failed: rc = -20 00000020:00080000:1.0:1786109817.711262:0:202509:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840726 00000001:00080000:1.0:1786109817.711297:0:201141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350986 is committed 00000100:00100000:2.0:1786109817.711699:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202495:x1872862933434880:12345-0@lo:1000:osp_up0-1.0 Request processed in 27231us (27346us total) trans 347892350986 rc 0/0 00000100:00100000:2.0:1786109817.711711:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000004:00080000:1.0:1786109817.711823:0:202495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350986 committed transno 347892350986 00000100:00100000:1.0:1786109817.711828:0:202495:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350986 gen 2 00000100:00100000:1.0:1786109817.711848:0:202495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933434880:0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1786109817.734310:0:202512:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 66 seconds 00000020:00080000:0.0:1786109817.734320:0:202512:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t30064771142 00000020:00080000:0.0:1786109817.734329:0:202512:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 30064771142 00010000:00080000:0.0:1786109817.734332:0:202512:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 30064771143 00010000:00080000:0.0:1786109817.734335:0:202512:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (30064771143) 00000020:00080000:0.0:1786109817.734338:0:202512:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 30064771142 00000020:00080000:0.0:1786109817.734356:0:202512:0:(update_records.c:53:update_records_dump()) master transno = 30064771142 batchid = 25769804644 flags = 0 ops = 10 params = 16 00000020:00080000:0.0:1786109817.734360:0:202512:0:(update_records.c:72:update_records_dump()) update 0th [0x240002ef9:0x2b:0x0] create params_count = 2 00000020:00080000:0.0:1786109817.734365:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cef922 0th off = 0 size = 208 00000020:00080000:0.0:1786109817.734368:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cef9fa 1th off = 1 size = 16 00000020:00080000:0.0:1786109817.734370:0:202512:0:(update_records.c:72:update_records_dump()) update 1th [0x240002ef9:0x2b:0x0] ref_add params_count = 0 00000020:00080000:0.0:1786109817.734372:0:202512:0:(update_records.c:72:update_records_dump()) update 2th [0x240002ef9:0x2b:0x0] insert params_count = 3 00000020:00080000:0.0:1786109817.734375:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefa12 0th off = 2 size = 2 00000020:00080000:0.0:1786109817.734377:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefa22 1th off = 3 size = 16 00000020:00080000:0.0:1786109817.734379:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefa3a 2th off = 4 size = 4 00000020:00080000:0.0:1786109817.734381:0:202512:0:(update_records.c:72:update_records_dump()) update 3th [0x240002ef9:0x2b:0x0] insert params_count = 3 00000020:00080000:0.0:1786109817.734383:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefa4a 0th off = 5 size = 3 00000020:00080000:0.0:1786109817.734385:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cef9fa 1th off = 1 size = 16 00000020:00080000:0.0:1786109817.734387:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefa3a 2th off = 4 size = 4 00000020:00080000:0.0:1786109817.734389:0:202512:0:(update_records.c:72:update_records_dump()) update 4th [0x240002ef9:0x2b:0x0] xattr_set params_count = 3 00000020:00080000:0.0:1786109817.734392:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefa5a 0th off = 6 size = 12 00000020:00080000:0.0:1786109817.734394:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefa72 1th off = 7 size = 48 00000020:00080000:0.0:1786109817.734396:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefaaa 2th off = 8 size = 4 00000020:00080000:0.0:1786109817.734398:0:202512:0:(update_records.c:72:update_records_dump()) update 5th [0x240002ef9:0x2b:0x0] xattr_set params_count = 3 00000020:00080000:0.0:1786109817.734401:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefaba 0th off = 9 size = 9 00000020:00080000:0.0:1786109817.734403:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefad2 1th off = 10 size = 5 00000020:00080000:0.0:1786109817.734404:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefaaa 2th off = 8 size = 4 00000020:00080000:0.0:1786109817.734406:0:202512:0:(update_records.c:72:update_records_dump()) update 6th [0x200026d31:0x7:0x0] insert params_count = 3 00000020:00080000:0.0:1786109817.734409:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefae2 0th off = 11 size = 11 00000020:00080000:0.0:1786109817.734411:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefa22 1th off = 3 size = 16 00000020:00080000:0.0:1786109817.734413:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefafa 2th off = 12 size = 4 00000020:00080000:0.0:1786109817.734415:0:202512:0:(update_records.c:72:update_records_dump()) update 7th [0x200026d31:0x7:0x0] ref_add params_count = 0 00000020:00080000:0.0:1786109817.734418:0:202512:0:(update_records.c:72:update_records_dump()) update 8th [0x240002ef9:0x2b:0x0] xattr_set params_count = 3 00000020:00080000:0.0:1786109817.734420:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefb0a 0th off = 13 size = 13 00000020:00080000:0.0:1786109817.734422:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefb22 1th off = 14 size = 52 00000020:00080000:0.0:1786109817.734425:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefaaa 2th off = 8 size = 4 00000020:00080000:0.0:1786109817.734427:0:202512:0:(update_records.c:72:update_records_dump()) update 9th [0x200026d31:0x7:0x0] attr_set params_count = 1 00000020:00080000:0.0:1786109817.734456:0:202512:0:(update_records.c:87:update_records_dump()) param = ffff930ab7cefb62 0th off = 15 size = 208 00000100:00100000:0.0:1786109817.735898:0:202512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202512:1872862933435264:0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1786109817.735964:0:202512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.736006:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933435264 00000100:00100000:0.0:1786109817.736013:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933435264 00000100:00100000:0.0:1786109817.736052:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1786109817.736061:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202512:x1872862933435264:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1786109817.736763:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:202512:x1872862933435264:12345-0@lo:1000:tgt_recover_1.0 Request processed in 700us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.736772:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1786109817.736799:0:202512:0:(client.c:2702:ptlrpc_set_wait()) set ffff930ac10c1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786109817.736825:0:202512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202512:1872862933435264:0@lo:1000:tgt_recover_1.0 00000020:00080000:0.0:1786109817.736862:0:202512:0:(update_recovery.c:695:update_is_committed()) Update of [0x200026d31:0x7:0x0]on MDT0 is not committed 00000020:00080000:0.0:1786109817.736866:0:202512:0:(update_recovery.c:1202:update_recovery_exec()) replay 6th update 00000020:00080000:0.0:1786109817.736876:0:202512:0:(update_recovery.c:1202:update_recovery_exec()) replay 7th update 00000020:00080000:0.0:1786109817.736881:0:202512:0:(update_recovery.c:1202:update_recovery_exec()) replay 9th update 00000020:00080000:0.0:1786109817.736902:0:202512:0:(update_recovery.c:1414:distribute_txn_replay_handle()) lustre-MDT0000-osp-MDT0001: executed 0/3: rc = 0 00000020:00080000:0.0:1786109817.736907:0:202512:0:(update_recovery.c:1414:distribute_txn_replay_handle()) lustre-MDT0000-osp-MDT0001: executed 1/3: rc = 0 00000020:00080000:0.0:1786109817.736911:0:202512:0:(update_recovery.c:1414:distribute_txn_replay_handle()) lustre-MDT0000-osp-MDT0001: executed 2/3: rc = 0 00000100:00100000:0.0:1786109817.736942:0:202512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202512:1872862933435392:0@lo:1000:tgt_recover_1.0 00000100:00100000:0.0:1786109817.736971:0:202512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.737003:0:202512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309825c5240 going to sleep for 11 seconds 00000100:00100000:1.0:1786109817.737705:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933435392 00000100:00100000:1.0:1786109817.737712:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933435392 00000100:00100000:1.0:1786109817.737747:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1786109817.737756:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202512:x1872862933435392:12345-0@lo:1000:tgt_recover_1.0 00000100:00100000:1.0:1786109817.737826:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:202512:x1872862933435392:12345-0@lo:1000:tgt_recover_1.0 Request processed in 71us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109817.737834:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1786109817.738486:0:202512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fdd880 pname:cluuid:pid:xid:nid:opc:job tgt_recover_1:lustre-MDT0001-mdtlov_UUID:202512:1872862933435392:0@lo:1000:tgt_recover_1.0 00000040:00080000:0.0:1786109817.739382:0:202512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200027cd1:0x1:0x0].1, 1096 off33864 00000004:00080000:0.0:1786109817.739394:0:202512:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff930a8163db40 with version 9 00000004:00080000:0.0:1786109817.739410:0:202495:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff930a83943180 version 9 rpc_version 9 00000020:00100000:0.0:1786109817.739466:0:202495:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786109817.739475:0:202495:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff93098e50f480 x1872862933435648/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786109817.739496:0:202495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933435648:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109817.740183:0:202495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109817.740212:0:202495:0:(client.c:2702:ptlrpc_set_wait()) set ffff930985db9780 going to sleep for 11 seconds 00000100:00100000:0.0:1786109817.740230:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933435648 00000100:00100000:0.0:1786109817.740235:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933435648 00000100:00100000:0.0:1786109817.740269:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1786109817.740277:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:202495:x1872862933435648:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786109817.742448:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:202495:x1872862933435648:12345-0@lo:1000:osp_up0-1.0 Request processed in 2147us (2876us total) trans 347892350987 rc 0/0 00000100:00100000:0.0:1786109817.742463:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1786109817.742533:0:202495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202495:1872862933435648:0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1786109817.742578:0:202512:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 66 seconds 00000020:00080000:0.0:1786109817.742582:0:202512:0:(update_recovery.c:483:dtrq_destroy()) destroy x0 t30064771142 00000020:00080000:0.0:1786109817.742590:0:202512:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1786109817.742592:0:202512:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 30064771143 00010000:00080000:0.0:1786109817.742595:0:202512:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1786109817.742598:0:202512:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1786109817.742603:0:202512:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1786109817.742606:0:202512:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1786109817.750676:0:202512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 8, last_transno is 34359738368 00000001:00100000:0.0:1786109817.750828:0:202489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00100000:1.0:1786109817.761514:0:202489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1786109817.761649:0:202512:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1786109817.761699:0:202512:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-MDT0001: cancel recovery timer 00010000:00080000:3.0:1786109817.761715:0:202512:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.203.38@tcp: req@ffff930ab8f29880 x1872862922195712/t0(0) o400->fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp:284/0 lens 224/0 e 0 to 0 dl 1786109824 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1786109817.761812:0:202512:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff930ac1707800 x1872862933435008/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:288/0 lens 224/0 e 0 to 0 dl 1786109828 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1786109817.761979:0:202512:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-MDT0001: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1786109817.766325:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1786109817.766342:0:3645:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff930aa5c56d80 x1872862933435008/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109833 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109817.766353:0:3645:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff930aa5c56d80 x1872862933435008/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109833 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786109817.766361:0:3645:0:(import.c:65:import_set_state_nolock()) ffff930a88c1d800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1786109817.766380:0:3645:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1786109817.766386:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000015c5cfb9): req@ffff930984ff2d80 x1872862933417344/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1786109809 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109817.766400:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1872862933435008:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1786109817.766695:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109817.766735:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac1706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933435776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109817.766760:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109817.766797:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933417344 00000100:00100000:1.0:1786109817.766803:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933417344 00000100:00100000:1.0:1786109817.769467:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933435776 00000100:00100000:1.0:1786109817.769480:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933435776 00000100:00100000:1.0:1786109817.769502:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1786109817.769512:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1872862933417344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109817.769554:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446031360 avail 1299791872 00000100:00100000:1.0:1786109817.769633:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1872862933417344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109817.769641:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1786109817.769658:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1786109817.769665:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933435776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786109817.769676:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446031360 avail 1299791872 00000100:00100000:1.0:1786109817.769707:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933435776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (2946us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109817.769713:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1786109817.769776:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac1706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933435776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109817.773959:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933417344:0@lo:41:osp-pre-1-0.0 00000004:00000080:2.0:1786109817.823230:0:202512:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa66f086efe10 00100000:10000000:2.0:1786109817.823245:0:202512:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:2.0:1786109817.826018:0:202498:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000401:0x40b:0x0] 00000100:00100000:2.0:1786109817.826068:0:202498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c55f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:202498:1872862933435904:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1786109817.826144:0:202498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109817.826177:0:202498:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c160180 going to sleep for 11 seconds 00000004:00080000:2.0:1786109817.826190:0:202500:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x40b:0x0] 00000100:00100000:2.0:1786109817.826206:0:202500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:202500:1872862933436032:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1786109817.826230:0:202500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109817.826247:0:202500:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1609c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109817.826263:0:179238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933435904 00000100:00100000:2.0:1786109817.826269:0:179238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933435904 00000100:00100000:2.0:1786109817.826306:0:179238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23205 00000100:00100000:2.0:1786109817.826315:0:179238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:202498:x1872862933435904:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1786109817.826341:0:179238:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1057 -> diff = -22 00002000:02000040:2.0:1786109817.826346:0:179238:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000401:1036 to 0x280000401:1057) 00000100:00100000:3.0:1786109817.828203:0:179254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933436032 00000100:00100000:3.0:1786109817.828212:0:179254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933436032 00000100:00100000:3.0:1786109817.828250:0:179254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23206 00000100:00100000:3.0:1786109817.828259:0:179254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:202500:x1872862933436032:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1786109817.828285:0:179254:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1057 -> diff = -22 00002000:02000040:3.0:1786109817.828290:0:179254:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:1036 to 0x2c0000400:1057) 00002000:00010000:2.0:1786109817.847101:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x421:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109817.847115:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca3900d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847132:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x421:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:2.0:1786109817.847137:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x421:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109817.847143:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca3900d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847159:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca3900d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847170:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca3900d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847177:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca3900d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847196:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109817.847207:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109817.847213:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca3900d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847220:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.847224:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca3900d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847232:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca3900d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847247:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca3900d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847254:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6b1bd36/0xdb52b77d7ca3900d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847274:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.847276:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.847277:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109817.847367:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x420:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109817.847373:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca39014 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847381:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x420:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:2.0:1786109817.847384:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x420:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109817.847388:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca39014 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847396:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca39014 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847403:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca39014 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847410:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca39014 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847426:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109817.847455:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109817.847460:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca39014 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847473:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.847477:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca39014 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847485:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca39014 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847494:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca39014 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847501:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4f2a028/0xdb52b77d7ca39014 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.847514:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.847516:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.847517:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109817.855297:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109817.855309:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca3901b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855325:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41f:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:2.0:1786109817.855329:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109817.855334:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca3901b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855349:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca3901b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855359:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca3901b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855366:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca3901b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855382:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109817.855393:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109817.855399:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca3901b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855407:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.855411:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca3901b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855419:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca3901b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855594:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca3901b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855603:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef32df23/0xdb52b77d7ca3901b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855618:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.855621:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.855623:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109817.855682:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109817.855687:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca39022 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855694:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41e:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:2.0:1786109817.855697:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109817.855701:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca39022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855709:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca39022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855717:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca39022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855723:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca39022 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855737:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109817.855744:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109817.855749:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca39022 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855755:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.855758:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca39022 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855770:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca39022 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855780:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca39022 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855787:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b07753b/0xdb52b77d7ca39022 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.855797:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.855799:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.855800:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109817.858201:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109817.858213:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca39029 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858228:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41d:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:2.0:1786109817.858232:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109817.858238:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca39029 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858252:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca39029 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858262:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca39029 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858270:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca39029 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858287:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109817.858297:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109817.858302:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca39029 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858309:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.858313:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca39029 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858321:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca39029 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858335:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca39029 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858343:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000137ea14/0xdb52b77d7ca39029 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858358:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.858360:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.858362:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109817.858409:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109817.858415:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca39030 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858422:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41c:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:2.0:1786109817.858426:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109817.858444:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca39030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858455:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca39030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858462:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca39030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858468:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca39030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858481:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109817.858489:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109817.858493:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca39030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858500:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.858503:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca39030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858511:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca39030 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858521:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca39030 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858528:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7ebc4de/0xdb52b77d7ca39030 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858541:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.858543:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.858544:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109817.858589:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109817.858595:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca39037 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858603:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41b:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:2.0:1786109817.858606:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109817.858611:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca39037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858620:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca39037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858627:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca39037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858634:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca39037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858648:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109817.858655:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109817.858659:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca39037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858666:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.858669:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca39037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858676:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca39037 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858686:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca39037 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858693:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e94311a3/0xdb52b77d7ca39037 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858706:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.858708:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.858710:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109817.858753:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109817.858758:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007374af43/0xdb52b77d7ca3903e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858765:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41a:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:2.0:1786109817.858768:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109817.858772:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007374af43/0xdb52b77d7ca3903e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858780:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007374af43/0xdb52b77d7ca3903e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858786:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007374af43/0xdb52b77d7ca3903e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858793:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007374af43/0xdb52b77d7ca3903e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.858804:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109817.860947:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109817.860955:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007374af43/0xdb52b77d7ca3903e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.860968:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.860973:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007374af43/0xdb52b77d7ca3903e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.860982:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007374af43/0xdb52b77d7ca3903e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861000:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007374af43/0xdb52b77d7ca3903e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861012:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007374af43/0xdb52b77d7ca3903e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861033:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.861035:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.861036:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109817.861152:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x419:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109817.861159:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c129c006/0xdb52b77d7ca39045 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861170:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x419:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:2.0:1786109817.861174:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x419:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109817.861179:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c129c006/0xdb52b77d7ca39045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861190:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c129c006/0xdb52b77d7ca39045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861199:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c129c006/0xdb52b77d7ca39045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861206:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c129c006/0xdb52b77d7ca39045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861222:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109817.861230:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109817.861234:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c129c006/0xdb52b77d7ca39045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861241:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97837200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.861245:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c129c006/0xdb52b77d7ca39045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861251:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c129c006/0xdb52b77d7ca39045 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861261:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c129c006/0xdb52b77d7ca39045 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861268:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c129c006/0xdb52b77d7ca39045 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.861280:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.861282:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.861284:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109817.863669:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x418:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109817.863681:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3904c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.863697:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x418:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:2.0:1786109817.863702:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x418:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109817.863708:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3904c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.863727:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3904c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.863737:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3904c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.863745:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3904c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.863769:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786109817.863781:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109817.863787:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3904c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.863795:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.863799:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3904c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.866198:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3904c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.866232:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3904c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.866241:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8d658c7/0xdb52b77d7ca3904c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.866266:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.866268:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.866271:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786109817.867746:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x417:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786109817.867757:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea339343/0xdb52b77d7ca39053 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x417:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.867773:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x417:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:2.0:1786109817.867778:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x417:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786109817.867784:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea339343/0xdb52b77d7ca39053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.867797:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea339343/0xdb52b77d7ca39053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.869983:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea339343/0xdb52b77d7ca39053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.870005:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea339343/0xdb52b77d7ca39053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.910872:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1786109817.911004:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x416:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109817.911013:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d42d58db/0xdb52b77d7ca3905a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911031:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x416:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:0.0:1786109817.911035:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x416:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109817.911042:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d42d58db/0xdb52b77d7ca3905a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911055:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d42d58db/0xdb52b77d7ca3905a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911064:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d42d58db/0xdb52b77d7ca3905a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911089:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d42d58db/0xdb52b77d7ca3905a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911105:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1786109817.911157:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x415:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109817.911162:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064ecb89f/0xdb52b77d7ca39061 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x415:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911169:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x415:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:0.0:1786109817.911173:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x415:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109817.911177:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064ecb89f/0xdb52b77d7ca39061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911185:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064ecb89f/0xdb52b77d7ca39061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911192:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064ecb89f/0xdb52b77d7ca39061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911198:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064ecb89f/0xdb52b77d7ca39061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911211:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1786109817.911244:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x414:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109817.911249:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7c368e3/0xdb52b77d7ca39068 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x414:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911258:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x414:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:0.0:1786109817.911261:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x414:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109817.911264:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7c368e3/0xdb52b77d7ca39068 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911272:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7c368e3/0xdb52b77d7ca39068 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911280:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7c368e3/0xdb52b77d7ca39068 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911287:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7c368e3/0xdb52b77d7ca39068 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911300:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1786109817.911337:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x413:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109817.911342:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecc2159a/0xdb52b77d7ca3906f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x413:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911349:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x413:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:0.0:1786109817.911352:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x413:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109817.911356:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecc2159a/0xdb52b77d7ca3906f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.911365:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecc2159a/0xdb52b77d7ca3906f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915581:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecc2159a/0xdb52b77d7ca3906f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915595:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecc2159a/0xdb52b77d7ca3906f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915613:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1786109817.915725:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x412:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109817.915731:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005817b1/0xdb52b77d7ca39076 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x412:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915742:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x412:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:0.0:1786109817.915747:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x412:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109817.915753:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005817b1/0xdb52b77d7ca39076 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915766:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005817b1/0xdb52b77d7ca39076 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915774:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005817b1/0xdb52b77d7ca39076 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915781:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000005817b1/0xdb52b77d7ca39076 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915795:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1786109817.915822:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x411:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109817.915826:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008378b7a7/0xdb52b77d7ca3907d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x411:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915834:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x411:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:0.0:1786109817.915836:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x411:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109817.915840:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008378b7a7/0xdb52b77d7ca3907d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915849:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008378b7a7/0xdb52b77d7ca3907d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915856:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008378b7a7/0xdb52b77d7ca3907d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915864:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008378b7a7/0xdb52b77d7ca3907d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915871:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1786109817.915896:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x410:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109817.915901:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aed5432/0xdb52b77d7ca39084 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x410:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915907:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x410:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:0.0:1786109817.915911:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x410:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109817.915915:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aed5432/0xdb52b77d7ca39084 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915923:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aed5432/0xdb52b77d7ca39084 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915931:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aed5432/0xdb52b77d7ca39084 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915938:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aed5432/0xdb52b77d7ca39084 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915945:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1786109817.915972:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109817.915977:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d32ac322/0xdb52b77d7ca3908b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915984:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40f:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:0.0:1786109817.915986:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109817.915991:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d32ac322/0xdb52b77d7ca3908b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.915999:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d32ac322/0xdb52b77d7ca3908b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916006:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d32ac322/0xdb52b77d7ca3908b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916014:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d32ac322/0xdb52b77d7ca3908b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916021:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1786109817.916046:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109817.916050:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002efca749/0xdb52b77d7ca39092 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916057:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40e:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:0.0:1786109817.916060:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109817.916064:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002efca749/0xdb52b77d7ca39092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916084:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002efca749/0xdb52b77d7ca39092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916092:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002efca749/0xdb52b77d7ca39092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916099:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002efca749/0xdb52b77d7ca39092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916107:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1786109817.916144:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109817.916149:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e78f0175/0xdb52b77d7ca39099 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916157:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40d:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:0.0:1786109817.916159:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109817.916164:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e78f0175/0xdb52b77d7ca39099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916173:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e78f0175/0xdb52b77d7ca39099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916180:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e78f0175/0xdb52b77d7ca39099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916187:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e78f0175/0xdb52b77d7ca39099 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916194:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1786109817.916223:0:179238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786109817.916227:0:179238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f315e8/0xdb52b77d7ca390a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916234:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40c:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:0.0:1786109817.916236:0:179238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786109817.916240:0:179238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f315e8/0xdb52b77d7ca390a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916249:0:179238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f315e8/0xdb52b77d7ca390a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916257:0:179238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f315e8/0xdb52b77d7ca390a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916263:0:179238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f315e8/0xdb52b77d7ca390a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786109817.916270:0:179238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00080000:0.0:1786109817.916288:0:179238:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1035 00000100:00100000:0.0:1786109817.921257:0:179238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0001-mdtlov_UUID+5:202498:x1872862933435904:12345-0@lo:5:osp-pre-0-1.0 Request processed in 90060us (90230us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109817.921275:0:179238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23205 00010000:00010000:2.0:1786109817.940236:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1786109817.940252:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea339343/0xdb52b77d7ca39053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940266:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930a97836400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.940272:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea339343/0xdb52b77d7ca39053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940283:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea339343/0xdb52b77d7ca39053 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940306:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea339343/0xdb52b77d7ca39053 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940314:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea339343/0xdb52b77d7ca39053 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940345:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1786109817.940349:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d42d58db/0xdb52b77d7ca3905a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940356:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.940359:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d42d58db/0xdb52b77d7ca3905a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940367:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d42d58db/0xdb52b77d7ca3905a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940377:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d42d58db/0xdb52b77d7ca3905a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940384:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d42d58db/0xdb52b77d7ca3905a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940601:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1786109817.940606:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064ecb89f/0xdb52b77d7ca39061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940614:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.940617:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064ecb89f/0xdb52b77d7ca39061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940624:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064ecb89f/0xdb52b77d7ca39061 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940634:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064ecb89f/0xdb52b77d7ca39061 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940641:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064ecb89f/0xdb52b77d7ca39061 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940653:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1786109817.940657:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7c368e3/0xdb52b77d7ca39068 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940664:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.940667:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7c368e3/0xdb52b77d7ca39068 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940681:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7c368e3/0xdb52b77d7ca39068 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940691:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7c368e3/0xdb52b77d7ca39068 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940697:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7c368e3/0xdb52b77d7ca39068 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940709:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1786109817.940712:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecc2159a/0xdb52b77d7ca3906f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940719:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.940722:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecc2159a/0xdb52b77d7ca3906f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940729:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecc2159a/0xdb52b77d7ca3906f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940738:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecc2159a/0xdb52b77d7ca3906f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940745:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecc2159a/0xdb52b77d7ca3906f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940762:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1786109817.940766:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005817b1/0xdb52b77d7ca39076 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940783:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.940786:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005817b1/0xdb52b77d7ca39076 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940794:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005817b1/0xdb52b77d7ca39076 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940804:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005817b1/0xdb52b77d7ca39076 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940811:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005817b1/0xdb52b77d7ca39076 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940823:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1786109817.940827:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008378b7a7/0xdb52b77d7ca3907d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940833:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.940836:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008378b7a7/0xdb52b77d7ca3907d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940848:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008378b7a7/0xdb52b77d7ca3907d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940858:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008378b7a7/0xdb52b77d7ca3907d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940865:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008378b7a7/0xdb52b77d7ca3907d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940877:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1786109817.940880:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aed5432/0xdb52b77d7ca39084 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940887:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.940890:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aed5432/0xdb52b77d7ca39084 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940897:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aed5432/0xdb52b77d7ca39084 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940906:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aed5432/0xdb52b77d7ca39084 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940913:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aed5432/0xdb52b77d7ca39084 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940928:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1786109817.940931:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d32ac322/0xdb52b77d7ca3908b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940937:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.940940:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d32ac322/0xdb52b77d7ca3908b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940946:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d32ac322/0xdb52b77d7ca3908b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940955:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d32ac322/0xdb52b77d7ca3908b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940961:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d32ac322/0xdb52b77d7ca3908b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940983:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786109817.940988:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002efca749/0xdb52b77d7ca39092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.940995:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.940998:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002efca749/0xdb52b77d7ca39092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941010:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002efca749/0xdb52b77d7ca39092 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941019:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002efca749/0xdb52b77d7ca39092 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941025:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002efca749/0xdb52b77d7ca39092 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941538:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786109817.941544:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e78f0175/0xdb52b77d7ca39099 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941551:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf9c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.941554:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e78f0175/0xdb52b77d7ca39099 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941561:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e78f0175/0xdb52b77d7ca39099 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941572:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e78f0175/0xdb52b77d7ca39099 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941579:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e78f0175/0xdb52b77d7ca39099 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941596:0:10402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109817.941599:0:10402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6f315e8/0xdb52b77d7ca390a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941604:0:10402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8cf8400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.941607:0:10402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f315e8/0xdb52b77d7ca390a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941614:0:10402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f315e8/0xdb52b77d7ca390a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941622:0:10402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6f315e8/0xdb52b77d7ca390a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941628:0:10402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f315e8/0xdb52b77d7ca390a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.941638:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.941640:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.941642:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.941653:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.941660:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.941665:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109817.941715:0:202498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c55f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:202498:1872862933435904:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1786109817.941729:0:202498:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000401:0x421:0x0] from OST, last_created [0x280000401:0x421:0x0]last_used is [0x280000401:0x40b:0x0] 00000100:00100000:2.0:1786109817.941878:0:202498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c54e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:202498:1872862933436288:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1786109817.941934:0:202498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109817.941968:0:202498:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c160180 going to sleep for 11 seconds 00000100:00100000:2.0:1786109817.942129:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786109817.942141:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933436160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109817.942170:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109817.942204:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933436160 00000100:00100000:2.0:1786109817.942210:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933436160 00000100:00100000:2.0:1786109817.942560:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6007 00000100:00100000:2.0:1786109817.942571:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933436160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786109817.942599:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109817.942643:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1872862933436160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109817.942650:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6007 00000100:00100000:2.0:1786109817.942721:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933436160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109817.943502:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933436288 00000100:00100000:2.0:1786109817.943509:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933436288 00000100:00100000:2.0:1786109817.943545:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23207 00000100:00100000:2.0:1786109817.943554:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:202498:x1872862933436288:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1786109817.943585:0:8443:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1058 00002000:00010000:3.0:1786109817.945034:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x421:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.945046:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca390a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945063:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x421:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.945068:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x421:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.945088:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca390a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945104:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca390a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945125:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca390a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945140:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca390a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945159:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786109817.945255:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x420:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.945260:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca390ae lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945269:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x420:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.945273:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x420:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.945277:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca390ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945286:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca390ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945293:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca390ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945301:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca390ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945315:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786109817.945352:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x41f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.945357:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca390b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945366:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x41f:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.945369:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x41f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.945373:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca390b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945382:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca390b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945403:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca390b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945411:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca390b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945425:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1786109817.945509:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x41e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.945514:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca390bc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945522:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x41e:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.945525:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x41e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.945529:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca390bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945538:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca390bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945545:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca390bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945551:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca390bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945564:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1786109817.945602:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x41d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.945607:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca390c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945615:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x41d:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.945618:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x41d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.945621:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca390c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945631:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca390c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945639:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca390c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945646:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca390c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945660:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1786109817.945691:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x41c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.945695:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca390ca lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945703:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x41c:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.945706:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x41c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.945710:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca390ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945719:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca390ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945726:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca390ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945734:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca390ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945741:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1786109817.945771:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x41b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.945775:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca390d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945781:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x41b:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.945784:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x41b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.945788:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca390d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945797:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca390d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945803:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca390d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945810:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca390d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945818:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1786109817.945852:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x41a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.945856:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca390d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945863:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x41a:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.945866:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x41a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.945870:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca390d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945879:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca390d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945886:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca390d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945893:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca390d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945901:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1786109817.945936:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x419:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.945941:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca390df lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945949:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x419:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.945951:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x419:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.945955:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca390df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945963:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca390df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945970:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca390df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945977:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca390df lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.945985:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1786109817.946022:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x418:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.946028:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca390e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946037:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x418:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.946039:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x418:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.946043:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca390e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946053:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca390e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946061:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca390e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946068:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca390e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946092:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1786109817.946130:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x417:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.946135:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca390ed lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946143:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x417:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.946146:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x417:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.946149:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca390ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946158:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca390ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946166:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca390ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946172:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca390ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946182:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1786109817.946229:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x416:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.946235:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca390f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946244:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x416:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.946246:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x416:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.946251:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca390f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946261:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca390f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946271:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca390f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946280:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca390f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946297:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1786109817.946338:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x415:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.946343:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca390fb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946351:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x415:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.946355:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x415:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.946359:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca390fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946368:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca390fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946376:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca390fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946383:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca390fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946392:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1786109817.946427:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x414:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.946486:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca39102 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946494:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x414:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.946497:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x414:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.946501:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca39102 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946509:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca39102 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946515:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca39102 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946522:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca39102 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946530:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1786109817.946560:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x413:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.946564:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca39109 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946572:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x413:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.946575:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x413:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.946579:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca39109 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946587:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca39109 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946594:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca39109 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946601:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca39109 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946608:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1786109817.946637:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x412:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.946642:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca39110 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x412:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946649:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x412:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.946652:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x412:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.946656:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca39110 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946663:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca39110 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946670:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca39110 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946676:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca39110 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946683:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1786109817.946710:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x411:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.946715:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca39117 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946722:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x411:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.946725:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x411:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.946728:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca39117 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946736:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca39117 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946742:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca39117 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946749:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca39117 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946756:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1786109817.946782:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x410:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.946786:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca3911e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x410:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946793:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x410:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.946795:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x410:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.946799:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca3911e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946807:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca3911e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946814:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca3911e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946820:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca3911e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946827:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:3.0:1786109817.946856:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x40f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.946860:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca39125 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x40f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946867:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x40f:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.946869:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x40f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.946873:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca39125 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946880:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca39125 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946886:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca39125 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946893:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca39125 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946903:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:3.0:1786109817.946929:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x40e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.946933:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca3912c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946940:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x40e:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.946942:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x40e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.946946:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca3912c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946953:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca3912c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946961:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca3912c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946967:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca3912c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.946974:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:3.0:1786109817.947002:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x40d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.947006:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca39133 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x40d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947013:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x40d:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.947016:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x40d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.947019:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca39133 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947027:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca39133 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947034:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca39133 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947041:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca39133 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947048:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:3.0:1786109817.947091:0:179254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x40c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786109817.947096:0:179254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca3913a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x40c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947102:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x40c:0x0].0x0 since=8674s v=(0 0) 00010000:00010000:3.0:1786109817.947105:0:179254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x40c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786109817.947109:0:179254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca3913a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947117:0:179254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca3913a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947125:0:179254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca3913a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947133:0:179254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca3913a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947141:0:179254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00080000:3.0:1786109817.947167:0:179254:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:1035 00000100:00100000:3.0:1786109817.947263:0:179254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_026:lustre-MDT0001-mdtlov_UUID+5:202500:x1872862933436032:12345-0@lo:5:osp-pre-1-1.0 Request processed in 119003us (121029us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109817.947273:0:179254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23206 00010000:00010000:3.0:1786109817.947333:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:3.0:1786109817.947339:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca390a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947348:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6da00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947352:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca390a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947362:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca390a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947380:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca390a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947387:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb57637c/0xdb52b77d7ca390a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947411:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:3.0:1786109817.947414:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca390ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947421:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6dc00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947424:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca390ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947451:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca390ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947462:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca390ae lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947469:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013bb2209/0xdb52b77d7ca390ae lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947480:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:3.0:1786109817.947484:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca390b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947490:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c800 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947493:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca390b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947506:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca390b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947515:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca390b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947521:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd7dca6/0xdb52b77d7ca390b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947530:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:3.0:1786109817.947534:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca390bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947540:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6de00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947543:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca390bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947550:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca390bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947558:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca390bc lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947565:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012cf0a4d/0xdb52b77d7ca390bc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947581:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:3.0:1786109817.947584:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca390c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947589:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6ca00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947592:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca390c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947599:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca390c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947607:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca390c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947614:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000609a3b4f/0xdb52b77d7ca390c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947623:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:3.0:1786109817.947626:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca390ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947632:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947635:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca390ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947646:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca390ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947654:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca390ca lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947660:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1c61bd0/0xdb52b77d7ca390ca lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947670:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:3.0:1786109817.947673:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca390d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947679:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6cc00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947682:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca390d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947688:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca390d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947696:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca390d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947703:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007efc191a/0xdb52b77d7ca390d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947717:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1786109817.947720:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca390d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947725:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947728:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca390d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947735:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca390d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947743:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca390d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947750:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000032ba9b5/0xdb52b77d7ca390d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947758:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1786109817.947761:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca390df lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947767:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947770:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca390df lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947782:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca390df lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947791:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca390df lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947797:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e636797/0xdb52b77d7ca390df lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947806:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1786109817.947809:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca390e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947815:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6ce00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947818:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca390e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947824:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca390e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947832:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca390e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947839:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f6ac537/0xdb52b77d7ca390e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947853:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1786109817.947857:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca390ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947862:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947865:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca390ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947872:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca390ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947880:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca390ed lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947886:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035aaeb91/0xdb52b77d7ca390ed lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947895:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1786109817.947898:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca390f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947904:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6c000 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947907:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca390f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947918:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca390f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947926:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca390f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947933:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6ece444/0xdb52b77d7ca390f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947942:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1786109817.947945:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca390fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947951:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f6d400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.947954:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca390fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947961:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca390fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.947968:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca390fb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953679:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1607353/0xdb52b77d7ca390fb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953723:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1786109817.953729:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca39102 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953738:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ac16c2a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.953743:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca39102 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953755:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca39102 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953777:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca39102 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953784:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bcd60a1/0xdb52b77d7ca39102 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953796:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1786109817.953800:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca39109 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953806:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06a00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.953810:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca39109 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953823:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca39109 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953833:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca39109 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953840:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc42eb40/0xdb52b77d7ca39109 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953851:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1786109817.953855:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca39110 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953861:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07600 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.953864:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca39110 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953872:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca39110 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953883:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca39110 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953891:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a5510d8/0xdb52b77d7ca39110 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x412:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953911:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786109817.953914:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca39117 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953924:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06800 already unused, calling callback (ffffffffc0e7cfd0) 00000100:00100000:2.0:1786109817.953924:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:202498:x1872862933436288:12345-0@lo:5:osp-pre-0-1.0 Request processed in 10364us (11983us total) trans 38654705691 rc 0/0 00010000:00010000:3.0:1786109817.953930:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca39117 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786109817.953940:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23207 00010000:00010000:3.0:1786109817.953941:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca39117 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953954:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca39117 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953961:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047599f64/0xdb52b77d7ca39117 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953973:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786109817.953976:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca3911e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953982:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.953986:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca3911e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.953999:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca3911e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954007:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca3911e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954013:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f72eb19/0xdb52b77d7ca3911e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x410:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954022:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786109817.954025:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca39125 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954031:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07c00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.954034:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca39125 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954041:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca39125 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954049:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca39125 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954056:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f334b2/0xdb52b77d7ca39125 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x40f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.954057:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786109817.954066:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca3912c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954094:0:29734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786109817.954098:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f06200 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:3.0:1786109817.954100:0:29734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca39133 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.954105:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca3912c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.954118:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca3912c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.954130:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca3912c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.954137:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002282b298/0xdb52b77d7ca3912c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.954152:0:6515:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786109817.954156:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca3913a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.954162:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07400 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.954166:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca3913a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.954173:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca3913a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954181:0:29734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff930ab8f07e00 already unused, calling callback (ffffffffc0e7cfd0) 00010000:00010000:2.0:1786109817.954183:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca3913a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954186:0:29734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca39133 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.954203:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ccbe017/0xdb52b77d7ca3913a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954207:0:29734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca39133 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954227:0:29734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca39133 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786109817.954227:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.954230:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109817.954234:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109817.954241:0:29734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b27a60/0xdb52b77d7ca39133 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x40d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 179254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786109817.954259:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109817.954260:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109817.954262:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109817.954270:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786109817.954274:0:202500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:202500:1872862933436032:0@lo:5:osp-pre-1-1.0 00010000:00010000:3.0:1786109817.954277:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786109817.954291:0:202500:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x421:0x0] from OST, last_created [0x2c0000400:0x421:0x0]last_used is [0x2c0000400:0x40b:0x0] 00000100:00100000:2.0:1786109817.954365:0:202500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c55f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:202500:1872862933436544:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1786109817.954482:0:202500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109817.954506:0:202500:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1609c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109817.954521:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933436416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109817.954547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109817.954657:0:202498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c54e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:202498:1872862933436288:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1786109817.954669:0:202498:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000401:0x421:0x0]-[0x280000401:0x441:0x0] 00000100:00100000:3.0:1786109817.954701:0:202498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930984ff2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:202498:1872862933436672:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1786109817.954780:0:202498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109817.954801:0:202498:0:(client.c:2702:ptlrpc_set_wait()) set ffff9309855a7840 going to sleep for 11 seconds 00000100:00100000:3.0:1786109817.954818:0:187911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933436672 00000100:00100000:3.0:1786109817.954824:0:187911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933436672 00000100:00100000:2.0:1786109817.954859:0:34008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933436544 00000100:00100000:2.0:1786109817.954864:0:34008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933436544 00000100:00100000:3.0:1786109817.954869:0:187911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786109817.954881:0:187911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:202498:x1872862933436672:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1786109817.954901:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23208 00000100:00100000:2.0:1786109817.954911:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:202500:x1872862933436544:12345-0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1786109817.954935:0:187911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:202498:x1872862933436672:12345-0@lo:900:osp-pre-0-1.0 Request processed in 57us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109817.954943:0:187911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00080000:2.0:1786109817.954946:0:34008:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 1058 00000100:00100000:3.0:1786109817.954975:0:202498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930984ff2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:202498:1872862933436672:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1786109817.955010:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933436416 00000100:00100000:3.0:1786109817.955014:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933436416 00000100:00100000:3.0:1786109817.955038:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6008 00000100:00100000:3.0:1786109817.955044:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933436416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786109817.955057:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 144064 pending 896 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109817.955106:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933436416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109817.955182:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6008 00000100:00100000:3.0:1786109817.955227:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933436416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109817.967298:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098d899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:202500:x1872862933436544:12345-0@lo:5:osp-pre-1-1.0 Request processed in 12382us (12809us total) trans 4294975849 rc 0/0 00000100:00100000:2.0:1786109817.967311:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23208 00000100:00100000:2.0:1786109817.967456:0:202500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930aa5c55f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:202500:1872862933436544:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1786109817.967472:0:202500:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x421:0x0]-[0x2c0000400:0x441:0x0] 00000100:00100000:2.0:1786109817.967517:0:202500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:202500:1872862933436800:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1786109817.967559:0:202500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109817.967586:0:202500:0:(client.c:2702:ptlrpc_set_wait()) set ffff93098c1609c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786109817.967604:0:187911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933436800 00000100:00100000:2.0:1786109817.967609:0:187911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933436800 00000100:00100000:2.0:1786109817.967646:0:187911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786109817.967655:0:187911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:202500:x1872862933436800:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1786109817.967700:0:187911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:202500:x1872862933436800:12345-0@lo:900:osp-pre-1-1.0 Request processed in 47us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109817.967706:0:187911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786109817.967735:0:202500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:202500:1872862933436800:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1786109818.248110:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1786109818.563412:0:202858:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1786109818.563725:0:202858:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1786109819.140947:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933436928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109819.141015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109819.142263:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786109819.142294:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933437056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786109819.142593:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109819.142629:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933436928 00000100:00100000:1.0:1786109819.142638:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933436928 00000100:00100000:1.0:1786109819.142816:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6009 00000100:00100000:1.0:1786109819.142829:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933436928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786109819.142851:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 143168 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109819.142901:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933436928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109819.142908:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6009 00000100:00080000:2.0:1786109819.143151:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109819.144320:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933436928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786109819.144495:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933437056 00000100:00100000:3.0:1786109819.144502:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933437056 00000100:00080000:0.0:1786109819.144623:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109819.144722:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6010 00000100:00100000:1.0:1786109819.144733:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933437056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786109819.144750:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109819.144800:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933437056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (2207us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109819.144807:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6010 00000100:00100000:0.0:1786109819.145142:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933437056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786109819.268954:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109819.375407:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109819.375481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109819.375520:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109819.375626:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922196352 00000100:00100000:3.0:1786109819.375635:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922196224 00000100:00100000:0.0:1786109819.375637:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922196352 00000100:00100000:3.0:1786109819.375643:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922196224 00000100:00100000:2.0:1786109819.375659:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922196096 00000100:00100000:2.0:1786109819.375666:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922196096 00000100:00100000:2.0:1786109819.375726:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:0.0:1786109819.375736:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 522 00000100:00100000:2.0:1786109819.375739:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2404:x1872862922196096:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:1.0:1786109819.375740:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786109819.375746:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109819.375752:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab8f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+7:2404:x1872862922196224:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109819.375782:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 523 00000100:00100000:1.0:1786109819.375799:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac1706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922196352:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109819.375816:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab8f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+7:2404:x1872862922196224:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 68us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109819.375817:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2404:x1872862922196096:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 79us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109819.375832:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 522 00000100:00100000:2.0:1786109819.375833:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:1.0:1786109819.375839:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac1706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fac74500-4523-4794-af20-dfdcdfae19c1+6:2404:x1872862922196352:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 45us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109819.375847:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 523 00010000:00010000:2.0:1786109820.293235:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109820.342623:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109820.343142:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922196480 00000100:00100000:0.0:1786109820.343153:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922196480 00000100:00100000:0.0:1786109820.343222:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1351 00000100:00100000:0.0:1786109820.343232:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:167102:x1872862922196480:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:0.0:1786109820.343268:0:187899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00000100:00100000:0.0:1786109820.343338:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:167102:x1872862922196480:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 107us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109820.343345:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1351 00000100:00100000:1.0:1786109820.345729:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109820.345824:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922196608 00000100:00100000:0.0:1786109820.345833:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922196608 00000100:00100000:0.0:1786109820.345951:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1352 00000100:00100000:0.0:1786109820.345963:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:167102:x1872862922196608:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:0.0:1786109820.346001:0:189813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446031360 avail 1299791872 00000100:00100000:0.0:1786109820.346096:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:167102:x1872862922196608:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 134us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109820.346104:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1352 00000100:00100000:3.0:1786109820.349167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109820.349361:0:43922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922196736 00000100:00100000:0.0:1786109820.349370:0:43922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922196736 00000100:00100000:0.0:1786109820.350165:0:43922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23209 00000100:00100000:0.0:1786109820.350175:0:43922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2401:x1872862922196736:12345-192.168.203.38@tcp:8:lfs.0 00010000:00080000:0.0:1786109820.350213:0:43922:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp t0 exp 0000000000000000 cur 8677 last 0 00000020:00000080:0.0:1786109820.350242:0:43922:0:(genops.c:1406:class_connect()) connect: client fac74500-4523-4794-af20-dfdcdfae19c1, cookie 0xdb52b77d7ca39141 00002000:00100000:0.0:1786109820.350253:0:43922:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fac74500-4523-4794-af20-dfdcdfae19c1/ffff930ab7ce8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786109820.350270:0:43922:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786109820.350335:0:43922:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1786109820.350364:0:43922:0:(import.c:65:import_set_state_nolock()) ffff930ab7ced800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109820.350760:0:43922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922196736:12345-192.168.203.38@tcp:8:lfs.0 Request processed in 583us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109820.350769:0:43922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23209 00000100:00100000:1.0:1786109820.352792:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109820.352915:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922196864 00000100:00100000:2.0:1786109820.352924:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922196864 00000100:00100000:2.0:1786109820.353027:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6011 00000100:00100000:2.0:1786109820.353208:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:167102:x1872862922196864:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1786109820.353233:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8713280 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1786109820.353322:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:167102:x1872862922196864:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 285us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109820.353329:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6011 00000100:00080000:1.0:1786109820.354895:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109820.358032:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109820.358286:0:17009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922196992 00000100:00100000:0.0:1786109820.358296:0:17009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922196992 00000100:00100000:0.0:1786109820.358499:0:17009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23210 00000100:00100000:0.0:1786109820.358508:0:17009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1872862922196992:12345-192.168.203.38@tcp:8:lfs.0 00010000:00080000:0.0:1786109820.358544:0:17009:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from fac74500-4523-4794-af20-dfdcdfae19c1@192.168.203.38@tcp t0 exp 0000000000000000 cur 8677 last 0 00000020:00000080:0.0:1786109820.358575:0:17009:0:(genops.c:1406:class_connect()) connect: client fac74500-4523-4794-af20-dfdcdfae19c1, cookie 0xdb52b77d7ca39148 00002000:00100000:0.0:1786109820.358586:0:17009:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fac74500-4523-4794-af20-dfdcdfae19c1/ffff930ab7cee000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786109820.358602:0:17009:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786109820.358663:0:17009:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786109820.359038:0:17009:0:(import.c:65:import_set_state_nolock()) ffff930ac1362800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786109820.359220:0:17009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fac74500-4523-4794-af20-dfdcdfae19c1+6:2401:x1872862922196992:12345-192.168.203.38@tcp:8:lfs.0 Request processed in 710us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109820.359228:0:17009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23210 00000100:00100000:0.0:1786109820.361471:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1786109820.361812:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922197120 00000100:00100000:3.0:1786109820.361821:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922197120 00000100:00100000:3.0:1786109820.362030:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6012 00000100:00100000:3.0:1786109820.362042:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:167102:x1872862922197120:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:3.0:1786109820.362077:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580928 pending 0 free 3923496960 avail 3691974656 00000100:00100000:3.0:1786109820.362147:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+6:167102:x1872862922197120:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 107us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109820.362155:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6012 00000100:00080000:2.0:1786109820.362348:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786109821.316566:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786109822.343416:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109822.728546:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109822.728567:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933437312:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.728568:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933437184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109822.728649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109822.730598:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933437312 00000100:00100000:0.0:1786109822.730611:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933437312 00000100:00100000:0.0:1786109822.730670:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1786109822.730681:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933437312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.731863:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109822.731904:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933437184 00000100:00100000:1.0:1786109822.731911:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933437184 00000100:00100000:1.0:1786109822.732278:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1786109822.732289:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933437184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786109822.732328:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00000100:00100000:1.0:1786109822.732520:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1872862933437184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 233us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109822.732532:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1786109822.732786:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933437184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786109822.733646:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933437440:0@lo:400:kworker.0 00000100:00100000:1.0:1786109822.733698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109822.733788:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933437568:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.733820:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109822.733876:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933437440 00000100:00100000:2.0:1786109822.733882:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933437440 00000100:00100000:2.0:1786109822.734157:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933437568 00000100:00100000:2.0:1786109822.734162:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933437568 00000100:00100000:2.0:1786109822.734193:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1786109822.734203:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933437440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.734252:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872862933437440:12345-0@lo:400:kworker.0 Request processed in 51us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109822.734260:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1786109822.734279:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1786109822.734287:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933437568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.734325:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1872862933437568:12345-0@lo:400:kworker.0 Request processed in 39us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109822.734335:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00080000:2.0:1786109822.734357:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109822.734361:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1786109822.734388:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac0bb1c00 x1872862933437568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786109822.734401:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1872862933437568:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.734467:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933437696:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.734497:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109822.734528:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933437696 00000100:00100000:2.0:1786109822.734532:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933437696 00000100:00100000:2.0:1786109822.734563:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1786109822.734571:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933437696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.734605:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1872862933437696:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109822.734612:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00080000:2.0:1786109822.734628:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109822.734639:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3647:x1872862933437312:12345-0@lo:400:kworker.0 Request processed in 3956us (5986us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109822.734649:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1786109822.734651:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1872862933437696:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.734693:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933437824:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.734715:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109822.734782:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786109822.734790:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933437952:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.734822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109822.734867:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933438080:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.734893:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109822.734921:0:179240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933438080 00000100:00100000:2.0:1786109822.734925:0:179240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933438080 00000100:00100000:1.0:1786109822.735607:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3647:1872862933437312:0@lo:400:kworker.0 00000100:00100000:1.0:1786109822.735634:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1872862933437440:0@lo:400:kworker.0 00000100:00100000:1.0:1786109822.735662:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933437824 00000100:00100000:1.0:1786109822.735667:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933437824 00000100:00100000:2.0:1786109822.736793:0:179240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7187 00000100:00100000:2.0:1786109822.736809:0:179240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933438080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.736893:0:179240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_022:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933438080:12345-0@lo:400:kworker.0 Request processed in 90us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109822.736900:0:179240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7187 00000100:00080000:2.0:1786109822.736923:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786109822.736929:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786109822.737137:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933438080:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.737206:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933438208:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.737241:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109822.737302:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933438336:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.737330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109822.737369:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933438336 00000100:00100000:2.0:1786109822.737375:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933438336 00000100:00100000:1.0:1786109822.737467:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1786109822.737479:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933437824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109822.737527:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872862933437824:12345-0@lo:400:kworker.0 Request processed in 53us (2811us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109822.737534:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1786109822.737591:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1786109822.737599:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a97808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933438336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.737631:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a97808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872862933438336:12345-0@lo:400:kworker.0 Request processed in 34us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109822.737637:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1786109822.737677:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a97809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933438592:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.737702:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109822.737729:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933438208 00000100:00100000:2.0:1786109822.737732:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933438208 00000100:00100000:2.0:1786109822.737759:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933438592 00000100:00100000:2.0:1786109822.737763:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933438592 00000100:00100000:2.0:1786109822.737783:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7188 00000100:00100000:2.0:1786109822.737790:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933438208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109822.737829:0:43911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7189 00000100:00100000:0.0:1786109822.737841:0:43911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933438592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.737865:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933438208:12345-0@lo:400:kworker.0 Request processed in 75us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109822.737872:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7188 00000100:00080000:2.0:1786109822.737889:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786109822.737907:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933438208:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.737933:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933438720:0@lo:400:kworker.0 00000100:00100000:0.0:1786109822.737961:0:43911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3648:x1872862933438592:12345-0@lo:400:kworker.0 Request processed in 122us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109822.737969:0:43911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7189 00000100:00100000:0.0:1786109822.737999:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1872862933438592:0@lo:400:kworker.0 00000100:00100000:1.0:1786109822.738158:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933437952 00000100:00100000:1.0:1786109822.738164:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933437952 00000100:00100000:1.0:1786109822.738192:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1786109822.738199:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a9780ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933437952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109822.738237:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a9780ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933437952:12345-0@lo:400:kworker.0 Request processed in 38us (3415us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109822.738243:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1786109822.738302:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a97809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872862933438336:0@lo:400:kworker.0 00000100:00100000:1.0:1786109822.738312:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933437952:0@lo:400:kworker.0 00010000:00080000:1.0:1786109822.738325:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac0bb1c00 x1872862933437824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109822.738335:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1872862933437824:0@lo:400:kworker.0 00000100:00100000:1.0:1786109822.738349:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109822.738355:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930a9780b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933438464:0@lo:400:kworker.0 00000100:00100000:1.0:1786109822.738379:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109822.738403:0:43912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933438464 00000100:00100000:1.0:1786109822.738406:0:43912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933438464 00000100:00100000:1.0:1786109822.738447:0:43912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7190 00000100:00100000:1.0:1786109822.738454:0:43912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933438464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109822.738483:0:43912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933438464:12345-0@lo:400:kworker.0 Request processed in 31us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109822.738488:0:43912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7190 00000100:00080000:1.0:1786109822.738501:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786109822.738516:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930a9780b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933438464:0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.738721:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109822.738749:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933438720 00000100:00100000:2.0:1786109822.738752:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933438720 00000100:00100000:2.0:1786109822.738776:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1786109822.738783:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933438720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786109822.738815:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1872862933438720:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109822.738821:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1786109822.738843:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1872862933438720:0@lo:400:kworker.0 00000100:00100000:1.0:1786109823.236680:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9309825ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933438848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786109823.237492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109823.237548:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786109823.237555:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933438976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109823.237594:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109823.237660:0:187905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933438848 00000100:00100000:2.0:1786109823.237669:0:187905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933438848 00000100:00100000:2.0:1786109823.237726:0:187905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1786109823.237738:0:187905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933438848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786109823.237776:0:187905:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446031360 avail 1299791872 00000100:00100000:2.0:1786109823.237841:0:187905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1872862933438848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109823.237849:0:187905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786109823.237854:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933438976 00000100:00100000:1.0:1786109823.237867:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933438976 00000100:00100000:1.0:1786109823.237914:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6013 00000100:00100000:1.0:1786109823.237921:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933438976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109823.237940:0:13445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580928 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109823.237974:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1872862933438976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109823.237980:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6013 00000100:00100000:1.0:1786109823.238018:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1872862933438976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786109823.238963:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9309825ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1872862933438848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109823.239951:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786109823.239967:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933439104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109823.240278:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1786109823.244584:0:194579:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00080000:0.0:1786109823.244603:0:194579:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 38654705691 is committed 00000001:00100000:3.0:1786109823.244989:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fac74500-4523-4794-af20-dfdcdfae19c1 00000001:00080000:3.0:1786109823.244999:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294975849 is committed 00000100:00100000:1.0:1786109823.245118:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933439104 00000100:00100000:1.0:1786109823.245128:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933439104 00000100:00100000:1.0:1786109823.245220:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6014 00000100:00100000:1.0:1786109823.245232:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933439104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109823.245274:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8713280 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109823.245371:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933439104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (5093us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109823.245377:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6014 00000100:00100000:2.0:1786109823.245477:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 38654705691 gen 2 00000100:00100000:2.0:1786109823.245504:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933439104:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1786109823.247182:0:201141:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 347892350987 is committed 00010000:00010000:3.0:1786109823.364553:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109824.260899:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109824.260921:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933439360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109824.260936:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933439232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109824.261063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109824.261130:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109824.261164:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933439360 00000100:00100000:1.0:1786109824.261172:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933439360 00000100:00100000:1.0:1786109824.261235:0:98687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933439232 00000100:00100000:1.0:1786109824.261238:0:98687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933439232 00000100:00100000:0.0:1786109824.261252:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6015 00000100:00100000:0.0:1786109824.261266:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9309825ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933439360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786109824.261273:0:98687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6016 00000100:00100000:1.0:1786109824.261283:0:98687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a893c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933439232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786109824.261291:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580928 pending 0 free 3923496960 avail 3691974656 00002000:00000024:1.0:1786109824.261297:0:98687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8713280 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1786109824.261351:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9309825ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933439360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109824.261353:0:98687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a893c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1872862933439232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109824.261364:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6015 00000100:00100000:1.0:1786109824.261371:0:98687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6016 00000100:00100000:1.0:1786109824.261459:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93098e50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933439232:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786109824.261463:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786109824.261468:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786109824.261668:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933439360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786109824.388680:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109824.527192:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109824.527380:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922197248 00000100:00100000:1.0:1786109824.527411:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922197248 00000100:00100000:1.0:1786109824.527515:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:1.0:1786109824.527529:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab19bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922197248:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1786109824.527607:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab19bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2403:x1872862922197248:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 81us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109824.527615:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:0.0:1786109824.535200:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109824.535242:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109824.535346:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109824.535373:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109824.535415:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922197376 00000100:00100000:0.0:1786109824.535423:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922197376 00000100:00100000:3.0:1786109824.536043:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922197632 00000100:00100000:3.0:1786109824.536049:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922197632 00000100:00100000:3.0:1786109824.536202:0:179253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922197760 00000100:00100000:3.0:1786109824.536207:0:179253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922197760 00000100:00100000:3.0:1786109824.536233:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7191 00000100:00100000:3.0:1786109824.536244:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922197632:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109824.536316:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922197632:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 74us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109824.536324:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7191 00000100:00100000:3.0:1786109824.536342:0:179253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7192 00000100:00100000:3.0:1786109824.536349:0:179253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922197760:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109824.536379:0:179253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_025:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922197760:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109824.536384:0:179253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7192 00000100:00080000:3.0:1786109824.536401:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109824.536405:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786109824.536408:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786109824.538410:0:187901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922197504 00000100:00100000:2.0:1786109824.538423:0:187901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922197504 00000100:00100000:0.0:1786109824.538594:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 530 00000100:00100000:0.0:1786109824.538616:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922197376:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109824.538961:0:187901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 531 00000100:00100000:2.0:1786109824.538971:0:187901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2405:x1872862922197504:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109824.539235:0:187901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fac74500-4523-4794-af20-dfdcdfae19c1+6:2405:x1872862922197504:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 265us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109824.539243:0:187901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 531 00000100:00080000:3.0:1786109824.539309:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786109824.539346:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922197376:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 739us (4154us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109824.539354:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 530 00000001:02000400:1.0:1786109825.137969:0:203051:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1786109825.412610:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786109826.411583:0:203099:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1786109826.445185:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786109827.461702:0:29734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786109827.844798:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933439872:0@lo:400:kworker.0 00000100:00100000:0.0:1786109827.844798:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933439488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786109827.844879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109827.844954:0:187904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933439488 00000100:00100000:2.0:1786109827.844965:0:187904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933439488 00000100:00100000:2.0:1786109827.845019:0:187904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1786109827.845027:0:187904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933439488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786109827.845058:0:187904:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00000100:00100000:3.0:1786109827.845107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109827.845184:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933439744:0@lo:400:kworker.0 00000100:00100000:0.0:1786109827.845211:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109827.845248:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933440000:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845289:0:189813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933439872 00000100:00100000:1.0:1786109827.845293:0:189813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933439872 00000100:00100000:1.0:1786109827.845333:0:189813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1786109827.845341:0:189813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933439872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845379:0:189813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872862933439872:12345-0@lo:400:kworker.0 Request processed in 39us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109827.845386:0:189813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1786109827.845410:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933439616:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845463:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109827.845479:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933440256:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845480:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac0fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933440128:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109827.845501:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109827.845517:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933440640:0@lo:400:kworker.0 00000100:00100000:0.0:1786109827.845517:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933440768:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845538:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786109827.845538:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109827.845569:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933440256 00000100:00100000:1.0:1786109827.845573:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933440256 00000100:00100000:0.0:1786109827.845577:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933439744 00000100:00100000:0.0:1786109827.845580:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933439744 00000100:00100000:1.0:1786109827.845591:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1786109827.845597:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933440256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109827.845603:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933440128 00000100:00100000:0.0:1786109827.845605:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933440128 00000100:00100000:0.0:1786109827.845625:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933440640 00000100:00100000:0.0:1786109827.845628:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933440640 00000100:00100000:1.0:1786109827.845631:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1872862933440256:12345-0@lo:400:kworker.0 Request processed in 34us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109827.845638:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1786109827.845643:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1786109827.845648:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933439744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845654:0:201148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933439616 00000100:00100000:1.0:1786109827.845657:0:201148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933439616 00000100:00100000:1.0:1786109827.845680:0:201148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1786109827.845680:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1872862933439744:12345-0@lo:400:kworker.0 Request processed in 32us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109827.845685:0:201148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930a87e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933439616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109827.845686:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1786109827.845701:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1786109827.845707:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933440128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845715:0:201148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930a87e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aeab97cc-8463-4daa-a678-1bb2ad93cc69+24:3648:x1872862933439616:12345-0@lo:400:kworker.0 Request processed in 30us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109827.845721:0:201148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1786109827.845759:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aeab97cc-8463-4daa-a678-1bb2ad93cc69:3648:1872862933439616:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845782:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109827.845796:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933440512:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109827.845834:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933441024:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845852:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109827.845863:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786109827.845868:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab1c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933440384:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845887:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109827.845903:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933440896:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.845925:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109827.845950:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933440768 00000100:00100000:1.0:1786109827.845954:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933440768 00000100:00100000:1.0:1786109827.845981:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933440512 00000100:00100000:1.0:1786109827.845984:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933440512 00000100:00100000:1.0:1786109827.846002:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933440384 00000100:00100000:1.0:1786109827.846019:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933440384 00000100:00100000:1.0:1786109827.846039:0:9990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933440896 00000100:00100000:1.0:1786109827.846042:0:9990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933440896 00000100:00100000:0.0:1786109827.846052:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1872862933440128:12345-0@lo:400:kworker.0 Request processed in 345us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109827.846059:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1786109827.846060:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7193 00000100:00100000:1.0:1786109827.846066:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933440768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.846098:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933440768:12345-0@lo:400:kworker.0 Request processed in 32us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109827.846104:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7193 00000100:00100000:1.0:1786109827.846115:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7194 00000100:00100000:1.0:1786109827.846122:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933440512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.846154:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933440512:12345-0@lo:400:kworker.0 Request processed in 32us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109827.846160:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7194 00000100:00100000:1.0:1786109827.846170:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7195 00000100:00100000:1.0:1786109827.846176:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933440384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.846199:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933440384:12345-0@lo:400:kworker.0 Request processed in 24us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109827.846204:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7195 00000100:00100000:1.0:1786109827.846212:0:9990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7196 00000100:00100000:1.0:1786109827.846217:0:9990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933440896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.846238:0:9990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933440896:12345-0@lo:400:kworker.0 Request processed in 21us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109827.846244:0:9990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7196 00010000:00080000:1.0:1786109827.846273:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac0fba680 x1872862933440128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786109827.846284:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1872862933440128:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.846301:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933440384:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.846308:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294975849 gen 2 00000100:00100000:1.0:1786109827.846316:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933440896:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.846324:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933440512:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.846353:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933440000 00000100:00100000:1.0:1786109827.846356:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933440000 00000100:00100000:1.0:1786109827.846374:0:188678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933441024 00000100:00100000:1.0:1786109827.846376:0:188678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933441024 00000100:00100000:1.0:1786109827.846387:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1786109827.846392:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933440640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.846455:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1872862933440640:12345-0@lo:400:kworker.0 Request processed in 36us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109827.846461:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1786109827.846470:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1786109827.846474:0:188678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1786109827.846477:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933440000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.846479:0:188678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933441024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786109827.846511:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872862933440000:12345-0@lo:400:kworker.0 Request processed in 35us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109827.846516:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:0.0:1786109827.846554:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab1c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1872862933440256:0@lo:400:kworker.0 00000100:00100000:0.0:1786109827.846563:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933440768:0@lo:400:kworker.0 00000100:00100000:0.0:1786109827.846572:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1872862933439744:0@lo:400:kworker.0 00000100:00100000:1.0:1786109827.846626:0:188678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872862933441024:12345-0@lo:400:kworker.0 Request processed in 145us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109827.846633:0:188678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1786109827.846669:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1872862933440640:0@lo:400:kworker.0 00000100:00080000:1.0:1786109827.846713:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786109827.846717:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786109827.846720:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786109827.846722:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1786109827.846770:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff930ac0fbb480 x1872862933439872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786109843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786109827.846781:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1872862933439872:0@lo:400:kworker.0 00000100:00100000:2.0:1786109827.846840:0:187904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933439488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1812us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109827.846847:0:187904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1786109827.847035:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac0fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1872862933440000:0@lo:400:kworker.0 00000100:00100000:0.0:1786109827.847048:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872862933441024:0@lo:400:kworker.0 00000100:00100000:0.0:1786109827.847056:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 347892350987 gen 2 00000004:00080000:0.0:1786109827.847060:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 347892350987 committed transno 347892350987 00000020:00080000:0.0:1786109827.847066:0:3647:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff930ac10c1cc0 refcount 2 committed 0 result 0 batchid 25769804644 00000020:00080000:0.0:1786109827.847139:0:3647:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9309858ea200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff930a8163db40 00000020:00080000:0.0:1786109827.847143:0:3647:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200027cd1:0x1:0x0].1 00000020:00080000:0.0:1786109827.847145:0:3647:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9309858ea700 obd lustre-MDT0001-osd committed 1 started 0 stopped 0 result 0 sub_th 0000000000000000 00000020:00080000:0.0:1786109827.847148:0:3647:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400036c8:0x1:0x0].2 00000100:00100000:0.0:1786109827.847204:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933439488:0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1786109827.847463:0:202509:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 25769804644 committed batchid 21474840726 00000020:00080000:3.0:1786109827.847532:0:202509:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21474840726 00000100:00100000:3.0:1786109828.356806:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933441152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786109828.356883:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786109828.356943:0:199402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933441152 00000100:00100000:3.0:1786109828.356951:0:199402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933441152 00000100:00100000:3.0:1786109828.357018:0:199402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1786109828.357028:0:199402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933441152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786109828.357059:0:199402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446031360 avail 1299791872 00000100:00100000:3.0:1786109828.357113:0:199402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1872862933441152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109828.357122:0:199402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1786109828.357227:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933441152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786109828.358908:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933441280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786109828.358967:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109828.359309:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933441280 00000100:00100000:1.0:1786109828.359317:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933441280 00000100:00100000:1.0:1786109828.359361:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6017 00000100:00100000:1.0:1786109828.359370:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933441280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786109828.359396:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580928 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109828.359464:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1872862933441280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109828.359472:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6017 00000100:00100000:1.0:1786109828.359498:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786109828.359507:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933441408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786109828.359535:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109828.359565:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933441408 00000100:00100000:1.0:1786109828.359569:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933441408 00000100:00100000:1.0:1786109828.359590:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6018 00000100:00100000:1.0:1786109828.359596:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933441408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786109828.359612:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8713280 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109828.359644:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872862933441408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109828.359650:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6018 00000100:00100000:1.0:1786109828.359687:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1872862933441408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786109828.359841:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1872862933441280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786109828.418467:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1786109828.418625:0:187900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922197888 00000100:00100000:2.0:1786109828.418635:0:187900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922197888 00000100:00100000:2.0:1786109828.418795:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1353 00000100:00100000:2.0:1786109828.418808:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:167569:x1872862922197888:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1786109828.418844:0:187900:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00000100:00100000:2.0:1786109828.418917:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:167569:x1872862922197888:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 112us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109828.418925:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1353 00000100:00080000:1.0:1786109828.418958:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786109828.421527:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109828.421643:0:187899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922198016 00000100:00100000:1.0:1786109828.421653:0:187899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922198016 00000100:00100000:1.0:1786109828.421735:0:187899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1354 00000100:00100000:1.0:1786109828.421754:0:187899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:167569:x1872862922198016:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:1.0:1786109828.421781:0:187899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446031360 avail 1299791872 00000100:00100000:1.0:1786109828.421848:0:187899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fac74500-4523-4794-af20-dfdcdfae19c1+6:167569:x1872862922198016:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 97us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109828.421858:0:187899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1354 00000100:00080000:3.0:1786109828.422029:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786109828.424618:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109828.424719:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922198144 00000100:00100000:1.0:1786109828.424728:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922198144 00000100:00100000:1.0:1786109828.424808:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6019 00000100:00100000:1.0:1786109828.424819:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa5c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:167569:x1872862922198144:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109828.424843:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8713280 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109828.424915:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa5c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:167569:x1872862922198144:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 96us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109828.424922:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6019 00000100:00080000:3.0:1786109828.425168:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786109828.427976:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1786109828.428088:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922198272 00000100:00100000:1.0:1786109828.428101:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922198272 00000100:00100000:1.0:1786109828.428247:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6020 00000100:00100000:1.0:1786109828.428257:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93098e50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:167569:x1872862922198272:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:1.0:1786109828.428286:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580928 pending 0 free 3923496960 avail 3691974656 00000100:00100000:1.0:1786109828.428363:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93098e50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fac74500-4523-4794-af20-dfdcdfae19c1+5:167569:x1872862922198272:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 107us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109828.428370:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6020 00000100:00080000:3.0:1786109828.428588:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786109828.484709:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786109829.382713:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933441536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786109829.382811:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786109829.382889:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933441536 00000100:00100000:1.0:1786109829.382898:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933441536 00000100:00100000:1.0:1786109829.382967:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6021 00000100:00100000:1.0:1786109829.382980:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac17bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933441536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786109829.383022:0:8445:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8713280 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786109829.383073:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac17bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872862933441536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1786109829.383081:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6021 00000100:00100000:1.0:1786109829.383138:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ac17bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1872862933441536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786109829.384531:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff930ab7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933441664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786109829.384611:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786109829.384678:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862933441664 00000100:00100000:2.0:1786109829.384685:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862933441664 00000100:00100000:2.0:1786109829.384733:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6022 00000100:00100000:2.0:1786109829.384744:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933441664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786109829.384768:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8580928 pending 0 free 3923496960 avail 3691974656 00000100:00100000:2.0:1786109829.384811:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1872862933441664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109829.384818:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6022 00000100:00100000:2.0:1786109829.384873:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff930ab7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1872862933441664:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1786109829.385157:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786109829.385162:0:6523:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786109829.508560:0:10402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786109829.679400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109829.679461:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109829.679488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109829.679510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109829.679536:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1786109829.679560:0:201147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922198400 00000100:00100000:0.0:1786109829.679570:0:201147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922198400 00000100:00100000:0.0:1786109829.679619:0:201147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:0.0:1786109829.679630:0:201147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930aa0c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922198400:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109829.679702:0:201147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930aa0c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4929093a-da1f-45c7-90e6-dcd2fb5a5df4+10:2405:x1872862922198400:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 74us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109829.679709:0:201147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:3.0:1786109829.679941:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922198912 00000100:00100000:3.0:1786109829.679945:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922198912 00000100:00100000:3.0:1786109829.679971:0:179237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922198784 00000100:00100000:3.0:1786109829.679974:0:179237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922198784 00000100:00100000:3.0:1786109829.680006:0:179237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7197 00000100:00100000:3.0:1786109829.680014:0:179237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922198912:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1786109829.680344:0:34008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7198 00000100:00100000:2.0:1786109829.680357:0:34008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922198784:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1786109829.680411:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922198656 00000100:00100000:0.0:1786109829.680415:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922198656 00000100:00100000:0.0:1786109829.680457:0:196401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872862922198528 00000100:00100000:0.0:1786109829.680461:0:196401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872862922198528 00000100:00100000:0.0:1786109829.680483:0:196401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 538 00000100:00100000:0.0:1786109829.680490:0:196401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ac0bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+6:2405:x1872862922198656:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109829.680595:0:179237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922198912:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 582us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109829.680603:0:179237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7197 00000100:00100000:3.0:1786109829.680944:0:187900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 539 00000100:00100000:3.0:1786109829.680955:0:187900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff930ab7f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922198528:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1786109829.680987:0:187900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fac74500-4523-4794-af20-dfdcdfae19c1+7:2405:x1872862922198528:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1786109829.681006:0:187900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 539 00000100:00100000:2.0:1786109829.681166:0:34008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ab7f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fac74500-4523-4794-af20-dfdcdfae19c1+5:2405:x1872862922198784:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 812us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1786109829.681173:0:34008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7198 00000100:00100000:0.0:1786109829.681316:0:196401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff930ac0bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fac74500-4523-4794-af20-dfdcdfae19c1+6:2405:x1872862922198656:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 824us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1786109829.681323:0:196401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 538 00000001:02000400:2.0:1786109829.909910:0:203148:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_80c: @@@@@@ FAIL: remote creation failed 00010000:00010000:3.0:1786109830.532653:0:6515:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 74540 lines, 74540 kept, 0 dropped, 0 bad.